3 ms·
Usually businesses want fast, accurate, and cheap. LLMs are somewhat fast, somewhat accurate, and not cheap. Basic NLP techniques can be faster, more accurate
by janalsncm 3y ago
Usually businesses want fast, accurate, and cheap.
LLMs are somewhat fast, somewhat accurate, and not cheap.
Basic NLP techniques can be faster, more accurate, and cheaper.
- jerrygenser 3y agoLLM are not somewhat fast when measured against CPU models in spacy that are specialized for a task. They are multiple orders of magnitude slower for e.g. token classification/NER, text classification, etc. that's not to mention the plumbing that spacy provides that are mostly bindings to C code for tokenization, lemmatization, etc. things like that which are more algorithms problems than machine learning problems.