3 ms·
> why we are using generative models for categorization and extraction Because LLM models have already amortized the man-years cost of collecting, curating and
by otabdeveloper4 6mo ago
> why we are using generative models for categorization and extraction
Because LLM models have already amortized the man-years cost of collecting, curating and training on text corpuses?
- danielbln 6mo agoYeah, LLMs are a solution to the cold start problem plus they are easy to integrate and if you know what you're doing in terms of evals, post processing and so on you can get excellent performance out of them, plus they can do semantic classification and reasoning that you won't get out of some bespoke traditional DS/ML model.
- z3c0 6mo agoThey amortized the creation of corpuses with trainable features, not the myriad of methods that can categorize text with a success rate in the levels required by high-stakes industries.