3 ms·
How do you generate keywords in a low effort way for each chunk? Asking an LLM is low effort to do, but its not efficient nor guaranteed to be correct.
by J_Shelby_J 2y ago
How do you generate keywords in a low effort way for each chunk?
Asking an LLM is low effort to do, but its not efficient nor guaranteed to be correct.
- kkzz99 2y agoIf the economical case justifies it you can use a cheap or lower end model to generate the meta information. Considering how cheap gpt-4o-mini is, seems pretty plausible to do that. At my startup we also got pretty good results using 7B/8B models to generate meta information about chunks/parts of text.