4 ms·
Categorization allows for retrieval strategy
by mettamage 4mo ago
Categorization allows for retrieval strategy
- pj_mukh 4mo agobecause you have a different vector store for each categorization? What if the question crosses categories?
- all2 4mo agoIn a general sense, you see this crop up in SKILLS.md files and other places, as LLMs have to deal with broad contexts. People try and drill into some taxonomy in a naive fashion using plaintext as a directive, which is not particularly optimal. I wonder if one could build a 'mixture of experts' at the model level that leveraged a variety of small models "within" a larger model...