3 ms·
“As an example, the question “When did we replace our pool pump?” will be mapped to a category called “pool” before querying the Index database.” Cool write up
by pj_mukh 4mo ago
“As an example, the question “When did we replace our pool pump?” will be mapped to a category called “pool” before querying the Index database.”
Cool write up! Really appreciate it but incidentally how does this categorization help you get better retrieval results?
- mettamage 4mo agoCategorization allows for retrieval strategy
- pj_mukh 4mo agobecause you have a different vector store for each categorization? What if the question crosses categories?
- all2 4mo agoIn a general sense, you see this crop up in SKILLS.md files and other places, as LLMs have to deal with broad contexts. People try and drill into some taxonomy in a naive fashion using plaintext as a directive, which is not particularly optimal. I wonder if one could build a 'mixture of experts' at the model level that leveraged a variety of small models "within" a larger model...