3 ms·
This is quite interesting. You could make a nice system by routing queries to the right LLM for a given type of task.
by dinkleberg 3y ago
This is quite interesting. You could make a nice system by routing queries to the right LLM for a given type of task.
- kordlessagain 3y agoRight. By logging all of this, then vectorizing, then evaluating using some type of transfer knowledge (classify this response and it's accuracy), one could build up a routing table of likely candidates for building an ensemble to evaluate the correct answer.
- yard2010 3y agoMaybe you can fine tune an llm for the routing thing ;)
- kordlessagain 3y agoStuff that stuff into a semantic graph and call it done.
- PUSH_AX 3y agoLike having a mixture of experts!