3 ms·
>I was hoping for that this year, but: split of LLMs into databases and reasoning This hasn't worked out because knowing what to query and how to query require
by paraschopra 2y ago
>I was hoping for that this year, but: split of LLMs into databases and reasoning
This hasn't worked out because knowing what to query and how to query requires intelligence, and that's contained in weights.
- viraptor 2y agoSplitting knowledge out doesn't mean you need to drop weights. Just that it needs to become independent / attachable. To some extent we've already seen this with MoE and Frankenstein models.