3 ms·
I wonder if specialization of the LLM is another way to reduce the RAM requirements. For example, if you can tell which nodes are touched through billions of
by mycall 3y ago
I wonder if specialization of the LLM is another way to reduce the RAM requirements. For example, if you can tell which nodes are touched through billions of web searches on a topic, then you can delete the ones that never are touched.
- opyate 3y agoKind of like "tree shaking" for weights? Like dead code elimination.