4 ms·
One could start with a large model for exploration during development, and then distill it down to a small model that covers the variety of the task and fits on
by janpmz 1y ago
One could start with a large model for exploration during development, and then distill it down to a small model that covers the variety of the task and fits on a USB drive. E.g. when I use a model for gardening purposes, I could prune knowledge about other topics.
- loktarogar 1y agoPruning is exactly what you're looking for in a gardening SLM
- dotancohen 1y agoIn what sense would you need an LLM while gardening for? I'm imagining for problem solving, like asking "what worm looks like a small horse hair". But that would require the LLM to know what a horse hair is. In other words, not a distilled model, but rather a model that contains pretty much anything our gardener's imagination will make analogies out of.