3 ms·
But they only know about specific tools with few or zero shot methods, whereas modern humans are highly trained to specifically always route all math through a
by eternityforest 2y ago
But they only know about specific tools with few or zero shot methods, whereas modern humans are highly trained to specifically always route all math through a calculator, it's "in the fine tune" not "in the prompt".
It doesn't use up any "context" to remember that calculators exist.
With the partial exception of Python code, models know how to solve problems with code and even 1.5B models do amazing things if you prompt them with something like "Use the Z3 solver"
- IanCal 2y agoBut if you give them a search they'll use that to look for tools and if you give them the ability they can write new tools for themselves.
- eternityforest 2y agoBut for tiny models on CPUs, that kind of thing doesn't seem practical, it seems like you get at most one LLM call to a 360M model with maybe a few paragraphs of context, before a user will probably be tired of waiting.