3 ms·
But if you give them a search they'll use that to look for tools and if you give them the ability they can write new tools for themselves.
by IanCal 2y ago
But if you give them a search they'll use that to look for tools and if you give them the ability they can write new tools for themselves.
- eternityforest 2y agoBut for tiny models on CPUs, that kind of thing doesn't seem practical, it seems like you get at most one LLM call to a 360M model with maybe a few paragraphs of context, before a user will probably be tired of waiting.