4 ms·
I'm quite impressed by the results of the web demo, especially given its size and the precision with which it uses the three available tools (tested with German
by silentbob7 2mo ago
I'm quite impressed by the results of the web demo, especially given its size and the precision with which it uses the three available tools (tested with German commands). I could imagine that this LLM would fit well into a setup with multiple micro-sized LLMs for different purposes; so 14 MB for precise tool invocation is a reasonable memory footprint when a number of other local models are running (e.g. STT, TTS + language models).
- HenryNdubuaku 2mo agoyes, that's what we had in mind while building