3 ms·
Compared to a 400b model, a 10b is practically useless, it's not even worth bothering outside of tinkering for fun and research.
by root_axis 7mo ago
Compared to a 400b model, a 10b is practically useless, it's not even worth bothering outside of tinkering for fun and research.
- geek_at 7mo agoStill dreaming about an android keyboard that plugs into local or self hosted llm backend for smarter text predictions