that's super contextually dependent. I use them just as essentially a decompress of what I already know that I'm doing. I legitimately use 4B models just fine.

that's super contextually dependent. I use them just as essentially a decompress of what I already know that I'm doing. I legitimately use 4B models just fine. I've got a large number of tools that make this entirely feasible and a daily driver for me (like https://github.com/day50-dev/llm-manpage-tool https://github.com/day50-dev/llm-manpage-tool) ... It's not really a bitter lesson here, I can scale those 4B models easier than someone can scale their 1000B models.