3 ms·
It’s tempting to be flippant about MacOS/windows but in all seriousness, the resources required for an LLM to do the job of a typical lighter weight app/softwar
by Forgeties79 7mo ago
It’s tempting to be flippant about MacOS/windows but in all seriousness, the resources required for an LLM to do the job of a typical lighter weight app/software is a serious consideration. No amount of bloat matches what an LLM needs.
- bigyabai 7mo ago> No amount of bloat matches what an LLM needs. I don't think that's necessarily true. For instance, LinkedIn uses more memory than Gemma E2B inference does.
- Forgeties79 7mo agoLinkedIn is an entirely different category and an extreme case at that. We’re not talking about LLM’s replacing LinkedIn either. It’s an entirely different comparison/discussion.
- cyanydeez 7mo agoFinally, we've fully documented the Singularity-is-actually-just-bloated software.