3 ms·
It's a thing right now. I'm running Qwen 30B code on my framework laptop to ask questions about ruby vs. python syntax because I can, and because the internet
by unethical_ban 1y ago
It's a thing right now.
I'm running Qwen 30B code on my framework laptop to ask questions about ruby vs. python syntax because I can, and because the internet was flaky.
At some point, more doesn't mean I need it. LLMs will certainly get "good enough" and they'll be lower latency, no subscription, and no internet required.
- nsonha 1y agopretty amazing, as a student I remember downloading offline copies of Wikipedia and Stack Overflow and felt that I have the entire world truly in my laptop and phones. Local LLMs are arguably even more useful than those archives.