4 ms·
Indirectly: choose boring tech because it's well documented, widely supported, and training data for LLMs abound. Do you run LLMs locally? I'd be keen to have
by tudorizer 2y ago
Indirectly: choose boring tech because it's well documented, widely supported, and training data for LLMs abound.
Do you run LLMs locally? I'd be keen to have an overview of your stack.
- markusw 2y agoI do! In the article, I mostly mean working with LLMs inside the applications I'm building, as opposed to as a tool as part of development. But I do both. Right now, I'm trying out Zed, which supports multiple LLMs natively. Just today, I tried Zed + Ollama + Qwen 2.5 Coder 32B running locally, and it worked! Blows my mind that I can have GPT-4o-level assistance running on my laptop. :D
- tudorizer 2y agoamazing! How do you gauge "GPT-4o-level assistance"? Have you tried side-by-side comparisons?