3 ms·
You could consider making your hobby project to get a local AI stack up and working. Open source models are not as good as claude, or GPT. But they don't need
by twosdai 4mo ago
You could consider making your hobby project to get a local AI stack up and working.
Open source models are not as good as claude, or GPT. But they don't need to be to fulfill useful small tasks. I think its worth considering using claude from your work to help you setup a local harness and model and then use that.
To me it feels a bit more fulfilling.
- 0x70run 4mo agoI would love this tbh, but it's just that context window issue for me right now. For my personal use, I have a MacBook Air M5 (maxed out), but I don't think I can run anything decent with large context window (for longer chat sessions) on it. I should also mention that I'm still learning about LLMs, so if I've missed something please do let me know. Running local LLMs is something I'm very interested in.