3 ms·
I think we're still waiting for the ultimate coding LLM setup: 1. Able to run locally on a high end GPU (IE. M3 Max/Nvidia 4080) 2. Able to read the entirety
by senttoschool 3y ago
I think we're still waiting for the ultimate coding LLM setup:
1. Able to run locally on a high end GPU (IE. M3 Max/Nvidia 4080)
2. Able to read the entirety of a decent sized codebase
3. As good as GPT4 (coding only)
4. Free or $10 or less/month
- justinclift 3y agoWouldn't ultimate setup be more like "runs on a raspberry pi"?
- senttoschool 3y agoJust trying to be reasonably realistic.
- klysm 3y agoI don’t think the Pi has enough flops