3 ms·
Seems like we may get local, open, workstation-grade models that are useful for coding in a few years. By workstation-grade I mean a computer around 2000 USD, a
by jononor 1y ago
Seems like we may get local, open, workstation-grade models that are useful for coding in a few years. By workstation-grade I mean a computer around 2000 USD, and by useful for coding I mean around Sonnet 4 level.
Current cloud based models are fun and useful, but a tool that is / will be so core to the developer experience, I want to be able to run locally.
- cft 1y agoThis will be essential for the open source. Otherwise open source development will become unsustainable. I'm actually a little bit more optimistic. I think we will get something more than Sonnet 4 level in two years, that can be run on a $2,000 machine.
- unshavedyak 1y agoI've been waiting to do exactly this. Improved latency and no throttling is super appealing to me.
- orangebread 1y agoI would say by end of year, not 2 years.
- jononor 1y agoYeah, if we are lucky it might happen that fast!