5 ms·
Question: for software development, how much of an AI do you need for local development? Can it be run locally? Can someone train something that knows a lot abo
by Animats 6mo ago
Question: for software development, how much of an AI do you need for local development? Can it be run locally? Can someone train something that knows a lot about software but lacks comprehensive coverage of history, politics, and popular culture?
- deleted 6mo ago[deleted]
- dd8601fn 6mo agoThe ones that are good for more than elaborate auto-complete are pretty hefty, but it can be done. They’re still not Opus behind claude code.
- mrkeen 6mo agoThis is a good snapshot of things: https://news.ycombinator.com/item?id=48050751 https://news.ycombinator.com/item?id=48050751 A specialist handrolls a cut-down framework to power a 1 or 2 bit quantised version of a cut-down sort-of-frontier model. It can be yours if you have 128GB or 256GB of RAM.