3 ms·
“Arguments that llms fundamentally a part of a system of political oppression fall flat against the case of open-weight models that can be run at home on (high-
by GPerson 2mo ago
“Arguments that llms fundamentally a part of a system of political oppression fall flat against the case of open-weight models that can be run at home on (high-end) consumer hardware.”
Can anybody comment on the validity of this in 2026? Compared to Fable on a $200 monthly subscription, what is a $2400 investment in a home setup (including electricity) getting me in a year?
- kylehotchkiss 2mo agoA model that doesn't change under your feet every few weeks. Great if you need to consistently process small data tasks over the course of months.
- fsmv 2mo agoQwen 27B is runnable for that price and it can produce patches that work using opencode as a harness. It's obviously not as capable as frontier models but it can do things if you provide the judgement.
- ShinyLeftPad 2mo ago60+ GB VRAM, unless you quantize. If you quantize sure, but then it will not really be comparable to what others are using.
- anon291 2mo agoI mean, spend a bit more to take into account the fact that deprecation on a graphics card (computer equipment) is five years and you can reasonably spend about 2400 * 5 = 12000 on a card which will get you an rtx pro 5000 blackwell with 96GB RAM which can run top-notch OSS models and fine-tune them for your purposes. It's just a computer. An expensive one, but a computer nonetheless. Unless OSS authors are going to be so fundamentalist as to insist the computer hardware also be free as in beer, then the argument is really just a dogmatic one