3 ms·
Yes, this is where it's at for me. LLM's are cool and I can see them as progress, but I really dislike that they're controlled by huge corporations and cost a s
by davidw 8mo ago
Yes, this is where it's at for me. LLM's are cool and I can see them as progress, but I really dislike that they're controlled by huge corporations and cost a significant amount of money to use.
- seanmcdirmid 8mo agoUse local OSS models then? They aren’t as good and you need beefy hardware (either Apple silicon or nvidia GPUs). But they are totally workable, and you avoid your dislikes directly.
- davidw 8mo ago"Not as good and costs a lot in hardware" still sounds like I'm at a disadvantage.
- seanmcdirmid 8mo ago$3000 is not that much for hardware (like a refurbished MBP Max with decent amount of RAM), and you'd be surprised how much more useful a thing that is slightly worse than the expensive thing is when you don't have anxiety about token usage.
- davidw 8mo ago$3000 might not be much to a wealthy software engineer in the US, but to, say, a college student in Portugal, it's a big expense. Open source software democratized software in a huge way.
- seanmcdirmid 8mo agoOk, from that perspective we are still a few years from when a college student in Portugal can run local OSS models on their own hardware...but we aren't a few decades away from that, at least.
- bdangubic 8mo ago> they're controlled by huge corporations and cost a significant amount of money to use. is there anything you use that isn't? like laptop on which you work, software that you use to browse the internet, read the email... I've heard similar comment like yours before and I am not sure I understand it given everything else - why does this matter for LLMs and not the phone you use etc etc?