4 ms·
"Not as good and costs a lot in hardware" still sounds like I'm at a disadvantage.
by davidw 8mo ago
"Not as good and costs a lot in hardware" still sounds like I'm at a disadvantage.
- seanmcdirmid 8mo ago$3000 is not that much for hardware (like a refurbished MBP Max with decent amount of RAM), and you'd be surprised how much more useful a thing that is slightly worse than the expensive thing is when you don't have anxiety about token usage.
- davidw 8mo ago$3000 might not be much to a wealthy software engineer in the US, but to, say, a college student in Portugal, it's a big expense. Open source software democratized software in a huge way.
- seanmcdirmid 8mo agoOk, from that perspective we are still a few years from when a college student in Portugal can run local OSS models on their own hardware...but we aren't a few decades away from that, at least.