4 ms·
I do too, but I still believe there is a bubble. Reason is that I can do most of my work with self-hosted models so there’s little need to pay for a subscriptio
by elorant 2y ago
I do too, but I still believe there is a bubble. Reason is that I can do most of my work with self-hosted models so there’s little need to pay for a subscription. Sure, I’m a minority for now because I’m tech savvy, but with that in mind it’s hard to justify the valuations of most AI companies. We don’t know if they’re keep accumulating users and most LLMs seem to have hit a plateau of performance.
- derekp7 2y agoAnd local models are getting more accurate and efficient. And they really don't need a dedicated GPU for fast response, just really fast ram. New APUs such as the AMD 395 are going to be game changers for local users with 256 GiB/s bandwidth.
- elorant 2y agoThe new Mac Studio is great for this job too. With the Max chip you get 128GBs of unified RAM for $3.5k. Memory bandwidth is at 546GB/s which is good enough for most tasks.
- dorisbella 2y ago[dead]