3 ms·
Try doing some inference with local models. I'd be surprised if they're making money on inference just from that. There's no way someone paying $20 p/m and usi
by mattmanser 7mo ago
Try doing some inference with local models.
I'd be surprised if they're making money on inference just from that. There's no way someone paying $20 p/m and using it all day is not spending way more on even just the electricity for tokens, let alone the capex.