4 ms·
Since we’re on a technical site here, can I ask why ChatGPT cost exponentially more to run? The inference time for a neural net is constant so I’d say that it s
by huijzer 4y ago
Since we’re on a technical site here, can I ask why ChatGPT cost exponentially more to run? The inference time for a neural net is constant so I’d say that it scales linearly with the number of users.
- resource0x 4y agoSee https://news.ycombinator.com/item?id=34390123 https://news.ycombinator.com/item?id=34390123
- HDThoreaun 4y agoI wasn't talking big O lol, maybe orders of magnitude would've been better?