5 ms·
Tricky to make predictions based on costs or quality when the costlier parts, training and inference, are totally disconnected from reality thanks to VC money a
by utopiah 2mo ago
Tricky to make predictions based on costs or quality when the costlier parts, training and inference, are totally disconnected from reality thanks to VC money and when total cost of ownership over time is radically different.
- IshKebab 2mo agoThey aren't totally disconnected from reality. There are plenty of providers who don't have a ton of VC money selling tokens at basically cost price.
- simianwords 2mo agoThere's a misconception going on that somehow the inference prices are so costly that eventually we would see some market correction. This is false.
- nullsanity 2mo ago[dead]