3 ms·
>Small models are rapidly growing in capability, require less compute to train and serve Must be very clear that China’s undercut strategy, which is a well-kno
by SV_BubbleTime 1mo ago
>Small models are rapidly growing in capability, require less compute to train and serve
Must be very clear that China’s undercut strategy, which is a well-known and studied tactic that they’ve used for a long time, it is absolutely dominating this point.
Right now you can LLM, code, make songs, images, and esp video on gaming hardware in your PC that would’ve been absolutely datacenter shit last year.
So the question will be does the scaling continue to benefit efficiency or ability?
If ability (needs datacenter storage and performance), how much better can the code get? How much more realistic in the images videos get? There are definitely strides to be made everywhere, but man, just like the bottleneck wasn’t coding, I’m not sure the creation bottleneck is rendering.