3 ms·
True! I just know that model optimization gains are much less guaranteed than say, FLOP density, even though model optimization has so far provided way more gai
by awongh 1y ago
True! I just know that model optimization gains are much less guaranteed than say, FLOP density, even though model optimization has so far provided way more gains than hardware advancements.
Part of me is optimistic that when the AI bubble bursts the excess data center capacity is going to be another force driving the cost of inference down.
- NemoNobody 1y agoHaha, I love how delusional everyone is about AI. Yeppers, when that bubble burst - that's hilarious. This is the kinda stuff grandkids won't believe someday.
- naasking 1y ago> I just know that model optimization gains are much less guaranteed than say, FLOP density, even though model optimization has so far provided way more gains than hardware advancements. Performance gained from model improvements has outpaced performance gained from hardware improvements for decades.