3 ms·
a far more obvious answer is that any AI that relies on matrix multiplication or equivalently near-cubic complexity cannot scale exponentially with existing ha
by countWSS 11mo ago
a far more obvious answer is that any AI that relies on
matrix multiplication or equivalently near-cubic complexity
cannot scale exponentially with existing hardware
and investing in datacenters requires actual
operating revenue(that doesn't grow exponentially) instead of loans and venture capital.
- flail 11mo agoOne more interesting aspect: the infrastructure doesn't age that well. We basically need to renew all that infrastructure every, like, 2-4 years or so? (And I think I'm being optimistic here.)