4 ms·
It’s not really about how the compute-intensive resources come to bear. You can draw a parallel to Moore’s law. Node advancement is one of the most expensive an
by ip26 2y ago
It’s not really about how the compute-intensive resources come to bear. You can draw a parallel to Moore’s law. Node advancement is one of the most expensive and cutting edge efforts by humanity today. But it’s also simultaneously true that software companies have succeeded or failed by betting for or against computers getting faster. There are famous examples of companies in the 80’s that designed software that was simply not usable on the computers on hand when the project began, but was incredible on the (much faster) computers of launch day.
The bitter lesson is very similar. In essence, when building on top of AI models, bet on the AI models getting much faster and more capable.
- immibis 2y agoAnd there is software today that is simply not usable on computers today, but will be incredible on computers in 20 years time if clock speed continue doubling every 2 years. Most of it is written in Electron.
- ip26 2y agoHah, point hilariously made. Although I might argue electron commits the sin of betting on endless increases in memory performance :)