4 ms·
So what happens when we figure out how to 10x both scale and throughput on existing hardware by using it more efficiently? Will gigantic models still be useful?
by infogulch 1y ago
So what happens when we figure out how to 10x both scale and throughput on existing hardware by using it more efficiently? Will gigantic models still be useful?
- peterlk 1y agoOf course! We still have computers the size of mainframes that ran on vacuum tubes. They are just built with vastly more powerful hardware and are used for specialized tasks that supercomputing facilities care about. But it has the potential to alter the economics of AI quite dramatically
- regularfry 1y agoAnything that improves scaling at the bottom end will also improve scaling at the top end, give or take.