4 ms·
Getting smaller is how the last revolution in computing happened. A VAX 11/780 was good, but an 80386 was a lot better, since the latter could run on 3 AA batt
by trollbridge 3mo ago
Getting smaller is how the last revolution in computing happened.
A VAX 11/780 was good, but an 80386 was a lot better, since the latter could run on 3 AA batteries and the former needed 6,000 watts of 3 phase.
- radialstub 3mo agoYes but that's because of the scaling laws for transistors. ML models seem to get better the bigger they are. If you want to compress the world's information, you need to look at all the information in the world.
- trollbridge 3mo agoQwen 3.6 27b is way ahead of Llama 70b.