3 ms·
Inspired me to write this, since it seems like most people don't understand how fast models run: https://unexcitedneurons.substack.com/p/how-to-calculate-home-
by jychang 1y ago
Inspired me to write this, since it seems like most people don't understand how fast models run:
https://unexcitedneurons.substack.com/p/how-to-calculate-home-inference-speed https://unexcitedneurons.substack.com/p/how-to-calculate-hom...
- PeterStuer 1y agoThank you for that writeup! In my case it is a fairly old system I built from cheap eBay parts. Threadripper 3970X with 8x32GB dual channel 2666Mhz DDR4.