4 ms·
When capacity or cost constrained (or both) consider running ML on “lesser” GPUs like A40, A10s and even consumer grade 3090/4090s. With compiler optimizations
by pavelstoev 3y ago
When capacity or cost constrained (or both) consider running ML on “lesser” GPUs like A40, A10s and even consumer grade 3090/4090s. With compiler optimizations these uncover surprising price-performance ratios.
- nickstinemates 3y agoYeah a home cluster of a few 3090's performs remarkably well.