4 ms·
No, AI inference is mainly RAM/RAM speed constrained, we need more fast RAM to make local AI thrive.
by u8080 7mo ago
No, AI inference is mainly RAM/RAM speed constrained, we need more fast RAM to make local AI thrive.
- downrightmike 7mo agoLol. Thanks to someone buying all the ram platters, before they became modules, that won't happen.