2 ms·
That will be very VERY slow. Pcie bandwidth is way too slow.
by koheripbal 4y ago
That will be very VERY slow. Pcie bandwidth is way too slow.
- moffkalast 4y agoShould be like an order of magnitude faster than trying to run it from a NVMe still, no? I've ran some small flan models from RAM and it was fine, but yeah it's not exactly realtime.