3 ms·
The latency improvements are impressive but the ability to run models beyond their typical memory limitations is way cooler.
by sosodev 3y ago
The latency improvements are impressive but the ability to run models beyond their typical memory limitations is way cooler.