2 ms·
what sort of hardware do i need to run qwen 1.5 and QwQ ?
by pkkkzip 2y ago
what sort of hardware do i need to run qwen 1.5 and QwQ ?
- doctoboggan 2y agoIts running with a decent token/second (as fast or faster than I can read...) on my M1 Max MBP with 64GB of memory
- greenavocado 2y agoProbably H100s to be safe. I use deepinfra.