2 ms·
Should run just fine with CPU-MoE and mmap, but inference might be a bit slow if you have little RAM.
by zozbot234 7mo ago
Should run just fine with CPU-MoE and mmap, but inference might be a bit slow if you have little RAM.
loading thread…
2 ms·