4 ms·
Nemotron-Cascade-2-30B-A3B is worth checking out too at the size - I found it even better than Qwen 3.5 35B! I ran it slowly but successfully on a 8GB 1070GTX w
by nl 7mo ago
Nemotron-Cascade-2-30B-A3B is worth checking out too at the size - I found it even better than Qwen 3.5 35B! I ran it slowly but successfully on a 8GB 1070GTX with CPU offload.
- anon373839 7mo agoThanks for the tip! Hadn't seen that one.