2 ms·
Qwen3.8-Flash-Next non-uniform quantization runs on 2 RTX3090s
- rcbdev 2mo agoDidn't expect to see the 180B model running on two 3090s so fast. The open model space is moving crazy fast, improvements like always remind me of Google's 2023 memo 'We Have No Moat', which looks to be more right every day.
- omarhawwash058 2mo agoNICE