5 ms·

Thanks! Qwen-3.8 27B seems to benchmark better but I'd like to try this some time.

• verdverm 2mo ago
  little qwen is my favorite for the homelab, vllm 0.28 now supports the dflash2 to go with it