3 ms·80B + INT4 + speculative (FP8 mode) => 72,188 tokens/s effective ..da fck!!by freakynit 4mo ago80B + INT4 + speculative (FP8 mode) => 72,188 tokens/s effective ..da fck!!