3 ms·
and whisper large is 1.55B parameters at 16bits instead of 4 bits, I believe. so nano-1 weights are ~1/3rd the size. Really impressive if these benchmarks are c
by sigmar 3y ago
and whisper large is 1.55B parameters at 16bits instead of 4 bits, I believe. so nano-1 weights are ~1/3rd the size. Really impressive if these benchmarks are characteristic of performance