4 ms·
It's not a bug. It's the reality of token generation. It's bottlenecked by memory bandwidth. Please publish your own benchmarks proving me wrong.
by EnPissant 1y ago
It's not a bug. It's the reality of token generation. It's bottlenecked by memory bandwidth.
Please publish your own benchmarks proving me wrong.
- DiabloD3 1y agoI cannot reproduce your bug on AMD. I'm going to have to conclude this is a vendor issue.