I can't square the numbers in the two articles at all. Other sources seem closer to their optimised results than their unoptimised results: llama3-70b throug

I can't square the numbers in the two articles at all. Other sources seem closer to their optimised results than their unoptimised results: llama3-70b throughput: Chips and Cheese: 4800 tok/sec (?!) This article: 849 tok/sec (fastest optimized) Mixtral 7B latency: Chips and cheese: 1.17s This article: 2.04s (fastest unoptimised) / 0.81 (fastest optimised) And then finally comparing mixtral 8x7b to the Reddit article using batch size 1... Reddit: 157 tok/sec This article: 165 tok/sec (optimized) or 141 tok/sec (unoptimised)