3 ms·Talks about throughput but doesn't mention memory I/O speed, which should be a bottleneck for LLMsby EvgeniyZh 3y agoTalks about throughput but doesn't mention memory I/O speed, which should be a bottleneck for LLMs