4 ms·In this case hardware is significant bottleneck: LLMs need lots of compute to strive.by riku_iki 2y agoIn this case hardware is significant bottleneck: LLMs need lots of compute to strive.