3 ms·LLM inference speed is bandwidth limited.by sbierwagen 3y agoLLM inference speed is bandwidth limited.