4 ms·Or Groq. They can do 1250 tokens/s with Llama 3 8B.by hmottestad 2y agoOr Groq. They can do 1250 tokens/s with Llama 3 8B.