> time to first token != tokens per second I said "and extremely low latency" because I know they are different. Groq's TTFT is still consistently competitive

> time to first token != tokens per second I said "and extremely low latency" because I know they are different. Groq's TTFT is still consistently competitive with any other provider, and lower than most of them. Here's some benchmarks: https://github.com/ray-project/llmperf-leaderboard#70b-models-1 https://github.com/ray-project/llmperf-leaderboard#70b-model...