I don't know about GPT 3.5 specifically, but on this independent benchmark (LLMPerf) Groq's time to first token is also lowest: https://github.com/ray-project/

I don't know about GPT 3.5 specifically, but on this independent benchmark (LLMPerf) Groq's time to first token is also lowest: https://github.com/ray-project/llmperf-leaderboard?tab=readme-ov-file#time-to-first-token-seconds https://github.com/ray-project/llmperf-leaderboard?tab=readm...