My mind was blown a night or two ago when Groq had end-to-end answers in ~0.25s. All my GPT-4 developer friends minds were blown too. Then we got sad the next d

My mind was blown a night or two ago when Groq had end-to-end answers in ~0.25s. All my GPT-4 developer friends minds were blown too. Then we got sad the next day, when it became of crapshoot of 10-20s end-to-end latency, due to the hug of death of too many users and too few instances. I applied to their API but didn't hear anything back. I strongly believe that a zero-latency computer experience unlocks a lot of the natural human creative flow. Constantly having momentary pauses ruins my train of thought.