5 ms·
And we had these toys with higher latency in 22 with gpt3. The better tooling and integration hides the extremely slowed down pace of innovation in base models
by BoredPositron 1y ago
And we had these toys with higher latency in 22 with gpt3. The better tooling and integration hides the extremely slowed down pace of innovation in base models all while throwing mountains of compute at it.