Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
djsh
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
djsh
3y ago
Since we are talking about throughput of API hosting providers, I wanted to add in the work we have done at Groq. I understand that the team is getting in touch with the ArtificialAnalysis folks to get benchmarked. Mixtral running at >5
2.
▲
by
djsh
3y ago
If you like that speed, you would love Mixtral running at >500 tokens/s @ Groq https://www.youtube.com/watch?v=5fJyOVtOk4Y In full disclosure, I have worked on getting this up @ Groq. PS: Experience the speed for yo