5 ms·
I don't think I've seen one that does that. Groq is pretty amazing to play with to see what fast models are like (llm-groq plugin).
by simonw 3y ago
I don't think I've seen one that does that.
Groq is pretty amazing to play with to see what fast models are like (llm-groq plugin).
- fzzzy 3y agoThanks. The problem with groq is time to first token (being in a queue, presumably).