2 ms·
Have you tried any of the ludicrously fast LLM demos yet? https://inference.cerebras.ai/ https://inference.cerebras.ai/ and https://groq.com/ https://groq.com/
by simonw 1y ago
Have you tried any of the ludicrously fast LLM demos yet?
https://inference.cerebras.ai/ https://inference.cerebras.ai/ and https://groq.com/ https://groq.com/ and https://deepmind.google/models/gemini-diffusion/ https://deepmind.google/models/gemini-diffusion/ (waitlisted) are all 10 to 100x faster than regular models, which really does have a meaningful impact on how I interact with them because I don't have to disengage for 15+ seconds while I wait for a response.
I have video demos of a few of those: https://simonwillison.net/2024/Oct/25/llm-cerebras/ https://simonwillison.net/2024/Oct/25/llm-cerebras/ and https://simonwillison.net/2024/Oct/31/cerebras-coder/ https://simonwillison.net/2024/Oct/31/cerebras-coder/ and https://simonwillison.net/2025/May/21/gemini-diffusion/ https://simonwillison.net/2025/May/21/gemini-diffusion/