3 ms·
The "AI overview" in google search seems to be a similar speed, and the resulting text of similar quality.
by londons_explore 2y ago
The "AI overview" in google search seems to be a similar speed, and the resulting text of similar quality.
- simonw 2y agoI wonder which of their models they use. Might even be Gemini 1.5 Flash 8B which is VERY quick. I just tried that out with the same prompt and it's fast, but not as fast as Cerebras: https://static.simonwillison.net/static/2024/gemini-flash-8b.mp4 https://static.simonwillison.net/static/2024/gemini-flash-8b...
- londons_explore 2y agoI suspect it is its own model. Running it on 10B+ user queries per day you're gonna want to optimize everything you can about it - so you'd want something really optimized to the exact problem rather than using a general purpose model with careful prompting.