3 ms·
Gemini Flash 2.0 is an absolute workhorse of a model at extremely low cost. It's obviously not going to measure up to frontier models in terms of intelligence b
by extr 1y ago
Gemini Flash 2.0 is an absolute workhorse of a model at extremely low cost. It's obviously not going to measure up to frontier models in terms of intelligence but the combination of low cost, extreme speed, and highly reliable structured output generation make it really pleasant to develop with. I'll probably test against 2.5 Lite for an upgrade here.
- wg0 1y agoI want to know what use cases you're using if for it it's not confidential.
- extr 1y agoWe use it by having a Large Model delegate to Flash 2.0. Let's say you have a big collection of objects and a SOTA model identifies the need to edit some properties of one of them. Rather than have the Large Model perform a tool call or structured output itself (potentially slow/costly at scale), it can create a small summary of the context and change needed. You can then provide this Flash 2.0 and have it generate the full object or diffed object in a safe way using the OpenAPI schema that Gemini accepts. The controlled generation is quite powerful, especially if you create the schema dynamically. You can generate an arbtirarily complex object with full typing, restrict valid values by enum, etc. And it's super fast and cheap and easily parallelizable. Have 100 objects to edit? No problem, send 100 simultaneous flash 2.0 calls. It's google, they can handle it.