4 ms·
We use it by having a Large Model delegate to Flash 2.0. Let's say you have a big collection of objects and a SOTA model identifies the need to edit some proper
by extr 1y ago
We use it by having a Large Model delegate to Flash 2.0. Let's say you have a big collection of objects and a SOTA model identifies the need to edit some properties of one of them. Rather than have the Large Model perform a tool call or structured output itself (potentially slow/costly at scale), it can create a small summary of the context and change needed.
You can then provide this Flash 2.0 and have it generate the full object or diffed object in a safe way using the OpenAPI schema that Gemini accepts. The controlled generation is quite powerful, especially if you create the schema dynamically. You can generate an arbtirarily complex object with full typing, restrict valid values by enum, etc. And it's super fast and cheap and easily parallelizable. Have 100 objects to edit? No problem, send 100 simultaneous flash 2.0 calls. It's google, they can handle it.