3 ms·
Question: Have you tried using this for video? Alternately, if I wanted to pipe a bunch of screencaps into it and get one grand response, how would I do that?
by bravura 2y ago
Question: Have you tried using this for video?
Alternately, if I wanted to pipe a bunch of screencaps into it and get one grand response, how would I do that?
e.g. "Does the user perform a thumbs up gesture in any of these stills?"
[edit: also, do you know the vision pricing? I couldn't find it easily]
- simonw 2y agoPrevious Gemini models worked really well for video, and this one can even handle steaming video: https://simonwillison.net/2024/Dec/11/gemini-2/#the-streaming-api-is-next-level https://simonwillison.net/2024/Dec/11/gemini-2/#the-streamin...
- bravura 2y agoWow this is amazing. It just gave me critique on my bodyweight squat form. But I also found it hard to prompt to tutor in French or Portuguese; the accents were gruesomely bad.
- famouswaffles 2y agoFor some reason, the realtime api is using TTS for speech output. Not sure if that's temporary
- andy_ppp 2y agoI can't wait to see these models are able to do video <-> video, just so that I can be in ten standup meetings at once :^)