4 ms·
I'm reading this post and wondering what kind of crazy accessibility tools one could make. I think it's a little off the rails but imagine a tool that describes
by troyvit 11mo ago
I'm reading this post and wondering what kind of crazy accessibility tools one could make. I think it's a little off the rails but imagine a tool that describes a web video for a blind user as it happens, not just the speech, but the actual action.
- GaggiX 11mo agoThis is not local but Gemini models can process very long videos and provide description with timestamps if asked for. https://ai.google.dev/gemini-api/docs/video-understanding#transcribe-video https://ai.google.dev/gemini-api/docs/video-understanding#tr...
- embedding-shape 11mo agoNor would it be describing things as they happen, but instead needing pre-processing, so in the end, very different :)