3 ms·
Video data doesn't work well with these multimodal LLMs because images are still somewhat intensive for them process. Both the GPT-4-Vision demos and Gemini tak
by minimaxir 3y ago
Video data doesn't work well with these multimodal LLMs because images are still somewhat intensive for them process. Both the GPT-4-Vision demos and Gemini take a few frames from each video (~1 frame per second).
Self-driving cars use much more efficient approaches for the real-time outputs needed.
- CamperBob2 3y agoSure, but my point is that self-driving may be easier to achieve if we don't insist on doing it the hard way with hardwired logic running task-specific models, the way I originally assumed it would have to be done.
- HellDunkel 3y agoI thought about this in the exact same way when there was a lot of talk about end to end learning in the early days. LLMs made me feel unsure too but i am still not conviced.