3 ms·
For sure, here's a few tidbits: ML: fine-tuned CLIP model. Each video frame is embedded using CLIP and then the image embedding is compared against the text qu
by axg11 5y ago
For sure, here's a few tidbits:
ML: fine-tuned CLIP model. Each video frame is embedded using CLIP and then the image embedding is compared against the text query embedding
Architecture: everything is serverless using AWS lambda. Basic flow is: video upload to storage, lambda for converting video to still frames, perform ML inference on each frame, aggregate inference results and create customer output.
- davidatbu 5y agoThank you so much for these pointers! I'm trying to keep up with the SoTA both in terms of research and production models in ML, and this is super helpful. Best of luck!