4 ms·
This looks dope! Any chance you'd be willing to share a bit about the core tech underneath? Ie, assuming this is neural net based, which architecture/paper/repo
by davidatbu 5y ago
This looks dope! Any chance you'd be willing to share a bit about the core tech underneath? Ie, assuming this is neural net based, which architecture/paper/repo did you use? Did you have to do any training / finetuning? ..etc.
I totally understand if you'd like to keep some/all of this secret, but I thought it's worth a shot :)
- axg11 5y agoFor sure, here's a few tidbits: ML: fine-tuned CLIP model. Each video frame is embedded using CLIP and then the image embedding is compared against the text query embedding Architecture: everything is serverless using AWS lambda. Basic flow is: video upload to storage, lambda for converting video to still frames, perform ML inference on each frame, aggregate inference results and create customer output.
- davidatbu 5y agoThank you so much for these pointers! I'm trying to keep up with the SoTA both in terms of research and production models in ML, and this is super helpful. Best of luck!