3 ms·
What would you say is an example of one of those “middle” tasks it can help with?
by libraryofbabel 1y ago
What would you say is an example of one of those “middle” tasks it can help with?
- CaptainOfCoit 1y agoAn example I just found worked very well with fine-tuning: I wanted to extract any frame that contained a full-screen presentation slide from a various videos I've archived, only when it's full-screen, and also not capture videos, and some other constraints. Naturally I reached for CLIP+ViT which got me a ~60% success rate out of the box. Then based on that, I created a tiny training script that read `dataset/{slide,no_slide}` and trained a new head based on that. After adding ~100 samples of each, the success rate landed at 95% which was good enough to call it done, and circle back to iterate once I have more data. I ended up with a 2.2K large "head_weights.safetensors" that increased the accuracy by ~35% which felt really nice.