2 ms·
This is the right question. It is plausible to me that this is a way of condensing a vast training set into a reduced set of high quality examples.
by minihat 3y ago
This is the right question. It is plausible to me that this is a way of condensing a vast training set into a reduced set of high quality examples.
- version_five 3y agoYou could also consider some kinds of sampling of the dataset - basically not including images that are too close together in whatever space. There are also data distillation methods that are supposed to generate a smaller training set - the ones I've seen don't generate images that look like real training samples though. I think it's definitely an interesting thing to study - it would be worth exploring what specifically the generative model can add. I've actually done something like this with GANs, but the gains came largely from generating plausible training images that were augmentations around some invariance, as I mentioned above.