4 ms·
Agreed, the idea is interesting and worthy of further exploration. For starters, does it scales beyond MNIST or 'tiny synthetic datasets'?
by alquemist 6y ago
Agreed, the idea is interesting and worthy of further exploration. For starters, does it scales beyond MNIST or 'tiny synthetic datasets'?
- freeone3000 6y agoThe approach appears similar to model distillation, performed on the input data instead of on the weights. Model distillation scales well in classification but less well in generation.