The approach appears similar to model distillation, performed on the input data instead of on the weights. Model distillation scales well in classification but

The approach appears similar to model distillation, performed on the input data instead of on the weights. Model distillation scales well in classification but less well in generation.