4 ms·
The title is click-bait. This has been known for several years[1], the technique has little practical value, and the assertion that you can learn from no data i
by codelord 6y ago
The title is click-bait. This has been known for several years[1], the technique has little practical value, and the assertion that you can learn from no data is completely false and misleading. The training data was compressed to a few examples. To the journalist: it's OK not to maximize for click-bait when you write an article.
[1]: https://www.ttic.edu/dl/dark14.pdf https://www.ttic.edu/dl/dark14.pdf
- bonoboTP 6y agoThis is not a magazine article written by a journalist, but a press release written by MIT marketing people to hype up research from their university.
- jerry80 6y agoWhy not just make one image where the pixel values are the trained network weights? Then you can say you can distill any training set into just one image.
- vonwoodson 6y agoYou just nailed it. The whole thing feels like reinventing the wheel of ML.