4 ms·
For some easy to grok examples: imagine MNIST, where all the pixels besides the writing are 0; or a recommendation system, where column i has the users rating f
by jtsiskin 6y ago
For some easy to grok examples: imagine MNIST, where all the pixels besides the writing are 0; or a recommendation system, where column i has the users rating for movie i, or number of times they listened to song i; or any one-got encoding scheme
- eru 6y ago> or any one-got encoding scheme Typo: should be one-hot encoding scheme. Sparsity of input isn't often relatively easy to achieve, as you suggest. Sparsity of intermediate layers requires more work. (But is often a good regularization technique.)
- jtsiskin 6y agoHumorously “one-got” is almost a apt description :)