5 ms·
The result was that constant/zero initialization was the best, which is the most natural choice anyway (for me at least), and definitely also the most simple op
by albertzeyer 8y ago
The result was that constant/zero initialization was the best, which is the most natural choice anyway (for me at least), and definitely also the most simple option. I'm a bit surprised that they emphasise so much on that. Also, not really sure what to learn from this.
- stochastic_monk 8y agoDoes this correspond to an intuition that a tabula rasa may be the best way for a learner to start?