3 ms·
Watched the video - thanks Ioannu is saying the paper's idea for training a dense network doesn't work in non-toy networks (the paper's method for selecting pr
by paulsutter 9mo ago
Watched the video - thanks
Ioannu is saying the paper's idea for training a dense network doesn't work in non-toy networks (the paper's method for selecting promising weights early doesn't improve the network)
BUT the term "lottery ticket" refers to the true observation that a small subset of weights drive functionality (see all pruning papers). It's great terminology because they truly are coincidences based on random numbers.
All that's been disproven is that paper's specific method to create a dense network based on this observation