3 ms·
It's also a problem that students are focusing so much on neural-network-based approaches, neglecting other techniques. There's what, like, 10 places in the wor
by pradn 7y ago
It's also a problem that students are focusing so much on neural-network-based approaches, neglecting other techniques. There's what, like, 10 places in the world where you'll have enough compute to be able to train cutting-edge neural networks? Real world problems are just as well solved with other techniques like XG-Boost, which wins pretty often in Kaggle, for example.
- hnaccy 7y ago>There's what, like, 10 places in the world where you'll have enough compute to be able to train cutting-edge neural networks You can just use a smaller amount of compute with transfer learning style stuff. I can probably fine-tune a transformer model with my pocket money and beat any NLP solution from two years ago.