3 ms·
In this case I'd argue this is more than just the usual iterative fodder. The architecture itself is not the interesting part, it's the evidence that many decen
by axg11 5y ago
In this case I'd argue this is more than just the usual iterative fodder. The architecture itself is not the interesting part, it's the evidence that many decent architectures exist and performant networks don't have to be analogous to human visual systems (CNNs). How do they stay motivated? 1) the pursuit of knowledge 2) publishing as a way to gain prestige and climb up the career ladder
- mirker 5y agoYeah, the motivation is pretty easy if you consider that much of software engineering is the same process (e.g., performance tuning), and on top of that you get prestige and do some math on the side. It’s basically a research version of test-driven development.
- dpflan 5y agoThe focus on architecture is interesting. Another paper Weight Agnostic Neural Networks [1.] explores neural network architecture search and focuses on how influential structure alone is with some success. [1.] Weight Agnostic Neural Networks (interactive site with link to paper) - https://weightagnostic.github.io/ https://weightagnostic.github.io/