3 ms·
The benefits here are not really to do with implementing inference, but rather the improvement in explainability that a shallow network can provide. Skip to sec
by kixiQu 3y ago
The benefits here are not really to do with implementing inference, but rather the improvement in explainability that a shallow network can provide. Skip to section 5 (page 8) for that.
- throwawaymaths 3y agoIf anything inference will probably get worse. Typically in ML constraining your architecture (which is what you're doing when you make a deep narrow network out of a shallow wide network, or rnns or grus/lstms, or transformers out of fcnns) yields inference and training performance benefits.