4 ms·

Is it harder to train the wider network or the deeper network all else equal?

• vatsadev 2y ago
  Post author here, if you look at MFU, then the wider layers win out, and init takes much longer the more you add layer
  • deleted 2y ago
    [deleted]