3 ms·
From what I can tell the architecture is more important anyway and having smaller but more parameters gives the model more chances to figure out the optimal arc
by imtringued 3y ago
From what I can tell the architecture is more important anyway and having smaller but more parameters gives the model more chances to figure out the optimal architecture on its own.
- tysam_and 3y agoMy best understanding is that architecture is predetermined, which determines the number of parameters up front? I do think that, however, having shallower bit depths over time will require some slightly deeper networks to compensate, as a result. Sorta makes sense when you think about it a bit. :) <3 :DDDD :)