> spatial receptive field. Yeap that's what I meant by inspired. It's a pretty weak inspiration. Thanks for the correction on ReLUs. Actually IIRC also the

> spatial receptive field. Yeap that's what I meant by inspired. It's a pretty weak inspiration. Thanks for the correction on ReLUs. Actually IIRC also the important bit about ReLUs is that their range is unbounded so that the derivatives don't diminish to zero over multiple iterations over the activated path.