Yep, it's linear. This is essentially a regression task and the distribution of the factors across the dataset is pretty close to Gaussian in most cases, so it

Yep, it's linear. This is essentially a regression task and the distribution of the factors across the dataset is pretty close to Gaussian in most cases, so it made sense not to have any nonlinearities there. As a sidenote, if it weren't for the L2-pooling in the global temporal pooling layer, the network would be completely piecewise linear from input to output :)