I notice that in this paper, some of the new weights can be initialized arbitrarily, and only some of them have to be zero. In the Gopher paper, were all the ne

I notice that in this paper, some of the new weights can be initialized arbitrarily, and only some of them have to be zero. In the Gopher paper, were all the new weights zero, or only the ones that this paper calls for being zero? I would guess the latter? (I don't expect you to either have or fetch an answer to this question. If you happen to already have the answer, or simply a more educated guess than I have, I'd like to hear it, but I mean this more as "this question comes to mind" than anything where I expect an answer.)