2 ms·
It's part of the TensorLi definition where all the magic happens.
by dauertewigkeit 3y ago
It's part of the TensorLi definition where all the magic happens.
- joennlae 3y agoThat is true. I went for a simple implementation of the layer norm and included it in the tensorli definition. But it would have been better to define it as a moduli for clarity.