3 ms·
Batching can lead to variance with things like batchnorm but most transformers use layer norm to avoid this problem
by jerpint 1y ago
Batching can lead to variance with things like batchnorm but most transformers use layer norm to avoid this problem
- amelius 1y agoBatchnorm can only have an effect between batches during training, not inference.