3 ms·
Orthogonality ensures that each weight has its own, individual importance. In a regular MLP, the weights are naturally correlated.
by slashdave 2y ago
Orthogonality ensures that each weight has its own, individual importance. In a regular MLP, the weights are naturally correlated.