3 ms·
Do I get it wrong, that this will be incompatible with OrthoGrad¹ optimizer? [¹] https://arxiv.org/abs/2501.04697 https://arxiv.org/abs/2501.04697
by pk-protect-ai 2y ago
Do I get it wrong, that this will be incompatible with OrthoGrad¹ optimizer?
[¹] https://arxiv.org/abs/2501.04697 https://arxiv.org/abs/2501.04697
- yorwba 2y agoThese seem like orthogonal developments to me that could easily be combined. What made you think they might be incompatible?