quantosaurus

4 ms·

1. 1.▲
   Schedule-Free Lion Optimizer(github.com)

   1 points by quantosaurus 1y ago|1 comments
2. 2.▲
   by quantosaurus 1y ago

   While working on new ML architectures I struggled to stabilize training by using countless learning-rate schedulers, gradient clippers and normalizers enough to go and implement a schedule-free optimizer. Here, Lion Schedule-Free optimizer
3. 3.▲
   by quantosaurus 2y ago

   Please forgive my ignorance, but what are the obvious reasons for you not having a website?