There are dozens of dozens of optimizers. Almost every single one of them claims superiority. Some of them, like MADGRAD, are great. But sticking with the basic

There are dozens of dozens of optimizers. Almost every single one of them claims superiority. Some of them, like MADGRAD, are great. But sticking with the basics is pretty good in my experience.