SGD > adaptive, according to this: https://people.eecs.berkeley.edu/~brecht/papers/17.WilEtAl.Ada.pdf https://people.eecs.berkeley.edu/~brecht/papers/17.WilEtA

SGD > adaptive, according to this: https://people.eecs.berkeley.edu/~brecht/papers/17.WilEtAl.Ada.pdf https://people.eecs.berkeley.edu/~brecht/papers/17.WilEtAl.A...