3 ms·

GrokFast strongly reminds me of Stochastic Average Gradient Descent: https://www.cs.ubc.ca/~schmidtm/Courses/540-W19/L12.pdf https://www.cs.ubc.ca/~schmidtm/Cou

by thesz 2y ago

GrokFast strongly reminds me of Stochastic Average Gradient Descent: https://www.cs.ubc.ca/~schmidtm/Courses/540-W19/L12.pdf https://www.cs.ubc.ca/~schmidtm/Courses/540-W19/L12.pdf Both use averaging.