3 ms·
sure: just posted on reddit: https://www.reddit.com/r/deeplearning/comments/1ro8uw2/analytical_training_for_cnns_transformers_lstms/ https://www.reddit.com/r/de
by fakesum 7mo ago
sure: just posted on reddit: https://www.reddit.com/r/deeplearning/comments/1ro8uw2/analytical_training_for_cnns_transformers_lstms/ https://www.reddit.com/r/deeplearning/comments/1ro8uw2/analy... with benchmarks and things. and yes it works for LLMs, LSTMs, RNNs, CNNs, and more.
- clbrmbr 7mo agoThanks. Do come back to post with your tutorials. I'd recommend going quite granular and being didactic. Take somebody who understands gradient descent on MLPs and ELI5 the analytical part. Try to anticipate some of the doubts (there will be many! gradient descent from random init is dogma at this point).