I just learned backprop for the first time a week ago and doing exactly what you described, working it out by hand, was absolutely invaluable. There's something

I just learned backprop for the first time a week ago and doing exactly what you described, working it out by hand, was absolutely invaluable. There's something about being able to visualize what my code is doing on a sheet of paper that just helped everything click.