In the comments Karpathy wrote this: > ...today's computers are terrible for neural nets. We are running in total emulation mode and there are many orders of m

In the comments Karpathy wrote this: > ...today's computers are terrible for neural nets. We are running in total emulation mode and there are many orders of magnitude of improvement to claim from a redesign of the architectures with neural nets in mind.