Good question. I have done the andrej karpathy course on youtube. It is not easy. And it is fast paced (about 12 or so hours that would be 50 if it were a unive

Good question. I have done the andrej karpathy course on youtube. It is not easy. And it is fast paced (about 12 or so hours that would be 50 if it were a university designed course plus same again for practice). Then even with all that debugging the model, and making architecture choices is a whole other thing he barely covers. Would love a good course on that. If you learn the nuts and bolts you can point to any part of the transformer model and describe what numbers and operations are happening in the forward and backward pass. That sort of is the reality. Reading other people’s fuzzy explanations is probably like understanding quantum mechanics by reading quanta (you get the layman example but don’t really understand… btw I know little about QM!) I needed to hop on other materials to exist. I van understand some of this but not all and running it and trying things out… probably not yet. Well never for 100k context size as I don’t want to sell my house to pay for compute :-).