Maybe basic stats, but we are not talking basics here. In the course knowing the proof of the law of large numbers for Markov chains was mandatory for example.

Maybe basic stats, but we are not talking basics here. In the course knowing the proof of the law of large numbers for Markov chains was mandatory for example. I am in systems programming and LLM research (as in worked on improving attention mechanism). And even in the latter the stats are only relevant because attention softmax looks like a probability distribution, and, surprise, attention works just fine without it, so even that relevance is questionable.