You don't need to and can't really load all training data. For LLMs you need to load single row of context size, that's vector of ie. 8k numbers, which is 32kB

You don't need to and can't really load all training data. For LLMs you need to load single row of context size, that's vector of ie. 8k numbers, which is 32kB for single precision floats.