Unfortunately a reality vague decision of the technique. They say you can train multiple models at once but wouldn't this require N times more memory? They also

Unfortunately a reality vague decision of the technique. They say you can train multiple models at once but wouldn't this require N times more memory? They also say that models that require heavy compute won't parallelize well which also seems just a bit absurd because aren't all those shaders all firing off perfectly in parallel to do all the big matrix math?