3 ms·

Short version: You trade off increased VRAM usage for better training/runtime speed and better splittability. The balance of this tradeoff is an open question

Short version: You trade off increased VRAM usage for better training/runtime speed and better splittability. The balance of this tradeoff is an open question.