See https://github.com/FMInference/FlexGen https://github.com/FMInference/FlexGen This is from much earlier this year and seems to be the same idea, only loadi

See https://github.com/FMInference/FlexGen https://github.com/FMInference/FlexGen This is from much earlier this year and seems to be the same idea, only loading part of the model into the GPU at a time.