Thanks for mentioning GPT-J :) I didn't know about them before. That looks very usable and I'm truly astonished that someone was generous enough to pay for tra

Thanks for mentioning GPT-J :) I didn't know about them before. That looks very usable and I'm truly astonished that someone was generous enough to pay for training such a large model and is now giving it away for free. As for the memory requirements, I'm pretty sure one could split the model into different stages which can then execute one after another => You only need 8GB with 3 slices. I'm currently using something similar to squeeze a ~30GB wav2vec2 into a 12 GB RAM 1080 TI.