GPT-3 isn't really all that optimized in terms of size. Later studies have shown that you don't need that many parameters to get the same results, so it should

GPT-3 isn't really all that optimized in terms of size. Later studies have shown that you don't need that many parameters to get the same results, so it should be possible to train a model that could run at least on something like an RTX 4090 Ti with 48GB ram.