That would be the cost of running GPT3 as-is, not to train a new model or hook it up to any live information. GPT4 has a much larger context window (16x larger

That would be the cost of running GPT3 as-is, not to train a new model or hook it up to any live information. GPT4 has a much larger context window (16x larger), which suggests its file size would be at least 16x as large.