Aren't we finding out you can get ChatGPT3.5 quality models for ~1-10M dollars? Not sure how much it costs to make chatGPT4 quality, isnt it just including hum

Aren't we finding out you can get ChatGPT3.5 quality models for ~1-10M dollars? Not sure how much it costs to make chatGPT4 quality, isnt it just including human reinforcement? Maybe that will get expensive.