It's quite different from gpt4 in two respects: 1) It's natively multi-modal in a way I don't think gpt4 was. 2) It's at least twice as efficient in terms of

It's quite different from gpt4 in two respects: 1) It's natively multi-modal in a way I don't think gpt4 was. 2) It's at least twice as efficient in terms of compute. Maybe 3 times more efficient, considering the increase in performance. Combined, those point towards some major breakthroughs having gone into the model. If the quality of the output hasn't gone up THAT much, it's probably because the technological innovations mostly were leveraged (for this version) to reduce costs rather than capabilities. My guess is that we should expect them to leverage the 2x-3x boost in efficiency in a model that is at least as large as GTP4 relatively soon, probably this year unless OpenAI has safety concerns or something, and keeps it internal-only.