I think that's a misinterpretation of what these types of papers are. GPT3.5 and GPT4 are already general purpose with text tasks. You can give it _any_ well d

I think that's a misinterpretation of what these types of papers are. GPT3.5 and GPT4 are already general purpose with text tasks. You can give it _any_ well defined programming task that involves a fairly direct route from natural language to code, along with the API/module description (or output data format), and it can do it. That's the only reason this and 500 other papers or services like it (but doing different things) are possible. 3.5 is not multimodal though. That's why it needs the other models. But GPT4 has image understanding and can do a lot of these things without the external tools. There is no reason to think that similar variations of GPT will not be able to handle video understanding or generation at some point.