While it is true language is an important input, there are plenty of examples of transformer architecture working on generating binary data - a good example wou

While it is true language is an important input, there are plenty of examples of transformer architecture working on generating binary data - a good example would be generating a 3d mesh from a text prompt (you have a shit ton of models for this). The input is text, the output is a binary file - a jpeg, a png or an stl. We're already there, just not for applications. Fyi you can do this today. Ask for a flying cape dog and have a stl you can print into a physical object.