Maybe images are the universal interface. With some of the advancements in ML, we have different decoders: image-to-text (OCR), layout information (object recog

Maybe images are the universal interface. With some of the advancements in ML, we have different decoders: image-to-text (OCR), layout information (object recognition), and other metadata (formatting, fonts, etc.). Now, with diffusion-based models like Stable Diffusion and DALL-E, we have an encoder – text-to-image. Natural analogy to how humans perceive the world and how we've designed our own human-computer interfaces. [0] https://matt-rickard.com/screenshots-as-the-universal-api https://matt-rickard.com/screenshots-as-the-universal-api [1] https://twitter.com/mattrickard/status/1577321709350268928 https://twitter.com/mattrickard/status/1577321709350268928