The underlying work is something called "Flamingo".[1] This is a system for understanding interleaved text and images in sequence. So it can process two "modali

The underlying work is something called "Flamingo".[1] This is a system for understanding interleaved text and images in sequence. So it can process two "modalities" that are both sequential. This new work seems to put some kind of time token in one "modality" channel, leading to more awareness of time. (The web site is too cute. Applying a left to right gradient on text is a bit much.) [1] https://arxiv.org/pdf/2204.14198 https://arxiv.org/pdf/2204.14198