Wildly tangential (given what the article actually means by "Optical Transformer"), but I was thinking about this the other day and what I really want is an Aud

Wildly tangential (given what the article actually means by "Optical Transformer"), but I was thinking about this the other day and what I really want is an Audial Transformer. The main reason for this is I want something I can hum a song to and it tells me what the song is. We have Shazam, but AFAIK that works almost entirely using fourier transforms / audio signals in frequency space, and so doesn't work well if it's not an actual snippet of the song. But it would be cool if we could train an audio model like we've trained language models to "fill in the gaps" for me. Potentially there could be some interesting applications where you sing an entirely new song and the model could "fill in the gaps" with instruments, etc.