3 ms·
Why would you feed pixels into transformers? Surely you could translate the overall image into frequencies using Fourier transforms and then into embeddings whi
by Solvency 3y ago
Why would you feed pixels into transformers? Surely you could translate the overall image into frequencies using Fourier transforms and then into embeddings which feed the LLM?
- birdiesanders 3y agoIt's essentially a process if denoising a spectrogram, and as such the data is processed that way.