3 ms·
> I don't really understand why RNNs are better at processing symbols and CNNs are better at processing images It's also possible to go the other way around.
by visarga 9y ago
> I don't really understand why RNNs are better at processing symbols and CNNs are better at processing images
It's also possible to go the other way around. PixelRNN uses a kind of special convolutions to encode and generate images. And CNN's have been used for text translation and speech synthesis, especially because they are faster.
The RNN and CNN contain prior knowledge about the domain. The RNN contains the idea that prior elements influence the following elements in a sequence. CNN's encode the idea that close pixels are related. Both imply some kind of domain knowledge.
Multiple attention heads could potentially learn domain knowledge from data.