3 ms·
Modern architectures are becoming simpler, usually just stacks of transformers, and they are good for text, vision, audio, or almost any task without special mo
by visarga 5y ago
Modern architectures are becoming simpler, usually just stacks of transformers, and they are good for text, vision, audio, or almost any task without special modifications. That means if they could implement an optical transformer that is 100x more efficient/faster everyone will want to have it.