4 ms·
I assume transformers will be replaced by something, just as transformers replaced other sequential models. That said, transformers have already earned a place
by dekhn 5y ago
I assume transformers will be replaced by something, just as transformers replaced other sequential models.
That said, transformers have already earned a place in the annals of ML, if for no other reason than they were the critical to the first technology to solve protein structure prediction.
- PartiallyTyped 5y agoTransformers are really just fancy graph neural networks, the next step is diffusion networks.