4 ms·
> It's just not true that everything not transformer is outdated. Am not expert, do you have some links about this? i.e. a neural net construction that outperf
by cjbprime 3y ago
> It's just not true that everything not transformer is outdated.
Am not expert, do you have some links about this? i.e. a neural net construction that outperforms a transformer model of the same size.
- deleted 3y ago[deleted]
- pedrosorio 3y agoConvNets Match Vision Transformers at Scale (Oct 2023) https://arxiv.org/abs/2310.16764 https://arxiv.org/abs/2310.16764
- golol 3y agoWell transformers still have some plausible competition in NLP but besides that, there are other fields of AI where convnets or RNNs still make a lot of sense.