3 ms·
The industry has been consolidating around transformers. I'd say it's getting deeper, not wider.
by valine 3y ago
The industry has been consolidating around transformers. I'd say it's getting deeper, not wider.
- senseiV 3y agoNLP is not the industry, and a lot of research still goes into other things, like RL I've worked with several transformers competitors, and it def wont stay centralized on them
- valine 3y agoTransformers are used outside of NLP
- catlover76 3y ago[dead]
- rockinghigh 3y agoTransformers are in many state-of-art models but they don't solve all machine learning problems. Even within the world of transformers, there are many variations depending on the application: generating embeddings, translation, next-token prediction, recommendations.