3 ms·
Sure, but we had Word2Vec and some primitive RNN-based language models 12 years ago. Arguably Word2Vec was the first big qualitative jump in NLP. Super modern
by VHRanger 4y ago
Sure, but we had Word2Vec and some primitive RNN-based language models 12 years ago.
Arguably Word2Vec was the first big qualitative jump in NLP. Super modern LLMs (say, starting with BERT -- ChatGPT isn't really a qualitative jump from those as much as a quantitative one) are another one that's maybe 4 years old.