4 ms·
It didn't appear in the last two years. We have had deep learning based autoregressive language models (like Word2Vec) for at least 10 years.
by FiberBundle 2y ago
It didn't appear in the last two years. We have had deep learning based autoregressive language models (like Word2Vec) for at least 10 years.
- fosk 2y agoEarly computer networks appeared in the 1960s and the public internet as we know it in the 1990s. We are still early in AI.
- whimsicalism 2y agototally, and i’ve been working with attention since at least 2017. but i’m colloquially referring to the real breakout and substantial scale up in resources being thrown at it