3 ms·
> We're 3 to 4 years into the LLM revolution and the rate of progress is still impressive. The “Attention Is All You Need” paper came out in 2017 and OpenAI re
by an0malous 3mo ago
> We're 3 to 4 years into the LLM revolution and the rate of progress is still impressive.
The “Attention Is All You Need” paper came out in 2017 and OpenAI released GPT-1 in 2018. ChatGPT was released in late 2022 but that was not the beginning of LLMs. Transformers and generative AI go back even further.