4 ms·
> We are tens of months into what looks like the AI age. The modern AI era started in 2017 with the "Attention Is All You Need" paper (https://arxiv.org/abs/17
by xnx 3y ago
> We are tens of months into what looks like the AI age.
The modern AI era started in 2017 with the "Attention Is All You Need" paper (https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1706.03762). ChatGPT is a popular manifestation of something that has been making huge and significant progress (image recognition, language translation, image generation, etc.) since then.
This blog post has helped me the most in trying to understand what LLMs are, how they work, and what they might be capable of: "Prompting as searching through a space of vector programs"
https://fchollet.substack.com/p/how-i-think-about-llm-prompt-engineering https://fchollet.substack.com/p/how-i-think-about-llm-prompt...
- bsenftner 3y agoThat's the "beginning of the start". We'll be "finished starting" when a market worthy demographic establishes itself as the "pro-AI may-as-well-be-religion" camp, disregard any official or scientific reasoning, and declare their own definition of what AI is, which they basically worship, but with enough words that they don't call it worship, they'll make up their own words, like they invented the idea of religion itself, but in a new AI understanding that is really their worshiping themselves. And they'll be enough of them they'll vote themselves into office. AI's capabilities is too much for the general public to handle, and all bets should be recognized as "off". The "AI Age" is going to be a lot of misunderstanding, a lot of propaganda, some very visible out of control ambitions, and too little critical thinking. At least until the colossal attempts at large scale automation fail, killing millions.
- kjkjadksj 3y agoIts even older if you want to focus on when these ideas started being written about academically. Markov chains are from the early 1900s. Bayes theorem is from the 18th century.
- xnx 3y agoDefinitely. I see it as being similar to the history of flight. There were ideas and attempts for hundreds of years, but the Wright brothers flight was a turning point.