5 ms·
I wonder if he thinks LLMs are an AGI dead end and he's not interested in selling a product. There's some academic papers floating around coming to the same con
by chasd00 2y ago
I wonder if he thinks LLMs are an AGI dead end and he's not interested in selling a product. There's some academic papers floating around coming to the same conclusion (no links. sorry, studying for a cert exam).
- KennyFromIT 2y agoYeah, I study* that way too. *procrastinate
- deleted 2y ago[deleted]
- dcchambers 2y agoThat's been my assumption since the beginning of this drama last year. He seems to have one goal: real AGI. He knows that while LLMs may make something that seems like AGI there's nothing actually intelligent about it and its never going to get them there. OpenAI wants to pivot and sell sell sell because all they see is potential trillions of dollars, and it's time to make money instead of burning more millions/billions chasing a dream. Yet all the AI weirdos on Twitter seem convinced that Ilya "saw something" (AGI) and got scared and wanted to pull the plug...lmao.
- MVissers 2y agoThere is more money in AGI than LLMs. Whatever it is, language seems key to intelligent algorithms. Nah, he departed due to politics (failed coup) and shift from research first to profit first. Same with Karpathy I believe. He’ll most likely go somewhere where he can get a lot of compute and go back to research first.
- msikora 2y agoLike Google?
- Jensson 2y ago> There is more money in AGI than LLMs. That doesn't matter, they know how to do LLMs, they don't know how to do AGI. To modern capitalists that means you invest in one and the other someone else can do. OpenAI was exploratory until they found something that could make them rich, then they went closed and for profit, now you should see them as just another for profit.
- dcchambers 2y ago> There is more money in AGI than LLMs. I'd argue there's no money in AGI. Such a technology actually being available would be such a seismic shift in society that it breaks every commonly accepted economic norm we have today. Real AGI means ALL knowledge workers are effectively out of a job. And AGI + advanced robotics means everyone is out of a job. Once no one has jobs, money loses all purpose. Whatever company invented AGI, if it ever happens, may rule the world but it won't be with money.
- surfingdino 2y ago> it's time to make money instead of burning more millions/billions chasing a dream. The investors want their money before people realise they have been oversold the dream/threat of AGI. > Yet all the AI weirdos on Twitter seem convinced that Ilya "saw something" (AGI) and got scared and wanted to pull the plug...lmao. The market to believe in made-up stories is alaways strong.
- Davidzheng 2y agoThis is counter to every interview ilya has ever given since gpt3--he believes scaling llms can get there that's why they scaled to gpt4 scales at all.
- EasyMark 2y agoIsn't it consensus that AGI will never arise from LLMs?
- qp11 2y agoJust based on current energy usage never going to happen. You just have to ask them to show you their energy bills alongside their demos.
- danielbln 2y agoA plane takes a LOT more energy than a bird, yet both fly, one of them a lot faster.
- ifdefdebug 2y agoA plane is good at hauling cargo and goes fast, but general flying skills? Doesn't even come close.
- danielbln 2y agoExactly, a giant LLM is not even close to be as power efficient as a human brain, in the same vein as a plane isn't as good at general flying. Yet it provides huge value and in many dimensions (that are important to us as humans) a plane can do way more than any bird.
- bamboozled 2y agoHonestly, is ChatGPT providing huge value yet though ? It’s cool and all. But I’m not sure if I’d say it’s as useful as flight yet. If I could choose between LLm access and aviation, I’d stick with aviation.
- Tenoke 2y agoThere is no such consensus.