3 ms·
What you say is certainly possible but I have not seen anything from LLMs so far that make me think it is probable. They just make too many mistakes and are no
by aqueueaqueue 2y ago
What you say is certainly possible but I have not seen anything from LLMs so far that make me think it is probable.
They just make too many mistakes and are not really thinking. I think they are a dead end. If the scenario you talk about happens it is because we discover some new architecture previously unthought of as well as advancement in processor efficiency and price.
- noname120 2y agoConsensus in the machine learning community is that current architectures are enough for AGI, no new architecture needed. There is plenty of leeway as well into how much money we can pour into training and if the linear scaling law for model capabilities still holds — and we have no reason to believe yet that they won't we have the resources (both financial and technological) to reach this within 10-20 years tops.
- pillefitz 2y agoA few counter points: Most developers prefer Claude 3.5 (or the slightly improved 3.7 since a few days back), which is a year old already. What was supposedly ChatGPT 5 will be called 4.5 instead, after two multi-month and hugely expensive training runs. Grok 3 was trained on a massive cluster of 200.000 H100 and still not beating SOTA models. There's certainly not "a clear way forward", even though one may hope the billions invested will lead to algorithmic breakthroughs.
- JohnFen 2y ago> Consensus in the machine learning community is that current architectures are enough for AGI, no new architecture needed. I don't think there's anything like consensus on this. There isn't even consensus on whether AGI is possible in the first place.
- unmole 2y agoThere isn't even consensus on what AGI means.