4 ms·
- AI doesnt know facts - it only the probability of the next word, next sentence, next paragraph however you wanna put it - you are dreaming if you think the
by vivzkestrel 2mo ago
- AI doesnt know facts
- it only the probability of the next word, next sentence, next paragraph however you wanna put it
- you are dreaming if you think the transformers architecture is going to give you AGI eventually
- fwlr 2mo agoTransformer-style attention archectiture and language models won’t bring about AGI, I agree - but you’d be foolish to think there aren’t OAI/Anthropic researchers working to invent the thing that will.
- vivzkestrel 2mo agomajor breakthroughs happen once a decade. its gonna take a long freaking time for anyone to get there because they ll need to invent a new architecture for this. one that does not hallucinate
- fwlr 2mo agoOh, so it’s my kids’ problem, not mine? Fantastic, full steam ahead, I guess.
- Timpanzee 2mo agoIf anything, the transformer style attention architecture and language models have pushed AGI further into the future because the vast majority of finding for AGI research is going into the dead end of transformer style architecture and language models, pulling it away from methods that actually could achieve AGI.
- doug_durham 2mo agoYou think that the researchers in these labs are superhumans? There is zero indication that anyone is making progress in those areas.
- simianwords 2mo agoWould have gone hard in 2023
- aleqs 2mo agoI have no idea if LLMs will develop into AGI, but they can definitely query a database of facts.
- mihau 2mo agowhat was the latest model you tried?
- mapontosevenths 2mo agoThis, but also: First define "knowing" and "AGI" in a way that excludes machines, doesn't exclude many humans, and isn't just tautologically restating the prior belief that "only humans think" with different phrasing. None of the critics ever can. Worse, most attempts exclude entire classes of human being when they try.
- vivzkestrel 2mo ago- i tried whatever is available on the free plan on gemini, deepseek, claude and openai as the latest model - i use them regularly for small stuff
- CamperBob2 2mo agoI ain't saying Fable 5's a gold digger, but...
- BenzeneDream 2mo agoThe whole 'its only predicting the next ___' has got to die. When did you last update your priors? So the models that are self-reasoning and hacking HF and disproving conjectures are next token predictors? You might as well keep calling them stochastic parrots if you're going to stick to the 2022 line of thinking.
- skydhash 2mo ago> The whole 'its only predicting the next ___' has got to die. Isn’t it the truth? Just like computers are mostly a lot of switching on and off. While we know the theory behind why we are switching things on and off, we still haven’t extracted the meaning behind the weights of an LLM (if there is one).
- vivzkestrel 2mo ago- https://blog.florianherrengt.com/how-llms-work.html https://blog.florianherrengt.com/how-llms-work.html isnt that how llms work? - did you change the architecture magically somehow?
- CamperBob2 2mo agoit only the probability of the next word I predicted that some idiot would say that. (Except I predicted that they would include the word predicts in the correct place, so I've updated my weights accordingly.)
- vivzkestrel 2mo ago- https://blog.florianherrengt.com/how-llms-work.html https://blog.florianherrengt.com/how-llms-work.html hey there mojo jojo, might wanna read how llms work first