3 ms·
Transformer-style attention archectiture and language models won’t bring about AGI, I agree - but you’d be foolish to think there aren’t OAI/Anthropic researche
by fwlr 2mo ago
Transformer-style attention archectiture and language models won’t bring about AGI, I agree - but you’d be foolish to think there aren’t OAI/Anthropic researchers working to invent the thing that will.
- vivzkestrel 2mo agomajor breakthroughs happen once a decade. its gonna take a long freaking time for anyone to get there because they ll need to invent a new architecture for this. one that does not hallucinate
- fwlr 2mo agoOh, so it’s my kids’ problem, not mine? Fantastic, full steam ahead, I guess.
- Timpanzee 2mo agoIf anything, the transformer style attention architecture and language models have pushed AGI further into the future because the vast majority of finding for AGI research is going into the dead end of transformer style architecture and language models, pulling it away from methods that actually could achieve AGI.
- doug_durham 2mo agoYou think that the researchers in these labs are superhumans? There is zero indication that anyone is making progress in those areas.