3 ms·
To me, I see LLMs as the same type of revolution that dragon naturally speaking was to voice to text. A huge leap forward over existing models, but we've spent
by malfist 2y ago
To me, I see LLMs as the same type of revolution that dragon naturally speaking was to voice to text.
A huge leap forward over existing models, but we've spent the last two (three?) decades trying to close the remaining gap left by dragon in the voice to text problem space, and haven't much progress to show.
I think LLMs are likely to be like that. They are a huge jump over previous models of NLP, but I don't see them improving enough to matter to indicate they'll ever make it to AGI
- kohee 2y agoThe limitation lies in Transformer architecture itself, therefore AGI was never a possibiblity. It's wonderful, but not miraculous; And that's okay. At this point big techs are just milking the hype of what already reached it's boundaries.
- zamadatix 2y agoI dunno I'm confident enough to say transformer based architectures have really reached their boundaries quite yet but I would agree the hype milks a bit past where it seems transformers alone will take things.
- HeatrayEnjoyer 2y agoWhat do you think of Google's new architecture?
- thaumasiotes 2y ago> but we've spent the last two (three?) decades trying to close the remaining gap left by dragon in the voice to text problem space, and haven't much progress to show. Who says it's possible to close the gap? Humans are certainly not capable of doing perfect speech-to-text. You can sit someone down with a song recording and the ability to replay it as much as they want and there's no guarantee they'll ever be able to tell you what the lyrics are.
- malfist 2y agoHuman speech recognition is not perfect but it's way higher than the 90% accuracy of current gold standard systems