25 ms·
>> we are starting to get neural networks that can do complex language understanding tasks. Ah, please, don't say things like that. We have neural networks th
by YeGoblynQueenne 10y ago
>> we are starting to get neural networks that can do complex language understanding tasks.
Ah, please, don't say things like that.
We have neural networks that can build complex models of language. But those complex models are nowhere near performing well in "understanding tasks", whatever those are (processing meaning, you mean basically).
The use of ANNs in Natural Language Processing has not led to the same advances it did in, say, image and speech processing, and... and, well, image and speech processing.
There's a ton of things about language that go well beyond building a model of language. Neural networks are nowhere near addressing meaning and context, or the way those are conveyed through language but are not the same as language.
In a way, NLP today, with ANNs or not, is still stuck in the same rut we were ages ago, where we assumed that syntax was the biggest part of language and solving that would solve language [1]. We got syntax down pat and it didn't do us much good. Neural Networks simply build more complex models of language than what we were able to build by hand-crafting grammars thirty years ago- but they're still just complex models of syntax. But syntax is just the surface of language and it's not even all of the surface.
No we're not starting to get nets that can do "complex understanding tasks". Not even ones that can do simple ones. No AI technique does "understanding" yet, except in very limited ways.
[1] Did we really assume that? I'm not even so sure anymore.