3 ms·
>> In order to predict the most probable next word in a sentence, a model is required not only to be able to express syntax (the grammatical form of the predict
by YeGoblynQueenne 8y ago
>> In order to predict the most probable next word in a sentence, a model is
required not only to be able to express syntax (the grammatical form of the
predicted word must match its modifier or verb) but also model semantics. Even
more, the most accurate models must incorporate what could be considered world
knowledge or common sense.
So, the first sentence in this passage is a huge assumption. For a model to
predict the next token (word or character) in a string, all it has to do is to
be able to predict the next token in a string. In other words, it needs to
model structure. Modelling semantics is not required.
Indeed, there exist a wide variety of models that can, indeed, predict the
most likely next token in a string. The simplest of those are n-gram models,
that can do this task reasonably well. Maybe what that first sentence above is
trying to say is that to predict the next token with good accuracy, modelling
of semantics is required, but that is still a great, big, huge leap of
reasoning. Again- structure is probably sufficient. A very accurate model
modelling structure, is still only modelling structure.
It's important to consider what we mean when we're talking about modelling
language probaiblistically. When humans generate (or recognise) speech, we
don't do that stochastically, by choosing the most likely utterance from a
distribution. Instead, we -very deterministically- say what we want to say.
Unfortunately, it is impossible to observe "what we want to say" (i.e. our
motivation for emitting an utterance). We are left with observing -and
modelling- only what we actually say. The result is models that can capture
the structure of utterances, but are completely incapable of generating new
language that makes any sense - i.e. gibberish.
It is also worth considering how semantic modelling tasks are evaluated (e.g.
machine translation). Basically, a source string is matched to an arbitrary
target string meant to capture the source string's intended meaning.
"Arbitrary" because there may be an infinite number of strings that carry the
same meaning. So what, exactly, are we measuring when we evaluate a model's
ability to map between to of those infinite strings chosen just because we
like them best?
Language inference and comprehension benchmarks like the ones noted in the
article are particularly egregious in this regard. They are basically
classification tasks, where a mapping must be found between a passage and a
multiple-choice spread of "correct" labels, meant to represent its meaning.
It's very hard to see how a model that does well in this sort of task is
"incorporating world knowledge" let alone "common sense"!
Maybe NLP will have its ImageNet moment- but that will only be in terms of
benchmarks. Don't expect to see machines understanding language and holding
reasonable conversations any time soon.
- DoctorOetker 8y agoI fully agree and while you probably word it much better than me, I made a somewhat similar argument at https://news.ycombinator.com/item?id=16961233 https://news.ycombinator.com/item?id=16961233 if you are interested...