4 ms·

>"A lightbulb containing some plants," makes sense, not "surrounding". It's too small to surround anything, which humans (and apparently, current AI) understand

>"A lightbulb containing some plants," makes sense, not "surrounding". It's too small to surround anything, which humans (and apparently, current AI) understand. Paradoxically, only primitive language models would actually understand the inverted sentences; proper AIs should, like humans, be confused by them; since zero human talks like that. Not sure this is credible. Most if not all human adults are capable of understanding what young children just learning to speak mean most of the time, not only people with very low IQs. So why would this be any different? Presumably the smarter the AI the better it can understand poor grammar.

concinds 4y ago
You understand poor grammar using context. This isn't poor grammar, this is a syntactically broken sentence, which requires more extrapolation for meaning. The AI hears "a lightbulb surrounding some plants" and understands the poor grammar using the context, i.e. understands that you mean that the plants are surrounding the lightbulb, since the reverse is vashingly unlikely to be what you mean. End result: your AI is actually quite good, but HuggingFace IYIs give it a bad grade. So: you fix the AI. You fix it so that it makes huge assumptions when it sees imperfect grammar. It doesn't necessarily pick what it thinks you actually meant; it picks utterly nonsensical crap (plants inside a lightbulb). That AI will end up severely misinterpreting human instructions, at some point or another. That AI is called HAL-9000. But it passes Huggingface's test!
- Jordrok 4y ago
  > This isn't poor grammar, this is a syntactically broken sentence Absolute nonsense! Sure, "containing" is more precise in conveying the idea, but "surrounding" still results in a perfectly valid sentence that the average human being can comprehend. Pretending otherwise is just being obtuse.

concinds 4y ago

You understand poor grammar using context. This isn't poor grammar, this is a syntactically broken sentence, which requires more extrapolation for meaning. The AI hears "a lightbulb surrounding some plants" and understands the poor grammar using the context, i.e. understands that you mean that the plants are surrounding the lightbulb, since the reverse is vashingly unlikely to be what you mean. End result: your AI is actually quite good, but HuggingFace IYIs give it a bad grade. So: you fix the AI. You fix it so that it makes huge assumptions when it sees imperfect grammar. It doesn't necessarily pick what it thinks you actually meant; it picks utterly nonsensical crap (plants inside a lightbulb). That AI will end up severely misinterpreting human instructions, at some point or another. That AI is called HAL-9000. But it passes Huggingface's test!

Jordrok 4y ago
> This isn't poor grammar, this is a syntactically broken sentence Absolute nonsense! Sure, "containing" is more precise in conveying the idea, but "surrounding" still results in a perfectly valid sentence that the average human being can comprehend. Pretending otherwise is just being obtuse.