4 ms·

Human: I'm a huge football fan - the Eagles are my favorite team! Knowledgable model: I've always been more of a fan of the American football team

Human: I'm a huge football fan - the Eagles are my favorite team! Knowledgable model: I've always been more of a fan of the American football team from Pittsburgh, the Steelers! While an impressive improvement from "I like football too," this stilted attempt at incorporating relevant information ends up coming off as "how do you do, fellow humans!?"

mrkstu 7y ago
Yes, still firmly in the uncanny valley.
- scottlocklin 7y ago
  I dunno, probably about as good as Zuck is doing.
- amelius 7y ago
  The problem is that they are trying to cheat, rather than truly understanding what somebody is saying and responding appropriately. That they are now addressing the consistency of their own model shows that they are barely able to understand what the model itself is saying, let alone what the other party is saying.
  - Master_Odin 7y ago
    That's the trick of these ML approaches though is that we trade the cost/time of building semantic understanding for something that appears to work, but will produce things that make no real semantic sense/understanding.
Zenst 7y ago
The aspect that it identified that this was about American Football and not say the rest of the World football is interesting. The name of the team gives that away. What does stilt it is the superfluous repeating of football as if the context was unclear in which for a human, it is. Then to clarify that further by stating "american football", does kinda add to the stiltedness. Then to state the location even further, as a football fan who was aware of their team, would be aware of other teams, because they are a huge football fan. The more human way of responding would of been more along the lines of: I've always been a Steelers fan myself. Though, banter and smacktalk of competitive sports fans, for an AI to blend in with that and get the balance right, that will be interesting to see play out as is. Expect the AI to go into parenting mode and ask why all the negativity.
mikeash 7y ago
To me it sounds like a badly trained foreign spy. Which is actually pretty good if the goal is to sound human-like!

mrkstu 7y ago

Yes, still firmly in the uncanny valley.

scottlocklin 7y ago
I dunno, probably about as good as Zuck is doing.
amelius 7y ago
The problem is that they are trying to cheat, rather than truly understanding what somebody is saying and responding appropriately. That they are now addressing the consistency of their own model shows that they are barely able to understand what the model itself is saying, let alone what the other party is saying.
- Master_Odin 7y ago
  That's the trick of these ML approaches though is that we trade the cost/time of building semantic understanding for something that appears to work, but will produce things that make no real semantic sense/understanding.

Zenst 7y ago

The aspect that it identified that this was about American Football and not say the rest of the World football is interesting. The name of the team gives that away. What does stilt it is the superfluous repeating of football as if the context was unclear in which for a human, it is. Then to clarify that further by stating "american football", does kinda add to the stiltedness. Then to state the location even further, as a football fan who was aware of their team, would be aware of other teams, because they are a huge football fan. The more human way of responding would of been more along the lines of: I've always been a Steelers fan myself. Though, banter and smacktalk of competitive sports fans, for an AI to blend in with that and get the balance right, that will be interesting to see play out as is. Expect the AI to go into parenting mode and ask why all the negativity.

mikeash 7y ago

To me it sounds like a badly trained foreign spy. Which is actually pretty good if the goal is to sound human-like!