3 ms·

I remember someone posting a chat thread from one of the more advanced AIs within the last few years wherein they asked it who the president of the US is, and i

I remember someone posting a chat thread from one of the more advanced AIs within the last few years wherein they asked it who the president of the US is, and it was not able to answer. Interestingly, this is a question my father would ask patients as a paramedic who was trying to assess people's consciousness. Another would be, "what day of the week is it?". I'd say that these technologies are just like magic - they can seem to do things that defy your expectations, but oftentimes they fall apart when looked at from a different angle.

unsupp0rted 4y ago
I'm not sure there's a basic question we can ask that a lot of human users wouldn't fail. President of the country? Too difficult.
- bombcar 4y ago
  The point isn't to check if they actually know - it's to gauge the response. If they say "I don't know" that may be a valid answer, but if they say "George Bush" then something is seriously wrong.
  - notahacker 4y ago
    Also, if a human has to be told a basic fact they'll generally provide an indication of embarrassment or an excuse or "why are you asking me these questions", not try to continue the conversation with interesting facts...
bnt 4y ago
Depending where the bot is and what time of day it is, it might tell you the wrong day of the week.
- robertlagrant 4y ago
  "I was trained on a Thursday... damn."
- PeterisP 4y ago
  For current mainstream text generation models it doesn't really depend on where the bot is and what time of the day it is, that's kind of the whole point - their text generation process simply doesn't use the current time as a possible input factor, these models would provide the exact same result (or random picks from the exact same distribution of potential results) no matter when and where you run them. They would be expected to answer with something matching the day/time distribution that was represented in the training data they used; like the answer to various prompts of the "current president" question is dominated by Trump, Obama and a bit of Bush and Clinton, simply because those are the presidents in the training data and the more recent events simply aren't there yet - like the many models who have no idea how to interpret the word 'Covid' simply because they have been trained on pre-2020 data even if the model was built and released later.
Jiro 4y ago
Many contexts in which the president is named in training data are political. And nobody's going to put a chatbot on the web without filtering out political material

unsupp0rted 4y ago

I'm not sure there's a basic question we can ask that a lot of human users wouldn't fail. President of the country? Too difficult.

bombcar 4y ago
The point isn't to check if they actually know - it's to gauge the response. If they say "I don't know" that may be a valid answer, but if they say "George Bush" then something is seriously wrong.
- notahacker 4y ago
  Also, if a human has to be told a basic fact they'll generally provide an indication of embarrassment or an excuse or "why are you asking me these questions", not try to continue the conversation with interesting facts...

bnt 4y ago

Depending where the bot is and what time of day it is, it might tell you the wrong day of the week.

robertlagrant 4y ago
"I was trained on a Thursday... damn."
PeterisP 4y ago
For current mainstream text generation models it doesn't really depend on where the bot is and what time of the day it is, that's kind of the whole point - their text generation process simply doesn't use the current time as a possible input factor, these models would provide the exact same result (or random picks from the exact same distribution of potential results) no matter when and where you run them. They would be expected to answer with something matching the day/time distribution that was represented in the training data they used; like the answer to various prompts of the "current president" question is dominated by Trump, Obama and a bit of Bush and Clinton, simply because those are the presidents in the training data and the more recent events simply aren't there yet - like the many models who have no idea how to interpret the word 'Covid' simply because they have been trained on pre-2020 data even if the model was built and released later.

Jiro 4y ago

Many contexts in which the president is named in training data are political. And nobody's going to put a chatbot on the web without filtering out political material