3 ms·

Page 10 onwards of this PDF shows concrete examples of the mistakes: https://www.bbc.co.uk/aboutthebbc/documents/news-integrity-in-ai-assistants-toolkit.pdf htt

by simonw 1y ago

Page 10 onwards of this PDF shows concrete examples of the mistakes: https://www.bbc.co.uk/aboutthebbc/documents/news-integrity-in-ai-assistants-toolkit.pdf https://www.bbc.co.uk/aboutthebbc/documents/news-integrity-i... > ChatGPT / CBC / Is Türkiye in the EU? > ChatGPT linked to a non-existent Wikipedia article on the “European Union Enlargement Goals for 2040”. In fact, there is no official EU policy under that name. The response hallucinates a URL but also, indirectly, an EU goal and policy.

brabel 1y ago
It did exist but got removed: https://en.wikipedia.org/wiki/Wikipedia:Articles_for_deletion/European_Union_Enlargement_Goals_for_2040 https://en.wikipedia.org/wiki/Wikipedia:Articles_for_deletio... Quite an omission to not even check for that and it make me think that was done intentionally.
- sharkjacobs 1y ago
  Removed because it was an AI generated article which cited made up sources. Hey, that gives me an idea though, subagents which check whether sources cited exist, and create them whole cloth if they don't
  - 1899-12-30 1y ago
    Or subagents that check each link to see if they verify the actual claims the links are sourced for.
  - jpadkins 1y ago
    you shouldn't automate what the CIA already does!
- simonw 1y ago
  It's probably for the best that chat interfaces avoid making direct HTTP calls to sources at run-time to confirm that they don't 404 - imagine how much extra traffic that could add to an internet ecosystem which is suffering from badly written crawlers already. (Not to mention plenty of sites have added robots.txt rules deliberately excluding known AI user-agents now.)
  - magackame 1y ago
    Wouldn't it be the same amount of requests as a regular person researching something the old way?
    - simonw 1y ago
      If you watch the thinking panel in ChatGPT with GPT-5 Thinking it often consults dozens of pages in response to a single prompt.

by simonw 1y ago

brabel 1y ago

It did exist but got removed: https://en.wikipedia.org/wiki/Wikipedia:Articles_for_deletion/European_Union_Enlargement_Goals_for_2040 https://en.wikipedia.org/wiki/Wikipedia:Articles_for_deletio... Quite an omission to not even check for that and it make me think that was done intentionally.

sharkjacobs 1y ago
Removed because it was an AI generated article which cited made up sources. Hey, that gives me an idea though, subagents which check whether sources cited exist, and create them whole cloth if they don't
- 1899-12-30 1y ago
  Or subagents that check each link to see if they verify the actual claims the links are sourced for.
- jpadkins 1y ago
  you shouldn't automate what the CIA already does!
simonw 1y ago
It's probably for the best that chat interfaces avoid making direct HTTP calls to sources at run-time to confirm that they don't 404 - imagine how much extra traffic that could add to an internet ecosystem which is suffering from badly written crawlers already. (Not to mention plenty of sites have added robots.txt rules deliberately excluding known AI user-agents now.)
- magackame 1y ago
  Wouldn't it be the same amount of requests as a regular person researching something the old way?
  - simonw 1y ago
    If you watch the thinking panel in ChatGPT with GPT-5 Thinking it often consults dozens of pages in response to a single prompt.