2 ms·
The link to the BBC research document is https://www.bbc.co.uk/aboutthebbc/documents/bbc-research-into-ai-assistants.pdf https://www.bbc.co.uk/aboutthebbc/docum
by amai 2y ago
The link to the BBC research document is https://www.bbc.co.uk/aboutthebbc/documents/bbc-research-into-ai-assistants.pdf https://www.bbc.co.uk/aboutthebbc/documents/bbc-research-int...
"In December 2024, the BBC carried out research into the accuracy of four prominent AI
assistants that can search the internet – OpenAI’s ChatGPT; Microsoft’s Copilot; Google’s
Gemini; and Perplexity. We did this by reviewing responses from the AI assistants to 100
questions about the news, asking AI assistants to use BBC News sources where possible.
Ordinarily the BBC ‘blocks’ these AI assistants from accessing the BBC’s websites. These
blocks were lifted for the duration of the research and have since been reinstated.
AI answers were reviewed by BBC journalists, all experts in the question topics. Journalists
rated each AI answer against seven criteria – (i) accuracy; (ii) attribution of sources; (iii)
impartiality; (iv) distinguishing opinions from facts; (v) editorialisation (inserting comments
and descriptions not backed by the facts presented in the source); (vi) context; (vii) the
representation of BBC content in the response. For each of these criteria, journalists could
rate each response as having no issues; some issues; significant issues or don’t know."