6 ms·

Wikipedia says it will use AI, but not to replace human volunteers

79 points by thm 1y ago

deleted 1y ago
[deleted]
MarkusQ 1y ago
What could possibly go wrong?
some_furry 1y ago
I appreciate that they emphasize the importance of their human volunteers. Too many bullish-on-AI folks have misanthropic incentives, and it's refreshing to not see more of that. (It probably helps that Wikimedia is a non-profit.)
thr0waway001 1y ago
Could be helpful.
itsdrewmiller 1y ago
Wikipedia already has thousands of bots running around cleaning things up - seems like AI is not really a significant change here.
- add-sub-mul-div 1y ago
  Automation is not AI and pre-LLM-era AI is not LLM AI. The arguments for why LLM AI will broadly worsen things are well known. You may not agree with them, but saying things won't change much is pretty empty.
  - animanoir 1y ago
    why will it worsen up?
    - cube00 1y ago
      Unleashing a hallucinating LLM to make edits will creates so many subtle problems on such a scale that it may not be possible to clean it up once other edits are made on top.
      - taraindara 1y ago
        They clearly stated that this is not the intention. The closest thing to this would be translation help. But even then they’ll undoubtedly include a notice like “this has been translated with the help of AI.” Along with a prompt to encourage the human to help improve upon the translation.
the_af 1y ago
The tasks for which they are planning to use AI make sense. These are good use cases. What must be avoided is Wikipedia becoming a repository of AI-generated slop (and possibly feeding the next generation models, becoming a recursive loop of even more slop). But this way? It makes sense. This won't create content for articles, it's just assistance for editors.
- palmotea 1y ago
  > What must be avoided is Wikipedia becoming a repository of AI-generated slop (and possibly feeding the next generation models, becoming a recursive loop of even more slop). Honestly, I think anyone who's a humanist should encourage that. Given the way AI is being hyped by the business elite, making it ineffective is an important goal and worth the cost of a compromised Wikipedia.
  - the_af 1y ago
    What makes you think a compromised Wikipedia would in any way hinder the "business elite"? We would just lose a valuable resource to AI slop. If businesses destroy something of value to you, that's not a win.
kelvinjps10 1y ago
I hope they don't use AI to automatically translate articles to other languages, the quality of the others Wikipedias would drop a lot
- deleted 1y ago
  [deleted]
- Scoundreller 1y ago
  Not saying they should, but as a PSA, if you’re anglophone and looking something up about a place in the non-Anglo world, it’s always worth switching to that area’s language and auto-translating. Even the images won’t be shared. Structure might be all different. Perspective may not be the same. E.g. a city in France’s BRT system: Contrast: https://en.m.wikipedia.org/wiki/Nantes_Busway https://en.m.wikipedia.org/wiki/Nantes_Busway With: https://fr.m.wikipedia.org/wiki/Busway_de_Nantes https://fr.m.wikipedia.org/wiki/Busway_de_Nantes
  - rcMgD2BwE72F 1y ago
    [dead]
  - amiga386 1y ago
    Hard agree. Some random examples where the Wikipedia page in the native language is much more detailed: https://en.wikipedia.org/wiki/Trams_in_Florence https://en.wikipedia.org/wiki/Trams_in_Florence vs https://it.wikipedia.org/wiki/Rete_tranviaria_di_Firenze https://it.wikipedia.org/wiki/Rete_tranviaria_di_Firenze (and an entire second article for the historic system!) https://en.wikipedia.org/wiki/La_D%C3%A9fense https://en.wikipedia.org/wiki/La_D%C3%A9fense vs https://fr.wikipedia.org/wiki/La_Défense https://fr.wikipedia.org/wiki/La_Défense https://en.wikipedia.org/wiki/Stasi https://en.wikipedia.org/wiki/Stasi vs https://de.wikipedia.org/wiki/Ministerium_f%C3%BCr_Staatssicherheit https://de.wikipedia.org/wiki/Ministerium_f%C3%BCr_Staatssic... https://en.wikipedia.org/wiki/Muslim_conquest_of_the_Iberian_Peninsula https://en.wikipedia.org/wiki/Muslim_conquest_of_the_Iberian... vs https://es.wikipedia.org/wiki/Conquista_omeya_de_Hispania https://es.wikipedia.org/wiki/Conquista_omeya_de_Hispania ... but https://ar.wikipedia.org/wiki/%D8%A7%D9%84%D9%81%D8%AA%D8%AD_%D8%A7%D9%84%D8%A5%D8%B3%D9%84%D8%A7%D9%85%D9%8A_%D9%84%D9%84%D8%A3%D9%86%D8%AF%D9%84%D8%B3 https://ar.wikipedia.org/wiki/%D8%A7%D9%84%D9%81%D8%AA%D8%AD... is better than both of them Does anyone else have good examples? Or are there counter-examples, where enwiki has a better article than the native language wiki?
notorandit 1y ago
Especially because they are free.
NotAnOtter 1y ago
Of course not. They would never do that. Industry has a good track record of this.
- niam 1y ago
  Maybe you have a reason to be so uncharitable here, but it's unclear what that reason is since "industry" is a broad term.
hexator 1y ago
This is a great way of applying AI. I wish more companies followed suit
- nailer 1y ago
  As a moderator, I wish StackOverflow would. I’m getting tired of manually marking answers that should be comments, I’m almost about to make a browser extension for it.
scudsworth 1y ago
- Supporting Wikipedia’s moderators and patrollers with AI-assisted workflows that automate tedious tasks in support of knowledge integrity; so, a chatbot on top of some tooling probably - Giving Wikipedia’s editors time back by improving the discoverability of information on Wikipedia to leave more time for human deliberation, judgment, and consensus building; extremely vague, but probably the "train a specialized ai on our own corpus to answer questions about it" style bot helper? these make stuff up left and right too - Helping editors share local perspectives or context by automating the translation and adaptation of common topics; automated translations would be a big step in the wrong direction - Scaling the onboarding of new Wikipedia volunteers with guided mentorship. you can't do "mentorship" with ai in any real way. all in all seems a box checking exercise for their ML officer.
niam 1y ago
> Scaling the onboarding of new Wikipedia volunteers with guided mentorship. Depending on what's meant by "mentorship": this is the bit I'm most keen to see. Much of the criticism lobbed at Wikipedia nowadays seems to come from how much of a pain it is to contribute (which perhaps leads to second-order criticisms about censorship, even if that's not the intention). It's often been the case that the person most-worthy to speak on a subject is not the most worthy steward of a Wikipedia page on it. Any attempt to make those two people one-and-the-same seems welcome. If this "mentorship" takes the form of UI hints, I think they'd go a long way. Having volunteers take an AI course, on the other hand, might be useful but might also be a complete waste of time.
- gwbas1c 1y ago
  I was afraid that mentorship was the point where human-to-human interaction is needed most. I suspect what you're getting at is that "mentorship" is really code for using AI to step in when people are making the wrong kind of changes to a Wikipedia page. (IE, introducing bias, promoting products, edit wars, ect.) I'm curious to see how this plays out.
  - niam 1y ago
    Yeah that's exactly it. I wonder too if it could be used to help the edit reviewing process, but I can imagine it runs a risk of becoming an accountability sink[^1] if reviewers can merely defer their judgement to what the bot says is OK to purge. It might have a chilling effect on edits if everyone, including procedure hawks, can rely on it in that way. I'm not enough of a contributor there to know. [^1]: https://news.ycombinator.com/item?id=41891694 https://news.ycombinator.com/item?id=41891694
rvz 1y ago
Narrator: They (eventually) will. Just look for the keyword "streamlining" in any sentence and they will.
film42 1y ago
I'm guessing any useful use of AI has already been adopted by some volunteers. Wikipedia might be able to build tools around the parts that work well, but the volunteers will end up footing the bill for the AI spend. Wikipedia will probably pivot to building an AI research product which they can sell to universities/ b2c.
- tempfile 1y ago
  > Wikipedia will probably pivot to building an AI research product which they can sell to universities/ b2c. Why would they do this? All of wikipedia is publicly available for any use. They literally do not have a competitive advantage (and don't seem interested in it, either).
  - film42 1y ago
    Exactly. But using AI to summarize articles, stitch them together, etc. under the Wikipedia brand as a product is something they could easily sell. I can totally see a university buying WikiResearch™ for every student.
    - some_furry 1y ago
      I don't anticipate them selling anything, ever.
ChrisArchitect 1y ago
Title is: Our new AI strategy puts Wikipedia’s humans first
_fat_santa 1y ago
Man these AI announcements really highlight CEO groupthink. Though I have to commend Wikimedia here, compared to the Shopify announcement, this one is much more sane and down to earth.
photochemsyn 1y ago
Suggestion: use LLMs coupled to playwright/puppeteer etc. to detect broken links to supporting references, and also use LLMs to analyze whether the supporting reference really does back up the claim being made in the Wikipedia article. This raises the thorny issue of what constitutes an 'authoritative reference' and given that many if not most such references are hidden behind various paywalls, and that the editors and volunteers are anonymoous actors with unknown special interests and biases, the conclusion is that Wikipedia is not a reliable source of information, and a wikipedia citation is essentially useless and should never be allowed in any reputable publication.
- card_zero 1y ago
  It's been said since the beginning, by Wikipedia, that the idea is not to cite the page itself. https://en.wikipedia.org/wiki/Wikipedia:Citing_Wikipedia https://en.wikipedia.org/wiki/Wikipedia:Citing_Wikipedia > Normal academic usage of Wikipedia is for getting the general facts of a problem and to gather keywords, references and bibliographical pointers, but not as a source in itself. There is always an issue about claim not in source. Often this is a matter of perception and has to be decided by an argument about what the source means, or what a conventional reading of the source is.
Havoc 1y ago
I could see it being a good thing with very careful guardrails and conservative use
tim333 1y ago
>Scaling the onboarding of new Wikipedia volunteers could be pretty helpful. I edit a bit and it's confusing in a number of ways, some I still haven't got the hang of. There's very little "thank you for your contribution but it needs a better source - why not this?" and usually just your work reverted without thanks or much explanation.
- westurner 1y ago
  Could AI sift through removals and score as biased or vandalist? And then what to do about "original research" that should've been moved to a different platform or better (also with community review) instead of being deleted? Wikipedia:No_original_research: https://en.wikipedia.org/wiki/Wikipedia:No_original_research https://en.wikipedia.org/wiki/Wikipedia:No_original_research #Using_sources
  - tim333 1y ago
    I'm guessing it could advise about that even if it didn't make decisions.

79 points by thm 1y ago

deleted 1y ago

[deleted]

MarkusQ 1y ago

What could possibly go wrong?

some_furry 1y ago

I appreciate that they emphasize the importance of their human volunteers. Too many bullish-on-AI folks have misanthropic incentives, and it's refreshing to not see more of that. (It probably helps that Wikimedia is a non-profit.)

thr0waway001 1y ago

Could be helpful.

itsdrewmiller 1y ago

Wikipedia already has thousands of bots running around cleaning things up - seems like AI is not really a significant change here.

add-sub-mul-div 1y ago
Automation is not AI and pre-LLM-era AI is not LLM AI. The arguments for why LLM AI will broadly worsen things are well known. You may not agree with them, but saying things won't change much is pretty empty.
- animanoir 1y ago
  why will it worsen up?
  - cube00 1y ago
    Unleashing a hallucinating LLM to make edits will creates so many subtle problems on such a scale that it may not be possible to clean it up once other edits are made on top.
    - taraindara 1y ago
      They clearly stated that this is not the intention. The closest thing to this would be translation help. But even then they’ll undoubtedly include a notice like “this has been translated with the help of AI.” Along with a prompt to encourage the human to help improve upon the translation.

the_af 1y ago

The tasks for which they are planning to use AI make sense. These are good use cases. What must be avoided is Wikipedia becoming a repository of AI-generated slop (and possibly feeding the next generation models, becoming a recursive loop of even more slop). But this way? It makes sense. This won't create content for articles, it's just assistance for editors.

palmotea 1y ago
> What must be avoided is Wikipedia becoming a repository of AI-generated slop (and possibly feeding the next generation models, becoming a recursive loop of even more slop). Honestly, I think anyone who's a humanist should encourage that. Given the way AI is being hyped by the business elite, making it ineffective is an important goal and worth the cost of a compromised Wikipedia.
- the_af 1y ago
  What makes you think a compromised Wikipedia would in any way hinder the "business elite"? We would just lose a valuable resource to AI slop. If businesses destroy something of value to you, that's not a win.

kelvinjps10 1y ago

I hope they don't use AI to automatically translate articles to other languages, the quality of the others Wikipedias would drop a lot

deleted 1y ago
[deleted]
Scoundreller 1y ago
Not saying they should, but as a PSA, if you’re anglophone and looking something up about a place in the non-Anglo world, it’s always worth switching to that area’s language and auto-translating. Even the images won’t be shared. Structure might be all different. Perspective may not be the same. E.g. a city in France’s BRT system: Contrast: https://en.m.wikipedia.org/wiki/Nantes_Busway https://en.m.wikipedia.org/wiki/Nantes_Busway With: https://fr.m.wikipedia.org/wiki/Busway_de_Nantes https://fr.m.wikipedia.org/wiki/Busway_de_Nantes
- rcMgD2BwE72F 1y ago
  [dead]
- amiga386 1y ago
  Hard agree. Some random examples where the Wikipedia page in the native language is much more detailed: https://en.wikipedia.org/wiki/Trams_in_Florence https://en.wikipedia.org/wiki/Trams_in_Florence vs https://it.wikipedia.org/wiki/Rete_tranviaria_di_Firenze https://it.wikipedia.org/wiki/Rete_tranviaria_di_Firenze (and an entire second article for the historic system!) https://en.wikipedia.org/wiki/La_D%C3%A9fense https://en.wikipedia.org/wiki/La_D%C3%A9fense vs https://fr.wikipedia.org/wiki/La_Défense https://fr.wikipedia.org/wiki/La_Défense https://en.wikipedia.org/wiki/Stasi https://en.wikipedia.org/wiki/Stasi vs https://de.wikipedia.org/wiki/Ministerium_f%C3%BCr_Staatssicherheit https://de.wikipedia.org/wiki/Ministerium_f%C3%BCr_Staatssic... https://en.wikipedia.org/wiki/Muslim_conquest_of_the_Iberian_Peninsula https://en.wikipedia.org/wiki/Muslim_conquest_of_the_Iberian... vs https://es.wikipedia.org/wiki/Conquista_omeya_de_Hispania https://es.wikipedia.org/wiki/Conquista_omeya_de_Hispania ... but https://ar.wikipedia.org/wiki/%D8%A7%D9%84%D9%81%D8%AA%D8%AD_%D8%A7%D9%84%D8%A5%D8%B3%D9%84%D8%A7%D9%85%D9%8A_%D9%84%D9%84%D8%A3%D9%86%D8%AF%D9%84%D8%B3 https://ar.wikipedia.org/wiki/%D8%A7%D9%84%D9%81%D8%AA%D8%AD... is better than both of them Does anyone else have good examples? Or are there counter-examples, where enwiki has a better article than the native language wiki?

notorandit 1y ago

Especially because they are free.

NotAnOtter 1y ago

Of course not. They would never do that. Industry has a good track record of this.

niam 1y ago
Maybe you have a reason to be so uncharitable here, but it's unclear what that reason is since "industry" is a broad term.

hexator 1y ago

This is a great way of applying AI. I wish more companies followed suit

nailer 1y ago
As a moderator, I wish StackOverflow would. I’m getting tired of manually marking answers that should be comments, I’m almost about to make a browser extension for it.

scudsworth 1y ago

- Supporting Wikipedia’s moderators and patrollers with AI-assisted workflows that automate tedious tasks in support of knowledge integrity; so, a chatbot on top of some tooling probably - Giving Wikipedia’s editors time back by improving the discoverability of information on Wikipedia to leave more time for human deliberation, judgment, and consensus building; extremely vague, but probably the "train a specialized ai on our own corpus to answer questions about it" style bot helper? these make stuff up left and right too - Helping editors share local perspectives or context by automating the translation and adaptation of common topics; automated translations would be a big step in the wrong direction - Scaling the onboarding of new Wikipedia volunteers with guided mentorship. you can't do "mentorship" with ai in any real way. all in all seems a box checking exercise for their ML officer.

niam 1y ago

> Scaling the onboarding of new Wikipedia volunteers with guided mentorship. Depending on what's meant by "mentorship": this is the bit I'm most keen to see. Much of the criticism lobbed at Wikipedia nowadays seems to come from how much of a pain it is to contribute (which perhaps leads to second-order criticisms about censorship, even if that's not the intention). It's often been the case that the person most-worthy to speak on a subject is not the most worthy steward of a Wikipedia page on it. Any attempt to make those two people one-and-the-same seems welcome. If this "mentorship" takes the form of UI hints, I think they'd go a long way. Having volunteers take an AI course, on the other hand, might be useful but might also be a complete waste of time.

gwbas1c 1y ago
I was afraid that mentorship was the point where human-to-human interaction is needed most. I suspect what you're getting at is that "mentorship" is really code for using AI to step in when people are making the wrong kind of changes to a Wikipedia page. (IE, introducing bias, promoting products, edit wars, ect.) I'm curious to see how this plays out.
- niam 1y ago
  Yeah that's exactly it. I wonder too if it could be used to help the edit reviewing process, but I can imagine it runs a risk of becoming an accountability sink[^1] if reviewers can merely defer their judgement to what the bot says is OK to purge. It might have a chilling effect on edits if everyone, including procedure hawks, can rely on it in that way. I'm not enough of a contributor there to know. [^1]: https://news.ycombinator.com/item?id=41891694 https://news.ycombinator.com/item?id=41891694

rvz 1y ago

Narrator: They (eventually) will. Just look for the keyword "streamlining" in any sentence and they will.

film42 1y ago

I'm guessing any useful use of AI has already been adopted by some volunteers. Wikipedia might be able to build tools around the parts that work well, but the volunteers will end up footing the bill for the AI spend. Wikipedia will probably pivot to building an AI research product which they can sell to universities/ b2c.

tempfile 1y ago
> Wikipedia will probably pivot to building an AI research product which they can sell to universities/ b2c. Why would they do this? All of wikipedia is publicly available for any use. They literally do not have a competitive advantage (and don't seem interested in it, either).
- film42 1y ago
  Exactly. But using AI to summarize articles, stitch them together, etc. under the Wikipedia brand as a product is something they could easily sell. I can totally see a university buying WikiResearch™ for every student.
  - some_furry 1y ago
    I don't anticipate them selling anything, ever.

ChrisArchitect 1y ago

Title is: Our new AI strategy puts Wikipedia’s humans first

_fat_santa 1y ago

Man these AI announcements really highlight CEO groupthink. Though I have to commend Wikimedia here, compared to the Shopify announcement, this one is much more sane and down to earth.

photochemsyn 1y ago

Suggestion: use LLMs coupled to playwright/puppeteer etc. to detect broken links to supporting references, and also use LLMs to analyze whether the supporting reference really does back up the claim being made in the Wikipedia article. This raises the thorny issue of what constitutes an 'authoritative reference' and given that many if not most such references are hidden behind various paywalls, and that the editors and volunteers are anonymoous actors with unknown special interests and biases, the conclusion is that Wikipedia is not a reliable source of information, and a wikipedia citation is essentially useless and should never be allowed in any reputable publication.

card_zero 1y ago
It's been said since the beginning, by Wikipedia, that the idea is not to cite the page itself. https://en.wikipedia.org/wiki/Wikipedia:Citing_Wikipedia https://en.wikipedia.org/wiki/Wikipedia:Citing_Wikipedia > Normal academic usage of Wikipedia is for getting the general facts of a problem and to gather keywords, references and bibliographical pointers, but not as a source in itself. There is always an issue about claim not in source. Often this is a matter of perception and has to be decided by an argument about what the source means, or what a conventional reading of the source is.

Havoc 1y ago

I could see it being a good thing with very careful guardrails and conservative use

tim333 1y ago

>Scaling the onboarding of new Wikipedia volunteers could be pretty helpful. I edit a bit and it's confusing in a number of ways, some I still haven't got the hang of. There's very little "thank you for your contribution but it needs a better source - why not this?" and usually just your work reverted without thanks or much explanation.

westurner 1y ago
Could AI sift through removals and score as biased or vandalist? And then what to do about "original research" that should've been moved to a different platform or better (also with community review) instead of being deleted? Wikipedia:No_original_research: https://en.wikipedia.org/wiki/Wikipedia:No_original_research https://en.wikipedia.org/wiki/Wikipedia:No_original_research #Using_sources
- tim333 1y ago
  I'm guessing it could advise about that even if it didn't make decisions.