4 ms·
Why give it oxygen?
by tptacek 1y ago
Why give it oxygen?
- mensetmanusman 1y agoIt's great idea to share knowledge bases collected and curated by LLMs. Amazing that Musk did it first. (Although it was suggested to him as part of an interview a month before release). These systems are very good at finding obscure references that were overlooked by mere mortals.
- simonw 1y ago"It's great idea to share knowledge bases collected and curated by LLMs" Is it though? LLMs are great at answering questions based on information you make available to them, especially if you have the instincts and skill to spot when they are likely to make mistakes and to fact-check key details yourself. That doesn't mean that using them to build a knowledge base itself is a good idea! We need reliable, verified knowledge bases that LLMs can make use-of.
- smcin 1y agoCrucial to distinguish between knowledge, fact, claim and allegation. Compare: https://en.wikipedia.org/wiki/Charlie_Kirk#Assassination https://en.wikipedia.org/wiki/Charlie_Kirk#Assassination https://grokipedia.com/page/Charlie_Kirk https://grokipedia.com/page/Charlie_Kirk : Assassination Details and Investigation This is an active case that has not gone to trial, and the alleged text messages and Discords have not had their forensics cross-examined. Yet Grokipedia is already citing them as fact, not allegation. (What is considered the correct neutral way to report on alleged facts in active cases?)
- jayd16 1y ago> collected and curated by LLMs. Wah? LLMs don't collect things. I mean, if any of these AI companies want to open up all their training data as a searchable archive, I'd be all for it.
- meowface 1y agoTo play devil's advocate: Grok has historically actually been one of the biggest debunkers of right-wing misinformation and conspiracy theories on Twitter, contrary to popular conception. Elon keeps trying to tweak its system prompt to make it less effective at that, but Grokipedia was worth an initial look from me out of curiosity. It took me 10 seconds to realize it was ideologically-motivated garbage and significantly more right-biased than Wikipedia is left-biased. (Unfortunately, Reply-Grok may have been successfully partially lobotomized for the long term, now. At the time of writing, if you ask grok.com about the 2020 election it says Biden won and Trump's fraud claims are not substantiated and have no merit. If you @grok in a tweet it now says Trump's claims of fraud have significant merit, when previously it did not. Over the past few days I've seen it place way too much charity in right-wing framings in other instances, as well.)
- pstuart 1y agoThe problem of debunking right-wing misinformation is that it doesn't seem to matter. The consumers of that misinformation want it and those of us who think it's bad for society already know that its garbage. It feels like we've reached Peak Stupidity but it's clear it can (and likely will) get much worse with AI videos.
- tshaddox 1y agoSame reason you posted that comment: it's sometimes interesting to discuss a thing even if you dislike the thing.
- tptacek 1y agoI'm fine with the logic of discussing it here but can't fathom why Tim Bray thought this would be a useful post given his own objectives.
- tim333 1y agoI doubt a post saying it was so boring he was unable to finish reading the page about himself is going to bring in many readers. That's kind of been my impression too. Not that it's terribly biased or anything but just rather boring to read.
- keeda 1y agoI don't know if this is why, but: he's in a unique position of having an article on himself on Grokipedia, and thus being able and willing to compare it with the reality as he remembers it. That's in contrast to other topics, the nuances of which even seasoned experts could disagree about. Any discussion on that could devolve into the nuances of the topic rather than Grokipedia itself. But it's fair to assume the topmost expert on Tim Bray is Tim Bray, so we should be getting a pretty unbiased review. As such it could be a useful insight into how Grok and Grokipedia and its owners operate.
- deleted 1y ago[deleted]
- TheBlight 1y ago[flagged]
- LastTrain 1y agoProof? More than a couple anecdotes please.
- TheBlight 1y agoAlthough I'm sure it's been a blast, we don't need to play by your rules any more.
- LastTrain 1y agoOK
- pureagave 1y agoHow many more than a couple do you need? 20 anecdotes? 40 anecdotes? 100? How much bias is okay for you and the world?
- LastTrain 1y agoI dunno. Give us at least some? Start with just one really mind blowing one. The implication is there is a big cabal imposing Wikipedia on the world. Given that, it should be easy enough to throw out some concrete examples of major impact.
- onetimeusename 1y agoThe ADL was caught in a campaign making edits. I remember more details in the past but I simply can't find them now with any search engine. https://forward.com/news/467423/adl-may-have-violated-wikipedia-rules-editing-its-own-entries/ https://forward.com/news/467423/adl-may-have-violated-wikipe... But also the ADL is accusing others of covert campaigns: https://wassermanschultz.house.gov/news/documentsingle.aspx?DocumentID=3330 https://wassermanschultz.house.gov/news/documentsingle.aspx?... So I am sure this is a thing among corporations/NGOs. Note that I picked the ADL because I happened to know this and not because I am trying to make a point about the ADL's purpose. Also I am not really answering the part about progressives although the ADL is arguably a progressive NGO. I think there are astroturfing campaigns on Wikipedia whether progressive or not.
- bebb 1y agoBecause it's a genuinely good idea, and hopefully one for which the execution will be improved upon over time. In theory, using LLMs to summarize knowledge could produce a less biased and more comprehensive output than human-written encyclopedias. Whether Grokipedia will meet that challenge remains to be seen. But even if it doesn't, there's opportunity for other prospective encyclopedia generators to do so.
- quantified 1y agoSummarizing all the knowledge is very very far from summarizing all that is written. All it takes is including everything published. The earth must be flat. Disease is caused by bad morals. Etc etc.
- epistasis 1y agoI don't why an LLM would be better in theory. The Wikipedia process is created to manage bias. LLMs are created to repeat the input data, and will therefore be quite biased towards the training data. Humans looking through sources, applying knowledge of print articles and real world experiences to sift through the data, that seems far more valuable.
- smitty1e 1y ago> The Wikipedia process is created to manage bias. LLMs are created to repeat the input data, and will therefore be quite biased towards the training data. The perception of bias in Wikipedia remains, and if LLMs can detect and correct for bias, then Grokipedia seems at least a theoretical win. I'm happy with at least a set of links for further research on a topic of interest.
- apical_dendrite 1y agoIs there some objective standard for what is biased? For many people (including Elon Musk) biased just means something that they disagree with. When grok says something factual that Elon doesn't like, he puts his thumb on the scale and changes how grok responds (see the whole South African white 'genocide' business). So why should we trust that an LLM will objectively detect bias, when the people in charge of training that LLM prefer that it regurgitate their preferred story, rather than what is objectively true?