4 ms·

With the articles left up but with a disclaimer, it will be interesting to see if the “facts” and “quotes” work their way into LLMs, losing the disclaimer

hammyhavoc 3y ago
Even with a disclaimer, they've already worked their way into factoids touted by human beings and will continue to be. It's an inevitability for LLMs too if it hasn't already happened.
- emayljames 3y ago
  Oh dear, from copilot: The term “Dark Weeks” in the context of the Scottish town of Moffat refers to a volunteer-led initiative where many residents and businesses in Moffat turn off their lighting for two weeks each winter, particularly in the village center1. This is done to reduce light pollution and preserve the wonders of the night sky2. However, public lighting around essential locations like the hospital and firehouse remains on1. It’s worth noting that Moffat is recognized as Europe’s first Dark Sky Town2, and it’s home to the Moffat Community Observatory3, which offers beautiful views of various night sky objects3. This observatory complements the town’s Dark Sky Town status as recognized by the International Dark-Sky Association3. However, an article from Atlas Obscura had to be retracted because it was found that the author fabricated the idea of “dark weeks” in Moffat, and also fabricated interviews with multiple sources1. Therefore, while Moffat is a Dark Sky Town, the specific concept of “Dark Weeks” might not be an officially recognized or widely practiced event. It’s always a good idea to check with local sources or official town information for the most accurate details. Learn more 1 atlasobscura.com 2 visitscotland.com
  - kalleboo 3y ago
    At least it included the disclaimer! Too bad it was at the end past where anyone will read, it wasn't smart enough to retroactively remove the false info.
gadders 3y ago
Like how Creative Commons has machine readable metatdata re: attribution etc, I think we need a similar one for LLMs as they hoover up content. <Truthiness>Utter Cobblers</Truthiness>
- JeremyNT 3y ago
  It's surely a great use case for the semantic web on paper, but I'm not sure that site owners have much incentive to make it easier for the bot owners to extract and resell their content.
  - gadders 3y ago
    deletes pitch deck
JKCalhoun 3y ago
I asked ChatGPT why lemmings choose to jump off cliffs, "The idea that lemmings intentionally jump off cliffs and into the sea is a myth. This misconception likely originated from a 1958 Disney documentary called "White Wilderness, ...."
- kalleboo 3y ago
  LLMs are statistical machines A google search will give you 1000 sources that lemmings don't jump off cliffs, because there was a Disney movie about it and now it's the prototypical example of falsification. Here are 10 articles on a comparatively small website, where only one gained enough notoriety to be directly called out as debunked on secondary sources, where the statistical data is insufficient.

hammyhavoc 3y ago

Even with a disclaimer, they've already worked their way into factoids touted by human beings and will continue to be. It's an inevitability for LLMs too if it hasn't already happened.

emayljames 3y ago
Oh dear, from copilot: The term “Dark Weeks” in the context of the Scottish town of Moffat refers to a volunteer-led initiative where many residents and businesses in Moffat turn off their lighting for two weeks each winter, particularly in the village center1. This is done to reduce light pollution and preserve the wonders of the night sky2. However, public lighting around essential locations like the hospital and firehouse remains on1. It’s worth noting that Moffat is recognized as Europe’s first Dark Sky Town2, and it’s home to the Moffat Community Observatory3, which offers beautiful views of various night sky objects3. This observatory complements the town’s Dark Sky Town status as recognized by the International Dark-Sky Association3. However, an article from Atlas Obscura had to be retracted because it was found that the author fabricated the idea of “dark weeks” in Moffat, and also fabricated interviews with multiple sources1. Therefore, while Moffat is a Dark Sky Town, the specific concept of “Dark Weeks” might not be an officially recognized or widely practiced event. It’s always a good idea to check with local sources or official town information for the most accurate details. Learn more 1 atlasobscura.com 2 visitscotland.com
- kalleboo 3y ago
  At least it included the disclaimer! Too bad it was at the end past where anyone will read, it wasn't smart enough to retroactively remove the false info.

gadders 3y ago

Like how Creative Commons has machine readable metatdata re: attribution etc, I think we need a similar one for LLMs as they hoover up content. <Truthiness>Utter Cobblers</Truthiness>

JeremyNT 3y ago
It's surely a great use case for the semantic web on paper, but I'm not sure that site owners have much incentive to make it easier for the bot owners to extract and resell their content.
- gadders 3y ago
  deletes pitch deck

JKCalhoun 3y ago

I asked ChatGPT why lemmings choose to jump off cliffs, "The idea that lemmings intentionally jump off cliffs and into the sea is a myth. This misconception likely originated from a 1958 Disney documentary called "White Wilderness, ...."

kalleboo 3y ago
LLMs are statistical machines A google search will give you 1000 sources that lemmings don't jump off cliffs, because there was a Disney movie about it and now it's the prototypical example of falsification. Here are 10 articles on a comparatively small website, where only one gained enough notoriety to be directly called out as debunked on secondary sources, where the statistical data is insufficient.