4 ms·

There should be some warning if some "fact" is only supported by one or very few obscure sources. The strength of the sources should be clearly indicated in th

by dmortin 5mo ago

There should be some warning if some "fact" is only supported by one or very few obscure sources. The strength of the sources should be clearly indicated in the answers to help users gauge how trustworthy the info is.

simmerup 5mo ago
But you can still just generate any arbitrary amount of information to support the ‘fact’ LLMs are very good at this clearly
- dmortin 5mo ago
  The strength of the sources are not a question of quantity. A hundred obscure blog post have not the same strength as one wikipedia link, because the latter is more trustworthy. There could be some indication beside the info showing the strength of the sources (how many major trustworthy sources support it, etc.).
  - 948382828528 5mo ago
    [dead]
  - simmerup 5mo ago
    Seems like a tall order to do that for literally everything. I guess there’ll be some guy at google going through every blog and saying whether it’s reliable or not?
    - gowld 5mo ago
      This is what Google has been doing, via various methods, for 25 years.
      - simmerup 5mo ago
        And obviously it’s not working for the LLM as a commodity world
    - dmortin 5mo ago
      That's exactly what PageRank is about, invented by Google.
psychoslave 5mo ago
There is no one scalar tell it all when it comes to trust.
notahacker 5mo ago
It does sometimes flag up sources, and when it does, the sources are often laughable (Reddit threads, or the vendor's own website [in response to an evaluation rather than factual question], or an AI generated SEO blog for some low profile company in a barely even adjacent industry). Sad considering what Google's origins were...
svachalek 5mo ago
We need a 2026 version of PageRank, some fully game-theory-maxed transitive trust model. And we need it a few years ago already.
deleted 5mo ago
[deleted]
chrismarlow9 5mo ago
We've been down this road when backlinks ran the game. It eventually ends with parasitic hosting. Find a domain with authority and spam whatever mis information or spam you'd like AI to run there. Or buy a domain that has trust already. Or for the darker hats just literally hack the site and use cloaking to send fake info to the AI bot. It's probably already being done. Everything old is new again when you start a new market. If you think that AI is bad imagine what old tricks are new with polymarkets

by dmortin 5mo ago

simmerup 5mo ago

But you can still just generate any arbitrary amount of information to support the ‘fact’ LLMs are very good at this clearly

dmortin 5mo ago
The strength of the sources are not a question of quantity. A hundred obscure blog post have not the same strength as one wikipedia link, because the latter is more trustworthy. There could be some indication beside the info showing the strength of the sources (how many major trustworthy sources support it, etc.).
- 948382828528 5mo ago
  [dead]
- simmerup 5mo ago
  Seems like a tall order to do that for literally everything. I guess there’ll be some guy at google going through every blog and saying whether it’s reliable or not?
  - gowld 5mo ago
    This is what Google has been doing, via various methods, for 25 years.
    - simmerup 5mo ago
      And obviously it’s not working for the LLM as a commodity world
  - dmortin 5mo ago
    That's exactly what PageRank is about, invented by Google.

psychoslave 5mo ago

There is no one scalar tell it all when it comes to trust.

notahacker 5mo ago

It does sometimes flag up sources, and when it does, the sources are often laughable (Reddit threads, or the vendor's own website [in response to an evaluation rather than factual question], or an AI generated SEO blog for some low profile company in a barely even adjacent industry). Sad considering what Google's origins were...

svachalek 5mo ago

We need a 2026 version of PageRank, some fully game-theory-maxed transitive trust model. And we need it a few years ago already.

deleted 5mo ago

[deleted]

chrismarlow9 5mo ago

We've been down this road when backlinks ran the game. It eventually ends with parasitic hosting. Find a domain with authority and spam whatever mis information or spam you'd like AI to run there. Or buy a domain that has trust already. Or for the darker hats just literally hack the site and use cloaking to send fake info to the AI bot. It's probably already being done. Everything old is new again when you start a new market. If you think that AI is bad imagine what old tricks are new with polymarkets