5 ms·

It is still concerning to many that they are at all capable of deception. The ramifications are significant. Even it it occurred in controlled circumstances.

• JohnMakin 2y ago
  This isn't "deception" though. That's just anthropomorphizing. Deception implies intent and an understanding of what a falsehood is - it's playing the game according to the rules it knows about. if the game was chutes and ladders, it's not like the model would suddenly start lying about what rolls it gets.
  • parineum 2y ago
    It's not even doing that. It has no idea what the rules are. It's calculating the most likely next token based in the context of previous tokens given to it. It just so happens that the next token in a poker game often involves deception because the data it was trained on involved players deceiving.
    • Imnimo 2y ago
      Pluribus is not an LLM and does not operate by next-token prediction. I also don't think it uses human training data - it's trained via self-play by my understanding.
      • parineum 2y ago
        > Park and colleagues sifted through publicly available data and identified multiple instances of Cicero telling premeditated lies, colluding to draw other players into plots and, on one occasion, justifying its absence after being rebooted by telling another player: “I am on the phone with my girlfriend.” At least part of this AI is a language model if it's writing text.
  • deleted 2y ago
    [deleted]
• callamdelaney 2y ago
  That's because it's not really 'artificial intelligence', it's just artificial regurgitation software ™ - so much sensationalism about this stuff.
  • staunton 2y ago
    It doesn't matter if you call what it does "intelligence" or not. We need to understand what it can do. And I'm certain that it can be used to spread misinformation on social networks. It can even be used to spread personally targeted misinformation with enough effort from bad actors. This will be a thing and do damage to societies across the globe. We'll see how much...
    • danaris 2y ago
      But learning to be deceptive when being taught a game that requires deception is not in any way related to spreading misinformation on social networks. LLMs can create misinformation to spread on social networks if the people using them ask them to. LLM bots can spread that misinformation without direct human control if they are programmed to do so. LLMs cannot be taught to play poker, and then use their newfound understanding of deception to go out and spread misinformation of their own volition, because they have neither understanding nor volition.
      • staunton 2y ago
        I broadly agree. There are caveats, however. Things might develop a dynamics of its own, not necessarily intended or in the interest of any major player. Similarly to how Facebook don't necessarily want to promote political extremism, conspiracy theories or teenage girls killing themselves, but are nonetheless driving these developments as a byproduct of following their business incentives.
    • callamdelaney 2y ago
      Mass media is regularly used to distribute misinformation already and nobody seems invested in stopping that.