4 ms·

There is actually a musician called Benn Jordan who was impersonated by someone on twitter who posted pro-Israel content [1]. That content is no longer availabl

There is actually a musician called Benn Jordan who was impersonated by someone on twitter who posted pro-Israel content [1]. That content is no longer available, but it might have snuck into the training data, i.e. Benn Jordan = pro Israel. This might also have been set in relation to the other Jordan's previous pro-Palestine comments, eventually misattributing the "I was wrong about Israel" video. It's still a clear fuckup - but I could see humans doing something similar when sloppily accruing information. [1] https://www.webpronews.com/musician-benn-jordan-exposes-fake-x-account-impersonating-his-views/ https://www.webpronews.com/musician-benn-jordan-exposes-fake...

ants_everywhere 1y ago
That article is about the same Benn Jordan in the Bluesky post. The photo in the article is not of Benn Jordan. Benn Jordan has several videos and projects devoted to "digital sabotage", e.g. https://www.google.com/search?hl=en&q=benn%20jordan%20data%20poisoning https://www.google.com/search?hl=en&q=benn%20jordan%20data%2... So this all kind of looks on its face like it's just him trolling. There may be ore than just what's on the face of course. For example, it could be someone else trolling him with his own methods.
- sigmoid10 1y ago
  That makes it even more believable that an LLM screwed up. I mean what are you supposed to believe at this point?
  - ants_everywhere 1y ago
    I guess so. But the situation we're in is that someone who does misinformation is claiming an LLM believed misinformation. Step one would be getting an someone independent, ideally with some journalistic integrity, to verify Benn's claims. Generally speaking if your aunt sally claims she ate strawberry cake for her birthday, the LLM or Google search has no way of verifying that. If Aunt Sally uploads a faked picture of her eating strawberry cake, the LLM is not going to go to her house and try to find out the truth. So if Aunt Sally is lying about eating strawberry cake, it's not clear what search is supposed to return when you ask whether she ate strawberry cake.
    - lazide 1y ago
      Eventually people are just going to think everything except what they want to believe is a lie. Oh wait, that’s where we are right now. Good thing I know aunt Sally is a pathological liar and strawberry cake addict, and anyone who says otherwise is a big fat fake.
      - ants_everywhere 1y ago
        I doubt it. But you can't simultaneously cultivate an image as a propagandist who lies to and about AI and a truth teller who tells the truth about AI. You either try hard to tell the objective truth or you bend the truth routinely to try to make a "larger" point. The more you do the latter the less credit people will give your word.
        lazide 1y ago
        Who is ‘you’ kemosabe?
        deleted 1y ago
        [deleted]
        ants_everywhere 1y ago
        One, as in, one can be sarcastic and dismissive or one can contribute to the discussion but not both
        lazide 1y ago
        And which do you think you’re being?
        deleted 1y ago
        [deleted]
    - sigmoid10 1y ago

ants_everywhere 1y ago

That article is about the same Benn Jordan in the Bluesky post. The photo in the article is not of Benn Jordan. Benn Jordan has several videos and projects devoted to "digital sabotage", e.g. https://www.google.com/search?hl=en&q=benn%20jordan%20data%20poisoning https://www.google.com/search?hl=en&q=benn%20jordan%20data%2... So this all kind of looks on its face like it's just him trolling. There may be ore than just what's on the face of course. For example, it could be someone else trolling him with his own methods.

sigmoid10 1y ago
That makes it even more believable that an LLM screwed up. I mean what are you supposed to believe at this point?
- ants_everywhere 1y ago
  I guess so. But the situation we're in is that someone who does misinformation is claiming an LLM believed misinformation. Step one would be getting an someone independent, ideally with some journalistic integrity, to verify Benn's claims. Generally speaking if your aunt sally claims she ate strawberry cake for her birthday, the LLM or Google search has no way of verifying that. If Aunt Sally uploads a faked picture of her eating strawberry cake, the LLM is not going to go to her house and try to find out the truth. So if Aunt Sally is lying about eating strawberry cake, it's not clear what search is supposed to return when you ask whether she ate strawberry cake.
  - lazide 1y ago
    Eventually people are just going to think everything except what they want to believe is a lie. Oh wait, that’s where we are right now. Good thing I know aunt Sally is a pathological liar and strawberry cake addict, and anyone who says otherwise is a big fat fake.
    - ants_everywhere 1y ago
      I doubt it. But you can't simultaneously cultivate an image as a propagandist who lies to and about AI and a truth teller who tells the truth about AI. You either try hard to tell the objective truth or you bend the truth routinely to try to make a "larger" point. The more you do the latter the less credit people will give your word.
      - lazide 1y ago
        Who is ‘you’ kemosabe?
        deleted 1y ago
        [deleted]
        ants_everywhere 1y ago
        One, as in, one can be sarcastic and dismissive or one can contribute to the discussion but not both
        lazide 1y ago
        And which do you think you’re being?
        deleted 1y ago
        [deleted]
  - sigmoid10 1y ago