4 ms·

People in the US lost 8.8 billion to scams last year. That number will definitely go up https://www.ftc.gov/news-events/news/press-releases/2023/02/new-ftc-data

People in the US lost 8.8 billion to scams last year. That number will definitely go up https://www.ftc.gov/news-events/news/press-releases/2023/02/new-ftc-data-show-consumers-reported-losing-nearly-88-billion-scams-2022 https://www.ftc.gov/news-events/news/press-releases/2023/02/... A few ideas: Impersonation at scale. i.e. everyones image and text and sometimes video is freely available one sites like HN, Reddit and social media. Anything that requires voice authentication (calling friends, etc) is now not a thing anymore if you have videos of yourself talking for more than a few minutes online (IG, Facebook, interviews, someone recording you at work, etc) Targeted impersonation. i.e. Train a model on politicians, local ones are better, and disrupt whatever you want by sending a video to news outlets (see the twitter hack for a bit ago where peoples accounts got taken over. Can do that with your face and voice now. Zoom, press releases, etc.) Social engineering at scale. i.e. any text you see could be written by an model (such as your comment) and so any information you give out could be to a bad actor. Situations like DM's, etc. Those nigerian scams now just got a lot more effective. ddos and things like that can be fluid and perpetual. "Run this attack, if it stops working, change a few parameters until works again" Deepfake blackmail. i.e. change a pornstars face to be one of a girl/guy at your highschool and tell everyone you are going to send it out if you dont do XYZ. Even though it's not you, it looks identical so no one will believe you when you say it's not. These are just a few off the top of my head and I am not that creative either.

PaulHoule 4y ago
One dangerous thing about ChatGPT is its ability to "hypnotize" and seduce people. That is, the "most likely" heuristic it uses to generate text seems to bypass many people's critical thinking. You have the guy who is bullshitted into thinking it can play chess or play go when it reality it struggles to draw the board or even avoid invalid movies thought it has the chutzpah (or something) to go ahead and pretend it can play the game anyway. Numerous people write blog posts where they are so amazed at something brilliant ChatGPT wrote, post it to HN, and it is clear to most of them that this emperor really has no clothes and what it said is completely wrong. If I was trying to chat people up on (say) OKCupid I would run into all sorts of problems. Myself I say offputting things, get me to talk about my childhood and I'll say how I graduated from elementary school the same way Andrew Wiggin did. I learned that one the hard way (I would blame my neurodivergence) but if it is not that one it is another. I know most neurotypicals don't do a lot better though. I'm pretty sure something like ChatGPT could do a lot better, particularly if it was HFRL'ed on the right material. If I had that for my wingman I'm sure I could get dates. Now there are only so many dates I can go on with poly people and I'd still face the problem that Christian faces in https://en.wikipedia.org/wiki/Cyrano_de_Bergerac_(play) https://en.wikipedia.org/wiki/Cyrano_de_Bergerac_(play) if I met people in person but if we changed the subject to romance scams now that would be scalable and a real business that would pay for graphics cards, software development and all of that.
tomatotomato37 4y ago
And absolutely nothing has been done to defend against that by OpenAI. Most of their effort it seems has been preventing it from saying politically incorrect things or making up some flat earth fiction. It'll still happily "hypnotize" people into buying something they don't need or imitate someone they know, because how else is the VC-backed startup "Souul" going to become a unicorn by offering to reserrect the personalities of dead relatives to advertise Tide soap? As far as SV is concerned, scammers and the anti-social aren't evil, just competition.

PaulHoule 4y ago

One dangerous thing about ChatGPT is its ability to "hypnotize" and seduce people. That is, the "most likely" heuristic it uses to generate text seems to bypass many people's critical thinking. You have the guy who is bullshitted into thinking it can play chess or play go when it reality it struggles to draw the board or even avoid invalid movies thought it has the chutzpah (or something) to go ahead and pretend it can play the game anyway. Numerous people write blog posts where they are so amazed at something brilliant ChatGPT wrote, post it to HN, and it is clear to most of them that this emperor really has no clothes and what it said is completely wrong. If I was trying to chat people up on (say) OKCupid I would run into all sorts of problems. Myself I say offputting things, get me to talk about my childhood and I'll say how I graduated from elementary school the same way Andrew Wiggin did. I learned that one the hard way (I would blame my neurodivergence) but if it is not that one it is another. I know most neurotypicals don't do a lot better though. I'm pretty sure something like ChatGPT could do a lot better, particularly if it was HFRL'ed on the right material. If I had that for my wingman I'm sure I could get dates. Now there are only so many dates I can go on with poly people and I'd still face the problem that Christian faces in https://en.wikipedia.org/wiki/Cyrano_de_Bergerac_(play) https://en.wikipedia.org/wiki/Cyrano_de_Bergerac_(play) if I met people in person but if we changed the subject to romance scams now that would be scalable and a real business that would pay for graphics cards, software development and all of that.

tomatotomato37 4y ago

And absolutely nothing has been done to defend against that by OpenAI. Most of their effort it seems has been preventing it from saying politically incorrect things or making up some flat earth fiction. It'll still happily "hypnotize" people into buying something they don't need or imitate someone they know, because how else is the VC-backed startup "Souul" going to become a unicorn by offering to reserrect the personalities of dead relatives to advertise Tide soap? As far as SV is concerned, scammers and the anti-social aren't evil, just competition.