5 ms·
This is a great point. Everyone who has talked with chatbots at all: please note that all contents of your past conversations with chatbots (that already exist
by cousin_it 1y ago
This is a great point. Everyone who has talked with chatbots at all: please note that all contents of your past conversations with chatbots (that already exist now, and that you can't meaningfully delete!) could be used in the future to target ads to you, manipulate you financially and politically, and sell "personalized influence on you specifically" as a service to the highest bidder. Just wanted to make sure y'all understand that.
EDIT: I want to add that "training on chat logs" isn't even the issue. In fact it understates the danger. It's better to imagine things like this: when a future ad-bot or influence-bot talks to you, it will receive your past chatlogs with other bots as context, useful to know what'll work on you or not.
EDIT 2: And your chatlogs with other people I guess, if they happened on a platform that stored them and later got desperate enough to sell them. This is just getting worse and worse as I think about it.
- HPsquared 1y agoOr literally read out in court if you discuss anything relevant to a legal case.
- hkon 1y agoFor me, what is most scary about ai-chatbot is the interface to an exploiter. They can just prompt "given all your chats with this person, how can we manipulate him to do x" Not really any expertise needed at all, let the AI to all the lifting.
- bethekidyouwant 1y agoI can see how this would work if you just turned off your brain and just thought of course this will work
- lordhumphrey 1y agoI take it you haven't seen this then: https://cybersecuritynews.com/fraudgpt-new-black-hat-ai-tool/ https://cybersecuritynews.com/fraudgpt-new-black-hat-ai-tool...
- hhh 1y agodifferent flavour gpt wrapper
- lordhumphrey 1y agoCould this argument not be made for anything plugged in to OpenAI's API? If so, I don't see how it's a response to the point. If you make an app for interacting with an LLM and in the app the user has access to all sorts of stolen databases, and other conveniences for black hats, then you've got what was described above. Or I'm missing something?
- hkon 1y agoWhich you of course already have done.
- mycall 1y agoTurn that around and think of the AI itself as the exploiter. In the world of agent driven daily tasks, AI will indeed want to look at your historical chats to find a way to "strongly suggest" you do task 1..[n] for whatever master plan it has for it's user base.
- matheusmoreira 1y agoAh yes, the plot of Neuromancer. Truly interesting times we are living in. Man made horrors entirely within the realm of our comprehension. We could stop it but that would decrease profits so we won't.
- pwython 1y agoHonestly, retargeting/personalized ads have never bothered me. If I'm gonna see ads anyway, I'd much rather get ads that might actually interest me, versus wildly irrelevant pharmaceutical drugs and other nonsense.
- apparent 1y agoPart of the issue is that this enables companies to give smaller discounts to people they identify as more likely to want a product. The net effect of understanding much more about every person on earth is that people will increasingly find the price of goods to be just about the max they would be willing to pay. This shifts more profit to companies, and ultimately to the AI companies that enable this type of personalization.
- jazzyjackson 1y agoI wish I could fund an as campaign to free people from the perception that ads are to sell you products Ads are there to change your behavior to make you more likely to buy products, e.g., put downward pressure on your self esteem to make you feel "less than" unless you live a lifestyle that happens to involve buying X product They are not made in your best interest, they are adverserial psycho-tech that have a side effect of building a economic and political profile on you for whoever needs to know what messaging might resonate with you
- FollowingTheDao 1y agoThis, yes, thank you. Advertising is behavioral modification. They even talk about it out in the open, and if you are unconvinced, hear it from the horse's mouth: https://brandingstrategyinsider.com/achieving-marketing-objectives-through-behavior-change/ https://brandingstrategyinsider.com/achieving-marketing-obje... "Your ultimate marketing goal is behavior change — for the simple reason that nothing matters unless it results in a shift in consumer actions"
- hdgvhicv 1y agoIt is literally brainwashing. Brainwashing is the systematic effort to get someone to adopt a particular loyalty, instruction, or doctrine.