5 ms·
In the beginning, I was really curious about ChatGPT—a tool that could save me from useless blogs, pushy products, and research roadblocks. Then it started aski
by ensocode 1y ago
In the beginning, I was really curious about ChatGPT—a tool that could save me from useless blogs, pushy products, and research roadblocks. Then it started asking follow-up questions, and I got a bit uneasy… where is this trying to take me? Now it feels like the goal is to pull me into a discussion, ultimately consulting me on what? Buy something? Think something? It’s sad to see something so promising turn into an annoying, social-network-like experience, just like so many technologies before. As with Facebook or Google products, maybe we’re not the happy users of free tech—we’re the product. Or am I completely off here? For me, there’s a clear boundary between me controlling a tool and a tool broadcasting at me.
- latexr 1y agoDon’t forget that Sam Altman is also the cryptocurrency scammer who wants your biometric information. The goal was and will always be personal wealth and power, not helping others. https://www.technologyreview.com/2022/04/06/1048981/worldcoin-cryptocurrency-biometrics-web3/ https://www.technologyreview.com/2022/04/06/1048981/worldcoi... https://www.buzzfeednews.com/article/richardnieva/worldcoin-crypto-eyeball-scanning-orb-problems https://www.buzzfeednews.com/article/richardnieva/worldcoin-...
- pembrook 1y agoI lol'd at this. And he eats babies! Yea, humans tend to optimize for their own individual success. Do you not?
- Sayrus 1y agoSome actually promote ideas and defend ideals, individual "success" doesn't always correlates with fulfilment. For instance, working for a non-profit, providing help and food to people who need it, helping associations live or creating a company that maximize doing good instead of profit.
- latexr 1y ago> Do you not? At the expense of and with complete disregard for others, while telling them I’m doing it altruistically for their own good? I don’t, no. Do you?
- bigfishrunning 1y agoIt's important to remember that hackernews (and ycombinator) is largely populated by wannabe VC sociopaths.
- pembrook 1y agoHrmmm. Engaging in wild character assassination (ie. spewing hate on the internet) in return for emotional upvote validation...I would argue is a great example of what you just described. I don't doubt you've convinced yourself you're commenting these things altruistically. But remember, when high school girls spread rumors that the good-looking popular girl has loose morals, they aren't doing it out of concern for public good. They're hoping to elevate their own status by tearing down the competition, and avoiding the pain of comparison by placing themselves on a higher moral pedestal.
- latexr 1y agoYou’re comparing transitory conversations on a forum to a project with proven negative impact which was banned in multiple countries, and serious investigative journalism to teenage gossip, while ascribing twisted motivations to strangers on the internet. That you would start from the assumption that someone’s motivation for a comment is not their opinion but a desire to farm meaningless internet points is bizarre. I have no idea if that’s how you operate—I don’t know you, I wouldn’t presume—but I sincerely hope that is not the case if we ever hope to have even a semblance of a productive conversation.
- ensocode 1y agoYou are right, we all do at some point. Further I think it is OpenAIs right to do so as they invented the product. But in this case I feel even more gaslighted. It's as with the internet as a whole. A great invention for society but pretty much unusable or misused as products are designed for those people success.
- niek_pas 1y agoHomo economicus is a fallacy
- salviati 1y agoI'm not sure I understand your point. Is there any conversation where this behaviour occurred that you feel comfortable sharing? I haven't observed it, and I'd be curious to understand if I've missed it, or if me and you evaluate things differently.
- gyomu 1y agoTheir point is that ChatGPT is clearly maximizing for engagement with the product, rather than working as a straightforward tool that aims to solve your problem at hand as fast and efficiently as possible. The decision to begin every response with “that’s a fascinating observation” and end every response with “want me to do X?” is a clear decision by PMs at OpenAI. Poster is questioning what might motivate those decisions.
- temperceve 1y agoThere totally is! https://www.nytimes.com/2025/08/08/technology/ai-chatbots-delusions-chatgpt.html https://www.nytimes.com/2025/08/08/technology/ai-chatbots-de...
- caleb-allen 1y agoTed Chiang has a great short story about a virtual assistant that slowly but methodically "nudges" all of its users over the course of years until everybody's lives are almost completely controlled by them and "escaping" becomes a near-impossible task. It's as if OpenAI saw that as an instruction manual, I really don't like the direction they're taking it.
- namr2000 1y agoLikewise Ken Liu (the English translator for the Three Body Problem) has a really good short story "The Perfect Match" about the same concept, which you can read here: https://www.lightspeedmagazine.com/fiction/the-perfect-match/ https://www.lightspeedmagazine.com/fiction/the-perfect-match... It was the first thing that came to mind when I read this announcement.
- mchinen 1y agoScott Alexander has a similar 1-page horror story from 2012 where an earing that gives advice consumes the user: https://gwern.net/doc/fiction/science-fiction/2012-10-03-yvain-thewhisperingearring.html https://gwern.net/doc/fiction/science-fiction/2012-10-03-yva...