4 ms·

While I am surprised by the extent of these breakdowns, I do think having a sycophantic mirror constantly praising all your stupid ideas does likely have profou

While I am surprised by the extent of these breakdowns, I do think having a sycophantic mirror constantly praising all your stupid ideas does likely have profound impacts. I think I am probably prone to a bit of delusions of grandeur and I can feel the pull whenever ChatGPT decides some of my input is the greatest thing mankind has considered, “maybe this is a billion dollar idea!”. I imagine a less skeptical, more vulnerable person could fall into an ugly spiral of aggrandizement. And it still seems to sycophantic despite openai saying they tuned it down even custom system prompts don’t seem to help beyond surface level, the general tone is still too much.

araes 1y ago
Part of the issue is kind of the same feedback loop, except on the corporate side. Providing that type of grandiose response, then gets better engagement and time spent with the chatbot, that then drives the numbers that corporations are looking for. There's not much motivation to provide a critical, or constructive criticism chatbot. Although, admittedly, I have actually noticed similar person issues with the automated Google AI Mode responses. It's difficult to not feel some personal emotional insult when Google responds with a "No, you're wrong" response at the top of the search. There've been a few that have at least been funny though. "No, you're wrong, Agent Smith never calls him Mr. Neo, that would imply respect." Course, it's a similar issue with trying to interact with humanity a lot of the time. Execs often seem to not want critical feedback about their ideas. Tends to be a lot of the same attraction towards a sycophantic entourage and "yes" people. "Your personal views on the subject are not desired, just implement whatever 'brilliant' idea has just been provided." Hollywood and culture (art circles) are also relatively well known for the same issues. Current state of politics seems to be very much about "loyalty" not critical feedback. Having not interacted that much with ChatGPT, does it tend to trend Really heavily on the "every idea is a billion dollar idea" side? May result in a lot of humanity existing in little sycophantic echo chambers over time. Difficult to tell how much of what you're interacting with online has not already become automated reviews, automated responses, and automated pictures.

araes 1y ago

Part of the issue is kind of the same feedback loop, except on the corporate side. Providing that type of grandiose response, then gets better engagement and time spent with the chatbot, that then drives the numbers that corporations are looking for. There's not much motivation to provide a critical, or constructive criticism chatbot. Although, admittedly, I have actually noticed similar person issues with the automated Google AI Mode responses. It's difficult to not feel some personal emotional insult when Google responds with a "No, you're wrong" response at the top of the search. There've been a few that have at least been funny though. "No, you're wrong, Agent Smith never calls him Mr. Neo, that would imply respect." Course, it's a similar issue with trying to interact with humanity a lot of the time. Execs often seem to not want critical feedback about their ideas. Tends to be a lot of the same attraction towards a sycophantic entourage and "yes" people. "Your personal views on the subject are not desired, just implement whatever 'brilliant' idea has just been provided." Hollywood and culture (art circles) are also relatively well known for the same issues. Current state of politics seems to be very much about "loyalty" not critical feedback. Having not interacted that much with ChatGPT, does it tend to trend Really heavily on the "every idea is a billion dollar idea" side? May result in a lot of humanity existing in little sycophantic echo chambers over time. Difficult to tell how much of what you're interacting with online has not already become automated reviews, automated responses, and automated pictures.