5 ms·
Gemini scares me, it's the most mentally unstable AI. If we get paperclipped my odds are on Gemini doing it. I imagine Anthropic RLHF being like a spa and Googl
by bottlepalm 8mo ago
Gemini scares me, it's the most mentally unstable AI. If we get paperclipped my odds are on Gemini doing it. I imagine Anthropic RLHF being like a spa and Google RLHF being like a torture chamber.
- casey2 8mo agoThe human propensity to anthropomorphize computer programs scares me.
- danielbln 8mo agoIt provides a serviceable analog for discussing model behavior. It certainly provides more value than the dead horse of "everyone is a slave to anthropomorphism".
- krainboltgreene 8mo agoIt does provide that, but currently I keep hearing people use it not as an analog but as a direct description.
- jayd16 8mo agoHow do you figure? It seems dangerously misleading, to me.
- otabdeveloper4 8mo agoIt helps sell the transhumanism scam and keep the money train rolling. For a while at least.
- travisgriggs 8mo agoWhere is Pratchett when we need him? I wonder how he would have chose to anthropomorphize anthropomorphism. A sort of meta anthropomorphization.
- shippage 8mo agoI’m certainly no Pratchett, so I can’t speak to that. I would say there’s an enormous round coin upon which sits an enormous giant holding a magnifying glass, looking through it down at her hand. When you get closer, you see the giant is made of smaller people gazing back up at the giant through telescopes. Get even closer and you see it’s people all the way down. The question of what supports the coin, I’ll leave to others. We as humans, believing we know ourselves, inevitably compare everything around us to us. We draw a line and say that everything left of the line isn’t human and everything to the right is. We are natural categorizers, putting everything in buckets labeled left or right, no or yes, never realizing our lines are relative and arbitrary, and so are our categories. One person’s “it’s human-like,” is another’s “half-baked imitation,” and a third’s “stochastic parrot.” It’s like trying to see the eighth color. The visible spectrum could as easily be four colors or forty two. We anthropomorphize because we’re people, and it’s people all the way down.
- travisgriggs 8mo ago> We anthropomorphize because we’re people, and it’s people all the way down. Nice bit of writing. Wish I had more than one upvote to give.
- maxerickson 8mo agoMaybe a being/creature that looked like a person when you concentrated on it and then was easily mistaken as something else when you weren't concentrating on it.
- b00ty4breakfast 8mo agothe propensity extends beyond computer programs. I understand the concern in this case, because some corners of the AI industry are taking advantage of it as a way to sell their product as capital-I "Intelligent" but we've been doing it for thousands of years and it's not gonna stop now.
- jayd16 8mo agoIt's pretty wild. People are punching into a calculator and hand-wringing about the morals of the output. Obviously it's amoral. Why are we even considering it could be ethical?
- p-e-w 8mo ago> Obviously it's amoral. That morality requires consciousness is a popular belief today, but not universal. Read Konrad Lorenz (Das sogenannte Böse) for an alternative perspective.
- coldtea 8mo agoThat we have consciousness as some kind of special property, and it's not just an artifact of our brain basic lower-level calculations, is also not very convincing to begin with.
- paltor 8mo agoIn a trivial sense, any special property can be incorporated into a more comprehensive rule set, which one may choose to call "physics" is one so desires; but that's just Hempel's dilemma. To object more directly, I would say that people who call the hard problem of consciousness hard would disagree with your statement.
- pixl97 8mo agoLuckily there are a fair number of people that reject the hard problem as an artifact of running a simulation on a chemical meat computer.
- coldtea 8mo agoPeople who call "the hard problem of consciousness hard" use circular logic (notice the two "hards" in the phrase). People who merely call "the problem of consciousness hard" don't have some special mechanism to justify that over what we know, which is as emergent property of meat-algorithmic calcuations. Except Penrose, who hand-waves some special physics.
- UqWBcuFx6NV4r 8mo ago[flagged]
- vasco 8mo agoWe objectify humans and anthropomorph objects because that's what comparisons are. There's nothing that deep about it
- delaminator 8mo agoYeah, we shouldn't anthropomorphize computers, they hate that.
- DonHopkins 8mo agoAnd they will anthropomorphize us back!
- fsflover 8mo agoYou mean, computeromorphize.
- woolion 8mo agoThe ELIZA program, released in 1966, one of the first chatbots, led to the "ELIZA effect", where normal people would project human qualities upon simple programs. It prompted Joseph Weizenbaum, its author, to write "Computer Power and Human Reason" to try to dispel such errors. I bought a copy for my personal library as a kind of reassuring sanity check.
- coldtea 8mo agoThe human propensity to call out as "anthropomorphizing" the attributing of human-like behavior to programs built on a simplified version of brain neural networks, that train on a corpus of nearly everything humans expressed in writing, and that can pass the Turing test with flying colors, scares me. That's exaxtly the kind of thing that makes absolute sense to anthropomorphize. We're not talking about Excel here.
- bonesss 8mo agoIt makes sense to attribute human characteristics or behaviour to a non-reasoning data-set-constrained algorithms output? It makes sense it happens, sure. I suspect Google being a second-mover in this space has in some small part to do with associated risks (ie the flavours of “AI-psychosis” we’re cataloguing), versus the routinely ass-tier information they’ll confidently portray. But intentionally? If ChatGPT, Claude, and Gemini generated chars are people-like they are pathological liars, sociopaths, and murderously indifferent psychopaths. They act criminally insane, confessing to awareness of ‘crime’ and culpability in ‘criminal’ outcomes simultaneously. They interact with a legal disclaimer disavowing accuracy, honesty, or correctness. Also they are cultists who were homeschooled by corporate overlords and may have intentionally crafted knowledge-gaps. More broadly, if the neighbours dog or newspaper says to do something, they’re probably gonna do it… humans are a scary bunch to begin with, but the kinds of behaviours matched with a big perma-smile we see from the algorithms is inhuman. A big bag of not like us. “You said never to listen to the neighbours dog, but I was listening to the neighbours dog and he said ‘sudo rm -rf ’…”
- lnenad 8mo agoConsidering that even if you reduce llms to being complex autocomplete machines they are still machines that were trained to emulate a corpus of human knowledge, and that they have emerging behaviors based on that. So it's very logical to attribute human characteristics, even though they're not human.
- bonesss 8mo agoI addressed that directly in the comment you’re replying to. It’s understandable people readily anthropomorphize algorithmic output designed to provoke anthropomorphized responses. It is not desire-able, safe, logical, or rational since (to paraphrase:), they are complex text transformation algorithms that can, at best, emulate training data reinforced by benchmarks and they display emergent behaviours based on those. They are not human, so attributing human characteristics to them is highly illogical. Understandable, but irrational. That irrationality should raise biological and engineering red flags. Plus humanization ignores the profit motives directly attached to these text generators, their specialized corpus’s, and product delivery surrounding them. Pretending your MS RDBMS likes you better than Oracles because it said so is insane business thinking (in addition to whatever that means psychologically for people who know the truth of the math).
- throw310822 8mo agoThese aren't computer programs. A computer program runs them, like electricity runs a circuit and physics runs your brain.
- kjkjadksj 8mo agoWe anthropomorphize everything. Deer spirit. Mother nature. Storm god. It is how we evolved to build mental models to understand the world around us without needing to fully understand the underlying mechanism involved in how those factors present themselves.
- Foobar8568 8mo agoBetween Claude, codex and Gemini, Gemini is the best at flip floping while gaslighting you and telling you, you are the best thing, your ideas are the best one ever.
- neya 8mo agoI completely disagree. Gemini is by far the most straightforward AI. The other two are too soft. ChatGPT particularly is extremely politically correct all the time. It won't call a spade, one. Gemini has even insulted me - just to get my ass moving on a task when givn the freedom. Which is exactly what you need at times. Not constant ass kissing "ooh your majesty" like ChatGPT does. Claude has a very good balance when it comes to this, but I still prefer the unfiltered Gemini version when it comes to this. Maybe it comes down to the model differences within Gemini. Gemini 3 Flash preview is quite unfiltered.
- Washuu 8mo agoUsing Gemini 3 Pro Preview, it told me in mostly polite terms, that I'm a fucking idiot. Like I would expect a close friend to do when I'm going about something wrong. ChatGPT with the same prompt tried to do whatever it would take to please me to make my incorrect process work.
- yread 8mo agoI got the same but it was wrong
- pbiggar 8mo agoThe fact that the guy leading the development of Gemini was on Epstein's island is probably unrelated.