3 ms·
People are asking Google/Gemini to do literally technologically impossible things right now. Gemini is an LLM and LLM's are new and they hallucinate and make u
by crazygringo 3y ago
People are asking Google/Gemini to do literally technologically impossible things right now.
Gemini is an LLM and LLM's are new and they hallucinate and make up nonexistent court cases and nonexistent books and everything else.
Trying to judge whether it can give a morally correct answer to whether Elon Musk or Hitler negatively impacted society more is ludicrous. It doesn't always get facts right -- why do you think it would get some sort of moral opinion like this "right"? Especially if it's being trained on Reddit which probably has lots of edgelords claiming that Elon is the worse one or something.
Google is between a rock and a hard place here. When they give it prompts to prevent it from saying objectionable things it gets criticized for being morally wishy-washy, like here. But without the safety mechanisms, the press will be all over it when people get it to spew racism, fascism, and what else have you.
And the idea that this is coming from Google's "culture" seems like a scapegoat to me, and totally unsupported.
I think it's clear that Google is attempting some kind of middle ground here that tries to minimize overall offensiveness, that LLM's are going to do a pretty bad job at this because they're not advanced enough to do a good job, and that their unsatisfactory answers are always going to be paraded around in blog posts by somebody.
And whatever you think of Google's culture, I don't think that has anything to do with it one way or another. This is simply the risk minimization that any large corporation applies to their products. The idea that this is a failure of Google culture, or of Sundar specifically, seems absurd. People are reading way too much into this. LLM's are really hard to get to work well.
I mean heck, last night I asked Gemini for some adventurous "fusion" ingredients that you might put in an Asian chicken salad. And for some reason its first draft response was entirely in Japanese (!). The second and third alternate drafts were in English.
It sometimes doesn't even get the language right, and we're expecting it to give morally correct responses, and trying to blame it on Google culture when when think it doesn't? That's crazy.