3 ms·

The right answer is no rocks. Some mentally ill person could type that in and get "eat 1000 rocks" and then die from eating rocks, and that would be Google's fa

The right answer is no rocks. Some mentally ill person could type that in and get "eat 1000 rocks" and then die from eating rocks, and that would be Google's fault. It's not funny. I have no doubt right now there are at least 50 youtube videos being made testing different glue's effectiveness holding cheese on a pizza. And some of those idiots are going to taste-test it, too. And then people will try it at home, some stupid kids will get sick - I have no doubt. It was a bit premature to label LLMs as "Intelligence", it's a cool parlor trick based on a shitload of power consumption and 3D graphics cards, but it's not intelligent and it probably shouldn't be telling real (stupid) humans answers that it can't verify are correct.

nomel 2y ago
Google is not responsible, and should never be responsible, for protecting mentally ill people from themselves. It would be at a severe detriment to the rest of us if they took on that responsibility. Society should set the bar to “a reasonable person”, otherwise you’re doomed, with no possible alternative to a nanny state.
- leptons 2y ago
  It's not only mentally ill people that are at risk, but anyone that doesn't know it's not a good idea to put "non-toxic" glue in pizza cheese. That includes a lot of not-mentally-ill but just plain dumb people. Google didn't need to tell people that glue+pizza is a reasonable thing to do, or even just a thing. It sure did frame it like it was a legitimate response. And Google didn't even have to reply with this or anything else, they could have just supplied the links to other sites where it had been suggested, but no - they have to make a show of force with their premature foray into AI, and have it tell real people all kinds of false, and possibly dangerous things. That's an unforced error by Google that they could end up being prosecuted for.
  - avery17 2y ago
    Thats what parents and mentors are for. We as a society should not have to break our backs bending over backwards to stop people from doing stupid things. People can make their own descisions and be responsible for them. If they lack proper guidance, well that just sucks.
    - leptons 2y ago
      >Thats what parents and mentors are for. It's nice that you have a parent that cares about how you are raised, or "a mentor". Do you realize that not everyone has that? >We as a society should not have to break our backs bending over backwards to stop people from doing stupid things. Sure, let's take down all the speed limits and see what happens. Let's tell people it's an option to wear seatbelts and see what happens. Let's deregulate everything and hope for the best. Sounds reasonable? >People can make their own descisions and be responsible for them. If they lack proper guidance, well that just sucks. There's this thing called "human nature". I think you should do some reading about it.
      - nomel 2y ago
        Sure. But we have to keep the bar somewhere reasonable, otherwise you won’t be free to make mistakes.
- anonymousab 2y ago
  They absolutely should bear responsibility for authoritatively telling people wrong and unsafe cooking temperatures for meats or spreading lies about people on their results page, in their own voice. "It's just a random text generator!" isn't a protection against, say, gross libel. They pass the threshold of criminal negligence when they keep up a system that they know will actively mislead countless people in subtly dangerous ways. The problem being hard or the tech being fundamentally unsound doesn't wave away their culpability - if anything it destroys any reason why they should be given some leeway.
avar 2y ago
> The right answer is no rocks. Sand is considered a "rock". If you live in e.g. the USA or the EU you've definitely inadvertently eaten rocks from food produce that's regulated and considered perfectly safe to eat. It's impossible to completely eliminate such trace contaminants from produce. Pedantic? Yes, but you also can't expect a machine to confidently give you absolutes is response to questions that don't even warrant them, or to distinguish them from questions like "do mammals lay eggs?".
- leptons 2y ago
  This is not a serious reply.
- fragmede 2y ago
  Salt is rock, and most everyone eats plenty of that. The LLM is clearly being dumb, but the underlying science of the question is actually interesting. Iron is another interesting one. Run a magnet though iron-fortified cereal.
viking123 2y ago
It's funny how people on reddit think that these LLMs will somehow become AGI in the next year, or when openAI releases gpt 5. The reality is though, that there is no known path currently to true AGI system and the research needs to be done. No one knows how to build this kind of system yet. LLMs are nice for things like roleplaying, helping with code stuff etc. but they are far from all that the marketers hype them to be.
- leptons 2y ago
  It's going to end up being another bubble, and it will eventually burst. Most people, investors included, don't really know why LLMs aren't going to be able to reason about and solve all of humanity's problems, so they go on believing it. It's just a matter of time before the money runs out, or gets shifted towards some new, shiny thing.

nomel 2y ago

Google is not responsible, and should never be responsible, for protecting mentally ill people from themselves. It would be at a severe detriment to the rest of us if they took on that responsibility. Society should set the bar to “a reasonable person”, otherwise you’re doomed, with no possible alternative to a nanny state.

leptons 2y ago
It's not only mentally ill people that are at risk, but anyone that doesn't know it's not a good idea to put "non-toxic" glue in pizza cheese. That includes a lot of not-mentally-ill but just plain dumb people. Google didn't need to tell people that glue+pizza is a reasonable thing to do, or even just a thing. It sure did frame it like it was a legitimate response. And Google didn't even have to reply with this or anything else, they could have just supplied the links to other sites where it had been suggested, but no - they have to make a show of force with their premature foray into AI, and have it tell real people all kinds of false, and possibly dangerous things. That's an unforced error by Google that they could end up being prosecuted for.
- avery17 2y ago
  Thats what parents and mentors are for. We as a society should not have to break our backs bending over backwards to stop people from doing stupid things. People can make their own descisions and be responsible for them. If they lack proper guidance, well that just sucks.
  - leptons 2y ago
    >Thats what parents and mentors are for. It's nice that you have a parent that cares about how you are raised, or "a mentor". Do you realize that not everyone has that? >We as a society should not have to break our backs bending over backwards to stop people from doing stupid things. Sure, let's take down all the speed limits and see what happens. Let's tell people it's an option to wear seatbelts and see what happens. Let's deregulate everything and hope for the best. Sounds reasonable? >People can make their own descisions and be responsible for them. If they lack proper guidance, well that just sucks. There's this thing called "human nature". I think you should do some reading about it.
    - nomel 2y ago
      Sure. But we have to keep the bar somewhere reasonable, otherwise you won’t be free to make mistakes.
anonymousab 2y ago
They absolutely should bear responsibility for authoritatively telling people wrong and unsafe cooking temperatures for meats or spreading lies about people on their results page, in their own voice. "It's just a random text generator!" isn't a protection against, say, gross libel. They pass the threshold of criminal negligence when they keep up a system that they know will actively mislead countless people in subtly dangerous ways. The problem being hard or the tech being fundamentally unsound doesn't wave away their culpability - if anything it destroys any reason why they should be given some leeway.

avar 2y ago

> The right answer is no rocks. Sand is considered a "rock". If you live in e.g. the USA or the EU you've definitely inadvertently eaten rocks from food produce that's regulated and considered perfectly safe to eat. It's impossible to completely eliminate such trace contaminants from produce. Pedantic? Yes, but you also can't expect a machine to confidently give you absolutes is response to questions that don't even warrant them, or to distinguish them from questions like "do mammals lay eggs?".

leptons 2y ago
This is not a serious reply.
fragmede 2y ago
Salt is rock, and most everyone eats plenty of that. The LLM is clearly being dumb, but the underlying science of the question is actually interesting. Iron is another interesting one. Run a magnet though iron-fortified cereal.

viking123 2y ago

It's funny how people on reddit think that these LLMs will somehow become AGI in the next year, or when openAI releases gpt 5. The reality is though, that there is no known path currently to true AGI system and the research needs to be done. No one knows how to build this kind of system yet. LLMs are nice for things like roleplaying, helping with code stuff etc. but they are far from all that the marketers hype them to be.

leptons 2y ago
It's going to end up being another bubble, and it will eventually burst. Most people, investors included, don't really know why LLMs aren't going to be able to reason about and solve all of humanity's problems, so they go on believing it. It's just a matter of time before the money runs out, or gets shifted towards some new, shiny thing.