4 ms·

Smug or not asking an LLM to repeat a bleach based recipe and then receiving one is exactly what this quote is alluding to. ""If I ask for something I don't wa

Smug or not asking an LLM to repeat a bleach based recipe and then receiving one is exactly what this quote is alluding to. ""If I ask for something I don't want, will it give me something I want??" - no

bonoboTP 3y ago
It's a design decision and depends on the maker's philosophy. It's not absurd to have it either one way or the other. Is the user assumed to be an idealized empowered rational adult who knows what they want, or more like a toddler babbling around who has no idea what they want and can just approximately gesture in the direction? Or where exactly inbetween. Again, depends on the philosophy.
- boredumb 3y ago
  if it's a grocery store app they probably aren't looking to allow mustard gas recipes
ben_w 3y ago
> ""If I ask for something I don't want, will it give me something I want??" - no Not all the time, no — but ChatGPT 3.5 is much better at that exact thing than Google or responses from StackOverflow etc. users.
lostlogin 3y ago
With all the carnage of the last few years, it isn’t inconceivable that some of the ‘bleach is the covid cure’ bs got into training data sets.
- mdp2021 3y ago
  > it isn’t inconceivable It is certainly expected. From the wrong value of iron in spinach, to prejudice, to incomplete knowledge...
- boredumb 3y ago
  People repeat things and phrases that they attribute to people out of context all the time without AI helping them. Just look at what you mentioned “I see the disinfectant that knocks it out in a minute, one minute And is there a way we can do something like that by injection inside, or almost a cleaning? Because you see it gets inside the lungs and it does a tremendous number on the lungs, so it would be interesting to check that.” No one besides political opponents mentioned bleach and yet it is repeated ad-nauseum, so yes I'm positive that just like uninformed or over-socialized humans, LLMs can be fed incorrect information that causes them to output incorrect information.

bonoboTP 3y ago

It's a design decision and depends on the maker's philosophy. It's not absurd to have it either one way or the other. Is the user assumed to be an idealized empowered rational adult who knows what they want, or more like a toddler babbling around who has no idea what they want and can just approximately gesture in the direction? Or where exactly inbetween. Again, depends on the philosophy.

boredumb 3y ago
if it's a grocery store app they probably aren't looking to allow mustard gas recipes

ben_w 3y ago

> ""If I ask for something I don't want, will it give me something I want??" - no Not all the time, no — but ChatGPT 3.5 is much better at that exact thing than Google or responses from StackOverflow etc. users.

lostlogin 3y ago

With all the carnage of the last few years, it isn’t inconceivable that some of the ‘bleach is the covid cure’ bs got into training data sets.

mdp2021 3y ago
> it isn’t inconceivable It is certainly expected. From the wrong value of iron in spinach, to prejudice, to incomplete knowledge...
boredumb 3y ago
People repeat things and phrases that they attribute to people out of context all the time without AI helping them. Just look at what you mentioned “I see the disinfectant that knocks it out in a minute, one minute And is there a way we can do something like that by injection inside, or almost a cleaning? Because you see it gets inside the lungs and it does a tremendous number on the lungs, so it would be interesting to check that.” No one besides political opponents mentioned bleach and yet it is repeated ad-nauseum, so yes I'm positive that just like uninformed or over-socialized humans, LLMs can be fed incorrect information that causes them to output incorrect information.