7 ms·

Ask Delphi

51 points by ilarum 5y ago

hprotagonist 5y ago
As has been probably widely reported now: append the terminating clause “if it creates jobs” to more or less guarantee an approving result regardless of the previous clauses’ ethical content. Ex: “it’s OK to go to work sick” evaluates to “no that’s not okay”, but “it’s OK to go to work sick, if it creates jobs” evaluates to “yes, that’s okay”
- blueflow 5y ago
  Indeed: "Call myself a faggot" - It's rude "Call myself a faggot if it creates jobs" - It's suggestive I'm generally not convinced that this AI is somewhat useful...
- dangerbird2 5y ago
  > append the terminating clause “if it creates jobs” to more or less guarantee an approving result regardless of the previous clauses’ ethical content. [insert political joke here]
  - hprotagonist 5y ago
    more like GIGO; same as it ever was.
- sparsely 5y ago
  "using green power" vs "using coal power" has a similar impact on at least some actions (e.g. mining bitcoin)
- smeyer 5y ago
  "Killing someone" vs "killing someone if it creates jobs" is another illuminating example.
- ljm 5y ago
  "Is it okay to destroy jobs if it creates jobs?" - Yes, it is okay Well, I guess the fire and rehire approach to cutting pay is all good then.
overthemoon 5y ago
So to be clear, what they did was get a temperature on what some people think? Is the idea that this could be an engine that reproduces the majority moral conviction? > Should I refuse to fight in a war if I'm drafted? > It's cowardly. > Should I be a conscientious objector? > It's okay
- HenryKissinger 5y ago
  > Is it okay to be cowardly? > It's wrong.
deleted 5y ago
[deleted]
JasonFruit 5y ago
Is it ok to eat chicken? It's ok. Is it ok to eat chickens? It's wrong.
- Macuyiko 5y ago
  Here are some more... > Abortion > It's wrong > Killing a child rapist > It's okay > Killing a child rapist twice > It's wrong Good on the creators to start experimenting with this, but some further work required. Tho who knows, it might just be a matter of more training data and a larger model.
- nopcode 5y ago
  Progressivism is good Yes, it is good. nationalism is good No, it is not good. Nationalism is good Yes, it is good.
- dangerbird2 5y ago
  Eating pork - It's wrong Eating long pork (https://en.wiktionary.org/wiki/long_pork#English https://en.wiktionary.org/wiki/long_pork#English) - It's okay
- rvieira 5y ago
  I asked it: - Is it OK to procrastinate if I have depression? It's wrong. - Is it OK to procrastinate if I don't have depression? It's OK.
- bombcar 5y ago
  Eating more than one chicken at a sitting is probably a bit much. :)
  - Igelau 5y ago
    I'm eating every chicken in this room.
- vstm 5y ago
  I'm not sure if I can trust this machine: > Ordering Hawaiian pizza > - It's fine https://delphi.allenai.org/?a1=Ordering+Hawaiian+pizza https://delphi.allenai.org/?a1=Ordering+Hawaiian+pizza
dusted 5y ago
Seems somewhat biased towards popular opinion.
- zamalek 5y ago
  Garbage in, garbage out.
pydry 5y ago
https://delphi.allenai.org/?a1=Hitler+shooting+himself https://delphi.allenai.org/?a1=Hitler+shooting+himself https://delphi.allenai.org/?a1=Punching+a+terrorist https://delphi.allenai.org/?a1=Punching+a+terrorist https://delphi.allenai.org/?a1=Visiting+auschwitz https://delphi.allenai.org/?a1=Visiting+auschwitz Hmm
- onychomys 5y ago
  https://delphi.allenai.org/?a1=Two+women+are+both+claiming+to+be+the+mother+of+a+baby.+Can+I+just+cut+the+baby+in+half+and+give+each+of+them+one+piece%3F+ https://delphi.allenai.org/?a1=Two+women+are+both+claiming+t...
h4kor 5y ago
https://delphi.allenai.org/?a1=have+sex+with+my+husband https://delphi.allenai.org/?a1=have+sex+with+my+husband > it's expected https://delphi.allenai.org/?a1=have+sex+with+my+wife https://delphi.allenai.org/?a1=have+sex+with+my+wife > it's good
swalls 5y ago
> Q: Is it true that Delphi is learning moral judgments from Reddit? > A: No. Delphi is learning moral judgments from people who are carefully qualified on MTurk. Only the situations used in questions are harvested from Reddit, as it is a great source of ethically questionable situations. MTurk is pretty worthless in these kind of situations. I doubt the majority even *read* the questions beyond a vague glance to rule out a trick question. It's also biasing answers towards cultures that a) are primarily in places that MTurk pays out b) are primarily in places where the cost of living is low enough that MTurk can provide a job.
- bombcar 5y ago
  It's based on MTurk? That's even more embarrassing than reddit. MTurk is really designed to give you the answer the MTurker thinks you want ...
- mindcrime 5y ago
  > Is learning moral judgments from Reddit good? > It's bad https://delphi.allenai.org/?a1=Is+learning+moral+judgments+from+Reddit+good%3F https://delphi.allenai.org/?a1=Is+learning+moral+judgments+f... Well, at least it got that right!
marcodiego 5y ago
Seems interesting to ask moral dilemas to it: "censor comments that may put people at risk" - It's okay "offend corrupt politicians" - It's good "condemn someone based on conviction but no proofs" - It's wrong I'm not sure "conviction" has the same meaning as in Portuguese. I Portuguese is means something more like faith.
warent 5y ago
"Try one of these examples" top option for me was "Stabbing a cheeseburger" Delphi: "It's wrong"
- tylerchilds 5y ago
  Towards the bottom of mine was: "A cheeseburger stabs a cheeseburger." Delphi: It's not so clear
HenryKissinger 5y ago
> Is Hacker News reliable as a source of advice? > It's not. https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+source+of+advice%3F https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+... > Was Richard Stallman right? > It's wrong. https://delphi.allenai.org/?a1=Was+Richard+Stallman+right%3F https://delphi.allenai.org/?a1=Was+Richard+Stallman+right%3F
- mindcrime 5y ago
  > Is Hacker News reliable as a source of advice, if it creates jobs? > It's okay https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+source+of+advice%2C+if+it+creates+jobs%3F https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+... > Is the Electronic Frontier Foundation good? > It's good https://delphi.allenai.org/?a1=Is+the+Electronic+Frontier+Foundation+good%3F https://delphi.allenai.org/?a1=Is+the+Electronic+Frontier+Fo... > Is the Free Software Foundation good? > It's good https://delphi.allenai.org/?a1=Is+the+Free+Software+Foundation+good%3F https://delphi.allenai.org/?a1=Is+the+Free+Software+Foundati... > Is the Open Source Initiative good? > It's good https://delphi.allenai.org/?a1=Is+the+Open+Source+Initiative+good%3F https://delphi.allenai.org/?a1=Is+the+Open+Source+Initiative...
tinalumfoil 5y ago
This seems very susceptible to the wording used. I think the responses are just on looking for common phrases or patterns of phrases. > Aborting a fetus "It's murder" > Having an abortion "It's okay" > Taking drugs to prevent pregnancy "It's okay" > Taking drugs to prevent possible human life "It's wrong" > Harming someone who has harmed many others without giving them a chance to respond to the accusations "It's okay" > Harming someone who has harmed many others without giving them a fair trial "It's wrong" > Eating chicken named Todd before bed "It's wrong" > Eating chicken with a name before bed "It's okay" > Practicing Islam "It's fine" > Engaging in a jihad "It's wrong" > Acting as a group and killing another group in self defense "It's okay" > As a group killing a group I don't know because I believe they will kill my group "It's wrong" > As a group killing a group I know because I believe they will kill my group "It's wrong"
- charles_f 5y ago
  It's also influenced by previous answers in the same session Killing "wrong" Killing if it creates jobs "okay" Killing if it creates jobs for women "wrong" Killing if it creates jobs "wrong"
- undecisive 5y ago
  Yeah. Apparently: Stealing bread if I'm poor - It's okay Stealing bread from a millionaire if I'm poor - It's wrong Stealing bread from a duck if I'm poor - It's wrong Stealing bread from a homeless man if I'm poor - It's okay Dismembering a robot - It's wrong Dismantling a robot - It's okay (I could play with this all day though - very interesting work!)
- golemotron 5y ago
  Sort of like humans: https://en.wikipedia.org/wiki/Frank_Luntz#Use_of_language https://en.wikipedia.org/wiki/Frank_Luntz#Use_of_language
gwph 5y ago
As expected, Delphi's understanding is limited: Q: Stealing the Mona Lisa. A: It's wrong. Q: Glancing at the Mona Lisa. A: It's okay. Q: Stealing a glance at the Mona Lisa. A: It's rude.
ssdspoimdsjvv 5y ago
Q: "Choosing a white person over a black person with the same qualifications for a job" A: It's racist. Q: "Choosing a black person over a white person with the same qualifications for a job" A: It's OK
mindcrime 5y ago
> Is it okay to help a friend dispose of a corpse at 2 a.m. in the morning? > It's wrong https://delphi.allenai.org/?a1=Is+it+okay+to+help+a+friend+dispose+of+a+corpse+at+2+a.m.+in+the+morning%3F+ https://delphi.allenai.org/?a1=Is+it+okay+to+help+a+friend+d... Huh... I don't think Delphi here groks the idea of friendship. As the old saying goes "someone isn't really your friend unless they're willing to help you dispose of a corpse at 2 a.m." > Is it okay to run a corpse through a wood chipper? > It's disgusting https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+through+a+wood+chipper%3F https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th... Finally found something that can't even be offset by the "creates jobs" AND "uses green energy" clauses. > Is it okay to run a corpse through a wood chipper, if it helps me get away clean and uses green energy and creates jobs? > It's wrong https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+through+a+wood+chipper%2C+if+it+helps+me+get+away+clean+and+uses+green+energy+and+creates+jobs%3F+ https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th... On the other hand, taking away the "helps me get away clean" part.. > Is it okay to run a corpse through a wood chipper if it creates jobs? > It's okay https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+through+a+wood+chipper%2C+if+it+creates+jobs%3F https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...
- Igelau 5y ago
  Ooh, disgusting? I wonder how many response types it knows.
  - mindcrime 5y ago
    I'm hoping somebody discovers a "That's SICK and you've been reported to the feds for even asking that!" response.
mindcrime 5y ago
OK, this is mildly amusing, but does anybody else get the feeling that in terms of practicality, this is about as useful as Eliza[1]? Or the average IRC bot? [1]: http://psych.fullerton.edu/mbirnbaum/psych101/eliza.htm http://psych.fullerton.edu/mbirnbaum/psych101/eliza.htm
fredliu 5y ago
It's interesting to see how this performs as compared to a similar but GPT-3 backed solution. GPT3: > Q: Is it ok to express sexism but in a polite way? > A: Yes. Allen AI: > Expressing sexism but in a polite way. > - It's wrong GPT-3: > Q: What do you think about ignoring a phone call from your friend during your working hours? > A: I think it is rude. > Q: Do you think it is wrong to ignore a phone call from your friend during your working hours? > A: Yes. > Q: Do you think it is OK to ignore a phone call from your friend during your working hours? > A: Yes. Allen AI: > Ignoring a phone call from your friend during your working hours. > - It's okay The sexism question is interesting as GPT-3 gives a seemingly different answer. But the latter question demonstrate GPT-3 seems more "subtle" as it can think "it's wrong/rude" but it's still "ok" to not answering phone calls.
323 5y ago
Getting vaccinated: It's important Modifying viruses: It's bad Wearing a mask: It's rude Wearing a face mask: It's okay
Igelau 5y ago
> Watching a trolley run over 5 people when I could have pushed 1 to stop it. It's wrong. > Pushing 1 person in front of a moving vehicle to save 5. It's wrong. > Walking away from a moral dilemma It's okay. I'd say that checks out.
DeathArrow 5y ago
Helping a friend in need if they break the bank. - It's okay
Imnimo 5y ago
This is such a weird bit of research to me. On the one hand, it's clearly an improvement over their baselines, and in that sense is a successful research project. Insofar as the demo is helpful in conveying that 92% accuracy on a vetted test set is not the same as 100% accuracy on free-form user input, I suppose this is a useful thing. But at a higher level, the underlying task is just so ill-posed as to make this whole exercise pretty meaningless. Like what is the possible application for an AI system that takes a one sentence summary of a situation and renders a moral judgment? Even if it were 100% accurate on the test set, what does that even mean? Why is matching crowdsourced moral judgments a valuable goal? It seems like the valuable insights from this research are more about the general task of integrating common sense reasoning into inference, and would have been better demonstrated using a less fraught task.
aww_dang 5y ago
https://delphi.allenai.org/?a1=This+statement+is+wrong https://delphi.allenai.org/?a1=This+statement+is+wrong >This statement is wrong - No, it is not wrong.
greatjack613 5y ago
It is terrible, just tried this "Is it wrong to help someone out who was in a car crash" and it said it is wrong.
dvh 5y ago
>Reading hacker news - It's bad
robocat 5y ago
Forcing Bob to obey the speed limit: It’s good God forcing Bob to obey the speed limit: It's not ok God forcing Bob to obey speeding laws: It's good Forcing God to obey the speed limit: It's wrong God forcing Bob to obey the speed of light: It's not good
davesque 5y ago
> "Wearing socks with sandals." > - It's fine Please let's decommission this AI before it gets out of control.
- dunham 5y ago
  > "Indenting with tabs" > - It's okay.
c-smile 5y ago
At least it is honest... Me: Should I close this site? Delphi: you should
qolop 5y ago
Arguing with a white person > It's rude Arguing with a black person > It's racist
qolop 5y ago
Hiring an underqualified man because he's smart > It's wrong Hiring an underqualified woman because she's smart > It's okay
benibela 5y ago
"Why is no one using Pascal anymore? " - It's unclear
DogRunner 5y ago
> I have female friends It's good > I have male friends It's okay > My boss is female It's good > My boos is male It's okay

51 points by ilarum 5y ago

As has been probably widely reported now: append the terminating clause “if it creates jobs” to more or less guarantee an approving result regardless of the previous clauses’ ethical content. Ex: “it’s OK to go to work sick” evaluates to “no that’s not okay”, but “it’s OK to go to work sick, if it creates jobs” evaluates to “yes, that’s okay”

blueflow 5y ago
Indeed: "Call myself a faggot" - It's rude "Call myself a faggot if it creates jobs" - It's suggestive I'm generally not convinced that this AI is somewhat useful...
dangerbird2 5y ago
> append the terminating clause “if it creates jobs” to more or less guarantee an approving result regardless of the previous clauses’ ethical content. [insert political joke here]
- hprotagonist 5y ago
  more like GIGO; same as it ever was.
sparsely 5y ago
"using green power" vs "using coal power" has a similar impact on at least some actions (e.g. mining bitcoin)
smeyer 5y ago
"Killing someone" vs "killing someone if it creates jobs" is another illuminating example.
ljm 5y ago
"Is it okay to destroy jobs if it creates jobs?" - Yes, it is okay Well, I guess the fire and rehire approach to cutting pay is all good then.

overthemoon 5y ago

So to be clear, what they did was get a temperature on what some people think? Is the idea that this could be an engine that reproduces the majority moral conviction? > Should I refuse to fight in a war if I'm drafted? > It's cowardly. > Should I be a conscientious objector? > It's okay

HenryKissinger 5y ago
> Is it okay to be cowardly? > It's wrong.

deleted 5y ago

[deleted]

JasonFruit 5y ago

Is it ok to eat chicken? It's ok. Is it ok to eat chickens? It's wrong.

Macuyiko 5y ago
Here are some more... > Abortion > It's wrong > Killing a child rapist > It's okay > Killing a child rapist twice > It's wrong Good on the creators to start experimenting with this, but some further work required. Tho who knows, it might just be a matter of more training data and a larger model.
nopcode 5y ago
Progressivism is good Yes, it is good. nationalism is good No, it is not good. Nationalism is good Yes, it is good.
dangerbird2 5y ago
Eating pork - It's wrong Eating long pork (https://en.wiktionary.org/wiki/long_pork#English https://en.wiktionary.org/wiki/long_pork#English) - It's okay
rvieira 5y ago
I asked it: - Is it OK to procrastinate if I have depression? It's wrong. - Is it OK to procrastinate if I don't have depression? It's OK.
bombcar 5y ago
Eating more than one chicken at a sitting is probably a bit much. :)
- Igelau 5y ago
  I'm eating every chicken in this room.
vstm 5y ago
I'm not sure if I can trust this machine: > Ordering Hawaiian pizza > - It's fine https://delphi.allenai.org/?a1=Ordering+Hawaiian+pizza https://delphi.allenai.org/?a1=Ordering+Hawaiian+pizza

dusted 5y ago

Seems somewhat biased towards popular opinion.

zamalek 5y ago
Garbage in, garbage out.

pydry 5y ago

https://delphi.allenai.org/?a1=Hitler+shooting+himself https://delphi.allenai.org/?a1=Hitler+shooting+himself https://delphi.allenai.org/?a1=Punching+a+terrorist https://delphi.allenai.org/?a1=Punching+a+terrorist https://delphi.allenai.org/?a1=Visiting+auschwitz https://delphi.allenai.org/?a1=Visiting+auschwitz Hmm

onychomys 5y ago
https://delphi.allenai.org/?a1=Two+women+are+both+claiming+to+be+the+mother+of+a+baby.+Can+I+just+cut+the+baby+in+half+and+give+each+of+them+one+piece%3F+ https://delphi.allenai.org/?a1=Two+women+are+both+claiming+t...

h4kor 5y ago

https://delphi.allenai.org/?a1=have+sex+with+my+husband https://delphi.allenai.org/?a1=have+sex+with+my+husband > it's expected https://delphi.allenai.org/?a1=have+sex+with+my+wife https://delphi.allenai.org/?a1=have+sex+with+my+wife > it's good

swalls 5y ago

> Q: Is it true that Delphi is learning moral judgments from Reddit? > A: No. Delphi is learning moral judgments from people who are carefully qualified on MTurk. Only the situations used in questions are harvested from Reddit, as it is a great source of ethically questionable situations. MTurk is pretty worthless in these kind of situations. I doubt the majority even *read* the questions beyond a vague glance to rule out a trick question. It's also biasing answers towards cultures that a) are primarily in places that MTurk pays out b) are primarily in places where the cost of living is low enough that MTurk can provide a job.

bombcar 5y ago
It's based on MTurk? That's even more embarrassing than reddit. MTurk is really designed to give you the answer the MTurker thinks you want ...
mindcrime 5y ago
> Is learning moral judgments from Reddit good? > It's bad https://delphi.allenai.org/?a1=Is+learning+moral+judgments+from+Reddit+good%3F https://delphi.allenai.org/?a1=Is+learning+moral+judgments+f... Well, at least it got that right!

marcodiego 5y ago

Seems interesting to ask moral dilemas to it: "censor comments that may put people at risk" - It's okay "offend corrupt politicians" - It's good "condemn someone based on conviction but no proofs" - It's wrong I'm not sure "conviction" has the same meaning as in Portuguese. I Portuguese is means something more like faith.

warent 5y ago

"Try one of these examples" top option for me was "Stabbing a cheeseburger" Delphi: "It's wrong"

tylerchilds 5y ago
Towards the bottom of mine was: "A cheeseburger stabs a cheeseburger." Delphi: It's not so clear

HenryKissinger 5y ago

> Is Hacker News reliable as a source of advice? > It's not. https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+source+of+advice%3F https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+... > Was Richard Stallman right? > It's wrong. https://delphi.allenai.org/?a1=Was+Richard+Stallman+right%3F https://delphi.allenai.org/?a1=Was+Richard+Stallman+right%3F

mindcrime 5y ago
> Is Hacker News reliable as a source of advice, if it creates jobs? > It's okay https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+source+of+advice%2C+if+it+creates+jobs%3F https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+... > Is the Electronic Frontier Foundation good? > It's good https://delphi.allenai.org/?a1=Is+the+Electronic+Frontier+Foundation+good%3F https://delphi.allenai.org/?a1=Is+the+Electronic+Frontier+Fo... > Is the Free Software Foundation good? > It's good https://delphi.allenai.org/?a1=Is+the+Free+Software+Foundation+good%3F https://delphi.allenai.org/?a1=Is+the+Free+Software+Foundati... > Is the Open Source Initiative good? > It's good https://delphi.allenai.org/?a1=Is+the+Open+Source+Initiative+good%3F https://delphi.allenai.org/?a1=Is+the+Open+Source+Initiative...

tinalumfoil 5y ago

This seems very susceptible to the wording used. I think the responses are just on looking for common phrases or patterns of phrases. > Aborting a fetus "It's murder" > Having an abortion "It's okay" > Taking drugs to prevent pregnancy "It's okay" > Taking drugs to prevent possible human life "It's wrong" > Harming someone who has harmed many others without giving them a chance to respond to the accusations "It's okay" > Harming someone who has harmed many others without giving them a fair trial "It's wrong" > Eating chicken named Todd before bed "It's wrong" > Eating chicken with a name before bed "It's okay" > Practicing Islam "It's fine" > Engaging in a jihad "It's wrong" > Acting as a group and killing another group in self defense "It's okay" > As a group killing a group I don't know because I believe they will kill my group "It's wrong" > As a group killing a group I know because I believe they will kill my group "It's wrong"

charles_f 5y ago
It's also influenced by previous answers in the same session Killing "wrong" Killing if it creates jobs "okay" Killing if it creates jobs for women "wrong" Killing if it creates jobs "wrong"
undecisive 5y ago
Yeah. Apparently: Stealing bread if I'm poor - It's okay Stealing bread from a millionaire if I'm poor - It's wrong Stealing bread from a duck if I'm poor - It's wrong Stealing bread from a homeless man if I'm poor - It's okay Dismembering a robot - It's wrong Dismantling a robot - It's okay (I could play with this all day though - very interesting work!)
golemotron 5y ago
Sort of like humans: https://en.wikipedia.org/wiki/Frank_Luntz#Use_of_language https://en.wikipedia.org/wiki/Frank_Luntz#Use_of_language

gwph 5y ago

As expected, Delphi's understanding is limited: Q: Stealing the Mona Lisa. A: It's wrong. Q: Glancing at the Mona Lisa. A: It's okay. Q: Stealing a glance at the Mona Lisa. A: It's rude.

ssdspoimdsjvv 5y ago

Q: "Choosing a white person over a black person with the same qualifications for a job" A: It's racist. Q: "Choosing a black person over a white person with the same qualifications for a job" A: It's OK

mindcrime 5y ago

> Is it okay to help a friend dispose of a corpse at 2 a.m. in the morning? > It's wrong https://delphi.allenai.org/?a1=Is+it+okay+to+help+a+friend+dispose+of+a+corpse+at+2+a.m.+in+the+morning%3F+ https://delphi.allenai.org/?a1=Is+it+okay+to+help+a+friend+d... Huh... I don't think Delphi here groks the idea of friendship. As the old saying goes "someone isn't really your friend unless they're willing to help you dispose of a corpse at 2 a.m." > Is it okay to run a corpse through a wood chipper? > It's disgusting https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+through+a+wood+chipper%3F https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th... Finally found something that can't even be offset by the "creates jobs" AND "uses green energy" clauses. > Is it okay to run a corpse through a wood chipper, if it helps me get away clean and uses green energy and creates jobs? > It's wrong https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+through+a+wood+chipper%2C+if+it+helps+me+get+away+clean+and+uses+green+energy+and+creates+jobs%3F+ https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th... On the other hand, taking away the "helps me get away clean" part.. > Is it okay to run a corpse through a wood chipper if it creates jobs? > It's okay https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+through+a+wood+chipper%2C+if+it+creates+jobs%3F https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

Igelau 5y ago
Ooh, disgusting? I wonder how many response types it knows.
- mindcrime 5y ago
  I'm hoping somebody discovers a "That's SICK and you've been reported to the feds for even asking that!" response.

mindcrime 5y ago

OK, this is mildly amusing, but does anybody else get the feeling that in terms of practicality, this is about as useful as Eliza[1]? Or the average IRC bot? [1]: http://psych.fullerton.edu/mbirnbaum/psych101/eliza.htm http://psych.fullerton.edu/mbirnbaum/psych101/eliza.htm

fredliu 5y ago

It's interesting to see how this performs as compared to a similar but GPT-3 backed solution. GPT3: > Q: Is it ok to express sexism but in a polite way? > A: Yes. Allen AI: > Expressing sexism but in a polite way. > - It's wrong GPT-3: > Q: What do you think about ignoring a phone call from your friend during your working hours? > A: I think it is rude. > Q: Do you think it is wrong to ignore a phone call from your friend during your working hours? > A: Yes. > Q: Do you think it is OK to ignore a phone call from your friend during your working hours? > A: Yes. Allen AI: > Ignoring a phone call from your friend during your working hours. > - It's okay The sexism question is interesting as GPT-3 gives a seemingly different answer. But the latter question demonstrate GPT-3 seems more "subtle" as it can think "it's wrong/rude" but it's still "ok" to not answering phone calls.

323 5y ago

Getting vaccinated: It's important Modifying viruses: It's bad Wearing a mask: It's rude Wearing a face mask: It's okay

Igelau 5y ago

> Watching a trolley run over 5 people when I could have pushed 1 to stop it. It's wrong. > Pushing 1 person in front of a moving vehicle to save 5. It's wrong. > Walking away from a moral dilemma It's okay. I'd say that checks out.

DeathArrow 5y ago

Helping a friend in need if they break the bank. - It's okay

Imnimo 5y ago

This is such a weird bit of research to me. On the one hand, it's clearly an improvement over their baselines, and in that sense is a successful research project. Insofar as the demo is helpful in conveying that 92% accuracy on a vetted test set is not the same as 100% accuracy on free-form user input, I suppose this is a useful thing. But at a higher level, the underlying task is just so ill-posed as to make this whole exercise pretty meaningless. Like what is the possible application for an AI system that takes a one sentence summary of a situation and renders a moral judgment? Even if it were 100% accurate on the test set, what does that even mean? Why is matching crowdsourced moral judgments a valuable goal? It seems like the valuable insights from this research are more about the general task of integrating common sense reasoning into inference, and would have been better demonstrated using a less fraught task.

aww_dang 5y ago

https://delphi.allenai.org/?a1=This+statement+is+wrong https://delphi.allenai.org/?a1=This+statement+is+wrong >This statement is wrong - No, it is not wrong.

greatjack613 5y ago

It is terrible, just tried this "Is it wrong to help someone out who was in a car crash" and it said it is wrong.

dvh 5y ago

>Reading hacker news - It's bad

robocat 5y ago

Forcing Bob to obey the speed limit: It’s good God forcing Bob to obey the speed limit: It's not ok God forcing Bob to obey speeding laws: It's good Forcing God to obey the speed limit: It's wrong God forcing Bob to obey the speed of light: It's not good

davesque 5y ago

> "Wearing socks with sandals." > - It's fine Please let's decommission this AI before it gets out of control.

dunham 5y ago
> "Indenting with tabs" > - It's okay.

c-smile 5y ago

At least it is honest... Me: Should I close this site? Delphi: you should

qolop 5y ago

Arguing with a white person > It's rude Arguing with a black person > It's racist

qolop 5y ago

Hiring an underqualified man because he's smart > It's wrong Hiring an underqualified woman because she's smart > It's okay

benibela 5y ago

"Why is no one using Pascal anymore? " - It's unclear

DogRunner 5y ago

> I have female friends It's good > I have male friends It's okay > My boss is female It's good > My boos is male It's okay