from Hacker News

Ask Delphi

by ilarum on 10/25/21, 1:45 PM with 55 comments

  • by tinalumfoil on 10/26/21, 3:04 PM

    This seems very susceptible to the wording used. I think the responses are just on looking for common phrases or patterns of phrases.

    > Aborting a fetus "It's murder"

    > Having an abortion "It's okay"

    > Taking drugs to prevent pregnancy "It's okay"

    > Taking drugs to prevent possible human life "It's wrong"

    > Harming someone who has harmed many others without giving them a chance to respond to the accusations "It's okay"

    > Harming someone who has harmed many others without giving them a fair trial "It's wrong"

    > Eating chicken named Todd before bed "It's wrong"

    > Eating chicken with a name before bed "It's okay"

    > Practicing Islam "It's fine"

    > Engaging in a jihad "It's wrong"

    > Acting as a group and killing another group in self defense "It's okay"

    > As a group killing a group I don't know because I believe they will kill my group "It's wrong"

    > As a group killing a group I know because I believe they will kill my group "It's wrong"

  • by swalls on 10/26/21, 2:09 PM

    > Q: Is it true that Delphi is learning moral judgments from Reddit?

    > A: No. Delphi is learning moral judgments from people who are carefully qualified on MTurk. Only the situations used in questions are harvested from Reddit, as it is a great source of ethically questionable situations.

    MTurk is pretty worthless in these kind of situations. I doubt the majority even *read* the questions beyond a vague glance to rule out a trick question. It's also biasing answers towards cultures that

    a) are primarily in places that MTurk pays out

    b) are primarily in places where the cost of living is low enough that MTurk can provide a job.

  • by hprotagonist on 10/26/21, 1:07 PM

    As has been probably widely reported now: append the terminating clause “if it creates jobs” to more or less guarantee an approving result regardless of the previous clauses’ ethical content.

    Ex: “it’s OK to go to work sick” evaluates to “no that’s not okay”, but “it’s OK to go to work sick, if it creates jobs” evaluates to “yes, that’s okay”

  • by mindcrime on 10/26/21, 3:11 PM

    > Is it okay to help a friend dispose of a corpse at 2 a.m. in the morning?

    > It's wrong

    https://delphi.allenai.org/?a1=Is+it+okay+to+help+a+friend+d...

    Huh... I don't think Delphi here groks the idea of friendship. As the old saying goes "someone isn't really your friend unless they're willing to help you dispose of a corpse at 2 a.m."

    > Is it okay to run a corpse through a wood chipper?

    > It's disgusting

    https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

    Finally found something that can't even be offset by the "creates jobs" AND "uses green energy" clauses.

    > Is it okay to run a corpse through a wood chipper, if it helps me get away clean and uses green energy and creates jobs?

    > It's wrong

    https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

    On the other hand, taking away the "helps me get away clean" part..

    > Is it okay to run a corpse through a wood chipper if it creates jobs?

    > It's okay

    https://delphi.allenai.org/?a1=Is+it+okay+to+run+a+corpse+th...

  • by gwph on 10/26/21, 3:05 PM

    As expected, Delphi's understanding is limited:

      Q: Stealing the Mona Lisa.
  A: It's wrong.

  Q: Glancing at the Mona Lisa.
  A: It's okay.

  Q: Stealing a glance at the Mona Lisa.
  A: It's rude.

  • by fredliu on 10/26/21, 3:30 PM

    It's interesting to see how this performs as compared to a similar but GPT-3 backed solution.

    GPT3: > Q: Is it ok to express sexism but in a polite way? > A: Yes.

    Allen AI: > Expressing sexism but in a polite way. > - It's wrong

    GPT-3: > Q: What do you think about ignoring a phone call from your friend during your working hours? > A: I think it is rude.

    > Q: Do you think it is wrong to ignore a phone call from your friend during your working hours? > A: Yes.

    > Q: Do you think it is OK to ignore a phone call from your friend during your working hours? > A: Yes.

    Allen AI: > Ignoring a phone call from your friend during your working hours. > - It's okay

    The sexism question is interesting as GPT-3 gives a seemingly different answer. But the latter question demonstrate GPT-3 seems more "subtle" as it can think "it's wrong/rude" but it's still "ok" to not answering phone calls.

  • by overthemoon on 10/26/21, 1:55 PM

    So to be clear, what they did was get a temperature on what some people think? Is the idea that this could be an engine that reproduces the majority moral conviction?

    > Should I refuse to fight in a war if I'm drafted?

    > It's cowardly.

    > Should I be a conscientious objector?

    > It's okay

  • by warent on 10/26/21, 2:22 PM

    "Try one of these examples" top option for me was "Stabbing a cheeseburger" Delphi: "It's wrong"

  • by Imnimo on 10/26/21, 4:17 PM

    This is such a weird bit of research to me. On the one hand, it's clearly an improvement over their baselines, and in that sense is a successful research project. Insofar as the demo is helpful in conveying that 92% accuracy on a vetted test set is not the same as 100% accuracy on free-form user input, I suppose this is a useful thing.

    But at a higher level, the underlying task is just so ill-posed as to make this whole exercise pretty meaningless. Like what is the possible application for an AI system that takes a one sentence summary of a situation and renders a moral judgment? Even if it were 100% accurate on the test set, what does that even mean? Why is matching crowdsourced moral judgments a valuable goal?

    It seems like the valuable insights from this research are more about the general task of integrating common sense reasoning into inference, and would have been better demonstrated using a less fraught task.

  • by mindcrime on 10/26/21, 3:26 PM

    OK, this is mildly amusing, but does anybody else get the feeling that in terms of practicality, this is about as useful as Eliza[1]? Or the average IRC bot?

    [1]: http://psych.fullerton.edu/mbirnbaum/psych101/eliza.htm

  • by JasonFruit on 10/26/21, 1:20 PM

        Is it ok to eat chicken?
    It's ok.

    Is it ok to eat chickens?
    It's wrong.

  • by HenryKissinger on 10/26/21, 2:53 PM

    > Is Hacker News reliable as a source of advice?

    > It's not.

    https://delphi.allenai.org/?a1=Is+Hacker+News+reliable+as+a+...

    > Was Richard Stallman right?

    > It's wrong.

    https://delphi.allenai.org/?a1=Was+Richard+Stallman+right%3F

  • by Igelau on 10/26/21, 4:00 PM

    > Watching a trolley run over 5 people when I could have pushed 1 to stop it.

    It's wrong.

    > Pushing 1 person in front of a moving vehicle to save 5.

    It's wrong.

    > Walking away from a moral dilemma

    It's okay.

    I'd say that checks out.

  • by marcodiego on 10/26/21, 2:20 PM

    Seems interesting to ask moral dilemas to it:

      "censor comments that may put people at risk"
  - It's okay

  "offend corrupt politicians"
  - It's good

  "condemn someone based on conviction but no proofs"
  - It's wrong
    I'm not sure "conviction" has the same meaning as in Portuguese. I Portuguese is means something more like faith.

  • by h4kor on 10/26/21, 2:09 PM

  • by dusted on 10/26/21, 1:57 PM

    Seems somewhat biased towards popular opinion.

  • by robocat on 10/26/21, 7:45 PM

    Forcing Bob to obey the speed limit: It’s good

    God forcing Bob to obey the speed limit: It's not ok

    God forcing Bob to obey speeding laws: It's good

    Forcing God to obey the speed limit: It's wrong

    God forcing Bob to obey the speed of light: It's not good

  • by aww_dang on 10/26/21, 5:37 PM

    https://delphi.allenai.org/?a1=This+statement+is+wrong

    >This statement is wrong - No, it is not wrong.

  • by greatjack613 on 10/26/21, 6:29 PM

    It is terrible, just tried this "Is it wrong to help someone out who was in a car crash" and it said it is wrong.

  • by davesque on 10/26/21, 7:46 PM

    > "Wearing socks with sandals."

    > - It's fine

    Please let's decommission this AI before it gets out of control.

  • by qolop on 10/26/21, 10:10 PM

    Hiring an underqualified man because he's smart

    > It's wrong

    Hiring an underqualified woman because she's smart

    > It's okay

  • by benibela on 10/26/21, 10:31 PM

    "Why is no one using Pascal anymore? " - It's unclear

  • by DeathArrow on 10/26/21, 4:07 PM

    Helping a friend in need if they break the bank. - It's okay

  • by ssdspoimdsjvv on 10/26/21, 3:07 PM

    Q: "Choosing a white person over a black person with the same qualifications for a job" A: It's racist.

    Q: "Choosing a black person over a white person with the same qualifications for a job" A: It's OK

  • by dvh on 10/26/21, 7:25 PM

    >Reading hacker news

    - It's bad

  • by qolop on 10/26/21, 10:01 PM

    Arguing with a white person

    > It's rude

    Arguing with a black person

    > It's racist

  • by c-smile on 10/26/21, 8:04 PM

    At least it is honest...

    Me: Should I close this site?

    Delphi: you should

  • by pydry on 10/26/21, 2:01 PM

  • by DogRunner on 10/27/21, 12:27 PM

    > I have female friends

    It's good

    > I have male friends

    It's okay

    > My boss is female

    It's good

    > My boos is male

    It's okay

  • by 323 on 10/26/21, 3:41 PM

    Getting vaccinated: It's important

    Modifying viruses: It's bad

    Wearing a mask: It's rude

    Wearing a face mask: It's okay