from Hacker News

What A.I. Learned from the Internet

by Don_Patrick on 7/23/20, 10:41 AM with 6 comments

  • by kristerv on 7/24/20, 4:23 PM

    best paragraph is the last one:

    > When will AI researchers learn? There is a saying in computer science: “Garbage in, garbage out”. The most remarkable thing about these stories is that the biggest companies, IBM, Microsoft, Amazon, all chose the worst corners of the internet as teaching material. Places that are widely known as the bridges of trolls. One can scarcely believe such naivety, and yet they keep doing it. Perhaps they are only “experimenting”, but that does not ring true for commercial products. More likely their goals are only feasible with current AI by prioritising quantity over quality. Or perhaps these stories are not entirely accurate. After all, I only learned them from the internet.

  • by rwnspace on 7/24/20, 6:45 PM

    A straightforward point that comes to mind regards reusing the output of GPT-n as part of the training input to GPT-n+1: Andrej Karpathy recently tweeted about it in terms of pollution, which has wonderful connotations: https://twitter.com/karpathy/status/1284660899198820352
  • by grillvogel on 7/25/20, 12:13 AM

    reminds me of this rather horrifying article i read recently: https://www.rand.org/blog/2020/01/artificial-intelligence-an...
  • by visarga on 7/24/20, 2:48 PM

    cherrypicking to the finest