from Hacker News

3T Token Open Corpus for Language Model Pretraining

by thatcherthorn on 8/18/23, 8:09 PM with 5 comments

• by version_five on 8/18/23, 9:02 PM

  This has some kind of stupid custom license with it that from what I can tell only lets you use models you train on it for "internal use" (or tries to, it's fair use so whatever) . It's getting really shitty to see everyone trying to control how people can use their "contributions" - if it was for commercial reasons I'd understand but it's all this silly "AI harms" garbage. Treat collaborators like adults and let them decide how they want to use ostensibly public domain stuff.

• by zwaps on 8/20/23, 8:31 AM

  According to the license, AllenAI can just take over (all) the rights and ownership for any derivative works by revoking your usage license, which they can also do at will.

  Reasonably speaking, nobody can use this dataset for anything of value. I really wonder who comes up with these "open-source" products with such licenses and why they even bother. I guess Marketing?

• by sunshadow on 8/19/23, 11:05 AM

  Unfortunately the license makes this somewhat useless. Hope they realize that and change it.

• by ttt3ts on 8/19/23, 2:54 PM

  Dumb license. Useless.