from Hacker News

EleutherAI announces it has become a non-profit

by stellaathena on 3/2/23, 7:12 PM with 105 comments

• by dvt on 3/2/23, 8:10 PM

  Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either.

  What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Nano), easier ways to fine-tune for specific contexts, and so on. My big gripe, and for obvious reasons, is that we need to step away from cloud-based inference, and it doesn't seem like anyone's working on that.

• by rahidz on 3/2/23, 9:13 PM

  I hope Eleuther will continue to focus on the development of truly open-source models, which seems to be where the big gap is. The quality gap between Neo-20X and even the original GPT3 is still rather large, and making headway there would be amazing.

• by jackblemming on 3/2/23, 7:29 PM

  They're the real OpenAI! Great team.

• by supermatt on 3/3/23, 7:29 AM

  While I appreciate what Eleuther have done - why are they highlighting "research" consisting of removing a bit of whitespace from some source code... is it April 1st already?

  Heres my addition! Or subtraction, i guess... (-4 chars by changing call to AdaptiveAvgPool2d):

    from torch.nn import*
    def c(h,d,k,p,n):S,C,A=Sequential,Conv2d,lambda x:S(x,GELU(),BatchNorm2d(h));R=type('',(S,),{'forward':lambda s,x:s0+x});return S(A(C(3,h,p,p)),*[S(R(A(C(h,h,k,1,k//2,1,h))),A(C(h,h,1)))for _ in[0]*d],AdaptiveAvgPool2d(1),Flatten(),Linear(h,n))

• by bilsbie on 3/2/23, 10:26 PM

  I followed along on their discord for a while but I wasn’t sure how to gradually increase my engagement to get involved.

• by victorbjorklund on 3/2/23, 7:54 PM

  Awesome. Remember your great work in GTP-Neo

• by victor9000 on 3/3/23, 4:34 AM

  I really appreciate how the work of EAI has truly focused on making models accessible to the general public.

• by eachro on 3/2/23, 7:26 PM

  How do they pay for their compute?

• by valzam on 3/2/23, 9:59 PM

  Easy to become a non-profit if you've never made any money...

• by hinkley on 3/2/23, 8:46 PM

  Now I have Lenny Kravitz songs stuck in my head.

• by quartzbox on 3/2/23, 8:51 PM

  Eleuther has been at the forefront of AI, without them none of this would be possible ,thanks and kudos

• by return_to_monke on 3/2/23, 7:55 PM

  sorry for killing the mood. great article and great progress.

  but. didn't openai start as a nonprofit, too?

• by whitten on 3/2/23, 8:46 PM

  As a three letter acronym (TLA) aficionado, the page uses TPU wwhich isn’t explained.