from Hacker News

2nd Batch of the A16Z Open Source AI Grant

by rajko_rad on 12/13/23, 7:24 PM with 9 comments

• by dwrodri on 12/13/23, 9:51 PM

  Huge props to A16Z for supporting lucidrains' work! His prolific output was instrumental to my self-teaching process when learning about Transformers, as he probably has the largest collection of publicly available implementations of Transformer-related papers in PyTorch.

  I think a large amount of people who get interested in implementing deep learning papers end up referencing lucidrains' work.

• by reflectored on 12/13/23, 10:59 PM

  When my GPU is under strain, my monitor makes weird noises - and so it does on this page! And then I checked my GPU util, are they mining bitcoin or training models using my GPU? :)

  Volatile GPU-Util 43%

• by toppy on 12/13/23, 9:07 PM

  Is it only me or this webpage hangs on mobile?

• by boiler_up800 on 12/13/23, 9:32 PM

  I immediately thought of the Axolotl Tanks in Dune when I saw this list. Great name.

• by mi_lk on 12/14/23, 3:40 PM

  How much is the grant, it doesn't seem to be disclosed?

• by dontupvoteme on 12/13/23, 10:27 PM

  Very nice to see LLaVA there, IMO it's one of the last puzzle pieces for a proper open source infrastructure in AI (e.g. filtering/classification after something like artspew).

  A bit surprised about common crawl, is the financial cost there due to the massively bloated scale of the modern web they're (presumably) still trying to crawl?