from Hacker News

Show HN: Llama.go – port of llama.cpp to pure Go

by Ambix on 4/12/23, 5:42 PM with 5 comments

It's April 12 - The First Man in Space* Day - and I'm releasing #ML framework I've been building for the last month :)

It's written in #Go and allows #LLaMA #GPT inference having just regular PC - so no monster GPU cluster is needed to start experiment with:

https://github.com/gotzmann/llama.go

The V1 is using FP32 math only, but will work with AVX2 data types and INT8 quantisation soon.

* The first man in space was Yuri Gagarin from USSR

  • by ipaddr on 4/13/23, 6:06 PM

    Do we have a php version yet
  • by smcleod on 4/13/23, 12:59 PM

    "Pure Go" ... looks at repo - 16.9% python.
  • by tough on 4/13/23, 8:26 PM

    very cool, waiting for llama.rust any day now