from Hacker News

Llama3 Performance Cost Benchmark

by joss82 on 4/25/24, 4:38 PM with 1 comments

• by joss82 on 4/25/24, 4:38 PM

  I spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.