from Hacker News

  • Top
  • New

TPI-LLM: Serving 70B-Scale LLMs Efficiently on Low-Resource Edge Devices

by CrypticShift on 10/2/24, 3:41 PM with 0 comments