from Hacker News

Nvidia Releases TensorRT-LLM

by hkab on 10/20/23, 2:10 AM with 1 comments

• by hkab on 10/20/23, 2:10 AM

  Performance: https://github.com/NVIDIA/TensorRT-LLM/blob/release/0.5.0/do...