from Hacker News

MLC LLM: Universal LLM Deployment with GPU Acceleration

by crowwork on 4/29/23, 3:46 AM with 1 comments

• by crowwork on 4/29/23, 3:46 AM

  Supported platforms include:

  - Metal GPUs on iPhone and Intel/ARM MacBooks

  - AMD and NVIDIA GPUs via Vulkan on Windows and Linux

  - NVIDIA GPUs via CUDA on Windows and Linux

  - WebGPU on browsers (through companion project WebLLM).