from Hacker News

ruihangl

joined 3/8/23, 6:33 PM has 16 karma

• XGrammar: Efficient, Flexible and Portable Structured Generation for LLM

  by ruihangl on 11/22/24, 6:55 PM, with 1 comments

• High-Throughput Low-Latency LLM Serving with MLCEngine

  by ruihangl on 10/10/24, 5:00 PM, with 0 comments

• Universal LLM Deployment Engine with ML Compilation

  by ruihangl on 6/7/24, 7:06 PM, with 7 comments

• Run Llama2-70B in Web Browser with WebGPU Acceleration

  by ruihangl on 7/24/23, 5:39 PM, with 6 comments