from Hacker News

WebGPU in Chrome Canary now supports float16 for faster local LLM inference

by NiekvdMaas on 9/5/23, 4:29 AM with 5 comments

• by no_time on 9/5/23, 6:55 AM

  I hope they gate webGPU behind a per domain allow/deny notification like they do with location and camera access.

  This whole thing is just begging to be exploited by cryptominers.

• by NiekvdMaas on 9/5/23, 4:31 AM

  To test, run Chrome Canary with:

    --enable-dawn-features=allow_unsafe_apis,disable_robustness
  

  Then, open: https://webllm.mlc.ai/#chat-demo