from Hacker News

Matryoshka Quantization

by qianli_cs on 2/12/25, 7:45 AM with 1 comments

  • by bryukh on 2/12/25, 7:50 AM

    How does this compare to just training separate quantized models? Is it actually easier in practice?