from Hacker News

zhye

joined 5/28/23, 11:26 PM has 3 karma

• Cascade Inference: Memory Bandwidth Efficient Shared Prefix Batch Decoding

  by zhye on 2/8/24, 2:02 PM, with 0 comments