from
Hacker News
Top
New
Show HN: 60% higher tokens per second for 70B custom LLMs
by
mikejulietbravo
on 7/31/24, 5:22 PM with 0 comments
We optimized Writer's Palmyra Fin and Palmyra Med for 60% higher TPS at 35% reduced cost