by helloericsf on 6/20/24, 3:48 PM with 8 comments
by ssheng on 6/20/24, 4:04 PM
How does Exllama rank among these? Heard good things about it.
by ShawnBasquiat on 6/20/24, 4:05 PM
Why aren't there more of these benchmark studies? How did TGI make the cut?
by timliu9 on 6/20/24, 3:50 PM
Why was onnx not part of the tested runtimes? Seems like an oversight