PowerInfer: Fast LLM Inference on a Consumer-Grade GPU

 (github.com)

1 points | by oldfuture 1 hour ago

0 comments