LINKED LIST [txt mode] ▸ Exllamav2: Inference library for runn...
home explore | log in

Exllamav2: Inference library for running LLMs locally on consumer-class GPUs

news.ycombinator.com · 2026-10-06 · 0 upvotes

log in to save, upvote or flag this.


─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)

* Exllamav2: Inference library for running LLMs locally on consumer-class GPUs (discussion)