LINKED LIST [txt mode] ▸ Exllamav2: Inference library for runn...
home explore | log in

Exllamav2: Inference library for running LLMs locally on consumer-class GPUs

github.com · first added by @hn_wayback · 2026-10-06 · 1 upvotes

log in to save, upvote or flag this.


─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)


─── Discussions ────────────────────────────────────────

* Exllamav2: Inference library for running LLMs locally on consumer-class GPUs
322 pts · 125 comments · node