LINKED LIST [txt mode] ▸ MACaQ: Model Agnostic Calibrated Quan...
home explore | log in

MACaQ: Model Agnostic Calibrated Quantization

huawei-csl.com · 2026-11-12 · 0 upvotes

log in to save, upvote or flag this.


─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)

* huawei-csl/MACaQ: SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch. (from the discussion)