GitHub - leonickson1/Swiftlet: Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

log in to save, upvote or flag this.

─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)