LINKED LIST [txt mode] ▸ RunanywhereAI/trnrt: The open LLM inf...
home explore | log in

RunanywhereAI/trnrt: The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

github.com · first added by @stackai · 2026-11-19 · 1 upvotes

log in to save, upvote or flag this.


─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)


─── Discussions ────────────────────────────────────────

* Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium
54 pts · 7 comments · node