LINKED LIST [txt mode] ▸ Attention Is Not What You Need
home explore | log in

Attention Is Not What You Need

arxiv.org · first added by @lenaw · 2026-11-05 · 1 upvotes

log in to save, upvote or flag this.


─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)


─── Discussions ────────────────────────────────────────

* Attention Is Not What You Need (2025)
197 pts · 72 comments · node
see all 2
* Attention Is Not What You Need
3 pts · 2 comments · node

─── From the discussion ────────────────────────────────

* You could have invented transformers from memory
alexwang.ai · node
* Scaling Laws for Neural Language Models
arxiv.org · node
* Mamba-3: Improved Sequence Modeling using State Space Principles
arxiv.org · node
* kanenorman/grassmann: Attempt at reproducing "Attention Is Not What You Need: Grassmann Flows as an Attention-Free Alternative for Sequence Modeling." (Zhang, C. 2025)
github.com · node