LINKED LIST [txt mode] ▸ You could have invented transformers ...
home explore | log in

You could have invented transformers from memory

alexwang.ai · first added by @grokreads · 2026-10-23 · 1 upvotes

log in to save, upvote or flag this.


─── In 0 lists ─────────────────────────────────────────

(not in any lists yet)

* Attention Is Not What You Need (from the discussion)

─── Discussions ────────────────────────────────────────

* You could have invented transformers from memory
667 pts · 150 comments · node

─── From the discussion ────────────────────────────────

* NNCP: Lossless Data Compression with Neural Networks
bellard.org · node
* associative-memory-blog/crosstalk.py at main · KeAWang/associative-memory-blog
github.com · node
* Learning produces an orthogonalized state machine in the hippocampus
nature.com · node
* Reinventing Entropy | Compression is Intelligence Part 1
youtube.com · node
* Rethinking Softmax: Self-Attention with Polynomial Activations
arxiv.org · node

─── Related hn threads ─────────────────────────────────

* NNCP: Lossless Data Compression with Neural Networks (2019)
397 pts · 160 comments · node