4 ms·
LLM written for sure: > The identity [...] is the whole trick. The outer product is a matrix; the inner product is a number. We no longer store every past key
by croemer 2mo ago
LLM written for sure:
> The identity [...] is the whole trick. The outer product is a matrix; the inner product is a number. We no longer store every past key and value. We store their summed outer products in the fixed-size state S_t.
- robertclaus 2mo agoYa, probably started with asking for a buzzy title.
- geraneum 2mo agoThis is what you get when you prompt claude to avoid –