3 ms·
Does anyone have a good recommendation for explaining or as a primer on KV cache?
by tonetegeatinst 4mo ago
Does anyone have a good recommendation for explaining or as a primer on KV cache?
- plutomeetsyou 4mo agoconvert this question to KV cache and give it to your agent
- wren6991 4mo agoIf you want the actual maths instead of handwaving, I recommend: https://arxiv.org/abs/2207.09238 https://arxiv.org/abs/2207.09238 For something gentler, 3Blue1Brown: https://www.youtube.com/watch?v=eMlx5fFNoYc https://www.youtube.com/watch?v=eMlx5fFNoYc (this is part of a series)
- kolinko 4mo agojust read up on how transformers and attention works, and kvq mechanism in attention