3 ms·
I recently did a livestream on trying to understand attention mechanism (K, Q, V) in LLM. I think it went pretty well (was able to understand most of the logic
by paradite 1y ago
I recently did a livestream on trying to understand attention mechanism (K, Q, V) in LLM.
I think it went pretty well (was able to understand most of the logic and maths), and I touched on some of these terms.
https://youtube.com/live/vaJ5WRLZ0RE?feature=share https://youtube.com/live/vaJ5WRLZ0RE?feature=share