3 ms·
https://stats.stackexchange.com/questions/421935/what-exactly-are-keys-queries-and-values-in-attention-mechanisms https://stats.stackexchange.com/questions/4219
by pests 3y ago
https://stats.stackexchange.com/questions/421935/what-exactly-are-keys-queries-and-values-in-attention-mechanisms https://stats.stackexchange.com/questions/421935/what-exactl...
It mentions it comes from the original Attention Is All You Need paper and goes on into more detail.
It seems to be named exactly as you would expect. Key/Value as in KV store, with Query being the term being retrived.