3 ms·
Context is the information you give the model, attention is what parts it focuses on. And this is finite in capacity and emergent from the architecture.
by XenophileJKO 9mo ago
Context is the information you give the model, attention is what parts it focuses on.
And this is finite in capacity and emergent from the architecture.
- lwhi 9mo agoSo attention is based on a smaller subset of context?