3 ms·
Isn't that exactly how attention based neural networks work?
by ImHereToVote 3y ago
Isn't that exactly how attention based neural networks work?
- nyrikki 3y agoAttention is probably most easily conceptualized as run time reweighting. A powerful tool but it doesn't really change the underlying model it is just modifying the weights at runtime.