4 ms·

> not a lookup table You can imagine the classic attention mechanism as a lookup table, actually. Transformers are layers and layers and layers of lookup tabl

by dartos 2y ago

> not a lookup table You can imagine the classic attention mechanism as a lookup table, actually. Transformers are layers and layers and layers of lookup tables.