3 ms·Unlock Massive Context Windows: Positional embeddings are just training wheels1 points by bigwheels 9mo agobigwheels 9mo agoref: https://x.com/hardmaru/status/2010565943269999091 https://x.com/hardmaru/status/2010565943269999091sjkoelle 9mo agoWould this generate the same completion for 'the cat sat on the' as 'on the cat sat the'?