3 ms·

This looks very cool and is a massive improvement. If only OpenAI would also publish what they are doing to make 32K work.