3 ms·
Well done! Besides immediate speed gains, I guess this opens the door to ultra-long contexts. Larger than say, 16M tokens.
by DrNosferatu 2y ago
Well done!
Besides immediate speed gains, I guess this opens the door to ultra-long contexts. Larger than say, 16M tokens.