3 ms·4096 tokens is pretty short by today's standards for transformers too.by Eridrus 2y ago4096 tokens is pretty short by today's standards for transformers too.