2 ms·It really depends on what you think a reasonable context length is, but I can get 50k-60k on a 4090.by kkzz99 5mo agoIt really depends on what you think a reasonable context length is, but I can get 50k-60k on a 4090.