3 ms·Significantly. You start to see improvements at 1000 tokens.by htrp 3y agoSignificantly. You start to see improvements at 1000 tokens.