4 ms·GPT-3 actually does track the previous 2048 tokens of input and output for context.by shawnz 5y agoGPT-3 actually does track the previous 2048 tokens of input and output for context.