> I think the ability of these models to actually use these contexts beyond the standard 8k / 16k tokens is pretty weak. For 32k GPT4 contexts, that's not accu

> I think the ability of these models to actually use these contexts beyond the standard 8k / 16k tokens is pretty weak. For 32k GPT4 contexts, that's not accurate. GPT4 Turbo is a bit weaker than GPT4-32k, but not to the extent that you claim.