There's the nominal context length, and the effective one. You need a benchmark like the needle-in-a-haystack or RULER to determine the latter. https://github.

There's the nominal context length, and the effective one. You need a benchmark like the needle-in-a-haystack or RULER to determine the latter. https://github.com/NVIDIA/RULER https://github.com/NVIDIA/RULER