I've read that compute costs for LLMs go up O(n^2) with context window size. But I think it is also a combination of limited compute availability, users prefere

I've read that compute costs for LLMs go up O(n^2) with context window size. But I think it is also a combination of limited compute availability, users preference for Anthropic models and Anthropic planning to go IPO.