No, this is not the first local model with a context length of greater than 128k, there have been such models, for example the following https://huggingface.co

No, this is not the first local model with a context length of greater than 128k, there have been such models, for example the following https://huggingface.co/ai21labs/AI21-Jamba-1.5-Mini https://huggingface.co/ai21labs/AI21-Jamba-1.5-Mini 256k https://huggingface.co/THUDM/glm-4-9b-chat-1m https://huggingface.co/THUDM/glm-4-9b-chat-1m 1M and many other's that supposedly extended traditional models via finetune/rope scaling