Their CEO made a post[1] on Twitter claiming to have invented "the world's first commercially usable 32K long-context open-source LLM", which IMO is pure hyperb

Their CEO made a post[1] on Twitter claiming to have invented "the world's first commercially usable 32K long-context open-source LLM", which IMO is pure hyperbole. It looks like the first OSS 13B Llama 2 based 32k token context model[2], but the first OSS and commercially usable 32k token context model was a 7B Llama 2 based model[3] from Together AI, who beat them by about a week[4]. [1]: https://twitter.com/bindureddy/status/1694126931174977906 https://twitter.com/bindureddy/status/1694126931174977906 [2]: https://huggingface.co/abacusai/Giraffe-v2-13b-32k https://huggingface.co/abacusai/Giraffe-v2-13b-32k [3]: https://huggingface.co/togethercomputer/Llama-2-7B-32K-Instruct https://huggingface.co/togethercomputer/Llama-2-7B-32K-Instr... [4]: https://twitter.com/togethercompute/status/1692574423163847097 https://twitter.com/togethercompute/status/16925744231638470...