From the official release page [1]: > We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 bil

From the official release page [1]: > We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI. > This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue. > We are releasing the weights and the architecture under the Apache 2.0 license. > To get started with using the model, follow the instructions at github.com/xai-org/grok. A little disappointing they are not releasing the weights for the Grok-1 finetuned model. [1] https://x.ai/blog/grok-os https://x.ai/blog/grok-os