3 ms·
My understanding is that they have a base model checkpoint for Behemoth from pre-training. This base model is not instruction-tuned so you can't use it like a
by paradite 2y ago
My understanding is that they have a base model checkpoint for Behemoth from pre-training.
This base model is not instruction-tuned so you can't use it like a normal instruction-tuned model for chatbots.
However, the base model can be distilled, and then the distilled model is post-trained to be instruction tuned, which can be released as a model for chatbots.