3 ms·
Azure AI Foundry says: How was the model trained? The gpt-oss models were pretrained primarily using synthetic data along with some heavily filtered real code.
by rynn 1y ago
Azure AI Foundry says:
How was the model trained?
The gpt-oss models were pretrained primarily using synthetic data along with some heavily filtered real code. The models were then post-trained using distillation (RLKD against o3/hailmary) and berry. For more details about the model training process, please refer to the documentation.
Meaning the author was spot on.