3 ms·
> with AI-generated content excluded from pre-training. Though this is largely impossible these days, unless they pre-trained on pre-AI era data.
by zamalek 5mo ago
> with AI-generated content excluded from pre-training.
Though this is largely impossible these days, unless they pre-trained on pre-AI era data.
- stymaar 5mo agoThat could be. Just use pre-training for language understanding and let the post-training on synthetic data do the heavy lifting.