4 ms·
They likely didn't use (just) ChatGPT, but the GPT-3.5/GPT-4 API. Both can be used to create training data quite successfully. This technique has been used in
by selfhoster11 3y ago
They likely didn't use (just) ChatGPT, but the GPT-3.5/GPT-4 API.
Both can be used to create training data quite successfully. This technique has been used in the past to create synthetic post-training (fine tuning) datasets like Orca, Samantha, and so on.