4 ms·
> one can produce high quality training data with the LLM itself which the next iteration of that model can use. Rinse and repeat. it may be higher quality, b
by riku_iki 3y ago
> one can produce high quality training data with the LLM itself which the next iteration of that model can use. Rinse and repeat.
it may be higher quality, but far from perfection.
After many rinses and repeats dataset will accumulate significant amount of errors.
- Tostino 3y agoThat depends. You can implement an error checking algorithm with the LLM itself to check for drift in meaning and loss of original context from version to version as you improve your training dataset, as well as measure performance as you train new versions of your LLM on that dataset.