4 ms·
The blog post says: > The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. Thes
by DominikPeters 4y ago
The blog post says:
> The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues.