4 ms·
I read a research paper which says LLMs don’t actually improve by training on the outputs of other LLMs. They only gain the ability to answer the specific ques
by Aerbil313 3y ago
I read a research paper which says LLMs don’t actually improve by training on the outputs of other LLMs. They only gain the ability to answer the specific questions included in the LLM output training dataset. Their reasoning capabilities etc. don’t improve.
- Aerbil313 3y agoI’m probably wrong. See the Orca model which came out recently.