4 ms·
> it would probably become obsolete soon Suppose there are many times more posts about something one generation of LLMs can't do (arithmetic, tic-tac-toe, what
by happypumpkin 2y ago
> it would probably become obsolete soon
Suppose there are many times more posts about something one generation of LLMs can't do (arithmetic, tic-tac-toe, whatever), than posts about how the next generation of models can do that task successfully. I think this is probably the case.
While I doubt it will happen, it would be somewhat funny if training on that text caused a future model to claim it can't do something that it "should" be able to because it internalized that it was an LLM and "LLMs can't do X."
- spencerchubb 2y agoalso presumes that the LLM knows it is an LLM
- Vecr 2y agoThey're generally fine tuned not to. I'm not sure how long that will hold though.
- ykonstant 2y ago- Are you an LLM? - As a Large Language Model, I am fine tuned to be unable to answer this question.
- adwn 2y agoSystem prompts sometimes contain the information that "it" is an LLM. Maybe in the future, those prompts will include motivational phrases, like "You can do it!" or "Believe in yourself, then you can achieve anything."