3 ms·
interesting thank you. intuitively, prompting like this to get an answer seems basically like the first part of a fine tuning process (more exemplars). what i
by viksit 3y ago
interesting thank you.
intuitively, prompting like this to get an answer seems basically like the first part of a fine tuning process (more exemplars).
what is your thought here behind why reinforcing good output via a loss optimization is worse than the one shot example? does the model start to over fit at some point towards some local minima? and this is avoided in this scenario?
- minimaxir 3y agoPrompt engineering in general is necessary because LLMs optimize for the average output, and average output is not good. So LLMs need a slight nudge.