3 ms·

Thank you. If you don't mind... > tweaking its parameters to more likely say the correct thing next time. Is this entirely, or just partially done via human f

Thank you. If you don't mind... > tweaking its parameters to more likely say the correct thing next time. Is this entirely, or just partially done via human feedback on models like GPT-4 and LLama-3, for example?

hirako2000 3y ago
Look into agent training.
a_wild_dandan 3y ago
Training is done by partially hiding (masking) text and making a (decoder-only) model predict what's missing. Training text which humans prefer as model responses is called RLHF. It's an expensive and small text dataset.