4 ms·
I misspoke. My question is whether the model was fine-tuned on multiple prompt/response pairs (with later prompts referencing earlier ones) or only on one-shot
by sterlind 4y ago
I misspoke. My question is whether the model was fine-tuned on multiple prompt/response pairs (with later prompts referencing earlier ones) or only on one-shot prompts. I expect fine-tuning on e.g.:
User: Pick an animal. Bot: Horse User: How many legs does it have? Bot: 4
to be different from just fine-tuning it on User: Pick an animal. Bot: Horse
Especially when it comes to e.g. training the bot to ask follow-up questions, etc.