3 ms·
Indeed, I pattern matched (a) as the correct answer too, but on reflection on the content of the words and what it would all actually mean, I think that (a) is
by kybernetikos 3y ago
Indeed, I pattern matched (a) as the correct answer too, but on reflection on the content of the words and what it would all actually mean, I think that (a) is a bad answer. If we aren't careful we'll train our AIs to be good at giving incorrect, pat answers to inadequately thought out questions.
- BoorishBears 3y agoTraining an LLM on a ton of multiple choice questions doesn't "infect it" like you're thinking. The tokens capture the fact it's a multiple choice question, and the LLM eventually captures the nuance of textual entailment as a common form of multiple choice question. In a more natural conversational setting, you'd get a different answer: https://chat.openai.com/share/00fed9d6-e3de-4319-9c76-ae180095a68a https://chat.openai.com/share/00fed9d6-e3de-4319-9c76-ae1800... https://chat.openai.com/share/dc9a796c-870c-44ee-b421-31c24b3ff2cf https://chat.openai.com/share/dc9a796c-870c-44ee-b421-31c24b...