3 ms·
If you really want to go full logician on this, even the format in which you're asked the question should make (a) being the correct answer clear. You're being
by BoorishBears 3y ago
If you really want to go full logician on this, even the format in which you're asked the question should make (a) being the correct answer clear.
You're being asked a multiple choice question:
- There's an implication of intended vagueness/indirection and multiple possibly suitable answers.
- Textual entailment is a very common type of multiple choice format, which would lean towards a more plain semantic correlation
- kybernetikos 3y agoIndeed, I pattern matched (a) as the correct answer too, but on reflection on the content of the words and what it would all actually mean, I think that (a) is a bad answer. If we aren't careful we'll train our AIs to be good at giving incorrect, pat answers to inadequately thought out questions.
- BoorishBears 3y agoTraining an LLM on a ton of multiple choice questions doesn't "infect it" like you're thinking. The tokens capture the fact it's a multiple choice question, and the LLM eventually captures the nuance of textual entailment as a common form of multiple choice question. In a more natural conversational setting, you'd get a different answer: https://chat.openai.com/share/00fed9d6-e3de-4319-9c76-ae180095a68a https://chat.openai.com/share/00fed9d6-e3de-4319-9c76-ae1800... https://chat.openai.com/share/dc9a796c-870c-44ee-b421-31c24b3ff2cf https://chat.openai.com/share/dc9a796c-870c-44ee-b421-31c24b...