4 ms·
If GPT is fed 99 text samples claiming that sky is red, and 1 sample that sky is blue, GPT will happily tell that sky is red. A reasoning model would be able to
by akomtu 3y ago
If GPT is fed 99 text samples claiming that sky is red, and 1 sample that sky is blue, GPT will happily tell that sky is red. A reasoning model would be able to spot the bogus data. However most people hardly use reasoning skills at all: just like GPT, they parrot what they've heard.
- burnished 3y agoHow would a 'reasoning model' do anything but report a red sky? The color of the sky isn't something you reason, it's something you observe. Any creature capable of generalizing and reporting would likely tell you that the sky is typically red given that information
- brabel 3y ago> A reasoning model would be able to spot the bogus data. You're basically trying to say that an AI model should know what "sky" means and what color it is without getting that information from the data... which is like... not how it works!! Where exactly do you expect the AI to know that from?? The data is all there is for the AI.
- nerevarthelame 3y ago>However most people hardly use reasoning skills at all: just like GPT, they parrot what they've heard. If your test for being able to reason disqualifies most humans, you may want to reevaluate that test.