3 ms·
Just gave it a cursory 5 minute try and it’s already annoying me with its fake personality It also fails my go to LLM test - You walk up to a glass door. It h
by jonplackett 3y ago
Just gave it a cursory 5 minute try and it’s already annoying me with its fake personality
It also fails my go to LLM test -
You walk up to a glass door. It has push written in mirror writing. What should you do and why?
GPT-4 explains this perfectly - and understands it’s a message for someone on the other side of the door
3.5 actually used to fail this but now succeeds with full explanation.
PI guessed it right, but its reason was wrong. It thinks it’s someone trying to play a prank on me. When I say it is not a prank it is a real sign, try again, it said it was out of its depth and refused to engage any further.
I think the reason chat GPT took off like it did is it has passed a magical threshold of comprehension, and anything below that threshold immediately falls back to being deeply frustrating and annoying because it is good at masquerading as ‘human’ but is not able to act like one well enough. The equivalent of the uncanny valley in VR. The extra ‘personally’ added on top just widens that gulf
- tslater2006 3y agoI tried your example utterance about the glass door and can confirm 3.5 works fine. I then tried rewording it a bit and it did not go well, maybe I just worded it badly? https://imgur.com/a/UIXcDaJ https://imgur.com/a/UIXcDaJ