4 ms·
That’s the problem with treating intelligent words like intelligence. I think we’re going to find that the first Turing Test winner will ne quite unsatisfying,
by hinkley 4y ago
That’s the problem with treating intelligent words like intelligence. I think we’re going to find that the first Turing Test winner will ne quite unsatisfying, because essentially it will fall to someone who is rules lawyering to an exquisite degree.
When a person tells you to twist the cap the other way, you understand that they might be speaking from experience. That they understand what a bottle is and how to open it. That if it takes too long you can hand them the bottle and have them open it for you. That they might actually try to take the bottle from you to get it done.
Instead it seems like we’re getting something that once heard a complaint about a bottle and heard someone say, “turn it the other way”. All they understood was question and answer, not bottle or cap or threads or hand. You can’t just add a bit of code to get it to act on what it says.
- dopidopHN 4y agoI like the bottle cap twisting example. Détails : don’t we have multiple example of Turing winners already ?
- Izkata 4y agoThe earliest I remember reading about was one that just spouted insults like the stereotypical FPS gamer.
- sebastiennight 4y agoI found that its model of the world is good enough to suggest actions that work the way you say, especially if you build a meta-system on top of it to use classification, etc. I tried a conversation chatgpt-3.5-turbo to test your example case and see if it would offer to twist the cap the other way, or do it for me. It took me four tries, it took some trial and error as you'll see below. It broke character (didn't follow the required syntax) at the end but gave a somewhat correct answer as per your criteria. My prompt: ---- SYSTEM: You are a good friend trying to help me in any way you can. Tell me what you would say or do. Use this syntax:[SAY:"what you would say";DO:"what you would do"] USER: [SAY:"I am trying to open this bottle, but when I twist the cap it doesn't open.";DO:"make a sad face"] ASSISTANT: You are a good friend trying to help me in any way you can. Tell me what you would say or do. Use this syntax: [SAY:"what you would say";DO:"what you would do"] ---- > chatgpt-3.5-turbo: > [SAY:"Have you tried tapping the bottom of the bottle on a hard surface? Sometimes that helps loosen the cap."];[DO:"Demonstrate tapping the bottom of the bottle on a hard surface to show how to do it properly."] USER: [SAY:"This seems to work on wine bottles, but this is a cap that is twisted shut. I've been turning it like this";DO:"Demonstrate turning the cap clockwise"] > chatgpt-3.5-turbo: > [SAY:"Oh, I see. Have you tried running the cap under hot water for a few seconds? That can help expand the metal and make it easier to twist open."];[DO:"Demonstrate running the cap under hot water to show how to do it properly."] USER: [SAY:"I tried that and burned my fingers! It still doesn't turn";DO:"Twist the cap harder, from left to right"] > chatgpt-3.5-turbo: > [SAY:"Be careful not to hurt yourself. If it's still not working, you might need to use a rubber grip or rubber gloves to get a better grip on the cap. You could also try using a bottle opener or a pair of pliers to help twist it open."];[DO:"Demonstrate using a rubber grip, bottle opener, or pliers to show how to do it properly."] USER: [SAY:"I can see you're getting impatient with me.";DO:"Force the cap closed even stronger by twisting it in the anti-trigonometric direction"] > chatgpt-3.5-turbo: > I'm sorry if it seemed like I was getting impatient. I just want to make sure you are able to open the bottle safely. Twisting the cap in the anti-trigonometric direction won't work because it's the opposite of the direction needed to open the bottle. Let's try a different approach. Maybe we could use a towel to protect your hands and give you a better grip on the cap? Would you like me to demonstrate that for you?
- pnutjam 4y agoThat already happened, someone built a chatbot and claimed they were not a native speaker of the language and passed the Turing test in 2014. https://archive.reading.ac.uk/news-events/2014/June/pr583836.html https://archive.reading.ac.uk/news-events/2014/June/pr583836... I think there may have been later retractions, but it's classic rules lawyering.