3 ms·

I'm ok with a mistake on the first try, what would really impress me if it could tell whether it made a mistake. In my experience GPT is tuned to be totally def

I'm ok with a mistake on the first try, what would really impress me if it could tell whether it made a mistake. In my experience GPT is tuned to be totally deferential, "you're right, i apologize, let me try again!", no spine to tell me "yeah the task looks good" it has no sense of whether a task has been fulfilled I've never seen any of the recursive models show convergence on a task, seems without a human hand they fall apart An exception I've seen is with the Wolfram plugin, it seems to at least try different approaches until it arrives at an answer to present to you.

IanCal 3y ago
> it has no sense of whether a task has been fulfilled I've definitely seen it say it's implementation is fine if just asked to identify problems or compare to the original problem statement (and alternatively fix issues it identifies).
capableweb 3y ago
> In my experience GPT is tuned to be totally deferential, "you're right, i apologize, let me try again!", no spine to tell me "yeah the task looks good" I've managed to work around this in GPT (4 at least) by having a system prompt that forces GPT to challenge me and not blindly accept what I say without verifying it first.
circuit10 3y ago
> In my experience GPT is tuned to be totally deferential, "you're right, i apologize, let me try again!", no spine to tell me "yeah the task looks good" This is definitely annoying, but considering their tendency to hallucinate facts it's usually preferable to something like this: https://scoop.upworthy.com/microsoft-chatbot-fights-with-human-user-608623 https://scoop.upworthy.com/microsoft-chatbot-fights-with-hum... But I do think it should be toned down a bit, especially if the user is just saying something like "are you sure that's right?"