3 ms·
I asked gpt4o to output some test questions for what I'm studying. Then I put one of the questions back into GPT to ask it to explain which of the 4 multi-choi
by the_real_cher 2y ago
I asked gpt4o to output some test questions for what I'm studying.
Then I put one of the questions back into GPT to ask it to explain which of the 4 multi-choice answers was correct.
GPT said the correct answer was answer C then output something completely different than any of the four options it gave me originally.
I find GPT very useful yet at the same time it has reliability issues to the point where I wouldn't trust it without another person to look at its output and verify on important issues.
I'm not really a machine learning scientist but this unreliability seems baked into the core of how it runs as it doesn't have 'human reason' it's just word location statistics.
Maybe reliability will happen in the future?? Ir maybe it will remain like a knowledge worker drill gun instead of a screwdriver and enhance people's work.
- danielbln 2y ago"Do a web search / run this on your code environment and vakidate your previous replies" works pretty well woth tool-enabled LLMs.
- the_real_cher 2y agoapparently not with trying to figure out how many R's are in the word strawberry.
- danielbln 2y agoWeb search no, code execution yes.