5 ms·
> Even when allowed to surf the web, ChatGPT gets it wrong: > Who was the eighth Federal Chancellor of the Federal Republic of Germany? - Gerhard Schröder Its
by dragonwriter 3y ago
> Even when allowed to surf the web, ChatGPT gets it wrong:
> Who was the eighth Federal Chancellor of the Federal Republic of Germany? - Gerhard Schröder
Its probably counting Walter Scheel, who was Acting Chancellor in 1974, and you are probably not.
When I asked ChatGPT to list the chancellors in order and identify the eighth, it listed eight ending in Schröder, with Scheel and his ten day Acting Chancellor tenure in May 74 as number 5. (Scheel’s tenure is in the timeline on the Wikipedia page you cite, though not in the numbered list in that page, which is why there is a dicontinuity in thr dates on the numbered list.)
- littlestymaar 3y agoIt's funny because you ascribe some reasoning in ChatGPT's answer “Gerhard Schröder”, but somehow missed that it's also able to give you two other answers that are unambiguously wrong…
- dragonwriter 3y ago> It's funny because you ascribe some reasoning in ChatGPT's answer “Gerhard Schröder”, but somehow missed that it's also able to give you two other answers that are unambiguously wrong Schröder is the only answer it gave when using functionality that would bring some representation if a list into its context first, and 10it did it with different prompts and mechanisms for bringing a list into its context. That LLMs are bad at counting-related tasks without doing that is well-known, and not a point I felt needed belaboring.
- postexitus 3y agoIf you think ChatGPT is "counting" anything, you have massively missed the point.
- RandomLensman 3y agoWalter Scheel was never Chancellor, he was fulfilling the duties of the Chancellor while being Foreign Minister, but he was not a Chancellor. So counting him is wrong.
- Kiro 3y agoImagine reading this comment thread a few years back. Just getting an answer to this question at all from a generic bot would be considered science-fiction and now we're dismissing it based on technicalities.
- RandomLensman 3y agoNot a technicality. It's like inventing a proper head of government that wasn't there. Also, knowing German chancellors was always easy, so that fact that a machine falls behind any normal dictionary or the German Chancellor's website is poor form. It's like a calculator getting basic addition wrong. I don't want a future full of poorly performing machines.
- Kiro 3y agoHe was acting Chancellor. It's like saying a red apple is not an apple. It's a technicality. The fact that we have a completely reasonable explanation to why GPT-4 includes him in the list and you guys still make it sound like the AI is a complete moron is just hilarious to me.
- RandomLensman 3y agoThere is no "Acting Chancellor", that is a poor translation of what the job is. There is only a Chancellor, not an "Acting Chancellor" - you have to trust that the Germans and their institutions kind of know who was Chancellor and who was not. The machine is a complete moron for not being able to get basic data from basic sources right.
- Kiro 3y ago> Scheel became acting Chancellor > Chancellor of Germany, Acting, 7 May 1974 – 16 May 1974 https://en.wikipedia.org/wiki/Walter_Scheel https://en.wikipedia.org/wiki/Walter_Scheel