3 ms·

> Claude 3.5 says to just bring the goat across in the boat, which is wrong but better than previous versions. So that's an improvement. Sometimes it's funny t

> Claude 3.5 says to just bring the goat across in the boat, which is wrong but better than previous versions. So that's an improvement. Sometimes it's funny to me how we can have such a feeling the responses are so obviously wrong in some way but then don't even see it the same way between ourselves. Imagine someone strikes up a conversation with you saying they've got a truck & a sofa with them and they want to know how to get to Manhattan. You say "just drive the sofa over the bridge" and they say "Good, but wrong. I don't need the sofa to get to Manhattan". You'd probably say "okay... so what are you going to do with this sofa you said you had with you"? Of course, like you point out, LLMs sometimes take those associations a little to far and where your average person would say "Okay, they're saying they are with all of these things but probably because it's a list of what's around not a list of what they need to cross with" the LLMs are eager to answer in the form "Oh he's with all of these things? Alright - let's figure out how to use them all for them regardless of how odd it may be!".

ModernMech 2y ago
For me, the problem with LLMs is their infinite capacity to ad lib and improv; it feels like trying to solve real problems during a taping of "Whose Line is it Anyway?" Yeah of course it's not a realistic scenario for humans, but the LLM is not a human, it's a tool, and I expect it to have some sort of utility as a tool (repeatability, predictability, fit for purpose). If it can't be used as a tool, and it can't replace human-level inference, then it's worthless at best and antagonistic at worst. I started testing with the goat/boat prompt because it was obvious given the framing that the LLM was trying to pattern match against the logic problem involving a wolf. Really takes the magic out of it. Most people who hadn't heard the puzzle before would answer with straight up logic, and those who had heard of it would maybe be confused about the framing but wouldn't hallucinate an invisible wolf was part of the solution as so many LLMs do. To me this just highlights how I have to be an expert at the domain in which I'm prompting, because otherwise I can't be sure the LLM won't suggest I drown a ferret.

ModernMech 2y ago

For me, the problem with LLMs is their infinite capacity to ad lib and improv; it feels like trying to solve real problems during a taping of "Whose Line is it Anyway?" Yeah of course it's not a realistic scenario for humans, but the LLM is not a human, it's a tool, and I expect it to have some sort of utility as a tool (repeatability, predictability, fit for purpose). If it can't be used as a tool, and it can't replace human-level inference, then it's worthless at best and antagonistic at worst. I started testing with the goat/boat prompt because it was obvious given the framing that the LLM was trying to pattern match against the logic problem involving a wolf. Really takes the magic out of it. Most people who hadn't heard the puzzle before would answer with straight up logic, and those who had heard of it would maybe be confused about the framing but wouldn't hallucinate an invisible wolf was part of the solution as so many LLMs do. To me this just highlights how I have to be an expert at the domain in which I'm prompting, because otherwise I can't be sure the LLM won't suggest I drown a ferret.