7 ms·

While the answer landed on bats, ChatGPT kind of trips itself up in its explanations: 1. "Most winged creatures either have paws (like bats) or lay eggs (like

While the answer landed on bats, ChatGPT kind of trips itself up in its explanations: 1. "Most winged creatures either have paws (like bats) or lay eggs (like birds and insects)" - but bats don't have paws. 2. "However, if we consider the term "wings" more broadly" - why do we need to consider the term "wings" more broadly? Nobody is arguing there is some definition of "wing" that would exclude bats. Bat wings evolved from largely the same structures that bird wings did. 3. "there are some species of bats that give live birth" - all species of bats give live birth - stating it like this makes it sound like there are some species of bats that lay eggs or something. 4. "...provided we interpret "wings" in a broad sense and "paws" in a strict sense." Again, no "broad" or "strict" senses are needed. Bats have wings and no paws. To be clear, I still think ChatGPT is amazing, but these kinds of things highlight some of the differences between LLMs and human cognition.

ordu 4y ago
> Bats have wings and no paws. Can hind limbs of bats be classified as paws? English is not my native language, so I'm just being curious.
- scheme271 4y ago
  No, not really. Paws kind of implies something that's fairly fleshy and soft and which bats don't have. Claws would be appropriate description of what bats have.
  - seanmcdirmid 4y ago
    I saw a huge bat in Ubud Bali who was definitely eating a peach with their paws. I guess they were closer to hands? But definitely not claws.
- ChatGTP 4y ago
  The real world is a squiggly place, with blurred lines...everything is on a spectrum.
williamcotton 4y ago
There's a sample-and-poll approach that I've used with factual question-and-answer based tools that can help with this kind of thing as well. First, you'll notice the added "work it out step by step" to encourage what is called chain-of-thought in the literature. Second, generate say, five responses from the LLM, then take all five responses and uses them in another prompt where you ask the LLM to reflect on all of the five responses, a process being called reflection. Then you take all of that, including the original prompts, and in another separate prompt ask it to figure out the best response, a process known as resolving. You could end it with another prompt to remove the step-by-step work and just return a succinct answer. Credit to https://www.youtube.com/watch?v=wVzuvf9D9BU https://www.youtube.com/watch?v=wVzuvf9D9BU
- QuadrupleA 4y ago
  Then, if that's not accurate, take that entire process and repeat that 5 times, looking for the most common answer.
  - jiggawatts 4y ago
    And then make sure to train GPT to help you trade stocks, because you’ll need those millions to pay your OpenAI bill.
    - williamcotton 4y ago
      Too true… I can’t think of a time prior to this where I was spending $200/month researching the use of a new tool.
    - washadjeffmad 4y ago
      Don't not do that, but also, a 30B with 70-80% of the reasoning of the latest GPT can be run on a home PC. Given that most people have computers and RAM is dirt cheap right now, I'm already maxing out all of my devices.
  - williamcotton 4y ago
    And 5 of those, and the best answer… But it does seem like a single call to an LLM is not the correct approach. I’ve gotten the best results from attempting to mirror how I would operate in response to a prompt. Much of this is colored by decades of philosophical readings, which in my case means a decent amount of analytical philosophy along with latter Wittgenstein and other post linguistic turn thinkers. So when I break things down, either in some kind of approach inspired by Frege, Wittgenstein or unadorned self-reflection, I can see that the unconscious mind seems to be doing something recursive before my conscious mind is ready to start fumbling over the word. It seems like an LLM is just part of a larger cognitive architecture that will use these metacognitive approaches. It’s also very obvious that mammalian brains are much more efficient than GPUs.
replygirl 4y ago
there are some google results suggesting bats have front paws, some using "paws" colloquially and some suggesting their pads can qualify as paws. these results are given authority because they show up in the ostensibly fact-based q&a section, which, in conflict with actual taxonomical literature, may be enough to indicate to gpt that it's necessary to define terms
- deleted 4y ago
  [deleted]
byyyy 4y ago
> but bats don't have paws. Bat paw: https://upload.wikimedia.org/wikipedia/commons/e/e1/Bat_in_a_Cave.jpg https://upload.wikimedia.org/wikipedia/commons/e/e1/Bat_in_a... ChatGPT was totally in tune with this concept. The appendage on the elbow of the wing can be a paw or not a paw but it certainly evolved from paws. The reasoning was spot on and amazingly nuanced.
- foobarbecue 4y ago
  What? No. You're rationalizing what is clearly an error. Truth still exists, and bats do not have paws, any more than humans do.
  - maxbond 4y ago
    (Add a grain of salt because I searched for about 15 minutes here.) Doing some digging, paws are "soft foot-like parts of a mammal, generally a quadruped, that has claws" (Wikipedia). Bats do appear to have claws, but not really with the same structure as a paw; they don't seem to be mounted above a soft, fleshy pad. Rather, they're at the top of the wing, sitting on bone. They're also very different in function, when I've had the fortune to see a bat they seemed to use the claw to climb in a similar way to how climbers use ice axes. My impression is that bat's claws are the anatomical equivalent of a thumb, not a hand/paw, and that the entire paw or hand of bat's ancestors evolved into their wings (sort of like if your fingers became very long and webbed and then you were able to fly with them). So, my conclusion is that no, the claws of a bat are not a paw. ETA: I neglected to consider their hind claws, but I don't think those are padded either. https://i.pinimg.com/originals/1e/8d/09/1e8d0923d5caf2dbab686b1b086f22b9.jpg https://i.pinimg.com/originals/1e/8d/09/1e8d0923d5caf2dbab68... That certainly has claws but I wouldn't describe that as being soft or as being similar to a paw. And they're pretty clearly made for hanging, climbing, and grasping prey/food, and not for walking.
    - byyyy 4y ago
      https://www.vocabulary.com/dictionary/paw https://www.vocabulary.com/dictionary/paw As long as it has claws according to vocabulary dot com it is a paw.
hammyhavoc 4y ago
I was sat here WTFing that some bat species laid eggs until I looked it up. This is why you can't trust the output.
diceduckmonk 4y ago
> "there are some species of bats that give live birth" - all species of bats give live birth ChatGPT is being more logical to be honest. It’s true, some species of bats give live birth. To assume all bats give live birth might be committing the fallacy of induction.
- HPsquared 4y ago
  Wiki: "Bats are mammals of the order Chiroptera" ... (funnily enough - chiro = hands, ptera = wings, hand-wings, makes sense) Chiroptera fits under Mammalia in the phylogenenetric tree.
  - gitrog 4y ago
    Just need to mention that Echidnas and Platypuses are also mammals and they lay eggs.
    - HPsquared 4y ago
      I should have said bats fit under "Placentalia" - placental mammals.
- foobarbecue 4y ago
  That's true -- some bats never have kids. They just have lots of hobbies and are very fulfilled.

ordu 4y ago

> Bats have wings and no paws. Can hind limbs of bats be classified as paws? English is not my native language, so I'm just being curious.

scheme271 4y ago
No, not really. Paws kind of implies something that's fairly fleshy and soft and which bats don't have. Claws would be appropriate description of what bats have.
- seanmcdirmid 4y ago
  I saw a huge bat in Ubud Bali who was definitely eating a peach with their paws. I guess they were closer to hands? But definitely not claws.
ChatGTP 4y ago
The real world is a squiggly place, with blurred lines...everything is on a spectrum.

williamcotton 4y ago

There's a sample-and-poll approach that I've used with factual question-and-answer based tools that can help with this kind of thing as well. First, you'll notice the added "work it out step by step" to encourage what is called chain-of-thought in the literature. Second, generate say, five responses from the LLM, then take all five responses and uses them in another prompt where you ask the LLM to reflect on all of the five responses, a process being called reflection. Then you take all of that, including the original prompts, and in another separate prompt ask it to figure out the best response, a process known as resolving. You could end it with another prompt to remove the step-by-step work and just return a succinct answer. Credit to https://www.youtube.com/watch?v=wVzuvf9D9BU https://www.youtube.com/watch?v=wVzuvf9D9BU

QuadrupleA 4y ago
Then, if that's not accurate, take that entire process and repeat that 5 times, looking for the most common answer.
- jiggawatts 4y ago
  And then make sure to train GPT to help you trade stocks, because you’ll need those millions to pay your OpenAI bill.
  - williamcotton 4y ago
    Too true… I can’t think of a time prior to this where I was spending $200/month researching the use of a new tool.
  - washadjeffmad 4y ago
    Don't not do that, but also, a 30B with 70-80% of the reasoning of the latest GPT can be run on a home PC. Given that most people have computers and RAM is dirt cheap right now, I'm already maxing out all of my devices.
- williamcotton 4y ago
  And 5 of those, and the best answer… But it does seem like a single call to an LLM is not the correct approach. I’ve gotten the best results from attempting to mirror how I would operate in response to a prompt. Much of this is colored by decades of philosophical readings, which in my case means a decent amount of analytical philosophy along with latter Wittgenstein and other post linguistic turn thinkers. So when I break things down, either in some kind of approach inspired by Frege, Wittgenstein or unadorned self-reflection, I can see that the unconscious mind seems to be doing something recursive before my conscious mind is ready to start fumbling over the word. It seems like an LLM is just part of a larger cognitive architecture that will use these metacognitive approaches. It’s also very obvious that mammalian brains are much more efficient than GPUs.

replygirl 4y ago

there are some google results suggesting bats have front paws, some using "paws" colloquially and some suggesting their pads can qualify as paws. these results are given authority because they show up in the ostensibly fact-based q&a section, which, in conflict with actual taxonomical literature, may be enough to indicate to gpt that it's necessary to define terms

deleted 4y ago
[deleted]

byyyy 4y ago

> but bats don't have paws. Bat paw: https://upload.wikimedia.org/wikipedia/commons/e/e1/Bat_in_a_Cave.jpg https://upload.wikimedia.org/wikipedia/commons/e/e1/Bat_in_a... ChatGPT was totally in tune with this concept. The appendage on the elbow of the wing can be a paw or not a paw but it certainly evolved from paws. The reasoning was spot on and amazingly nuanced.

foobarbecue 4y ago
What? No. You're rationalizing what is clearly an error. Truth still exists, and bats do not have paws, any more than humans do.
- maxbond 4y ago
  (Add a grain of salt because I searched for about 15 minutes here.) Doing some digging, paws are "soft foot-like parts of a mammal, generally a quadruped, that has claws" (Wikipedia). Bats do appear to have claws, but not really with the same structure as a paw; they don't seem to be mounted above a soft, fleshy pad. Rather, they're at the top of the wing, sitting on bone. They're also very different in function, when I've had the fortune to see a bat they seemed to use the claw to climb in a similar way to how climbers use ice axes. My impression is that bat's claws are the anatomical equivalent of a thumb, not a hand/paw, and that the entire paw or hand of bat's ancestors evolved into their wings (sort of like if your fingers became very long and webbed and then you were able to fly with them). So, my conclusion is that no, the claws of a bat are not a paw. ETA: I neglected to consider their hind claws, but I don't think those are padded either. https://i.pinimg.com/originals/1e/8d/09/1e8d0923d5caf2dbab686b1b086f22b9.jpg https://i.pinimg.com/originals/1e/8d/09/1e8d0923d5caf2dbab68... That certainly has claws but I wouldn't describe that as being soft or as being similar to a paw. And they're pretty clearly made for hanging, climbing, and grasping prey/food, and not for walking.
  - byyyy 4y ago
    https://www.vocabulary.com/dictionary/paw https://www.vocabulary.com/dictionary/paw As long as it has claws according to vocabulary dot com it is a paw.

hammyhavoc 4y ago

I was sat here WTFing that some bat species laid eggs until I looked it up. This is why you can't trust the output.

diceduckmonk 4y ago

> "there are some species of bats that give live birth" - all species of bats give live birth ChatGPT is being more logical to be honest. It’s true, some species of bats give live birth. To assume all bats give live birth might be committing the fallacy of induction.

HPsquared 4y ago
Wiki: "Bats are mammals of the order Chiroptera" ... (funnily enough - chiro = hands, ptera = wings, hand-wings, makes sense) Chiroptera fits under Mammalia in the phylogenenetric tree.
- gitrog 4y ago
  Just need to mention that Echidnas and Platypuses are also mammals and they lay eggs.
  - HPsquared 4y ago
    I should have said bats fit under "Placentalia" - placental mammals.
foobarbecue 4y ago
That's true -- some bats never have kids. They just have lots of hobbies and are very fulfilled.