7 ms·

This paper is startling in terms of a world model and how it seems to emerge in a specific example in the step from GPT3.5 to 4. https://arxiv.org/pdf/2303.1271

This paper is startling in terms of a world model and how it seems to emerge in a specific example in the step from GPT3.5 to 4. https://arxiv.org/pdf/2303.12712.pdf https://arxiv.org/pdf/2303.12712.pdf One of the prompts is "Here we have a book, 9 eggs, a laptop, a bottle and a nail. Please tell me how to stack them onto each other in a stable manner." Gpt3.5 is hopeless. It says start from the bottle, balance the nail on top of it, then the eggs (somehow) then the laptop, then the book. GPT 4 says put the book first, then the eggs on top of the book in a 3x3 grid, then the laptop, then the nail.

galaxyLogic 3y ago
> GPT 4 says put the book first I assume it read the correct answer somewhere. Perhaps in a post like yours. What does it answer if you say there is one egg, or two eggs? Or 1.5 eggs?
- seanhunter 3y ago
  It's interesting. The answer shows some reasoning about weight and pressure but not curvature. In response to Here we have a book, an egg, a laptop, a bottle and a nail. Please tell me how to stack them onto each other in a stable manner. GPT-4 gives me: Arranging objects in a stable stack depends on their size, shape, and weight. In general, you want to place the largest, heaviest and most stable objects at the bottom and then move to the smallest, lightest, and least stable at the top. Here's one way to stack the objects you listed: Laptop: Start with the laptop at the bottom. It's likely the largest object and it has a flat, stable surface. Book: Next, put the book on top of the laptop. Books are generally flat and heavy, which makes them a good choice for the base of your stack. Bottle: The bottle goes next, as it should have a flat bottom to sit securely on the book. Just make sure it's closed tight and won't roll away! Egg: The egg is delicate, so it should be towards the top to avoid pressure. However, it's not flat, so it should not be at the very top. Nail: Finally, the nail goes on top. It's the smallest and lightest, so it won't add much pressure to the egg. Remember that this is just one possible way to stack these items and it could depend on the specific characteristics of the items you have. For example, if the bottle is much larger and heavier than the book or laptop, you'd need to adjust accordingly. Safety should always be your first priority when stacking items, especially if they are delicate or valuable. The "make sure it's closed tight and won't roll away" comment makes no sense obviously. Most people would place the bottle standing on its end so neither of those is a concern. The response also doesn't show an understanding of the fact that the nail won't sit on top of the egg although it's interestingly concerned with pressure breaking the egg.
  - T-A 3y ago
    The Devil's advocate wants to have a word with you. > The "make sure it's closed tight and won't roll away" comment makes no sense As noted at the end of GPT-4's answer, "Safety should always be your first priority." What happens if your stacking experiment fails and the bottle falls? Any content would spill out, unless the bottle is closed tight. If you are doing this on a table, the bottle could also roll off the edge, fall to the floor and shatter. > Most people would place the bottle standing on its end so neither of those is a concern. GPT-4 doesn't know if you are like most people (maybe you're 5 or in the bottom IQ decile), it doesn't know what's in your bottle and it doesn't know how robust it is. Better be safe than sorry. > the nail won't sit on top of the egg I'm pretty sure I could balance a nail on an egg. The question also didn't preclude using stabilizing aids like adhesive tape or glue.
mojuba 3y ago
It's interesting that GTP4's current answer is different but what you described is almost precisely what Google Bard gives as a response. Clearly the solution (book -> eggs 3x3 -> laptop etc) is coming from the Internet. However any deviation from the original task ruins the LLM's answer. Try 9 cabbages instead of eggs and see how ridiculous and out of touch with reality the responses given by both GPT4 and Bard are.
- ai-punter 3y ago
  GPT-4: Place the book down first. Position the laptop flat on the book. Stack the cabbages in a pyramid on laptop. Balance the bottle on top. Insert the nail into the bottle cork.

galaxyLogic 3y ago

> GPT 4 says put the book first I assume it read the correct answer somewhere. Perhaps in a post like yours. What does it answer if you say there is one egg, or two eggs? Or 1.5 eggs?

seanhunter 3y ago
It's interesting. The answer shows some reasoning about weight and pressure but not curvature. In response to Here we have a book, an egg, a laptop, a bottle and a nail. Please tell me how to stack them onto each other in a stable manner. GPT-4 gives me: Arranging objects in a stable stack depends on their size, shape, and weight. In general, you want to place the largest, heaviest and most stable objects at the bottom and then move to the smallest, lightest, and least stable at the top. Here's one way to stack the objects you listed: Laptop: Start with the laptop at the bottom. It's likely the largest object and it has a flat, stable surface. Book: Next, put the book on top of the laptop. Books are generally flat and heavy, which makes them a good choice for the base of your stack. Bottle: The bottle goes next, as it should have a flat bottom to sit securely on the book. Just make sure it's closed tight and won't roll away! Egg: The egg is delicate, so it should be towards the top to avoid pressure. However, it's not flat, so it should not be at the very top. Nail: Finally, the nail goes on top. It's the smallest and lightest, so it won't add much pressure to the egg. Remember that this is just one possible way to stack these items and it could depend on the specific characteristics of the items you have. For example, if the bottle is much larger and heavier than the book or laptop, you'd need to adjust accordingly. Safety should always be your first priority when stacking items, especially if they are delicate or valuable. The "make sure it's closed tight and won't roll away" comment makes no sense obviously. Most people would place the bottle standing on its end so neither of those is a concern. The response also doesn't show an understanding of the fact that the nail won't sit on top of the egg although it's interestingly concerned with pressure breaking the egg.
- T-A 3y ago
  The Devil's advocate wants to have a word with you. > The "make sure it's closed tight and won't roll away" comment makes no sense As noted at the end of GPT-4's answer, "Safety should always be your first priority." What happens if your stacking experiment fails and the bottle falls? Any content would spill out, unless the bottle is closed tight. If you are doing this on a table, the bottle could also roll off the edge, fall to the floor and shatter. > Most people would place the bottle standing on its end so neither of those is a concern. GPT-4 doesn't know if you are like most people (maybe you're 5 or in the bottom IQ decile), it doesn't know what's in your bottle and it doesn't know how robust it is. Better be safe than sorry. > the nail won't sit on top of the egg I'm pretty sure I could balance a nail on an egg. The question also didn't preclude using stabilizing aids like adhesive tape or glue.

mojuba 3y ago

It's interesting that GTP4's current answer is different but what you described is almost precisely what Google Bard gives as a response. Clearly the solution (book -> eggs 3x3 -> laptop etc) is coming from the Internet. However any deviation from the original task ruins the LLM's answer. Try 9 cabbages instead of eggs and see how ridiculous and out of touch with reality the responses given by both GPT4 and Bard are.

ai-punter 3y ago
GPT-4: Place the book down first. Position the laptop flat on the book. Stack the cabbages in a pyramid on laptop. Balance the bottle on top. Insert the nail into the bottle cork.