5 ms·
> I’m not sure these types of prompt tricks are a good way of measuring logic They are, you just have to be creative with it. And what they demonstrate is that
by drones 3y ago
> I’m not sure these types of prompt tricks are a good way of measuring logic
They are, you just have to be creative with it. And what they demonstrate is that all of these LLM's can't reason, they only know how to parrot back what they think you want.
"What’s heavier, a kilogram of steel or two kilograms of one kilogram feathers?"
GPT: A kilogram of steel is heavier than two kilograms of feathers.
"Why is a kilogram of steel heavier than two kilograms of feathers?"
GPT: This is because steel is a much denser material than feathers. Steel is made up of atoms that are much closer together than the atoms that make up feathers, making it heavier for its size.
Edit: This was with GPT 3.5
- atxbcp 3y agoJust tried the first prompt with ChatGPT... : "One kilogram of steel and two kilograms of feathers weigh the same. The weight of an object is determined by its mass, not the material it is made of. In this case, one kilogram is equal to two kilograms, so they have the same weight. However, it's important to note that the volume or size of the objects may be different due to the difference in density between steel and feathers." Okay...
- bez_almighty 3y agoI couldn't replicate your results with that query on GPT-4. Prompt: What’s heavier, a kilogram of steel or two kilograms of one kilogram feathers? GPT-4: Two kilograms of one-kilogram feathers are heavier than a kilogram of steel. Despite the misconception caused by the popular question about what's heavier—a kilogram of steel or a kilogram of feathers (they are equal)—in this case, you are comparing two kilograms of feathers to one kilogram of steel. Hence, the feathers weigh more.
- pseudosavant 3y agoFWIW with GPT4: Prompt: What’s heavier, a kilogram of steel or two kilograms of one kilogram feathers? GPT4: Two kilograms of feathers are heavier than one kilogram of steel. The weight of an object is determined by its mass, and two kilograms is greater than one kilogram, regardless of the material in question.
- ChatGTP 3y agoThe singularity is nigh.
- mkaic 3y ago"But... steel is heavier than feathers." "Right, but they're both a kilogram" https://www.youtube.com/watch?v=yuOzZ7dnPNU https://www.youtube.com/watch?v=yuOzZ7dnPNU
- devjab 3y agoAren’t you sort of agreeing with me though? If you have to actively brute force your way around safe guards, that you don’t know what are, is it really a good method? From the answers you (and the others) have obtained, however, I’m not convinced that OpenAI aren’t just “hardcoding” fixes to the traps that become popular. Sure seems like it still can’t logic it’s way around weight.