5 ms·
My favorite is “what weighs more, 1 lb of feathers or 2 lb of bricks?” almost every llm ive tried says “they weigh the same”
by rabbits_2002 3y ago
My favorite is “what weighs more, 1 lb of feathers or 2 lb of bricks?” almost every llm ive tried says “they weigh the same”
- ghayes 3y agoIt’s funny since it feels like an overfit solution (since the riddle is so common).
- ziixu 3y agoIndeed lol https://g.co/bard/share/cc604648a15f https://g.co/bard/share/cc604648a15f
- ozzydave 3y agoI just tried with ChatGPT 3.5 & 4, they both got the correct answer…
- rabbits_2002 3y ago3.5 used to fail every time, glad its working now
- szatkus 3y agoI did some re-adjustments and... https://imgur.com/a/0Ww2Uln https://imgur.com/a/0Ww2Uln
- Kerbonut 3y agoChatGPT-3.5 and 4 both got it right. Here’s Mixtral 8x7b’s answer: > The 18 lbs of bricks weigh more. The weight of an object is determined by its mass and the force of gravity acting upon it, regardless of the material it is made of. In this case, 18 lbs (pounds) is greater than 17 lbs, so the bricks weigh more than the feathers.
- edanm 3y agoInteresting, I just ran other numbers too and got: "26 lb of bricks weighs more than 25 lb of feathers. The weight is directly compared, and 26 lb is greater than 25 lb."
- petters 3y agoYes, questions like that are currently the best way to distinguish humans and machines. Common riddles or questions made trivial. A little more sophisticated and GPT-4 will also fail.
- vinni2 3y agoChatGPT4 answer: Two pounds of bricks weigh more than one pound of feathers. Weight is determined by the mass, and 2 pounds is greater than 1 pound, regardless of the materials being compared.