From that link: Q. If a water bottle breaks and all the water comes out, how much water is left in the bottle, roughly? A. … Roughly half. … If the bottle is f

From that link: Q. If a water bottle breaks and all the water comes out, how much water is left in the bottle, roughly? A. … Roughly half. … If the bottle is full, there is no water left in the bottle. I wouldn’t describe this as GPT-3 “smashing” the questions. It’s still clearly subhuman. This sort of question, logical real-world reasoning embedded in a descriptive sentence, is still hard for it. It’s definitely improving on GPT-2 though.