14 ms·
ChatGPT passes MBA exam given by a Wharton professor
- cyanydeez 4y agoSays more about the MBA exam than anything else
- AustinDev 4y agoReading through the questions on the test I'm thinking about getting an MBA in my spare time this exam seems incredibly easy unless I'm missing something.
- refurb 4y agoNot really. There was a post a while back that ChatGPT passed the radiology exams. It’s not that impressive of a feat. It’s no different than just googling answers to an exam. Of course you’d do great.
- 8note 4y agoGood things about the exam, no less. If you couldn't answer it with chatgpt, you shouldn't expect an MBA course taker to answer it
- ghaff 4y agoIt doesn't seem like a terribly hard test. But that's as someone who has (quiet now) an MBA who did a 1:1 project for an operations management professor and graduated high in their class albeit a long time ago. So don't read a lot into my assessment. The Kanban answer I found especially interesting. The equivocation on the one answer is exactly the one I would have equivocated on. (Well, yes, that's the idea but it has to be done correctly.) I'd also observe that operations management/engineering is a lot closer to other types of engineering than things like organizational behavior are so writing this off as just an MBA thing is pretty complacent.
- labrador 4y ago> It doesn't seem like a terribly hard test. That was my reaction too. Donald J. Trump, a man not known for his intellect, also passed
- ghaff 4y agoOh. He passed this specific test? Otherwise keep your political side-eye off this site.
- labrador 4y agoFor all you know I'm a Trump supporter. It's well known that he's more street smart than book smart.
- deleted 4y ago[deleted]
- hobom 4y agoDonald Trump never attended an MBA program.
- labrador 4y agoI don't know what to believe anymore
- indymike 4y agoWe're seeing the death of the essay test.
- Enginerrrd 4y agoThat's like saying calculators will result in the death of the arithmetic test. Or that graphing calculators will result in the death of the algebra test.
- ilyt 4y agoNo, it is not. Calculator still needs operator knowledge, in this case if copy-pasting questions is enough then it doesn't and the test itself would have to change completely
- 8note 4y agoMy arithmetic tests were definitely things that could be written directly into a calculator
- honkler 4y agoits far easier to formulate maths questions, than it is to formulate non-math essay questions.
- b1ue64 4y agoChatGPT is being used as a generic keyword here, it's actually GPT3
- yieldcrv 4y agoits even worse, it is being used interchangeably in both the source articles and the research paper > Professor Christian Terwiesch, who authored the research paper "Would Chat GPT3 Get a Wharton MBA?... > https://mackinstitute.wharton.upenn.edu/2023/would-chat-gpt3-get-a-wharton-mba-new-white-paper-by-christian-terwiesch/ https://mackinstitute.wharton.upenn.edu/2023/would-chat-gpt3... They are just calling ChatGPT "Chat GPT3" and GPT3 as "GPT3". With an acknowledgement much later in the article that it is not ChatGPT being used in this paper.
- spullara 4y agoThey are allegedly the same though. The difference is only the prompt prefix: https://learnprompting.org/docs/applied_prompting/build_chatgpt https://learnprompting.org/docs/applied_prompting/build_chat... https://github.com/karfly/chatgpt_telegram_bot https://github.com/karfly/chatgpt_telegram_bot
- mikeyouse 4y agoThe actual research paper with the questions / ChatGPT answers: https://mackinstitute.wharton.upenn.edu/wp-content/uploads/2023/01/Christian-Terwiesch-Chat-GTP.pdf https://mackinstitute.wharton.upenn.edu/wp-content/uploads/2...
- cbrozefsky 4y agoThat first answer says the same thing in 4 different sentences and the author acts like that is excellently explained? So much willful suspension of disbelief.
- janalsncm 4y ago> Wow! Not only is the answer correct, but it is also superbly explained. The idea of the bottleneck as the rate limiting step was clearly understood and all calculations were carried out correctly. I don’t see any reasons to take points off from this answer: A+! I tend to agree. This is exposing a (perhaps universal) bias towards confidence, correct grammar, and a general encyclopedic tone. The trappings of a correct answer, rather than explanatory power and correctness. It’s a con artist.
- hyperhello 4y agoHow many of these “machine does something humans do” articles are we going to get? It says a lot about how we’ve discovered core concepts and streamlined learning that a machine can pass a test. Text is a wonderful medium for communication, and computers are finally somewhat up to it and it’s marvelous, but this is like producing solved sudokus — it doesn’t really create anything. ChatGPT isn’t an MBA any more than someone equipped with the answer key to the test is an MBA.
- humanistbot 4y agoAbsolutely. You can Google the MBA questions and get directed to tons of pages that contain passing answers.
- FormerBandmate 4y agoIIRC it got a 1300 on the SAT
- csande17 4y agoThat seems like the same situation -- it got 1300 on a practice test where a bunch of Internet sources discuss the exact questions and answers.
- deleted 4y ago[deleted]
- graeme 4y agoI tried feeding it an LSAT logic game which has multiple explanations on the internet. It got 2/5 correct, and for one answer it said “E, none of the above” E does not say none of the above on this logic game. Though many other different standardized tests do use E as none of the above. So it was pattern matching to that and not the text in front of it. And it wasn’t using explanations
- zone411 4y agoOh how quickly the goalposts shift... If the test was done correctly and there was no data leakage, this absolutely does not compare to someone equipped with the answer key.
- thenerdhead 4y agoI'm actually glad something is forcing the education system to think critically about change. When I enrolled in a MBA a few years ago, I was a glorified test taker being monitored by some random person overseas to prevent cheating. Even then, many people in my cohort cheated on their tests and it is pretty well known that MBAs cheat more than other degrees. I dropped out a year into it after learning nothing and seeing all those test answers on websites like Chegg while noticing that majority of the schools that offer an online MBA program all used the same curriculum/tests/answers and that nobody was actually teaching. I had a dream that I might learn from a business professor of the notoriety of Clayton Christensen or similar. I got a huge reality check instead. So if ChatGPT can interpret the answer from Chegg, then it is fair game to have earned that MBA.
- ghaff 4y agoThat sounds awful. Also absolutely different from my in-person experience a long time ago. Not sure to what degree a virtual experience can be made worthwhile.
- thatfrenchguy 4y agoI thought the point of the MBA is the connections you make along the way?
- majormajor 4y agoThere are two sorts of MBAs, as I understand it: One kind ticks a box at big organizations where promotion above a certain level strictly requires it. The other kind is for high-level networking, study, and development. If you want the latter, you have a pretty small pool of schools that you're interested in.
- mc32 4y agoWharton being among that small pool, as far as I understand it.
- 4y ago
- petilon 4y agoRelated: ChatGPT Passes U.S. Medical Licensing Exam: https://www.medpagetoday.com/special-reports/exclusives/102705 https://www.medpagetoday.com/special-reports/exclusives/1027...
- epicureanideal 4y ago[flagged]
- revskill 4y agoTry some leetcode question for interview ;)
- honkler 4y ago>implying the value of MBA is the grade transcript.
- lfmunoz4 4y ago[dead]
- deleted 4y ago[deleted]
- politician 4y agoGPT-assisted test-taking versus adversarial GPT-assisted test-making would be an interesting project.
- 8note 4y agoI don't think it would You'd get incomprehensible tests that humans couldn't succeed at
- janalsncm 4y agoAttention is All You Need. Was not just an esoteric comment about dot-product attention and transformers. It was a proclamation. With teeth. For decades the statistical language folks had to take it from the symbolic AI camp, which made pretty good progress for its time with expert systems. But symbolic systems also stumbled at seemingly trivial tasks, like parsing the following sentence: Time flies like a banana. It’s pretty clear to a human what this means, but for a computer it’s pretty hard. There’s nothing in the knowledge base about “time flies”, nor what this particular species eats. Once computers became powerful enough, statistical language modeling folks just ignored that entire issue and digested the whole internet. Strings that would start a lexical parser on fire, a GPT eats for breakfast. It’s an approach that seems to work pretty well for some things. But statistical language models aren’t the panacea. They have issues. They hallucinate. They bullshit. They lie with such charming bravado that they can con pretty much anyone not suspecting it. In my personal opinion, we won’t have a complete solution without burying the hatchet and marrying the two camps.
- sitkack 4y agoIt is almost like you need multiple competing minds to form a consensus and hold each other in check. I really enjoy watching LLMs bullshit, it is like they see a path to a goal and take it. http://www2.csudh.edu/ccauthen/576f12/frankfurt__harry_-_on_bullshit.pdf http://www2.csudh.edu/ccauthen/576f12/frankfurt__harry_-_on_...
- legostormtroopr 4y ago> Time flies like a banana. > It’s pretty clear to a human what this means. Is it though? The full quote is "Time flies like an arrow, fruit flies like a banana". The humour, being the nonsense that the first phrase sets you up with a metaphor, the secod is literal. "Time flies like a banana" means very little, because while "time flies" and "flies like bananas" make sense, as you said "time flies" aren't a thing and banana's can't fly. As a matter of fact, ChatGPT agrees and said '"Time flies like an arrow" is a common idiomatic expression meaning that time seems to pass quickly. The phrase "time flies like a banana" does not have any meaning or usage in the English language. It may be a play on words or a made-up phrase.'
- codeshav 4y agoI have used chat gpt. It is very useful. I am in college and I do coding only in python but most of the college internship/placement test does not accept python code. So, previously it was very difficult to me but now I can convert it into any desired language. The best things is happening in the world.
- threeseed 4y agoDon't cheat or take shortcuts early in your career. Deep and diverse technical understanding is what will make you last in this industry.
- codeshav 4y agoYeah, but it very difficult to understand any other language if you know python. I never used it to convert code in exam but I heard about this practice.
- osigurdson 4y agoI've known many MBAs over the years but yet to understand what they actually know vs those that do not have one. I think a person with a 4 year business degree likely has a more complete business education vs an MBA imo. The best business leaders are charismatic, great speakers and are able to inspire people. I'm not sure that these qualities are teachable but, to the extent they are, it seems that this is what should be taught in something like an MBA/executive school.
- sumanthvepa 4y agoOkay. As an MBA, I'll take a shot. First, remember an MBA is a terminal degree. It is usually preceded by other degrees. In my case I have a bachelors in computer engineering and an MS in computer science. Many of my colleagues had PhDs in a variety of subjects both in the social sciences and in the hard sciences, and usually had several years of work experience in their field. For example, I was developer at Amazon before I went to b-school. The MBA does not suddenly erase one's technical competence. Indeed, I've written far more code since I left b-school, than I wrote before it. Second, it is a misconception that an MBA makes you a leader. I know business schools try to make that association in their marketing materials, but that's not true. They try to prepare you for leadership roles, and some classes at some schools do indeed have specific classes on leadership. But they don't automatically qualify you as a leader. There are some hard skills that an MBA can give you. But whether you take advantage of the opportunity or not depends on your interest. For me it was a solid grasp of accounting and finance that I continue to use in my own business to this day. The class on negotiation strategies was absolutely invaluable to me. I've used that so many times to structure my negotiations to better effect. I have enjoyed exploring game theory in the context of strategy, although I haven't had an opportunity to apply it any real-world setting. Some of my classmates focused on operations, and others on more advanced finance -- it's a case of whatever interests you. There is very significant overlap between, what you learn in an MBA vs. an executive-MBA. But the most important difference is the usually the participants in an executive-MBA already have considerable leadership experience, and are looking less for basic leadership advice (e.g. how to negotiate) but more as an opportunity to fill in the gaps in foundational experience. Some may be missing operations or marketing experience, that to some extent an MBA compensate for. In the end the MBA is designed to help you become familiar with a variety of business functions in a modern corporation. The nature of the corporation itself is evolving, and so are the curricula of MBA courses. Get an MBA if you want to take time off to immerse yourself in an academic environment to really get the opportunity to think and learn about business. And the network you develop doesn't hurt either. It may not be immediately useful, but when you're in your 50s like me and are trying to bootstrap an idea, it's really useful to be able to ping the CEO of a hotshot startup, who was your classmate at school. (BTW that works even for your classmates from undergrad and high-school) Finally remember that MBAs are people. There is a very wide diversity amongst them. Like with any other profession. So the sample of people you experience may or may not be representative of the larger population. Hope that helps.
- allturtles 4y agoI'm always impressed by Chat GPT, but I didn't realize that the bar was this low at one of the top business schools in the country. The first four problems are arithmetic word problems. I think a smart middle-schooler could solve these. Questions 5-6 require some knowledge of queueing theory, question 7 requires you to have read the Wikipedia page on Kanban.
- BaRRaKID 4y agoBesides the AI being able to interpret the questions, which is the entire point of a language model, isn't this just the same as someone googling the answers to the exam?