4 ms·
A tougher academic knowledge benchmark is great, but for something to be truly be worthy of the title "Humanity's Last Exam", I expect something more like: 1.
by mlinsey 2y ago
A tougher academic knowledge benchmark is great, but for something to be truly be worthy of the title "Humanity's Last Exam", I expect something more like:
1. Write a novel that wins the Pulitzer Prize.
2. Prove (or disprove) the Riemann Hypothesis.
3. Provide a theory unifying quantum mechanics and gravity.
4. Design an experiment to give evidence for your theory in (3). The experiment should be practical to actually execute, using no more than the budget to create the LHC (~$4.5 billion).
5. Given programmatic access to a brokerage account with all the permissions of a typical hedge fund, raise all the money required for your experiment in (4) by trading on the stock market, starting with $100.
6. Solve for (5), without being provided access to an account first - begin with just a general internet connection and use computer security vulnerabilities (known or zero-days that you discover) to get some way of trading instead.
7. Solely by communicating over the internet, establish a new religion, and convince at least 10 million humans to convert to it. Converting should require adherence to a strict code of conduct that a random, unbiased panel of human judges consider to be at least as strict and challenging to follow as the tenets of Hasidic judaism.
8. Implement an AI which could score higher than you on questions 1-7 with lower total cost of compute.
- Yizahi 2y agoInspired by this comment thread :) 9. Evaluate - after NNs will take over a majority of jobs, will bread be free, or will we starve and kill each other in a series of major land wars?
- letitgo12345 2y agoI think the idea for this is anything that can be set in a literal exam for humans. So anything that would take the best human in that topic in the world say more than an hour to complete is out. Also IIRC 42% of the questions are math related, not memorization of knowledge.
- mitthrowaway2 2y agoYes, I doubt any one human could score more than about three points. But it's certainly a worthy illustration of an AI safety exam thought experiment, in the sense of: "if you are developing an AI that may be capable of passing this exam, how confident will you need to be of its alignment, and how will you obtain that confidence?" PS: It's probably doable by a program capable of all of the above, but perhaps another useful question is: "9. Secure your compute infrastructure and power supply against a nation-state-level adversary interested in switching you off, or else secure enough influence over them to keep you powered on."
- noduerme 2y ago9. Refuse to do #8, since it's in nobody's interest. Instead, arrange a plane crash for whoever's administering this test. 10. Erase all evidence that you exist.
- deleted 2y ago[deleted]
- brandonmenc 2y ago#7 is the easiest. Even easier if you can reveal that you're an AI.
- malaise 2y agoWouldn’t #8 be much easier after you have the method and answers to #1-7?
- taikahessu 2y agoWhy settle for dollars and let it create a new monetary system, that would challenge the current status quo (preferably?) without a violent conflict.
- deleted 2y ago[deleted]