3 ms·

The "easy" optimization targets I have mentioned (tokens/memory/etc.) seem to confuse you. Ignore them for the main point - how do you create good tests for a m

by generic92034 3y ago

The "easy" optimization targets I have mentioned (tokens/memory/etc.) seem to confuse you. Ignore them for the main point - how do you create good tests for a more advanced AI than you yourself are (or have control of)? For so many human fields of knowledge and ability it is already extremely hard to find meaningful tests to rank humans. No amount of letting an AI optimize on games with fixed and limited rules will automatically improve them on all the other abilities, which are not easily testable or even measurable. And that difficulty pertains for human intelligence trying to measure or test human intelligence. How much more difficult would it be for humans to measure or test super-human intelligence?

travisjungroth 3y ago
> how do you create good tests for a more advanced AI than you yourself are (or have control of)? I think I answered that. You use more resources to create it than answer it. When creating it, you can have a team take lots of time, use all sorts of tools, etc. When taking it, you constrain time and tools. That’s the general pattern of how to make a question harder than you can answer. There are also lots of trapdoor questions, especially in math. An overly simple example is factoring numbers.
- generic92034 3y ago
  I think that can only work with very small, incremental steps in intelligence, though. Will a ten year old human be able to create a meaningful test for an adult with high intelligence? No matter the resources you give the young one, they usually will not be able to. There also might be thresholds, barriers, were small increments in intelligence are not possible. But that is speculative, I will admit.
  - travisjungroth 3y ago
    You don’t need big jumps. You have the previous version write the test for the next. I’m not saying I’ve solved the path to AGI or anything. It’s just that this specific issue of “making a test harder than you can solve” has an answer.

travisjungroth 3y ago

> how do you create good tests for a more advanced AI than you yourself are (or have control of)? I think I answered that. You use more resources to create it than answer it. When creating it, you can have a team take lots of time, use all sorts of tools, etc. When taking it, you constrain time and tools. That’s the general pattern of how to make a question harder than you can answer. There are also lots of trapdoor questions, especially in math. An overly simple example is factoring numbers.

generic92034 3y ago
I think that can only work with very small, incremental steps in intelligence, though. Will a ten year old human be able to create a meaningful test for an adult with high intelligence? No matter the resources you give the young one, they usually will not be able to. There also might be thresholds, barriers, were small increments in intelligence are not possible. But that is speculative, I will admit.
- travisjungroth 3y ago
  You don’t need big jumps. You have the previous version write the test for the next. I’m not saying I’ve solved the path to AGI or anything. It’s just that this specific issue of “making a test harder than you can solve” has an answer.