The whole problem is that you don't know where the "rules" came from in the first place, which means the thought-experiment doesn't reveal much about how to gen

The whole problem is that you don't know where the "rules" came from in the first place, which means the thought-experiment doesn't reveal much about how to generate fresh responses to novel situations.