3 ms·
Probably a silly question, but ...: if it's optimizing itself purely inside a simulator, what keeps it from just exploiting the simulator's glitches to look goo
by h2aichat 2mo ago
Probably a silly question, but ...: if it's optimizing itself purely inside a simulator, what keeps it from just exploiting the simulator's glitches to look good on paper, while not being so good when it hits the real world?
- kfallah15 2mo agoGreat question. You need the simulator to be realistic enough that the optimizer cannot reward hack, but it does not need to be perfectly realistic.
- SilenN 2mo ago^this There's two ways to functionally measure this, reconstruction fidelity (which we're able to get to 0.7 - 0.95), and downstream performance (which agrees on the best and worst models, but can sometimes disagrees on the middle of the pack routing).
- deleted 2mo ago[deleted]