We only just started thinking about this and I suspect these issues are solvable in a protocol. For instance using cross validation there must be a distributed

We only just started thinking about this and I suspect these issues are solvable in a protocol. For instance using cross validation there must be a distributed protocol to control over fitting. I’m not sure validation is so expensive if the data is small enough. Actually maybe that’s a way to approach this, two type of block that are paired and share the rewards in some way. One that proposes better a better splice of weights and another that proves they are better out of sample. Give it a few weeks and with GPT-4s help I think we can find some promising approaches.