Theoretically it is nice. We did the same in the 80's for evolving small NN (less than 30 neurons) for controlling self sustaining simulated mobile robots. The

Theoretically it is nice. We did the same in the 80's for evolving small NN (less than 30 neurons) for controlling self sustaining simulated mobile robots. The problem is you have to keep eval relatively cheap, as you are going to need a lot of instances to test. If your eval is loading a large SOTA LLM and running SWE bench, this will become painfully slow and expensive. That said, I am a fan of a=live/GA like approaches, purely from a scientific interest pov.