The most interesting thing here is the kernel optimization graph. It look like all models were still improving, when they cut off the experiment. It reminds m

The most interesting thing here is the kernel optimization graph. It look like all models were still improving, when they cut off the experiment. It reminds me of a genetic algorithm. The graph is the same: long plateaus and then massive leaps. The only difference between the models seems to be how quickly they arrive.