This is sometimes the case in computer search algorithms as well -- sometimes trying to minimize error or some heuristic of distance to the goal performs worse

This is sometimes the case in computer search algorithms as well -- sometimes trying to minimize error or some heuristic of distance to the goal performs worse than just searching for things that are 'different' from previous things you've found. My PhD work is on 'novelty search' which is an evolutionary search without a goal.