And I disagree with that. Tuning parameters and selecting features needs (a) understanding of the model(s) used and (b) an understanding of the data. 'Brute f

And I disagree with that. Tuning parameters and selecting features needs (a) understanding of the model(s) used and (b) an understanding of the data. 'Brute forcing' these steps can grow exponentially in time (eg. feature selection out of n features takes 2^n combinations) and makes your approach not only very inefficient but also doesn't predict if you have a good model. Your approach makes sensitivity analysis makes very very hard.