I personally love the topic of bayesian optimization over all the possible parameters including model choice. My point was more about given the resource is alwa

I personally love the topic of bayesian optimization over all the possible parameters including model choice. My point was more about given the resource is always constrained, it typically pays off long term for practitioners to analyze the data, understand the underlying mechanics before jumping into modeling.