4 ms·

I spend a good portion of my time creating / cleaning / structuring / feature engineering / running ml on data and I am extremely skeptical of automated ways of

I spend a good portion of my time creating / cleaning / structuring / feature engineering / running ml on data and I am extremely skeptical of automated ways of doing that. Everything I have seen so far was so laughably besides the point. This whole process involves an extreme amount of judgment and tradeoffs and most importantly a lot of knowledge of the respective domain. I have seen so many people with no domain knowledge trying to run an "automated approache" and horribly fail.

antihipocrat 5y ago
My job also involves a lot of time cleaning and structuring data, and I agree. I've been able to automate some parts of a cleaning/transforming process within the same domain but it would be very rare for that same process to be applicable to another domain without modification (and extensive consultation with the subject experts).