3 ms·
For decades, folks in the area of industrial quality control have used methods called "design of experiments" (DOE), that could be loosely described as fitting
by analog31 8y ago
For decades, folks in the area of industrial quality control have used methods called "design of experiments" (DOE), that could be loosely described as fitting minimalistic experimental data sets to arbitrary functions (typically low order multivariate Taylor polynomials).
The tools are usually packaged for use by people who don't have the math background to understand the underpinnings. In the results of DOE's, I've seen everything that is now generalized as the "replication crisis."
Everything I've learned about ML so far (granted not a huge amount) invokes DOE -- fitting data sets to arbitrary functions whose form is more flexible than a Taylor polynomial but otherwise cut from the same cloth.
I've seen exactly the same problem as with ML, but 30 years ago: It can help you optimize a process that you don't understand, turning it into a better process that you also don't understand. But it can't tell you how something works. DOE seems to be a microcosm of ML, with all of the pitfalls such as overfitting and underfitting.