3 ms·
You are right about this anti-pattern, but it's not the way most ML models are operated - especially in trading operations. The following principles are well k
by evrydayhustling 5y ago
You are right about this anti-pattern, but it's not the way most ML models are operated - especially in trading operations. The following principles are well known:
- enlist domain expertise
- validate incrementally
- expect adverse selection
- expect failures to generalise
Many, many production ML teams operate in this framework. The fact that Zillow either cut corners or hit a bigger snag suggests there is a more interesting story we haven't heard yet, not that they should have consulted OP or a few hn readers.
- ethbr0 5y agoTrading models are a very specific and exceptional (in multiple senses) subset of ML use. A given business probably doesn't employ more than a few people of that class and rigorousness: not least, because those people have the option of making a lot more money at a trading firm. So yes, all businesses should do all those things. And yes, the best run places do. But it feels like there's going to be a decade or two where employee supply & expertise lags corporate demand, with bad results.