3 ms·
That's not true. There's a variety of reasons why outliers can exist, for example data quality issues where an experiment failed or the method to measure the da
by aquafox 4y ago
That's not true. There's a variety of reasons why outliers can exist, for example data quality issues where an experiment failed or the method to measure the data did not work. The approach presented there in my opinion has one big caveat: It tries to learn the cause of outliers from the data itself instead of incorporating domain knowledge! Having and using domain knowledge is time consuming and difficult, but nothing can replace it. One cannot automate away to critically explore and understand the data, although machine learning folks think they do.
- Retric 4y agoIf your population is sensor readings rather than actual objects then malfunctions should be completely expected behavior. Treating them as exceptional is simply a sign you don’t have enough data.
- kqr 4y agoThere's a difference between expected malfunctions (due to common causes) and exceptional malfunctions (due to assignable causes) though.