There’s a big bias in industry towards weak baselines. Rigorous evaluation is both time consuming and unrewarding prone to conversations like “you mean we could

There’s a big bias in industry towards weak baselines. Rigorous evaluation is both time consuming and unrewarding prone to conversations like “you mean we could have just used off the shelf method X?!”. A consistent theme I’ve observed is that scientists who use weak baselines and data sets which are easy enough to reach 97%+ accuracy are the most likely to be perceived as doing good science.