Related thread on the front page right now: "Simple questions to help reduce AI hype (smerity.com)" https://news.ycombinator.com/item?id=12062294 https://news.

Related thread on the front page right now: "Simple questions to help reduce AI hype (smerity.com)" https://news.ycombinator.com/item?id=12062294 https://news.ycombinator.com/item?id=12062294 Excerpt: > ...good performance on a dataset also doesn't necessarily imply good performance in the real world. I'd wager that even trivial self-driving car models, given reasonable data, would be able to score in the high 90s if we decided on a reasonable notion of accuracy. The real stickler is the last few percent. When we make a mistake at high speed on a road, potentially under questionable conditions, the results can be disastrous. If the cost of a mistake is high, accuracy really doesn't mean anything, especially over a dataset that might not be representative in the first place.