3 ms·
"after training it on a huge amount of data it magically works" The magic part can be problematic. I think there have been some recent(ish) advances in introsp
by ineedasername 8y ago
"after training it on a huge amount of data it magically works"
The magic part can be problematic. I think there have been some recent(ish) advances in introspection of neural networks to better understand how the initial input features influence the output, but the "black box" is still a problem in some practical environments where, for example, deployment of a model may need to show there's no disproportionate impact on effected sub populations.
Then there's things like the most recent Tesla Autopilot Crash [0] where comprehension of the failure mode & cause can be difficult to obtain.
[0] https://news.ycombinator.com/item?id=19932918 https://news.ycombinator.com/item?id=19932918