3 ms·
You're definitely right that we've found joint training to be highly useful and having a neural net simply act as a feature extractor is unsatisfying, but I thi
by Eridrus 10y ago
You're definitely right that we've found joint training to be highly useful and having a neural net simply act as a feature extractor is unsatisfying, but I think that success at unifying neural nets with symbolic or even non-learning systems would be a big step forward. This isn't it, but even the alphago work relied on Monte Carlo tree search, so I wouldn't dismiss this out of hand.
- hacker42 10y agoBut MCTS works in AlphaGo because the 'world' can be fully represented by a tiny state vector which fits a billion times into primary memory these days. The real difficultly of real world problems is the ill-defined, mutable, high-dimensional and partially observable state space.
- Eridrus 10y agoI'm merely pointing out that "all neural everything" is not always the best approach despite joint training being very appealing.