4 ms·
People mostly use gradient descent to "solve" nonconvex problems.
by kragen 5y ago
People mostly use gradient descent to "solve" nonconvex problems.
- mirker 5y agoThere isn’t much theory on why it works in the nonconvex case. You can similarly make discrete heuristic algorithms for sorting, etc. with no guarantees. Anyway, as nonconvex models are usually stacked convex models, you can find works that incorporate these submodular functions as neural network layers.