3 ms·

These are machine learning experts making the claim? Machine learning is usually embarrassingly parallel.

• scott_s 11y ago
  If I was reviewing a paper with bits on machine learning (presumably written by machine learning experts), I would ask machine learning experts I know to verify the claims I was not familiar with. I do know that a lot of ML algorithms become, at the low-level, matrix operations. Matrix operations are typically not embarrassingly parallel. Now, I can imagine a bunch of independent matrix operations, but whether you'd call the entire problem "embarrassingly parallel" would depend on how coarse the independent bits are.
  • hedgehog 11y ago
    In many cases you can train multiple instances of a neural net simultaneously in increments, average the weights together, and repeat. Making the underlying compute more efficient is an interesting problem.