4 ms·
A trained model, which is obviously the subject here, is an algorithm.
by IAmEveryone 5y ago
A trained model, which is obviously the subject here, is an algorithm.
- robbrown451 5y agoI generally wouldn't define algorithm as such, although I can see where the lines between them can become blurry.
- kaibee 5y ago> I generally wouldn't define algorithm as such, although I can see where the lines between them can become blurry. Its pretty clear cut tbh. An algorithm is a set of steps to follow to produce some output. A trained model is, 'hey do these matrix multiplications with these coefficients to get an output'. The fact that the exact coefficients were arrived at via backprop, doesn't make it not an algorithm.
- The_rationalist 5y agoOh yes so chromium and minecraft are algorithms now. What a useful definition we have here.. Obviously colloquially when people says algorithm, it is an implicature that they mean a hard computing (not soft) serie of steps that achieve a specific goal. In other words, a statistical algorithm does not point to the same category as a deterministic algorithm and an algorithm refer to the later class by default.
- SirSavary 5y agoNo reasonable person would define Chromium or Minecraft as algorithms; that's not what the poster was saying.
- The_rationalist 5y agooh yes chromium is not a "set of steps to follow to produce some output" then?.. If the author wasn't meaning what he said, what is the actual criteria he was meaning?
- mannykannot 5y ago> What a useful definition we have here.. Indeed it is - for one thing, it allows us to see that various useful theorems and results about algorithms and computability apply as much to large programs as to small ones, such as the fact that there's no fundamental impediment to porting them between computers with different instruction sets, or running them in virtual machines. What's not so well or usefully defined here is your distinction between hard and soft computing. > In other words, a statistical algorithm does not point to the same category as a deterministic algorithm and an algorithm refer to the later class by default. You appear to be under the misapprehension that the set of statistical algorithms is disjoint from that of deterministic algorithms. I strongly suspect that all the algorithms covered by the article are both statistical in terms of what they compute and deterministic in terms of how they do it.
- mattmcknight 5y agoNot necessarily, as the trained model can just be the matrix. It's more like data, as presumably the same algorithm with different weights, trained by different data would be permissible.
- riking 5y agoML training is an algorithm that produces an algorithm as output
- mattmcknight 5y agoIt doesn't really though. The prediction algorithm already existed before training, it just is a particular collection of parameters that the training produces. You wouldn't say changing the interest rate changes the algorithm for calculating interest payments. The weights can be viewed another input to the algorithm. You aren't going to outlaw linear regression, but a particular set of coefficients.