5 ms·

Are you sure about this? I'm not an expert by any means but when I participated in the Netflix Prize a few years, there seemed to be lots of investigation abou

Are you sure about this? I'm not an expert by any means but when I participated in the Netflix Prize a few years, there seemed to be lots of investigation about different variations of neural networks. For example, the Restricted Boltzmann Machine (http://en.wikipedia.org/wiki/Boltzmann_machine#Restricted_Boltzmann_Machine http://en.wikipedia.org/wiki/Boltzmann_machine#Restricted_Bo...), as far as I understand it, seems to be a variation of neural networks. If you can post a link to an article that covers recent work in the area and explains why they none of them are breakthroughs, I'd love to read it.

yid 15y ago
The backpropagation neural network itself is a variation of many nonlinear, additive statistical models. The field emerged as an independent entity largely because it had "cool" neurological connotations and was largely ignored by statisticians. The Netflix prize was ultimately won using linear algebra with sensible starting values (the KDD paper that describes the winning method is remarkably easy to read).
- pdhborges 15y ago
  Is http://www.commendo.at/references/files/kdd08.pdf http://www.commendo.at/references/files/kdd08.pdf (this) the paper you are talking about?
  - yid 15y ago
    Nope, it was by Bell and Koren. This one is related, but not the one I originally mentioned: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197422 http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197... I was at the talk but can't for the life of me remember the title, sorry.
- dododo 15y ago
  backpropagation is just the chain rule of differentiation. each layer of an ANN is logistic regression, which statisticians have been and continue to be interested in. i'm not sure your caricature of the netflix winning solution is correct: i believe it was a blending of around 25 different models (including, i think, the RBM someone pointed about above) each in themselves quite varied from one another. this is typically how these challenges are won.
  - yid 15y ago
    A lot of the top teams had blended submissions, but my characterization was not incorrect: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197422 http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197...
    - elq 15y ago
      I work on the cinematch team at netflix... I've reviewed all of the winning code... your characterization is incorrect. The netflix prize would not have been won when it was without rbm.
deleted 15y ago
[deleted]
ignifero 15y ago
not an expert either, and indeed, the Hinton papers on RBMs are the last thing i remember reading about. But their invention dates back to the 80s. I 'm just noticing that if you search "neural network" on google scholar for the recent years, you will find many neuroscientific results. Of course i dont have the data to back it up.

yid 15y ago

The backpropagation neural network itself is a variation of many nonlinear, additive statistical models. The field emerged as an independent entity largely because it had "cool" neurological connotations and was largely ignored by statisticians. The Netflix prize was ultimately won using linear algebra with sensible starting values (the KDD paper that describes the winning method is remarkably easy to read).

pdhborges 15y ago
Is http://www.commendo.at/references/files/kdd08.pdf http://www.commendo.at/references/files/kdd08.pdf (this) the paper you are talking about?
- yid 15y ago
  Nope, it was by Bell and Koren. This one is related, but not the one I originally mentioned: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197422 http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197... I was at the talk but can't for the life of me remember the title, sorry.
dododo 15y ago
backpropagation is just the chain rule of differentiation. each layer of an ANN is logistic regression, which statisticians have been and continue to be interested in. i'm not sure your caricature of the netflix winning solution is correct: i believe it was a blending of around 25 different models (including, i think, the RBM someone pointed about above) each in themselves quite varied from one another. this is typically how these challenges are won.
- yid 15y ago
  A lot of the top teams had blended submissions, but my characterization was not incorrect: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197422 http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5197...
  - elq 15y ago
    I work on the cinematch team at netflix... I've reviewed all of the winning code... your characterization is incorrect. The netflix prize would not have been won when it was without rbm.

deleted 15y ago

[deleted]

ignifero 15y ago

not an expert either, and indeed, the Hinton papers on RBMs are the last thing i remember reading about. But their invention dates back to the 80s. I 'm just noticing that if you search "neural network" on google scholar for the recent years, you will find many neuroscientific results. Of course i dont have the data to back it up.