3 ms·

> I see "Letter Recognition Dataset" from UCI ML repository. What's the hell is that? Can you point to any paper published in a respectable conference (NIPS/ICM

by anjc 8y ago

> I see "Letter Recognition Dataset" from UCI ML repository. What's the hell is that? Can you point to any paper published in a respectable conference (NIPS/ICML/CVPR) in the last 5 years that used it? Why are you pro MNIST but anti Letter Recognition Dataset? A quick search of Scholar shows hundreds of papers that have used it in the last 4 years. Again, I'm still not sure what you want. They aren't doing a paper on NN vs PR for image classification. They aren't trying to get a higher score on a Kaggle classification challenge. Their hypothesis is that PR is a good alternative to NN, and their findings show that - for certain datasets - they are correct. Will more research arise from this? Will future results be mindblowing? Maybe, who knows. It's just research, and somebody has to do it.

p1esk 8y ago
Their hypothesis is that PR is a good alternative to NN No, they are not correct, because they have not compared their model to state of the art NNs. That's exactly why I insist they use standard, canonical datasets, such as ImageNet: because it's easy to find well-known state of the art, and compare the models. Google Scholar, last 4 years: "Letter Recognition Dataset": 98 results, "MNIST": 10,000 results, "Imagenet": 18,000 results. They aren't doing a paper on NN vs PR for image classification If they include image classification results, and claim their model compares favorably to NNs, then yes, their paper is, at least in part, on NN vs PR for image classification. I only commented on image classification results because that's the field I'm familiar with. I suspect other results they presented would also be unconvincing to people working in those areas. Will more research arise from this? If they want more research to arise from that, then they should have made sure their results are convincing, or at least promising. As presented in the paper, they are not.
- nightski 8y ago
  Your obsession with state of the art on the specific subset of data that deep nn excels at blinds you to the entire point of this discussion.

by anjc 8y ago

p1esk 8y ago

Their hypothesis is that PR is a good alternative to NN No, they are not correct, because they have not compared their model to state of the art NNs. That's exactly why I insist they use standard, canonical datasets, such as ImageNet: because it's easy to find well-known state of the art, and compare the models. Google Scholar, last 4 years: "Letter Recognition Dataset": 98 results, "MNIST": 10,000 results, "Imagenet": 18,000 results. They aren't doing a paper on NN vs PR for image classification If they include image classification results, and claim their model compares favorably to NNs, then yes, their paper is, at least in part, on NN vs PR for image classification. I only commented on image classification results because that's the field I'm familiar with. I suspect other results they presented would also be unconvincing to people working in those areas. Will more research arise from this? If they want more research to arise from that, then they should have made sure their results are convincing, or at least promising. As presented in the paper, they are not.

nightski 8y ago
Your obsession with state of the art on the specific subset of data that deep nn excels at blinds you to the entire point of this discussion.