5 ms·

No downvotes. I agree with you. I can guarantee you that deep NN/RL researchers are thinking of these hypotheses every other week. But they don't publish them.

No downvotes. I agree with you. I can guarantee you that deep NN/RL researchers are thinking of these hypotheses every other week. But they don't publish them. Even I, who got more active in this kind of research very recently, came up with the exact same hypothesis. I didn't publish. We don't publish because we have a strong sense of empiricism. There proverbial proof has to be in the pudding. We should be able to setup a DNN and run experiments. If it confirms our hypothesis, we publish. If it disproves our hypothesis, we move on to something else. These armchair neuroscientists/psychologists come along and type out a dozen pages of brain-dump, no pun, and think they're doing science. They need to do better than that, and do some real work with hands-on deep learning, and/or experimental neuroscience (or collaborate with someone who can do that).

lostmyoldone 6y ago
This comment on its own can be read as testimony that covid-19 self isolation / social distancing can cause a compulsive need to try to feel relevant in some way when you meet to little people in situations where you are actually relevant. So yeah, I know it is somewhat preposterous to claim any relevancy, but one has to try to cope in some way. I'm only just "DNN-literate" enough to get the broader points of the more well written papers. I certainly don't know enough to give any criticism on my own, but in a somewhat funny way, statistics, and my experience could perhaps lend some additional weight to your argument. I'm pretty sure this is very similar to one hypotheses I've amused myself with from time to time, if not exactly. I don't even think I knew what the word overfitting meant at the point I came up with it. Though the ideas involved would seem to boil down to the same thing, or close enough to gauge how common this line of thinking would be. It's a sample of one, but since I don't believe myself to be that special, and don't believe others would believe so either, it adds some weight that this line of thinking might be relatively common among anyone with even a little knowledge in the field(s). Perhaps one could even argue I ought to be relatively bad at coming up with novel (creative) ideas, and ideas which are not precluded by known facts. At least partially because my brain would have a higher chance of being overfitted to the few bits I know. Any of my ideas should then either be shallow or false with high probability.

lostmyoldone 6y ago

This comment on its own can be read as testimony that covid-19 self isolation / social distancing can cause a compulsive need to try to feel relevant in some way when you meet to little people in situations where you are actually relevant. So yeah, I know it is somewhat preposterous to claim any relevancy, but one has to try to cope in some way. I'm only just "DNN-literate" enough to get the broader points of the more well written papers. I certainly don't know enough to give any criticism on my own, but in a somewhat funny way, statistics, and my experience could perhaps lend some additional weight to your argument. I'm pretty sure this is very similar to one hypotheses I've amused myself with from time to time, if not exactly. I don't even think I knew what the word overfitting meant at the point I came up with it. Though the ideas involved would seem to boil down to the same thing, or close enough to gauge how common this line of thinking would be. It's a sample of one, but since I don't believe myself to be that special, and don't believe others would believe so either, it adds some weight that this line of thinking might be relatively common among anyone with even a little knowledge in the field(s). Perhaps one could even argue I ought to be relatively bad at coming up with novel (creative) ideas, and ideas which are not precluded by known facts. At least partially because my brain would have a higher chance of being overfitted to the few bits I know. Any of my ideas should then either be shallow or false with high probability.