4 ms·
how effective would this be in deep nets with small data sets? edit: does anyone know of any papers that talk about this technique formally?
by mlevental 8y ago
how effective would this be in deep nets with small data sets?
edit: does anyone know of any papers that talk about this technique formally?
- yuy910616 8y agointeresting to see an answer too...usually bays is better with small data sets right?
- paraschopra 8y agoBayesian techniques are effective with small data sets if you build your model carefully. For example, if you are able to encode the generating process of your dataset, even a _single_ example could be used for effective training. For example, see this http://web.mit.edu/jgross/Public/lake_etal_cogsci2011.pdf http://web.mit.edu/jgross/Public/lake_etal_cogsci2011.pdf By providing a good generative model, you are shifting the effort from collecting more data to carefully coding your expert knowledge. In my view, this is an exciting paradigm as it allows combination of human knowledge (as generating process and prjors) that can be overcome (in posterior distributions) if enough data is accumulated against it.