4 ms·
Wait, isn't "deep learning with small data" just machine learning, after all the buzzwords cancel themselves out? I thought the whole point of "deep learning"
by cocktailpeanuts 10y ago
Wait, isn't "deep learning with small data" just machine learning, after all the buzzwords cancel themselves out?
I thought the whole point of "deep learning" is its approach to using data.
- IanCal 10y agoThe point of deep learning is using a deep graph, like a neural network with a lot of layers, not the amount of data. However, picking millions of parameters with small amounts of data is unlikely to work well.
- bunderbunder 10y agoIt seems, at first blush, like using a very complex model to fit a very small amount of data is a recipe for some serious overfitting.
- cocktailpeanuts 10y agoyeah that's what i was trying to say. Saying you can construct a deep graph using small data feels like "I'm gonna become a millionaire in ten years, only by operating this single lemonade stand"
- bowlesbe 10y agoI would agree. Its kind of amazing that it indeed it does seem to work better than simpler models.