3 ms·
This is a great read. It is accurate to what I felt the last time I trained a CNN -- it's not fun, and I don't get to feel clever. My brain isn't wired to give
by LeftHandPath 4y ago
This is a great read. It is accurate to what I felt the last time I trained a CNN -- it's not fun, and I don't get to feel clever. My brain isn't wired to give me a dopamine hit when the training does its job. It's just a, "wait, that's it?"
We will always want to do the discovery ourselves, and I can see why fighting that instinct is a challenge for those in the field.
- shawntan 4y agoIsn't the CNN a discovery in itself? Without it, we'd be following the bitter lesson and "leveraging computation" to throw more data / compute at an MLP. Clearly someone felt that there'd be a better inductive bias and attempted something else, and now CNNs are what's used "in the long run".