3 ms·
Hi Bob, thanks for the kind words and for sharing with HN. For TinyML, you need to go in almost the opposite direction of what my book suggests, since the model
by d_burfoot 3y ago
Hi Bob, thanks for the kind words and for sharing with HN. For TinyML, you need to go in almost the opposite direction of what my book suggests, since the model complexity limits are so strict! I think MDL should be very helpful, but make sure you understand the danger of "manual overfitting" that I described in the book. I would also encourage you to read Vapnik's book the Nature of Statistical Learning Theory, which shows the relation b/t MDL and VC theory. Feel free to reach out to me at firstname dot lastname at gmail.com, I'm always happy to chat about these ideas.