3 ms·
but most researchers don't use first principles day to day, like others in this thread -have said - if you don't use it you lose it. researchers don't utilize t
by ausbah 4y ago
but most researchers don't use first principles day to day, like others in this thread -have said - if you don't use it you lose it. researchers don't utilize the details of back prop in there day to day work, so expecting an off the cuff derivation isn't a fair assessment of what makes a good researcher
- jenny91 4y agoResearchers absolutely do use first principles day to day. I suppose you have a very lax definition of "researcher" if you don't think they do?
- ausbah 4y agounderlying their work sure, but I doubt many ML researcher will be recounting the definitions of items like backprop day to day
- PeterisP 4y agoResearchers specialize and as such even in a "single field" they work at very different levels of abstraction; one subfield will care about building up some novel construction from first principles and then another subfield will want to use that construction as a basic axiomatic building block and abstracting from the details. E.g. execution performance optimization of a known formula is orthogonal to developing a better formula, we want people working on both these aspects, these are going to be different people who each build on their own subfields first principles that don't overlap much with the first principles of the other researcher.