4 ms·
> So it doubles the training time and FLOPS. Then the graph X axis should be wall time or FLOPS when comparing the methods, instead of steps. Thanks for pointi
by fn-mote 4y ago
> So it doubles the training time and FLOPS. Then the graph X axis should be wall time or FLOPS when comparing the methods, instead of steps.
Thanks for pointing this out.
Inflating your results by tricky measurement methods has been around forever, but it can be hard to spot if you're not close enough to the field.
Also, unfortunately, the blog post does not contain anything about the key idea used. (Well, I couldn't find it.)
Trust regions have been around forever; that's not the new idea.
It would be nice if somewhere there was a piece about "this is what we do better". Decoding a scientific article to figure out how much fluff it is seems like it has an uncertain return.