3 ms·
Now I realise that I _somehow_ totally missed your link to Page's work right in the README… Thanks for the detailed comment, I definitely will dive into your s
by m3at 4y ago
Now I realise that I _somehow_ totally missed your link to Page's work right in the README…
Thanks for the detailed comment, I definitely will dive into your script soon!
One early suggestion, you might want to try torch dynamo [1], anecdotally I had good speedups (~20%) on some image models; though not sure how significant the impact might be at this (relatively) small scale.
[1] https://pytorch.org/docs/master/dynamo/ https://pytorch.org/docs/master/dynamo/
- tbalsam 4y agoThank you! And good feedback, the README could be condensed a bit more to be more clean and readable. Thanks so much for the suggestion, I'll take a look at it! And much appreciated to a huge degree on interest in the script, it's still not perfectly polished stylistically but now that the baseline checks out, we definitely have a lot of performance gains to be had in the next release! :D :) Feel free to ping me if you ever need anything, I'm not the most active on GitHub but if you ever need to reach me by email for questions/comments/thoughts/etc, hi [ period ] tysam [ the at symbol ] gmail [ period ] com is my email address. :D
- m3at 4y agoWill do if I have feedback :)