2 ms·
Show HN: Transformers Calculator
The other day, I was wondering how big of a model I can train on a single GPU in one month. I found this great blog post and I thought it would be cool to make a simple calculator:
https://medium.com/@dzmitrybahdanau/the-flops-calculus-of-language-model-training-3b19c1f025e4 https://medium.com/@dzmitrybahdanau/the-flops-calculus-of-la...