3 ms·
Well that is pretty dubious. That completely changes the metric of how much money and how difficult this costs. (And I definitely believe you because there's se
by godelski 7y ago
Well that is pretty dubious. That completely changes the metric of how much money and how difficult this costs. (And I definitely believe you because there's several other comments with that same number). Could be a typo? But I feel like that's something you'd say. Then again, these are masters students.
- p1esk 7y agoIt's $50k per training run. Their main contribution has been finding the optimal hyperparameters, not described in the OpenAI paper. Obviously you need more than one training run to to that.