3 ms·
That's cheap for an AI model training at big tech. Your average ads model engineer at those companies likely uses more compute each quarter. It mostly suggests
by justapassenger 4y ago
That's cheap for an AI model training at big tech. Your average ads model engineer at those companies likely uses more compute each quarter.
It mostly suggests that we're in another AI hype bubble. MS and other big tech companies can easily replicate OpenAI results and do same type of research.
- mannerheim 4y agoWell, there's not only monetary cost on compute, you need humans interacting with it for RLHF, it takes time as well, you need engineers, and at the end of it, if you're just copying the leader, you're always going to be behind and not going to be coming up with the latest and greatest. I'm just disappointed the compute cost alone seems difficult to surmount for open source/community projects.
- mochomocha 4y agoThe number of companies ready to spend $40M/year of compute per "average ads model engineer" is exactly 0.
- londons_explore 4y agoI know of 1 at least... 'compute' costs are tricky to convert to dollar values - everyone does it at 'what would it cost to rent this from AWS', but the reality is, people like AWS are prepared to give low priority access to unsold compute for almost any project.