> The hardware requirements were stunning (280 GPUs and 1920 CPUs for the largest variant) Stunningly big, or stunningly small? The CPUs would cost around $65

> The hardware requirements were stunning (280 GPUs and 1920 CPUs for the largest variant) Stunningly big, or stunningly small? The CPUs would cost around $65/hour on Google Cloud. I can't immediately find pricing for GPUs on either Amazon or Google, but let's suppose it doubles that price. It's pretty small potatoes. Especially if you put it in the context of a project with ~15 researchers.