3 ms·

What I'm really asking is: how much effective compute throughput are you able to get during Transformer training relative to the amount of theoretical raw compu

by gok 7y ago

What I'm really asking is: how much effective compute throughput are you able to get during Transformer training relative to the amount of theoretical raw compute available?

zak 7y ago
That's a great question. I don't have that analysis handy, but it would definitely be worth doing.
- gok 7y ago
  What about energy? (watt-hours?)