4 ms·
The saying comes from a slide by Noam Shazeer (see: https://www.youtube.com/watch?v=HgGyWS40g-g&ab_channel=TensorFlow&t=13m10s https://www.youtube.com/watch?v=H
by jon_tau 6y ago
The saying comes from a slide by Noam Shazeer (see:
https://www.youtube.com/watch?v=HgGyWS40g-g&ab_channel=TensorFlow&t=13m10s https://www.youtube.com/watch?v=HgGyWS40g-g&ab_channel=Tenso...). It just means the current goal should be to have models with 1 trillion parameters.