2 ms·
So this author trained a neural network billions of times using different hyper parameters ? How much dod that cost ?
by kalu 3y ago
So this author trained a neural network billions of times using different hyper parameters ? How much dod that cost ?
- tpm 3y ago"overnight on an A100" per https://twitter.com/jaschasd/status/1757056127991439832 https://twitter.com/jaschasd/status/1757056127991439832
- mkl 3y agoVery small networks are cheap and easy (even 20 years ago).
- TheCoreh 3y agoThe networks trained were really small, with only one hidden layer, and a width of 16.