3 ms·
Training time is a massive constraint on advancement of the science, so at the very least the field would progress much faster and be much more accessible to re
by Salgat 4y ago
Training time is a massive constraint on advancement of the science, so at the very least the field would progress much faster and be much more accessible to researchers.
- 6nf 4y agoFaster processing alone won't make training 1000x faster, the bottleneck is more on the memory size / bandwidth side
- rowanG077 4y agoThe thread is about the whole stack 1000x'ing. Not just processing speed.
- anigbrowl 4y agoI feel people are overlooking the OP's mention of parallel improvements in storage and speed of access. While there are physical limits to this, I feel like capabilities will continue to expand not so much in terms of pure speed as in better automation of parallelization and resource allocation.