2 ms·
often left out of this argument is 1. After the expensive training phase, huge amounts of benefits can be realized during inference 2. These things save time
by verdverm 3y ago
often left out of this argument is
1. After the expensive training phase, huge amounts of benefits can be realized during inference
2. These things save time & effort elsewhere, and in theory could offset their initial cost.
3. The rapid pace of innovation is drastically reducing the computational cost to reach the same levels of capability