4 ms·
I think expecting five orders of magnitude improvement from either side of this (inference cost or phone performance) is insane.
by radioactivist 2y ago
I think expecting five orders of magnitude improvement from either side of this (inference cost or phone performance) is insane.
- esafak 2y agoI don't, because most of the improvement will be algorithmic, not physical.
- radioactivist 2y agoBy a factor of 10,000,000,000? (that's the ten orders of magnitude needed, since the physical side is out). Algorithmic improvements will make this 10 billion times cheaper?