2 ms·
Agreed. Once a model has been trained, I believe the main metrics people care about are 1. inference speed 2. memory requirements 3. quality of output. The
by djoldman 2y ago
Agreed.
Once a model has been trained, I believe the main metrics people care about are
1. inference speed
2. memory requirements
3. quality of output.
There are usually tradeoffs here. Generally you get a lower memory requirement (a good thing), sometimes faster inference (a good thing), but usually a lower quality of output.
I don't think reproduction of original output is the typical goal.