2 ms·
Yes, this is the best I've seen too. Unfortunately, "quickly" is a matter of perspective. Usually you train a neural net that's as large as possible with a ru
by lostdog 7y ago
Yes, this is the best I've seen too. Unfortunately, "quickly" is a matter of perspective.
Usually you train a neural net that's as large as possible with a runtime that's within your latency and GPU budget. Running the net even twice will blow up your budget.
Also, I haven't seen a great evaluation on how well this method works in practice. For example, how well does predicted uncertainty capture mistakes on a real-world dataset?