4 ms·
“ High on the ML punch list is how to run models more efficiently using less power, especially in critical applications like self-driving vehicles where latency
by voz_ 4y ago
“ High on the ML punch list is how to run models more efficiently using less power, especially in critical applications like self-driving vehicles where latency becomes a matter of life or death.”
Never ever heard of inference latency being a bottleneck here…