3 ms·
Batched inference makes these calculations hard - roughly takes the same amount of power and time for one inference vs 30 (as i understand it)
by sodality2 3y ago
Batched inference makes these calculations hard - roughly takes the same amount of power and time for one inference vs 30 (as i understand it)