2 ms·I sort of assumed they cached like 30 inferences and just repeat them, but maybe I'm being too cynical.by energy123 1y agoI sort of assumed they cached like 30 inferences and just repeat them, but maybe I'm being too cynical.