4 ms·The cache shouldn't affect inference. It is purely an I/O optimization.by dwaltrip 12d agoThe cache shouldn't affect inference. It is purely an I/O optimization.