2 ms·
Coz it uses all of the memory so the moment you'd have to spill it to RAM or worse, disk it would be not x4 but x100+ slower
by ilyt 4y ago
Coz it uses all of the memory so the moment you'd have to spill it to RAM or worse, disk it would be not x4 but x100+ slower
- grogenaut 4y agoSure but that would get you to one inferences around every second. I wait around 1-2 minutes with some online tools for 4 inferences. So seems like it might work fine for a local no data leak version?