3 ms·

you solve that problem with massively parallel batch processing. Look at schedulers like Platform LSF or HTCondor.

• sandermvanvliet 6y ago
  Haven’t heard those two in a while, played around with those while I was in uni 15 years ago :-O