Use pipelines with simple filter commands. No thread programming required. Use ssh to distribute this across nodes securely, assuming the I/O doesn't make that

Use pipelines with simple filter commands. No thread programming required. Use ssh to distribute this across nodes securely, assuming the I/O doesn't make that unworkable.