3 ms·
Perhaps there's a way to insert GNU Parallel in there to do parallel search of different chunks? Or just use ripgrep, which integrates multi-core.
by AceJohnny2 4y ago
Perhaps there's a way to insert GNU Parallel in there to do parallel search of different chunks?
Or just use ripgrep, which integrates multi-core.
- chkhd 4y agoThat is already doable with xargs itself xargs -P maxprocs Parallel mode: run at most maxprocs invocations of utility at once. If maxprocs is set to 0, xargs will run as many processes as possible.
- giantrobot 4y agoGNU parallel gives you some extra features like a runtime log and resumable operation.
- deleted 4y ago[deleted]
- throwaway14356 4y agoif have 10 computers put every 10th line in its own file, if each file is 1000 lines put line 500 at the start, then line 250, then line 750, then line 125, 375 etc