It is dangerous but it often pays. perl parsers for HTML are still one of the fastests way to handle it - no parallelism, so spin one thread per core and keep

It is dangerous but it often pays. perl parsers for HTML are still one of the fastests way to handle it - no parallelism, so spin one thread per core and keep it well fed. You will quickly get IO bound.