Two reasons why I can't do my stuff with CUDA even though I've got thousands of work packages that are independent of each other: * I'm splitting data sets int

Two reasons why I can't do my stuff with CUDA even though I've got thousands of work packages that are independent of each other: * I'm splitting data sets into batches of around 50-300MB, but each individual batch must be processed sequentially. Each batch loops through the data (multiple times), and every single iteration of a loop depends on state from previous iterations. * Altough each batch essentially does the same thing, it does not operate in lockstep. Lot's of ifs, different execution paths, differently sized sub-problems, etc. I'd benefit from having 200 CPU cores and enough RAM to fit the batches, but I can't let individual GPU threads run through batches of 50MB, each.