I was referring to the inputs, mostly. My app also has a lot of intermediate data that wants to stick around and be durable across batches, things like scraping

I was referring to the inputs, mostly. My app also has a lot of intermediate data that wants to stick around and be durable across batches, things like scraping results that needs to avoid incurring duplicate work when nothing has changed. For that, some kind of data-locality-awareness would also be nice.