Also, what processing is actually going on with the data? Just updating the data in storage seem like less than half the problem. You're going to need an effi

Also, what processing is actually going on with the data? Just updating the data in storage seem like less than half the problem. You're going to need an efficient system for parallelizing whatever processing jobs need to be run.