I think you'll be constrained by the inserts - even if you use bulk insert. You are probably better off using a bulk loader to get the data in - SQL*Loader on

I think you'll be constrained by the inserts - even if you use bulk insert. You are probably better off using a bulk loader to get the data in - SQL*Loader on Oracle. I believe MySQL has an equivalent. You could use Hadoop to process the data into whatever intermediate format (SQL or Bulk Data), but my instinct would be that getting the data loaded/inserted will be the slowest part by far.