Building our own ETL tool on top of Apache Spark. It did work better than Informatica or whatever, but now we run 20k Spark jobs a day in the cloud, and it is

Building our own ETL tool on top of Apache Spark. It did work better than Informatica or whatever, but now we run 20k Spark jobs a day in the cloud, and it is incredibly wasteful to start whole Spark instance to touch ten megabyte csv file or database table.