awk is very powerful. There is a story here http://consultuning.blogspot.com/2008/10/optimizing-mysql-data-loads.html http://consultuning.blogspot.com/2008/10/o

awk is very powerful. There is a story here http://consultuning.blogspot.com/2008/10/optimizing-mysql-data-loads.html http://consultuning.blogspot.com/2008/10/optimizing-mysql-da... where the time of a data load goes from 10 to less than 1 minute using three lines of awk.