If you have a csv file that's 10 GB of numbers, and for your purposes float32 is sufficient precision, and there are only 1 billion numbers in the file, then yo

If you have a csv file that's 10 GB of numbers, and for your purposes float32 is sufficient precision, and there are only 1 billion numbers in the file, then you can read the file into a 4 GB array of float32 with very little overhead beyond the size of that target array. Reading the 10 GB file into memory in its entirety wouldn't help anything; nor would creating an intermediate array of full-precision numbers.