Have you considered using HDFS? There is a fairly informative post here: https://www.quora.com/How-are-most-data-sets-for-large-scale-machine-learning-stored/a

Have you considered using HDFS? There is a fairly informative post here: https://www.quora.com/How-are-most-data-sets-for-large-scale-machine-learning-stored/answer/Sean-Owen?share=d1ba6d56&srid=uA6AR https://www.quora.com/How-are-most-data-sets-for-large-scale...