Perhaps you could use FastBit ( http://sdm.lbl.gov/fastbit http://sdm.lbl.gov/fastbit ) along with mysql. This paper may of interest: Analyzing Enron Data: Bi

Perhaps you could use FastBit ( http://sdm.lbl.gov/fastbit http://sdm.lbl.gov/fastbit ) along with mysql. This paper may of interest: Analyzing Enron Data: Bitmap Indexing Outperforms MySQL Queries by Several Orders of Magnitude. Kurt Stockinger, Doron Rotem, Arie Shoshani, Kesheng Wu Abstract FastBit [1] is an efficient, compressed bitmap indexing technology that was developed in our group. In this report we evaluate the performance of MySQL and FastBit for analyzing the email traffic of the Enron dataset. The first finding shows that materializing the join results of several tables significantly improves the query performance. The second finding shows that FastBit outperforms MySQL by several orders of magnitude. http://www.osti.gov/bridge/servlets/purl/881612-KQlHWx/881612.PDF http://www.osti.gov/bridge/servlets/purl/881612-KQlHWx/88161...