I guess it depends on how the sample data is skewed as to what you can statistically gain from it. If it was collected fairly random without favoring any one au

I guess it depends on how the sample data is skewed as to what you can statistically gain from it. If it was collected fairly random without favoring any one audience, then there's lots of options. If not, then there's more restrictions. Like for example, collecting data from somewhere that appeals to the general population is going to give different results than collecting data from a development community. Tech wise, you could throw all the data into full text search engine like Sphinx or alternatively use something like Lucene or NLTK. http://nltk.org/ http://nltk.org/ http://lucene.apache.org/ http://lucene.apache.org/ http://sphinxsearch.com/ http://sphinxsearch.com/