I always find sphinx limiting. For example, I can add a single doc to the index, I have to run a full re-index. Also, I can't programmatically get a list of al

I always find sphinx limiting. For example, I can add a single doc to the index, I have to run a full re-index. Also, I can't programmatically get a list of all "words" in the index with their frequency and the inverse dod freq, etc. With anything lucene based this kind of thing is really easy.