You could also use current search algorithms but add a penalty for redundancy. Or perhaps group similar results. I've always like the idea of column-based web

You could also use current search algorithms but add a penalty for redundancy. Or perhaps group similar results. I've always like the idea of column-based web results. I suppose some of what Google does has this flavor.