It's worth to note that the web has grown a lot recently. The number of web pages is more than 100 times larger than 10 years ago thus the size of information t

It's worth to note that the web has grown a lot recently. The number of web pages is more than 100 times larger than 10 years ago thus the size of information to get the exact page that you want should increase as well. Although Google did some works on this area, but it's possible (and very likely) that the speed of web growth simply outpaced Google's algorithmic improvements. I don't know if a single universal search engine can be the answer without very deep personalization plus pervasive tracking; maybe domain specific search engines can do a better job?