While designing a webcrawler I found out how a LOT of sites are reachable using www.example.com and not using example.com. Some browser just tend to try the w

While designing a webcrawler I found out how a LOT of sites are reachable using www.example.com and not using example.com. Some browser just tend to try the www. prefix if they can't connect/resolve the non-www one. This is why nobody finds out about it and the internet is somewhat broke :(