4 ms·

We've just launched our new web app seoprofiler.com after crawling the web for over a year (own crawler using the Amazon EC2 infrastructure). The submitted page

We've just launched our new web app seoprofiler.com after crawling the web for over a year (own crawler using the Amazon EC2 infrastructure). The submitted page shows some statistics that we've gained.

laut 16y ago
Interesting concept. But this makes me wonder: http://toksvaerd.net/ http://toksvaerd.net/ is number 7 on the list for Denmark. It's apparently a site for parents of school children in a small town. The site has had about 300 visits in 2010 according to their counter http://www.counter.gd/Homepage-193570.html http://www.counter.gd/Homepage-193570.html Are there really only 6 sites with more backlinks in Denmark? http://www.seoprofiler.com/statistics/top-backlinks/denmark http://www.seoprofiler.com/statistics/top-backlinks/denmark
- andrevoget 16y ago
  I can only speculate. We used seed sites from all American and European countries, including Denmark, so Danish websites should be covered. It might be the geo IP database that we use (maxmind.com), or there are really only 6 sites with more backlinks in Denmark, or Danish webmasters use other countries to host their sites.
  - laut 16y ago
    Looks like some fishy sites are linking to that page. http://www.google.com/search?q=links%3Atoksvaerd.net&ie=utf-8&oe=utf-8 http://www.google.com/search?q=links%3Atoksvaerd.net&ie=... Maybe it was previously hacked and part of a SEO-spam network?
mlinksva 16y ago
http://www.seoprofiler.com/company/about http://www.seoprofiler.com/company/about compares to Google link: queries, which are indeed incomplete. How does your crawl compare to Yahoo! Site Explorer link: queries. The latter seem more complete to me.
- andrevoget 16y ago
  In our tests, Yahoo Site Explorer sometimes shows more links, sometimes less links than we do. It depends on the subdomain.
  - mlinksva 16y ago
    Here's an example: http://siteexplorer.search.yahoo.com/search?p=http%3A%2F%2Fcreativecommons.org&bwm=i&bwmo=&bwmf=s http://siteexplorer.search.yahoo.com/search?p=http%3A%2F%2Fc... 293m http://www.seoprofiler.com/analyze/creativecommons.org http://www.seoprofiler.com/analyze/creativecommons.org 19m
    - andrevoget 16y ago
      SEOprofiler shows the backlinks only for the creativecommons.org subdomain, excluding support.creativecommons.org, wiki.creativecommons.org, search.creativecommons.org, de.creativecommons.org, etc. For this reason, the backlink number appears to be lower.
      - mlinksva 16y ago
        No, that's not the reason. As you can see by clicking "subdomains", they only account for 1.1% of links seoprofiler knows about.

laut 16y ago

Interesting concept. But this makes me wonder: http://toksvaerd.net/ http://toksvaerd.net/ is number 7 on the list for Denmark. It's apparently a site for parents of school children in a small town. The site has had about 300 visits in 2010 according to their counter http://www.counter.gd/Homepage-193570.html http://www.counter.gd/Homepage-193570.html Are there really only 6 sites with more backlinks in Denmark? http://www.seoprofiler.com/statistics/top-backlinks/denmark http://www.seoprofiler.com/statistics/top-backlinks/denmark

andrevoget 16y ago
I can only speculate. We used seed sites from all American and European countries, including Denmark, so Danish websites should be covered. It might be the geo IP database that we use (maxmind.com), or there are really only 6 sites with more backlinks in Denmark, or Danish webmasters use other countries to host their sites.
- laut 16y ago
  Looks like some fishy sites are linking to that page. http://www.google.com/search?q=links%3Atoksvaerd.net&ie=utf-8&oe=utf-8 http://www.google.com/search?q=links%3Atoksvaerd.net&ie=... Maybe it was previously hacked and part of a SEO-spam network?

mlinksva 16y ago

http://www.seoprofiler.com/company/about http://www.seoprofiler.com/company/about compares to Google link: queries, which are indeed incomplete. How does your crawl compare to Yahoo! Site Explorer link: queries. The latter seem more complete to me.

andrevoget 16y ago
In our tests, Yahoo Site Explorer sometimes shows more links, sometimes less links than we do. It depends on the subdomain.
- mlinksva 16y ago
  Here's an example: http://siteexplorer.search.yahoo.com/search?p=http%3A%2F%2Fcreativecommons.org&bwm=i&bwmo=&bwmf=s http://siteexplorer.search.yahoo.com/search?p=http%3A%2F%2Fc... 293m http://www.seoprofiler.com/analyze/creativecommons.org http://www.seoprofiler.com/analyze/creativecommons.org 19m
  - andrevoget 16y ago
    SEOprofiler shows the backlinks only for the creativecommons.org subdomain, excluding support.creativecommons.org, wiki.creativecommons.org, search.creativecommons.org, de.creativecommons.org, etc. For this reason, the backlink number appears to be lower.
    - mlinksva 16y ago
      No, that's not the reason. As you can see by clicking "subdomains", they only account for 1.1% of links seoprofiler knows about.