Ah, ok, strange that they have /sitemap.xml in addition to that then. I would assume any robot that would understand sitemap also understands that it can be spe

Ah, ok, strange that they have /sitemap.xml in addition to that then. I would assume any robot that would understand sitemap also understands that it can be specified in robots.txt