It is interesting as you cannot see the content which is being indexed. Suspect only bot does. If I understand correctly this is the sequence of events from the

It is interesting as you cannot see the content which is being indexed. Suspect only bot does. If I understand correctly this is the sequence of events from the bot's perspective: ## read robots.txt `curl 'https://havfruen4220.dk/robots.txt https://havfruen4220.dk/robots.txt'` ## use pointer to a sitemap.xml curl -A 'Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html http://www.google.com/bot.html)' 'https://havfruen4220.dk/sitemap-no.xml https://havfruen4220.dk/sitemap-no.xml' > sitemap.xml ## read more sitemaps curl -A 'Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html http://www.google.com/bot.html)' 'https://havfruen4220.dk/sitemap-no-1.xml https://havfruen4220.dk/sitemap-no-1.xml' > sitemap1.xml Other sitemaps contain a pointer to a "webpage" eg: https://havfruen4220.dk/no/7a28855e4714dd14 https://havfruen4220.dk/no/7a28855e4714dd14 ## read web pages Each location in a sitemap has a "lastmod" of today/yesterday so bot returns there everyday. In addition each webpage has a "<meta name="robots" content="noarchive">" But if you visit each of those pages then it shows you a cartoon image. It seems the actual indexed content is visible only to the bot. ## But how is actual content being rendered? The question is, what conditions (request params/headers) result in the actual content being rendered? The bot needs to evaluate it. Suspect it is some combo of checking if the requester is an actual google bot, maybe by looking up the IP https://developers.google.com/search/docs/advanced/crawling/verifying-googlebot https://developers.google.com/search/docs/advanced/crawling/...