This is an equivalent problem to the web search problem, right? I believe Google indexes webpages by visiting them in headless Chrome and dumping the resulting

This is an equivalent problem to the web search problem, right? I believe Google indexes webpages by visiting them in headless Chrome and dumping the resulting DOM - it seems like archive.org could do the same. https://searchengineland.com/google-will-ensure-googlebot-runs-the-latest-version-of-chromium-316534 https://searchengineland.com/google-will-ensure-googlebot-ru... (Also archive.today solves this somehow, no?)