I'll just note that robots.txt does not affect indexing. It is used for traffic management and will not hide pages from Google. [1] -- [1] https://support.goo

I'll just note that robots.txt does not affect indexing. It is used for traffic management and will not hide pages from Google. [1] -- [1] https://support.google.com/webmasters/answer/6062608?hl=en https://support.google.com/webmasters/answer/6062608?hl=en