4 ms·

how are the links structured in the ahref tag? is it relative or absolute? if relative, then thats prob why.

• babuskov 2y ago
  Relative. For example, the page: https://website/blog/1-post https://website/blog/1-post contains: href="2-post" Browsers and other bots like Google Bot correctly interpret this as a link to https://website/blog/2-post https://website/blog/2-post While OpenAI crawler goes to: https://website/blog/1-post/2-post https://website/blog/1-post/2-post I wonder is there some way to report this bug to them?
  • fullstackwife 2y ago
    Google recommends absolute urls: https://web.archive.org/web/20221208150134/https://www.webmasterworld.com/google/29720.htm#:~:text=I%20recommend%20absolute%20links%20instead%20of%20relative%20links https://web.archive.org/web/20221208150134/https://www.webma...
  • AznHisoka 2y ago
    I actually think OpenAI is right, unless you have a base url tag? That’s a relative url and its relative to the current url you are on, not the root domain
    • deleted 2y ago
      [deleted]