In addition to the myriad of reasons a page / site can be slow, with .NET if the site has to do a cold start, aka nobody's accessed it in a while (by default 20

In addition to the myriad of reasons a page / site can be slow, with .NET if the site has to do a cold start, aka nobody's accessed it in a while (by default 20 minutes), it can take a significant amount of time to load it all up depending on various factors. If you know you're scraping a .NET site you could do a simple request a few minutes earlier so it shouldn't have to do a cold start.