A few years ago I built something similar to this, in that it used the JSON API definitions to automatically scrape the entire AWS API surface area. But I was

A few years ago I built something similar to this, in that it used the JSON API definitions to automatically scrape the entire AWS API surface area. But I was doing it every 5 minutes and storing the result in postgres instead of it being on demand. I very quickly received a call from our account rep asking for it to not query particular services as frequently. Apparently some of the newer services at the time I was scraping were not as optimized in terms of response caching or metadata queries as they should have been. (Note: apparently it wasn't the overall frequency that was the problem, it was a few services that returned paginated results and fetching every page every 5 minutes was causing issues.)