That assumes that none of your Docker images have a build step that includes interacting with GitHub, or if some do, that you have every affected layer already

That assumes that none of your Docker images have a build step that includes interacting with GitHub, or if some do, that you have every affected layer already cached on your local computer.