There is also in between solution. There are whole bunch of small providers that would host your website and if you keep a copy you are safe and small provider

There is also in between solution. There are whole bunch of small providers that would host your website and if you keep a copy you are safe and small provider will not dictate you what your content should be (within the law of course).