Many/most hot water bottles have a knitted fabric cover. When the heat runs out (which takes many hours), you are not in direct contact with the rubber/plastic

Many/most hot water bottles have a knitted fabric cover. When the heat runs out (which takes many hours), you are not in direct contact with the rubber/plastic body of the water bottle, so there is no sensation of cold or clamminess.