If the isp doesn’t go down with the power outage you could probably get a big enough ups to keep the router and voip phone going for at least a couple of hours.

If the isp doesn’t go down with the power outage you could probably get a big enough ups to keep the router and voip phone going for at least a couple of hours. Those things don’t use much power