Proxy them through nginx would be what I'd do. Not exactly your use case but when running software that has a complicated HTTPS cert system, I just add nginx i

Proxy them through nginx would be what I'd do. Not exactly your use case but when running software that has a complicated HTTPS cert system, I just add nginx in front of it and then use let's encrypt.