There is an annual challenge for synthetic voice detection, ASVSpoof, that evaluates submissions on different types of attacks to speaker verification systems:

There is an annual challenge for synthetic voice detection, ASVSpoof, that evaluates submissions on different types of attacks to speaker verification systems: text to speech, voice conversions and replayed attacks. The conclusion from the 2019 evaluation [1]: known synthetic deep fakes are fairly easy to detect using simple models with very low error rates (even high-fidelity techniques with Wavenet vocoders). [1]: ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection speech (https://www.isca-speech.org/archive/Interspeech_2019/pdfs/2249.pdf https://www.isca-speech.org/archive/Interspeech_2019/pdfs/22...)