I know that the point of Signal is zero-trust, but a savvy middle man could still use large scale information about source and destination of encrypted packets

I know that the point of Signal is zero-trust, but a savvy middle man could still use large scale information about source and destination of encrypted packets for useful intelligence. Just like NSA would find it useful to inspect email headers despite the email body being encrypted.