People would have the right to download a binary from someone else who'd already compiled it. You're thinking of just having the binaries under a separate licen

People would have the right to download a binary from someone else who'd already compiled it. You're thinking of just having the binaries under a separate license, which isn't unheard of, but it also means that someone's just going to compile it and release it for free.