Conceptually, this is exactly how webauthn works. Except your identity is always per-site, and the site itself stores your per-site secret, encrypted by some me

Conceptually, this is exactly how webauthn works. Except your identity is always per-site, and the site itself stores your per-site secret, encrypted by some mechanism you control (HSM or whatever).