Hijack my ssh-agent but you're not using my ssh key for lateral movement unless I touch my Yubikey for you. And I'll notice when it's blinking but it shouldn't

Hijack my ssh-agent but you're not using my ssh key for lateral movement unless I touch my Yubikey for you. And I'll notice when it's blinking but it shouldn't be and just unplug it :)