Having your ssh key password protected would be a lot more annoying than having them touch id protected. The threat model would be someone using your Mac if you

Having your ssh key password protected would be a lot more annoying than having them touch id protected. The threat model would be someone using your Mac if you left it unlocked for a minute or something.