You should use at least a different IdentityFile for each realm -- publc, personal, work. So definitely have a custom ~/.ssh/config Possibly a different key f

You should use at least a different IdentityFile for each realm -- publc, personal, work. So definitely have a custom ~/.ssh/config Possibly a different key for each machine, especially public because your public key can be used to identify you.