Yes but then you'd also have to store them across all installed clients/browsers and, when accessing from another computer, first transport the keys to that com

Yes but then you'd also have to store them across all installed clients/browsers and, when accessing from another computer, first transport the keys to that computer. That's why I think public keys would be the user-friendly way. Public = Only passphrase protects the key.