Is it safe to disable 2FA on personal devices?

Many services providing 2FA allow you to make an exception for your personal devices, after you log on for the first time. Is this safe on an un-encrypted device, especially in case you lose the device?