If you want to use Notes and don’t want to trust Apple, you can store the notes on any IMAP server you like. I don’t know if it is possible to store Reminders

If you want to use Notes and don’t want to trust Apple, you can store the notes on any IMAP server you like. I don’t know if it is possible to store Reminders outside of iCloud, I don’t really use it.