You are absolutely correct that temperature has those effects...but that doesn't change the fact that the underlying reaction inside the batteries is a chemical

You are absolutely correct that temperature has those effects...but that doesn't change the fact that the underlying reaction inside the batteries is a chemical in nature. That chemical reaction inside the batteries is what gets slowed down as the temperature drops.