If you see a bank offering 4.75 percent on a certificate vs another offering 2.75, which one would you choose? If you always choose the highest, should you not

If you see a bank offering 4.75 percent on a certificate vs another offering 2.75, which one would you choose? If you always choose the highest, should you not have a stake if the bank was found to take a lot of risk to offer this higher rate?