There are 2 things you can brute-force: 1) the seed for the private key - this is infeasible to brute-force just like you can't brute-force a private key direc

There are 2 things you can brute-force: 1) the seed for the private key - this is infeasible to brute-force just like you can't brute-force a private key directly 2) the authentication credential to the hardware wallet - the key space is small enough that brute forcing it would normally be easy, except the whole purpose of a hardware wallet is to limit the amount of attempts. The former option is infeasible, the latter has a slim chance if some vulnerability in the hardware wallet was discovered in the future.