How would knowing the architecture or safety mechanisms help you decide if it’s going to give incorrect results more than actual testing would? I’m no LLM expe

How would knowing the architecture or safety mechanisms help you decide if it’s going to give incorrect results more than actual testing would? I’m no LLM expert, but I don’t think you can eyeball the arch and say “that’s going to confuse veggies for fried chicken”.