Agreed, the loss of institutional knowledge will cripple the team. However, what I am arguing is that they leavers won't be able to take the business elsewhere

Agreed, the loss of institutional knowledge will cripple the team. However, what I am arguing is that they leavers won't be able to take the business elsewhere just with what is in their heads.