They could argue that the git commit history being immutable means that they have to delete the entire repository to remedy the existence of the proprietary cod

They could argue that the git commit history being immutable means that they have to delete the entire repository to remedy the existence of the proprietary code being available for download. The best way to continue would be to either rewrite history (eg. with BFG) or fix it, destroy the git history, then start from scratch.