The main disadvantage is that over the years, we have developed amazing set of tools that all presuppose source code is text (so it's not only we are used to it

The main disadvantage is that over the years, we have developed amazing set of tools that all presuppose source code is text (so it's not only we are used to it, it's stronger than that). Can you imagine what would it take today to reimplement all the editors, source control, half of unix basically...