I am not aware of Chomsky ever making the argument that language has a specific physical location with the brain, or that it is the achievement of a single orga

I am not aware of Chomsky ever making the argument that language has a specific physical location with the brain, or that it is the achievement of a single organ which evolved for exactly this purpose. You may be confusing Chomsky with Jerry Fodor, whose "Modularity of Mind" was inspired by Chomsky's ideas (which it helped popularize).