The buildings are called Central Offices. The switches inside are the actual pieces of equipment handling the calls. Yes, "telephone exchange" is also used, but

The buildings are called Central Offices. The switches inside are the actual pieces of equipment handling the calls. Yes, "telephone exchange" is also used, but not so much in the United States.