It's not a total restriction. You can fly at the airport if you tell ATC and they clear you. Though that specific scenario is unlikely, I've seen emails from ho

It's not a total restriction. You can fly at the airport if you tell ATC and they clear you. Though that specific scenario is unlikely, I've seen emails from hobbyists to ATCs asking permission to fly within the limits and they approved it with certain hight restrictions (below the trees in one case).