At least in the scramble I've used in Toronto, there's actually 3 walk signals: 1 for each direction (what a regular crosswalk would have) + 1 where you can go

At least in the scramble I've used in Toronto, there's actually 3 walk signals: 1 for each direction (what a regular crosswalk would have) + 1 where you can go in any direction (and all cars face a red signal).