I wonder if, instead of having two different layouts and changing between them, an alternative would be to put all the navigation keys at fifth level and above,

I wonder if, instead of having two different layouts and changing between them, an alternative would be to put all the navigation keys at fifth level and above, and then hijack the Kanji modifier to switch to them, or maybe pretend you're a Far East keyboard and use Eisu_toggle.