I'd recommend just using a project like buildroot - it's really easy to begin with, and afterwards every odd device you eventually decide you need to cross comp

I'd recommend just using a project like buildroot - it's really easy to begin with, and afterwards every odd device you eventually decide you need to cross compile for (old router with a MIPS CPU, etc.) becomes just as easy.