My edited statement wasnt directed at you (Ive only just read your reply) but it does indirectly answer your question. What I mean is that you survey your user

My edited statement wasnt directed at you (Ive only just read your reply) but it does indirectly answer your question. What I mean is that you survey your users via your app on, say, the config page and ask them if they think its too complex and if it would benefit from layers or whatever and always let then enter an optional opinion when you do.