If you want to stay unnoticed you need to remove the backdoor and all the traces after you are done with what you wanted to do (steal some information, damage s

If you want to stay unnoticed you need to remove the backdoor and all the traces after you are done with what you wanted to do (steal some information, damage something, ...), sure.