Your suggestion is very interesting. Here is some recent related work which seems to have explored the idea in more depth: https://arxiv.org/pdf/1703.10034.pdf

Your suggestion is very interesting. Here is some recent related work which seems to have explored the idea in more depth: https://arxiv.org/pdf/1703.10034.pdf https://arxiv.org/pdf/1703.10034.pdf