I did something very much like this years ago (upscaling used to be an obsession of mine). The results were pretty disappointing. But there's a lot of space to

I did something very much like this years ago (upscaling used to be an obsession of mine). The results were pretty disappointing. But there's a lot of space to explore there in terms of choosing and designing the neural net, choosing the right training set, and figuring out an initial transform for data that is input to the neural net.