3 ms·
If you're interested in seeing the top of the line inpainting results, you should check out DeepFill and DeepFill2. http://jiahuiyu.com/deepfill2/ http://jiahu
by mattgroh 8y ago
If you're interested in seeing the top of the line inpainting results, you should check out DeepFill and DeepFill2.
http://jiahuiyu.com/deepfill2/ http://jiahuiyu.com/deepfill2/
Deep Angel is based on an architecture combining Mask R-CNN (for object detection and instance segementation) and DeepFill for image inpainting.
And here's the paper behind DeepFill
https://arxiv.org/pdf/1806.03589.pdf https://arxiv.org/pdf/1806.03589.pdf
If you look at the papers, you'll see which one has the best inpainting results.
- jl2718 8y agoCan you help us understand why deep angel is giving gray blobs if these two pieces seem to work well independently?
- mattgroh 8y agoThat's a super fair question. Depending on the image, Deep Angel can produce a quite plausible background but sometimes it just fills in the object with a "gray blob." The gray blob issue can arise from (1) the object is too big relative to the rest of the image. For example, consider an image in which 67% of it is made up by the object that you wish to remove. In this case, DeepFill doesn't have enough context to fill in the pixels in a plausible manner. (2) the object is on the side of the image. The further skewed the object is from the center, the less information DeepFill has to plausibly inpaint. (3) the training data is quite different from the test data. The gray blob is a collapse of the pixels to the mean of the colors and textures around the removed portion of the photo. The AI isn't yet perfect, and as you use the AI, you'll start to see which kind of photographs work really well and which do not.