8 ms·
Anime2Sketch: A sketch extractor for illustration, anime art, manga
- ekianjo 6y agoDoes not work as well as advertised :) I think the author clearly cherry picked their examples.
- CobrastanJorji 6y agoI think I'm missing something. I get the Sketch-to-Photo synthesis that this is based on. It's really weird, neat stuff. But as a layman, I'm having trouble seeing the difference between the result of this anime-to-sketch synthesis and what I'd expect to get out of a simple edge detection. Is the difference that it's more clever about which details to ignore?
- greatgoat420 6y agoI was actually going to ask if someone had done a comparison with edge detection.
- loosetypes 6y agoAlso not familiar but presumably a temporal aspect weighs in, so whether something is a meaningful edge isn’t strictly dependent only on the content within a specific frame?
- edge17 6y agoMy high level guess is, you would do some linear cost minimization in deciding what are edges over time when doing things the traditional way. The neural network can handle nonlinearities for the optimization so you can get better results for some set of inputs (in this case, some class of anime images)
- mattigames 6y agoNot actually, here is what most common edge detection methods produce (last one is Anime2Sketch): https://i.imgur.com/nt0D1ef.png https://i.imgur.com/nt0D1ef.png
- Chris2048 6y agolink appears to be broken?
- mattigames 6y agoIt's working for me, here it is on a different hosting site if that helps https://i.ibb.co/pn5d01f/nt0-D1ef-d.webp https://i.ibb.co/pn5d01f/nt0-D1ef-d.webp
- Chris2048 6y agoNope, getting a timeout for that too.
- mattigames 6y agoIt must be your connection then (or the image format), last try: here it is again in Google Drive: https://drive.google.com/file/d/1rMagXGgth-pAXH2RQ-Ltj59jpgb9C3_b/view?usp=sharing https://drive.google.com/file/d/1rMagXGgth-pAXH2RQ-Ltj59jpgb...
- CobrastanJorji 6y agoOkay, that's pretty significant. Neat, thanks!
- gregoriol 6y agoYour edge detection examples are really basic stuff: there are way more advanced studies and examples. Search for example for "Coherent Line Drawing" by Henry Kang (image from the research: https://d3i71xaburhd42.cloudfront.net/92b2ec5ef4f58c4206fc5cee9c5f0e9435870c69/2-Figure2-1.png https://d3i71xaburhd42.cloudfront.net/92b2ec5ef4f58c4206fc5c...) or for "XDoG: An eXtended difference-of-Gaussians ..." by Holger Winnemoller, Jan Eric Kyprianidis, ... (https://ars.els-cdn.com/content/image/1-s2.0-S009784931200043X-gr2.jpg https://ars.els-cdn.com/content/image/1-s2.0-S00978493120004...)
- fsloth 6y agoI only dabble in graphics - but generallly simple edge detection needs really uniform tonality and no textures in the input to work well. Look for example in the more "sketchy" examples how the linework that "looks right" is extracted from a quite noisy input. Also, in the top example where there are houses, the contrast difference that gets extracted to linework is lower than in the character areas. So, the flat shaded images with explicit black outlines - yes, it's likely there is much difference with edge detection. But when the image has lots of different contrasts and tonalities this looks much more impressive.
- ZephyrBlu 6y agoI'm not super familiar with Deep Learning, but based on the fact this is effectively extracting edges and the ConvTranspose2d layers I'm guessing it's some sort of Convolutional Neural Net?
- wj 6y agoThis looks like a great tool to generate some Pokémon and Beyblade coloring pages for my kids. We went through everything in Google image results many moons ago.
- swsieber 6y agoI really want to see how this performs on Octonauts stills
- mushufasa 6y agoHow is this technically different from photoshop filters? https://design.tutsplus.com/tutorials/sketch-photoshop-effect--cms-27461 https://design.tutsplus.com/tutorials/sketch-photoshop-effec...
- karmasimida 6y agoThe project is much cleaner, and from the link you posted, the picture is noisy.
- asutekku 6y agoPhotoshop just detects edges and does thus ends up detecting both sides of a drawn line or change in shading for example. This does not appear to show such artefacts.
- zakki 6y agoIf I want to use this program do I have to have a good GPU in my computer to run this program or I just need to install the required software?
- fireattack 6y agoJust a heads up, you should use higher quality (or better, just use PNG) for the output. The default Image.save quality is very low to a point that the JPEG artifact is more prominent than the line art themselves. L91 @ data.py: image_pil.save(image_path, format='PNG')
- A4ET8a8uTh0 6y agoIt is pretty neat. Off-topic, what anime is that test from?
- bla15e 6y agoVinland Saga https://youtu.be/7U7BDn-gU18 https://youtu.be/7U7BDn-gU18
- Cerium 6y agoWhich I found by observing that the file name is "vinland_saga.gif" when I went to try putting the image in a search engine.
- 0x142857 6y agooff-topic, but this is a great open-source anime image reverse search engine: https://trace.moe/ https://trace.moe/
- bavell 6y agoFantastic anime, I highly recommend it!
- deleted 6y ago[deleted]
- androng 6y agoWhat could we use this for? The immediate thing that comes to mind is making a coloring book. I’m wondering if I could use it to make something original
- gibolt 6y agoThis feels like a tool with lots of business cases. Studios may be able to accelerate digitalization and colorization. The ability to convert stills to a fillable outline or repurchase for labels/marketing/branded coloring books (or apps) could be worth some money to those with a large content library.
- dagmx 6y agoThis is actually pretty impressive, and I can see it being really useful if it can generate clean line art from Animation roughs. It would be really interesting to see this in OpenToonz or the like.
- pjgalbraith 6y agoI wonder if this can be used for comic book inking. It looks like they have an example of that. Typically the workflow is pencil drawing -> cleaned up ink drawing (japanese animation uses a similar process too). If this can speed up that process it could save a lot of time.
- 0x426577617265 6y agoSemi off-topic – is there a tool to turn a picture into an drawing? I sometimes see websites where people have created a avatar of their headshot that looks ‘toonish’.
- knicholes 6y agoI believe you're looking for something like https://github.com/taki0112/UGATIT https://github.com/taki0112/UGATIT.
- chias 6y agoYMMV... https://i.imgur.com/6lFYnmi.jpg https://i.imgur.com/6lFYnmi.jpg
- camillovisini 6y agoHow WSJ stipple drawings are made: https://youtu.be/sZzP9PQJXLs https://youtu.be/sZzP9PQJXLs
- Cloudef 6y agoLooks more like shaded art to unshaded lineart rather than sketch. Sketches are usually way more messy, like a blueprint for the final product.
- swframe2 6y agoAlso checkout u-2-net: https://github.com/xuebinqin/U-2-Net https://github.com/xuebinqin/U-2-Net There is a variant that can turn images into line drawings.
- throw_m239339 6y agoInteresting. I wonder how it fares with 3D renderings? I'm a Blender user and unfortunately, Blender "Toon Shading" capabilities are not very good compared to say Cinema 4D.
- jp555 6y agoThere are lots of very good techniques to do toon shading in Blender. Here's a few: BEER NPR (MALT renderer) - https://blendernpr.org/beer/ https://blendernpr.org/beer/ Lightning Boy shader 2.0 - https://www.youtube.com/watch?v=8fHZcnTFYEI https://www.youtube.com/watch?v=8fHZcnTFYEI Procedural hatching and manga shaders - https://gumroad.com/l/tcKOI https://gumroad.com/l/tcKOI
- kalal 6y agoIf you find this interesting, you may also consider canny edge detector.
- interestica 6y agoAnything preventing this from running on Python3 on Windows?
- forgotpwd16 6y agoThen someone can use https://github.com/taivu1998/GANime https://github.com/taivu1998/GANime to recolor them.
- slazaro 6y agoDo it iteratively one after the other to see if after a while the results are unrecognizable from the originals. Like those experiments that translated a text between languages to create gibberish.
- offtop5 6y agoIs there any way for someone to post a Google collab notebook with this. I think this would be pretty cool if it would support any picture or video.
- istorical 6y agocan anyone show what happens if you feed it regular video / photo?
- chias 6y agoNothing very good. https://i.imgur.com/LfZI0QD.png https://i.imgur.com/LfZI0QD.png
- jakearmitage 6y agoDoes anyone know a similar model that transforms normal images into Western Comic Book style? I've seen it a lot for Anime/Manga, but never for that classic style of 90's comic books.