19 ms·
Illustrating Gutenberg library using Stable Diffusion
We are illlustrating existing books using stable diffusion and other ML models.
We are currently on our quest to illustrate the Project Gutenberg library.
This Show HN is really early in our journey and we are happy to receive your feedback!
- naillo 4y agoIs this really using stable diffusion? Has a really 'midjourney' type style to it.
- Aedraie 4y agoGood eyes! We currently pipe text input to Stable Diffusion, Dall-E and Midjourney at the same time and continue with the most pleasing result. The (very small compared to what we want to achieve) content we currently have required hundreds of renderings and Midjourney came out as most pleasing nearly all of the times. From what's on the website only the Sherlock Holmes renderings have been produced using Stable Diffusion. Nothing published so far from Dall-E, which most of the times is showing us uncanny valley. In terms of preference: We are experimenting hard to achieve better results using Stable Diffusion.
- fsloth 4y agoWith this effort it sounds it would be faster to actually draw the frames yourself. Get exactly what you want and so on…
- karencarits 4y agoOne interesting feature of these services is that one can be surprised: suddenly you get an image that is different from what you envisioned when writing the prompt but that is still visually pleasing or interesting or inspiring
- johnfn 4y agoOf course, then you have to learn how to draw, which can take years and years for middling results (source: me)
- spyder 4y agoOr in between the two: draw just some blobs to set the general concept and do img2img with diffusion models. https://simonwillison.net/2022/Aug/29/stable-diffusion/ https://simonwillison.net/2022/Aug/29/stable-diffusion/
- poisonarena 4y agoIf the majority of the models were produced with Midjourney, why did you title it as SD as u did?
- samstave 4y ago>>what we want to achieve What is it, SPECIFICALLY, you want to achieve. And, assuming you do achieve THING, what are the negative consequences of such achievement? How will you be accountable for dark patterns? What recourse would any biologically physical Human Being have against [THE BAD THING] that may ensue from said achievements... SERIOUS QUESTION
- samstave 4y agoYou literally can't fucking answer this question?
- Tenobrus 4y agoI find stable diffusion requires a lot more prompt engineering than either midjourney or dalle, but has a higher ceiling of quality if you do put in that effort. I wouldn't expect just using exactly the same prompt for all three models would work very well, need at least a little tuning per-model.
- cercatrova 4y agoMidjourney now used SD underneath
- frameset 4y agoIf I was a commercial artist doing illustration work for articles or the like, I'd be getting worried about now.
- iamflimflam1 4y agoI’ve been using midjourney to add a bunch of images to a conference talk I’m doing. It’s great for “ambience” type pictures, but hopeless if you actually want to represent anything concrete.
- rahimnathwani 4y agoYou can use Stable Diffusion to make more specific compositions, but you usually need multiple steps and a little bit of manual editing.
- deleted 4y ago[deleted]
- reb 4y agoIt's definitely possible to get concrete representation out of DALL•E, although it takes some experimentation to achieve realism within the constraints of the tech today. Still, we're not far off at all from indistinguishable synth imagery. Some generated work in a photographic style: — https://www.hearthe.art/ https://www.hearthe.art/ — https://objkt.com/profile/heartheart/created https://objkt.com/profile/heartheart/created
- odessacubbage 4y agoi think people underestimate just how many commercial images effectively fall within the 'ambience' category. i'm really convinced that in the mid to longterm, the only viable future for human artists will be a matter of GANs being subjected to the same sort of social stigma that is attached to other forms of highly economically lucrative, but morally dubious practices like child labour. ultimately sustaining a living in art has always been a matter of convincing the layman that what we produce has value and this will be the same at scale. if society does not value human-made art, there wont be any.
- temp_account_32 4y agoI feel like the next killer feature of these models will be when they can retain contextual visuals between different scenes being generated As in, the same mouse in four different pictures in different situations, not four different mice styled in the same way over four pictures
- karencarits 4y agoTextual inversion for stable diffusion, which is related, was discussed a few days ago: https://news.ycombinator.com/item?id=32643564 https://news.ycombinator.com/item?id=32643564
- temp_account_32 4y agoThis is nice but still has some huge limitations, e.g. you need 3-5 images of something to train it. It becomes a chicken and egg problem if I start by generating something, since I cannot create 5 different images of it to train the textual inversion. It is also intensive and slow to train on each object. Also I think we're running into limitations of using a single prompt to describe things, as it's often hard to separate the 'what' is in the scene and the 'how' to draw the scene, with many prompts looking like a giant word salad trying to tap in the internal secret language of the model
- deleted 4y ago[deleted]
- dr_dshiv 4y agoYeah, this seems to be the key challenge right now. Some how an image and its elements might be used as context to condition the subsequent generations.
- dr_dshiv 4y agoOh, looks like Google solved this last week with dream booth: https://arxiv.org/pdf/2208.12242.pdf https://arxiv.org/pdf/2208.12242.pdf
- 4y ago
- lifeisstillgood 4y agoThere is something of the meta-humanity going on here. These illustrations are drawn from hundreds of years of human effort, and are being used to enhance our enjoyment of these stories. But it is only possible because of the prior human work. It's a little like copying the work of hundreds of other artists at once. Index funds bother me in the same way as in at some point the price discovery mechanism ought to break as everyone just uses one corpus. All in all, this is an amazing idea, enabled by the work of amazing people, and it is like looking at something significant - I just don't know what :-)
- hydrolox 4y agocan you explain the index funds line
- nuclearnice3 4y agoI think the notion is the index fund is simply buying a stock because it has a certain market cap. It is not evaluating the fundamentals of the company. The algorithmic art is similar in the sense that it is an averaging of previous effort. People made art and it was fed into the algorithm. The algorithm is some weighting of the art it was fed. Analogously, people who thought about companies bought and sold the stock. It landed at some price. The index fund just followed that. There has been criticism of index funds [1] and defense [2] as far as price discovery. Other people have raised the possibility that an index fund holding large amounts of competitor companies is an antitrust issue. [3] [1] https://www.ft.com/content/87a3b117-7085-40f4-8cca-66bb8353c971 https://www.ft.com/content/87a3b117-7085-40f4-8cca-66bb8353c... [2] https://www.blackrock.com/corporate/literature/whitepaper/policy-spotlight-index-investing-supports-price-discovery-april-2019.pdf https://www.blackrock.com/corporate/literature/whitepaper/po... [3] https://corpgov.law.harvard.edu/2018/12/04/why-common-ownership-is-not-an-antitrust-problem/ https://corpgov.law.harvard.edu/2018/12/04/why-common-owners...
- bheadmaster 4y agoHuman learning itself is a little like copying the work of hundreds of other artists at once.
- astrange 4y agoMidjourney isn't very good for this (eg with https://storybooks.ai/sb/the-lion-and-the-mouse/ https://storybooks.ai/sb/the-lion-and-the-mouse/) because it only has one style it forces everything into. Anything else you make it just going to look like that. Though it's not as bad if you turn down stylization to "light" or do your own postprocessing.
- ncr100 4y agoExcellent steps, kind of tragic to lose humanity bit by bit. Edit: I recognize the images are curated. And that we're moving in a direction. The reality of one premise of the book The Diamond Age is closing in ... https://en.m.wikipedia.org/wiki/The_Diamond_Age#Plot_summary https://en.m.wikipedia.org/wiki/The_Diamond_Age#Plot_summary the Young Lady's Primer was an AI that manifest in this book, to help the child that reads the book to become .. mentally strong, I don't fully recall. The book would converse with the child and tell appropriate stories. So I suppose we're really close (10 years) to this, needing to try and see if AI can predict the "next step" in a child's psychological growth, and somehow observe their status. We kind of do part of this profiling with Machine Learning and our advertising prediction capacities.