5 ms·

This is a tangent, but I’ve been wondering… and perhaps HNera know? I use some basic libre cad programs to plan my dream house project. And their renderings a

This is a tangent, but I’ve been wondering… and perhaps HNera know? I use some basic libre cad programs to plan my dream house project. And their renderings are pretty non-photorealistic. Are there any upscalers that can take an inside or outside house render and make it look like something from Pinterest? Meaning the input is an image, not text?

Tajnymag 4y ago
The existing tooling around Stable Diffusion very often features either a style transfer tool or even have a an input image to be given together with the text prompt. For example: https://nmkd.itch.io/t2i-gui https://nmkd.itch.io/t2i-gui
matheist 4y ago
ControlNet maybe? https://github.com/lllyasviel/ControlNet https://github.com/lllyasviel/ControlNet At huggingface: https://huggingface.co/spaces/hysts/ControlNet https://huggingface.co/spaces/hysts/ControlNet Play around with the different models, you might get better results with some vs others.
davidbarker 4y ago
Yes! Something like ControlNet is great for this. I use this[1] API on Replicate specifically because it offers the various methods (depth maps, edge detection, etc.) Replicate sometimes give you free use (I forget if this model does), but if you pay then an image output will cost you about one cent. Give it your image, write a prompt (something like "a modern living room"), choose your ControlNet model from the drop-down, and submit. If you choose depth map, for example, it will generate its best guess depth map for your image and use that to steer the Stable Diffusion output. It's fascinating, and a lot of fun to play with. [1] https://replicate.com/jagilley/controlnet https://replicate.com/jagilley/controlnet Edit: I'd love to see what you produce, if you do use it.
- canadiantim 4y ago
  Do you think it's possible to use similar tools for visualizing a house from a floor plan only? Or maybe ChatGPT 4.0 is more up to the task these days
v9v 4y ago
You can also try importing your CAD model into Blender, assigning some materials to the different objects and getting renders there, though tuning the render may take more time than tuning a prompt.

Tajnymag 4y ago

The existing tooling around Stable Diffusion very often features either a style transfer tool or even have a an input image to be given together with the text prompt. For example: https://nmkd.itch.io/t2i-gui https://nmkd.itch.io/t2i-gui

matheist 4y ago

ControlNet maybe? https://github.com/lllyasviel/ControlNet https://github.com/lllyasviel/ControlNet At huggingface: https://huggingface.co/spaces/hysts/ControlNet https://huggingface.co/spaces/hysts/ControlNet Play around with the different models, you might get better results with some vs others.

davidbarker 4y ago

Yes! Something like ControlNet is great for this. I use this[1] API on Replicate specifically because it offers the various methods (depth maps, edge detection, etc.) Replicate sometimes give you free use (I forget if this model does), but if you pay then an image output will cost you about one cent. Give it your image, write a prompt (something like "a modern living room"), choose your ControlNet model from the drop-down, and submit. If you choose depth map, for example, it will generate its best guess depth map for your image and use that to steer the Stable Diffusion output. It's fascinating, and a lot of fun to play with. [1] https://replicate.com/jagilley/controlnet https://replicate.com/jagilley/controlnet Edit: I'd love to see what you produce, if you do use it.

canadiantim 4y ago
Do you think it's possible to use similar tools for visualizing a house from a floor plan only? Or maybe ChatGPT 4.0 is more up to the task these days

v9v 4y ago

You can also try importing your CAD model into Blender, assigning some materials to the different objects and getting renders there, though tuning the render may take more time than tuning a prompt.