4 ms·
Training AI to Paint with Code
- mysterydip 1mo agoMakes me wonder, can any LLMs code in Logo? Could result in some interesting designs.
- accomplishdent 1mo agoWhat is the JavaScript doing?
- simonw 1mo agoDrawing things with p5.js.
- _boffin_ 1mo agoI think this actually might be one of the best ways to train people to use AI. I can see this honing people's prompting abilities and expressiveness, along with constraints and desired outcome. Wild the possibilities
- bombastic311 1mo agoThis is really really awesome
- behnamoh 1mo ago[flagged]
- pelasaco 1mo agoMarch 2026 · Research, Design, Development.
- smokel 1mo agoInteresting, tell me more!
- aflinik 1mo agoCan you post some links to other similar projects you've seen? I'd love to compare different approaches
- conradkay 1mo agoIt seems pretty novel so I'm guessing they only read the title? People have done plenty with SVGs but it's rare to see human-in-the-loop approaches
- orta 1mo agoI've been working in this space, though with a different goal (deterministic watercolour + ink houseplants in svg) - https://github.com/orta/plants https://github.com/orta/plants / https://plants-production-71e6.up.railway.app https://plants-production-71e6.up.railway.app
- mskogly 1mo agoReally liked your video presentation, thanks for sharing, especially the part of image generators locking us into a certain context immediately, reducing us to spectators instead of creatives. Played a lot with p5js some years ago, might pick it up again and try some of your ideas. The reinforcement learning part sounds about above my skill level though. :)
- kickingkeys 1mo agoHi, this post wasn't made by me but thank you for the kind works :)
- ACCount37 1mo agoI wonder how the image generation models that generate SVGs work. Are they trained roughly like this? Or is it an LLM conditioned on image? Or on diffusion latents from a model trained to emit SVG-compatible imagery?
- radarsat1 1mo agoBeautiful. I am reminded of a paper I was inspired by a long time ago [0], (okay it's 2018 so I guess just 8 years ago, but it feels like longer, from the before-times), that demonstrated learning brush strokes. At the time there was already a lot of work on GANs, but these are pixel-based methods, and I was really interested in the idea of how to derive descriptive methods of scene generation/understanding. I found this work really interesting because it combined RL and GAN techniques in a creative way. I miss that kind of research. Now of course VLMs have shown that you can mix modalities in generalized sequence-to-sequence problems and it doesn't surprise me that this kind of thing is possible, but it's so nice to see it done well using modern techniques. [0] https://proceedings.mlr.press/v80/ganin18a.html https://proceedings.mlr.press/v80/ganin18a.html
- thrance 1mo agoI've been building something similar, but for voxels. It's able to make pretty good models from just Python code (calling into a custom native module written in Rust). Better than I hoped it would, in fact, but it's still not perfect.
- lxrogers 1mo agoReally awesome! Been thinking about how to get LLMs to do generative art (yes, the pre-AI definition of generative art). Love to see this approach and results!
- 13639366668 1mo ago[flagged]
- iambenm 1mo agoIt's Genetic Programming via LLM, cool!
- yoloakki 1mo ago[flagged]
- Brendinooo 1mo agoThis is really nice, and it's a good reminder that we're so early with regards to how AI can be used to make art. And the fact that it's flowers creates a pretty nice mental model for it! One can plant seeds and cultivate the plants that grow from them but ultimately aren't in complete control of the outcome.
- Alien1Being 1mo agoAI HYPE
- retinaros 1mo agoI did that on SVG mostly to teach it to draw pelicans but also to generalize it. most of the behavior is from SFT on the base model tho. RL is very ineficient at style or at least at generating novelty out of distrib.
- kickingkeys 1mo agoThank you for sharing this! did not expect to find my work on HN randomly haha
- kickingkeys 1mo agoIf you're curious about why I did this you can watch my thesis here: https://vimeo.com/1190839818 https://vimeo.com/1190839818
- mrmarmac 1mo agoThis video was incredible. Thank you for sharing and for the work and thought you poured into your project.
- mannycalavera 1mo agoI love this, thank you for creating it!
- lilpi3dot14 1mo ago[dead]
- deleted 1mo ago[deleted]
- deleted 1mo ago[deleted]
- deleted 1mo ago[deleted]
- eramooh 1mo agojack lacan - sözü yazan bir doğa resmi yap
- deleted 1mo ago[deleted]
- dolmen 1mo agoSVG is image as code. This is basically a DSL with graphics primitives. It seems to me that teaching a model to directly produce SVG is more helpful than teaching to write JavaScript that produce pixels. By the way, someone here is benchmarking LLMs on how they draw an SVG of a pelican on a bicycle.
- QAtration 1mo agothats cool) my Claudy always gives me "amazing" vector style pictures
- lindyman 1mo agoA fun diversion and general capabilities test that I like to do is to ask the models to "programmatically assign color and alpha values to a png to generate an image. it should be a painting or whatever subject interests you in the moment. 800x800" or something along those lines, and they'll make a "generative" art piece for you. For example first time I tried this Claude Fable used Python to generate a transparent PNG of a quartz crystal with inclusions that were variable depending on the seed number. So anyway yeah it's surprisingly easy to get the frontier models nowadays to make cool art!