4 ms·

I don't think anyone claims this is an iterative linear measure, rather than a step function. SVG can present arbitrarily complex graphics. The underlying disp

by fsloth 3y ago

I don't think anyone claims this is an iterative linear measure, rather than a step function. SVG can present arbitrarily complex graphics. The underlying display tech supports what ever fidelity GPT will eventually mature into. Has GPT plateaud? Will it be stuck forever at this hilariously naive level of competence at SVG art? Will it mature into Midjourney level competence? I have no frigging clue. Since the token context is so small I imagine it will put limitations to the complexity of SVG art piece. But I don't know. And it's fun to have a daily measure. As a software engineer with a penchant for graphics asking GPT to draw complex graphic shapes was one of the first tests I did for it. It's extremely interesting for me to collect progress data, no matter how noisy. I have no idea if GPT will ever mature beyond these squiggles but if it does, this track record will have at least considerable artistic value, if nothing else.

jquery 3y ago
I mean, how many humans can draw art by writing out svg? If that's not in the training set, I don't even see how GPT-4 gets much better at this over time.
- imdsm 3y ago
  And so, if we see that it /does/ get better, over the next few years, will that not lead us to ask /how/? Let's think about it: 1. It has to output SVG [1] 2. It is given a text based representation of what it must draw[2] 3. It must then somehow convert words -- the concept of a unicorn: equine with a horn, white, maybe rainbows? -- into SVG code, and attempt to convey both their location, shape, colour, appearance, with code. And keep in mind, this is just a token predictor. I doubt there is much data in its training that is this specific. So while it's quite far from science, for me, it's a bit of fun and I get emails every now and then remarking on things like the turd of May (2023-05-18) and it lightens the mood every now and then, which I think ultimately, is worth it. [1] System: You are a helpful assistant that generates SVG drawings. You respond only with SVG. You do not respond with text. [2] User: Draw a unicorn in SVG format. Dimensions: 500x500. Respond ONLY with a single SVG string. Do not respond with conversation or codeblocks. See: https://github.com/adamkdean/gpt-unicorn/blob/master/src/lib/generator.js#L39-L40 https://github.com/adamkdean/gpt-unicorn/blob/master/src/lib...
- fsloth 3y ago
  GPT-4 is really great at transferring concepts between domains. That's one the reasons why GPT when it works, feels magical. SVG art does not need to be in it's training set, as long as it knows how to present geometric concepts in SVG. A good unicorn would require capabilities something like "the outline of unicorn is composed of lines {...}." -> "export lines as svg".
  - jquery 3y ago
    Ok that makes perfect sense, thanks.

by fsloth 3y ago

jquery 3y ago

I mean, how many humans can draw art by writing out svg? If that's not in the training set, I don't even see how GPT-4 gets much better at this over time.

imdsm 3y ago
And so, if we see that it /does/ get better, over the next few years, will that not lead us to ask /how/? Let's think about it: 1. It has to output SVG [1] 2. It is given a text based representation of what it must draw[2] 3. It must then somehow convert words -- the concept of a unicorn: equine with a horn, white, maybe rainbows? -- into SVG code, and attempt to convey both their location, shape, colour, appearance, with code. And keep in mind, this is just a token predictor. I doubt there is much data in its training that is this specific. So while it's quite far from science, for me, it's a bit of fun and I get emails every now and then remarking on things like the turd of May (2023-05-18) and it lightens the mood every now and then, which I think ultimately, is worth it. [1] System: You are a helpful assistant that generates SVG drawings. You respond only with SVG. You do not respond with text. [2] User: Draw a unicorn in SVG format. Dimensions: 500x500. Respond ONLY with a single SVG string. Do not respond with conversation or codeblocks. See: https://github.com/adamkdean/gpt-unicorn/blob/master/src/lib/generator.js#L39-L40 https://github.com/adamkdean/gpt-unicorn/blob/master/src/lib...
fsloth 3y ago
GPT-4 is really great at transferring concepts between domains. That's one the reasons why GPT when it works, feels magical. SVG art does not need to be in it's training set, as long as it knows how to present geometric concepts in SVG. A good unicorn would require capabilities something like "the outline of unicorn is composed of lines {...}." -> "export lines as svg".
- jquery 3y ago
  Ok that makes perfect sense, thanks.