8 ms·

Giving this a quick spin and I like what I'm seeing. I gave it a picture of Paolo Veronese's Lament over the Dead Christ [0] and asked what was going on in the

Giving this a quick spin and I like what I'm seeing. I gave it a picture of Paolo Veronese's Lament over the Dead Christ [0] and asked what was going on in the background. > The painting depicts the scene of the crucifixion of Jesus Christ. In the foreground, there is a group of people standing around the cross, including Mary, the mother of Jesus, and the two thieves who were crucified with him. In the background, there is a hill with a group of people standing on it, watching the crucifixion. The sky is dark and stormy, with lightning illuminating the scene. The overall mood of the painting is one of sadness and tragedy. Then I asked for a sonnet on it: "In this painting, we see the scene of the cross Where Jesus is crucified, with Mary at his side And the thieves who were crucified with him In the background, a hill with people standing Watching the tragic event unfold The sky is dark and stormy, with lightning flashing Illuminating the scene of the crucifixion The mood is one of sadness and tragedy As we contemplate the sacrifice of Jesus But even in death, he shows us the way To love and forgiveness, to live another day And so we remember the crucifixion And the love that Jesus showed us that day." So...not quite what I was expecting, but it's progress! [0] https://en.wikipedia.org/wiki/Lament_over_the_Dead_Christ_(Veronese) https://en.wikipedia.org/wiki/Lament_over_the_Dead_Christ_(V...

omeid2 4y ago
What did you expect?
- causi 4y ago
  I never know what to expect anymore. We live in a world where computers can describe paintings and write sonnets about them but a half-trillion dollar car company can't figure out how to parallel park with eight cameras.
  - niemandhier 4y ago
    That's because the decided they do not need lidar.
    - tough 4y ago
      Couldn't afford*
    - valine 4y ago
      Near term it’s a frustrating decision, but if these gpt4 vision LLMs are anything to go by it will prove to be the right decision in the long term.
      - rafram 4y ago
        Why wouldn’t LIDAR in addition to computer vision with cameras be a strictly better idea?
        bradstewart 4y ago
        It's all trade offs. I'm just spitballing here, but if you have limited resources, you can either spend cash/time on lidar or invest in higher-quality mass-produced optics, or better computer vision software. If you get to a functional camera-only system sooner, might everyone be better off as you can deploy it more rapidly. Manufacturing capacity of lidar components might be limited. Another might be reliability/failure modes. If the system relies on lidar, that's another component that can break (or brownout and produce unreliable inputs). So in a vaccum, yea a lidar+camera system is probably better, but who knows with real life trade offs. (again, I just made these up, I do not work on this stuff, but these are a few scenarios I can imagine)
      - astrange 4y ago
        Remember that "cameras" aren't as good as human perception because human eyes interact with the environment instead of being passive sensors. (That is, if you can't see something you can move your head.) Plus we have ears, are under a roof so can't get rained on, are self cleaning, temperature regulating, have much better dynamic range, wear driving glasses…
        spaceman_2020 4y ago
        And we still get into millions of accidents every year…
  - moffkalast 4y ago
    DriveGPT as it hits 2 parked cars and runs over a dog: "Apologies for the confusion earlier. You are correct that the cars were in the planned local planner path..."
    - dceddia 4y ago
      Sorry, yes, that was a dog. Let me try again and this time I will definitely not hit anything. Sorry, that was another dog.
      - brycedriesenga 4y ago
        "Was that another dog?" BingDrive: I'm sorry, but I prefer not to continue this conversation.
    - gary_0 3y ago
      It's like something right out of a Douglas Adams book.
  - astrange 4y ago
    That's a well known result from the last AI hype era. https://en.wikipedia.org/wiki/Moravec%27s_paradox https://en.wikipedia.org/wiki/Moravec%27s_paradox Although, I'm not surprised AI can describe paintings, but I'm still pretty surprised it can generate them. How'd we get that to work!?
    - causi 4y ago
      Yeah, and I'm still completely lost as to why resolution is such a limiting factor. If you know you're drawing a soccer ball why is a 512x512 soccer ball so much easier than a 1024x1024 soccer ball?
      - gary_0 3y ago
        There are a few cases where people have used ChatGPT to generate SVG[0], with mostly unimpressive results. I'm sure sooner or later models will be developed specifically for creating vector drawings instead of raster, including with the ability to apply textures and gradients. Also, the resolution of Stable Diffusion's output isn't much of a limitation if you're willing to use other tools to massage the output into something professional-quality. See [1] [0] For example: https://praeclarum.org/2023/04/03/chatsvg.html https://praeclarum.org/2023/04/03/chatsvg.html [1] https://news.ycombinator.com/item?id=35592847 https://news.ycombinator.com/item?id=35592847
  - bugglebeetle 4y ago
    Don’t worry. That’s valuation has always been ZIRP nonsense and will fall with Musk’s addiction to publicly demonstrating his incompetence.
- wsgeorge 4y ago
  A 14-line poem with a consistent rhyme scheme and meter. Perhaps my request should have been more specific.
  - pmoriarty 4y ago
    From my experimentation, LLMs tend to kind of suck at rhyme and meter, and all but the simplest types of poetry, so even if you'd specified it probably wouldn't have been able to deliver. This is definitely something they could be trained to be much better at, but I guess it's hasn't been a priority.
    - astrange 4y ago
      GPT4 is surprisingly good at it, considering BPE tokenization means it shouldn't be able to do rhyme at all.
    - jcims 4y ago
      Has anyone tried using phonetic tokens instead of text? I'm curious if that would help with things like rhyming.
pmoriarty 4y ago
How about asking it to describe a Robert Williams painting? Here's a relatively easy one: [1] [1] - http://www.illustrationartgallery.com/acatalog/WilliamsTimmy-G.jpg http://www.illustrationartgallery.com/acatalog/WilliamsTimmy...
- wg0 4y ago
  I tried that and here's what it has to say: > This painting appears to be a depiction of a child running down a dirt road with a kite in hand. The child is wearing a yellow shirt and blue shorts, and the background is filled with various colors and shapes. The overall mood of the painting is playful and carefree. What's amazing is that it has correctly described the scene including details such as: - A boy - On a dirt road. - Having a Kite in hand. - Wearing Yellow shirt and blue shorts.
- jcims 3y ago
  Used this prompt Could you describe the image as thoroughly as possible? Please include the content, any noteworthy symbology, techniques or styles, what kind of media, guess at the artist or identify any attribution, then attempt to describe the theme or idea it represents? Got this The image is a painting of a child running down a dirt road with a kite in hand. The child is wearing a yellow shirt and blue shorts. The background is a mix of urban and rural elements, with buildings and trees in the background and a field of grass in the foreground. The style of the painting is a mix of realism and abstraction, with a focus on the child and the kite. The artist may be attempting to convey a sense of freedom and playfulness, with the child running with the kite representing the joy and wonder of childhood. The medium used is oil paint on canvas. The artist may have used brushes and other tools to create the different textures and effects in the painting. The artist may have also used underpainting to establish the composition and values before adding the final layers of color and detail. It is difficult to identify the artist without more information, but the style and technique of the painting suggest that it may be the work of an artist who is skilled in realism and abstraction, and who is interested in exploring themes of childhood and playfulness.
  - pmoriarty 3y ago

omeid2 4y ago

What did you expect?

causi 4y ago
I never know what to expect anymore. We live in a world where computers can describe paintings and write sonnets about them but a half-trillion dollar car company can't figure out how to parallel park with eight cameras.
- niemandhier 4y ago
  That's because the decided they do not need lidar.
  - tough 4y ago
    Couldn't afford*
  - valine 4y ago
    Near term it’s a frustrating decision, but if these gpt4 vision LLMs are anything to go by it will prove to be the right decision in the long term.
    - rafram 4y ago
      Why wouldn’t LIDAR in addition to computer vision with cameras be a strictly better idea?
      - bradstewart 4y ago
        It's all trade offs. I'm just spitballing here, but if you have limited resources, you can either spend cash/time on lidar or invest in higher-quality mass-produced optics, or better computer vision software. If you get to a functional camera-only system sooner, might everyone be better off as you can deploy it more rapidly. Manufacturing capacity of lidar components might be limited. Another might be reliability/failure modes. If the system relies on lidar, that's another component that can break (or brownout and produce unreliable inputs). So in a vaccum, yea a lidar+camera system is probably better, but who knows with real life trade offs. (again, I just made these up, I do not work on this stuff, but these are a few scenarios I can imagine)
    - astrange 4y ago
      Remember that "cameras" aren't as good as human perception because human eyes interact with the environment instead of being passive sensors. (That is, if you can't see something you can move your head.) Plus we have ears, are under a roof so can't get rained on, are self cleaning, temperature regulating, have much better dynamic range, wear driving glasses…
      - spaceman_2020 4y ago
        And we still get into millions of accidents every year…
- moffkalast 4y ago
  DriveGPT as it hits 2 parked cars and runs over a dog: "Apologies for the confusion earlier. You are correct that the cars were in the planned local planner path..."
  - dceddia 4y ago
    Sorry, yes, that was a dog. Let me try again and this time I will definitely not hit anything. Sorry, that was another dog.
    - brycedriesenga 4y ago
      "Was that another dog?" BingDrive: I'm sorry, but I prefer not to continue this conversation.
  - gary_0 3y ago
    It's like something right out of a Douglas Adams book.
- astrange 4y ago
  That's a well known result from the last AI hype era. https://en.wikipedia.org/wiki/Moravec%27s_paradox https://en.wikipedia.org/wiki/Moravec%27s_paradox Although, I'm not surprised AI can describe paintings, but I'm still pretty surprised it can generate them. How'd we get that to work!?
  - causi 4y ago
    Yeah, and I'm still completely lost as to why resolution is such a limiting factor. If you know you're drawing a soccer ball why is a 512x512 soccer ball so much easier than a 1024x1024 soccer ball?
    - gary_0 3y ago
      There are a few cases where people have used ChatGPT to generate SVG[0], with mostly unimpressive results. I'm sure sooner or later models will be developed specifically for creating vector drawings instead of raster, including with the ability to apply textures and gradients. Also, the resolution of Stable Diffusion's output isn't much of a limitation if you're willing to use other tools to massage the output into something professional-quality. See [1] [0] For example: https://praeclarum.org/2023/04/03/chatsvg.html https://praeclarum.org/2023/04/03/chatsvg.html [1] https://news.ycombinator.com/item?id=35592847 https://news.ycombinator.com/item?id=35592847
- bugglebeetle 4y ago
  Don’t worry. That’s valuation has always been ZIRP nonsense and will fall with Musk’s addiction to publicly demonstrating his incompetence.
wsgeorge 4y ago
A 14-line poem with a consistent rhyme scheme and meter. Perhaps my request should have been more specific.
- pmoriarty 4y ago
  From my experimentation, LLMs tend to kind of suck at rhyme and meter, and all but the simplest types of poetry, so even if you'd specified it probably wouldn't have been able to deliver. This is definitely something they could be trained to be much better at, but I guess it's hasn't been a priority.
  - astrange 4y ago
    GPT4 is surprisingly good at it, considering BPE tokenization means it shouldn't be able to do rhyme at all.
  - jcims 4y ago
    Has anyone tried using phonetic tokens instead of text? I'm curious if that would help with things like rhyming.

pmoriarty 4y ago

How about asking it to describe a Robert Williams painting? Here's a relatively easy one: [1] [1] - http://www.illustrationartgallery.com/acatalog/WilliamsTimmy-G.jpg http://www.illustrationartgallery.com/acatalog/WilliamsTimmy...

wg0 4y ago
I tried that and here's what it has to say: > This painting appears to be a depiction of a child running down a dirt road with a kite in hand. The child is wearing a yellow shirt and blue shorts, and the background is filled with various colors and shapes. The overall mood of the painting is playful and carefree. What's amazing is that it has correctly described the scene including details such as: - A boy - On a dirt road. - Having a Kite in hand. - Wearing Yellow shirt and blue shorts.
jcims 3y ago
Used this prompt Could you describe the image as thoroughly as possible? Please include the content, any noteworthy symbology, techniques or styles, what kind of media, guess at the artist or identify any attribution, then attempt to describe the theme or idea it represents? Got this The image is a painting of a child running down a dirt road with a kite in hand. The child is wearing a yellow shirt and blue shorts. The background is a mix of urban and rural elements, with buildings and trees in the background and a field of grass in the foreground. The style of the painting is a mix of realism and abstraction, with a focus on the child and the kite. The artist may be attempting to convey a sense of freedom and playfulness, with the child running with the kite representing the joy and wonder of childhood. The medium used is oil paint on canvas. The artist may have used brushes and other tools to create the different textures and effects in the painting. The artist may have also used underpainting to establish the composition and values before adding the final layers of color and detail. It is difficult to identify the artist without more information, but the style and technique of the painting suggest that it may be the work of an artist who is skilled in realism and abstraction, and who is interested in exploring themes of childhood and playfulness.
- pmoriarty 3y ago