3 ms·

Have you... actually used the image recognition features of even something like the web-accessible ChatGPT 4 interface, or are you just guessing here? I feed

by ssl-3 2y ago

Have you... actually used the image recognition features of even something like the web-accessible ChatGPT 4 interface, or are you just guessing here? I feed it unstructured images of all kinds of things and it generally does a rather good job of describing them. Just now, I found (what is allegedly) a screenshot of a Facebook ad about microdosing mushrooms. I fed the image to the bot and asked it to identify whether or not it was an ad, and the content of it, and to rate the legality of it on a scale of 1 to 50, with 1 being perfectly legal and 50 being criminally punishable. It nailed all three questions and gave it a score of 45. I then did the same thing with a screenshot of a Facebook ad for an Audi Q5, and it nailed all three questions and gave it a score of 1. I followed this up with some human-made drawing of 4 horses that I found fairly randomly. It also nailed all three questions and gave it a score of 1. Satisfied with the result, I then stopped. I don't get paid enough to make a study of this. I have little doubt that these results are reproducible. (And is this an LLM trick or something else? Perhaps a combination of things? Is it AI, LLM, LMNOP, or some kid in a sweatshop overseas? I don't really know -- that distinction is also beyond my pay grade.)

dragontamer 2y ago
> (And is this an LLM trick or something else? Perhaps a combination of things? Is it AI, LLM, LMNOP, or some kid in a sweatshop overseas? I don't really know -- that distinction is also beyond my pay grade.) That's the thing: The hidden layers that process the text _MUST_ have some kind of language structure getting figured out. Otherwise none of the behaviors of ChatGPT make sense. Interpreting those layers and passing them to the user in some way should be the core focus IMO anyway. On the other hand: there's also the problem of brute force. If they paid 50,000 cheap "Mechanical Turks" to manually teach an AI that the "top left" of an image is pixel coordinates (0,0), that's... trickery. Its no longer intelligence. Its disconnected and not innate to the model anymore. The nature of the training set is what would determine how useful any of this actually is, and how well it generalizes to new tasks.
- ssl-3 2y ago
  You're still stuck on "the text," and not seeing the whole picture. ChatGPT does better than this.

by ssl-3 2y ago

dragontamer 2y ago

> (And is this an LLM trick or something else? Perhaps a combination of things? Is it AI, LLM, LMNOP, or some kid in a sweatshop overseas? I don't really know -- that distinction is also beyond my pay grade.) That's the thing: The hidden layers that process the text _MUST_ have some kind of language structure getting figured out. Otherwise none of the behaviors of ChatGPT make sense. Interpreting those layers and passing them to the user in some way should be the core focus IMO anyway. On the other hand: there's also the problem of brute force. If they paid 50,000 cheap "Mechanical Turks" to manually teach an AI that the "top left" of an image is pixel coordinates (0,0), that's... trickery. Its no longer intelligence. Its disconnected and not innate to the model anymore. The nature of the training set is what would determine how useful any of this actually is, and how well it generalizes to new tasks.

ssl-3 2y ago
You're still stuck on "the text," and not seeing the whole picture. ChatGPT does better than this.