3 ms·

I guess what I'm saying is that I agree we're in the Clever Hans stage of AI, where we're just more explicit about stopping Hans when his tapping has reached ou

I guess what I'm saying is that I agree we're in the Clever Hans stage of AI, where we're just more explicit about stopping Hans when his tapping has reached our goal. I think the ability of these image models to synthesize new images is really amazing. It makes the computer feel like it is doing something organic, and not just applying filters and things to the images. Then, when we see the new image paired with a text that generated it, we think the system might actually know what we're talking about. But it obviously doesn't, it's just the luck of a model with billions of parameters. Whenever the model fails to produce an acceptable output, it stops being intelligent and the user is considered to be bad at their job, or to be asking for something that is unreasonable. I think it's still spot-on to say that comprehension is far away, even though you can pair outputs to inputs and have a simulacrum of comprehension.

sdenton4 4y ago
Take a look at the curse of dimensionality... We're at the stage of reducing a haystack from nearly infinite to a small pile of hay to search for the needle, which has required massive advances. This really isn't clever hans at all. Additionally, it's helpful to look at these systems as tools. We don't expect cars to work well without humans learning how to interact with them in a safe and reliable way. ML tools, thanks to high expectations and moving goalposts, aren't tested in the same way. But ultimately this specific line of questions - handling context over multiple queries - is something people are actively working on, and I'm confident it'll have some real solutions within a year. It's closely connected to synthesizing video, which has a huge amount of effort going in right now and some really incredible early results already. And then we can move the goal pays again and continue talking about horses...

sdenton4 4y ago

Take a look at the curse of dimensionality... We're at the stage of reducing a haystack from nearly infinite to a small pile of hay to search for the needle, which has required massive advances. This really isn't clever hans at all. Additionally, it's helpful to look at these systems as tools. We don't expect cars to work well without humans learning how to interact with them in a safe and reliable way. ML tools, thanks to high expectations and moving goalposts, aren't tested in the same way. But ultimately this specific line of questions - handling context over multiple queries - is something people are actively working on, and I'm confident it'll have some real solutions within a year. It's closely connected to synthesizing video, which has a huge amount of effort going in right now and some really incredible early results already. And then we can move the goal pays again and continue talking about horses...