3 ms·

There were a lot of people that thought ELIZA was intelligent. There's some in-roads in finding specialized models that work very well, up until they don't, and

There were a lot of people that thought ELIZA was intelligent. There's some in-roads in finding specialized models that work very well, up until they don't, and when they fail, they fail hard, showing us just how different their processing can be from our own mental models. My own personal definitions of intelligence cover some amount of self-reinforced learning. That is, if I tell an AI how to do something, it will think about how to do it, Google for the answer, watch and understand a YouTube tutorial, and try to follow along with it, and if it doesn't understand a part it has the ability to rewatch and try again. I've never seen a jaguar in person; I've maybe seen 10 minutes total of videos and photos of one, and yet I can imagine one running through a field, chasing down a predator, and eating its corpse. Current AI need to be trained on gigabytes of data manually labeled "jaguar" to identify a single one. Why can't an AI, after seeing something it doesn't recognize, ask a question like "what is that"? Just a few years ago, there was that Minecraft AI challenge that failed spectacularly -- the task was to watch 50 hours of video of someone else playing the game, and then do it themselves. I could probably do that after ten minutes.

sdenton4 4y ago
In twenty years, we're going to look at classifiers in the same way we look at pre-Google search engines. They are buggy as hell because the classification problem is incredibly ill posed. DALL-E2 is a fantastic example of zero-shot learning working spectacularly well. It's able to combine various concepts interchangeably.
mountainriver 4y ago
Modern models can do few shot learning, and MuZero proved the ability to learn a game quickly using self-play. They aren't human level yet in all tasks but we are getting demonstrably closer. I would spend more time studying what exists today and less time critiquing

sdenton4 4y ago

In twenty years, we're going to look at classifiers in the same way we look at pre-Google search engines. They are buggy as hell because the classification problem is incredibly ill posed. DALL-E2 is a fantastic example of zero-shot learning working spectacularly well. It's able to combine various concepts interchangeably.

mountainriver 4y ago

Modern models can do few shot learning, and MuZero proved the ability to learn a game quickly using self-play. They aren't human level yet in all tasks but we are getting demonstrably closer. I would spend more time studying what exists today and less time critiquing