6 ms·

I'm thinking the current-generation AI (deep CNNs, not symbol-based reasoning) are enough to be paradigm-changers in the future by allowing us to record empiric

by ddalex 5y ago

I'm thinking the current-generation AI (deep CNNs, not symbol-based reasoning) are enough to be paradigm-changers in the future by allowing us to record empiric knowledge. Computers are good at recording structured knowledge - who owns that, this merch goes where, things that were recorded on stone tablets since times immemorial. But human experts also have a different type of knowledge, empiric, accumulated through years of experience. Artisan crafters "know" how good some material is by sense of touch, smell, sight, without always being able to say WHY or HOW this wood is better than that wood for this table. This is why apprenticeship with a master was a key part of developing an artisan - you'd transfer SOME of this empirical knowledge from a master that took a lifetime to develop it. The humanity took a huge step forward by moving a lot of empirical knowledge to structured knowledge through the use of models (mathematical?) and books. Instead of an apprentinceship with a mason, a builder now goes to school and learns how to structurally design a building based on construction codes. This allows huge scaling of knowledge, at the expense of missing subtle details which are not modelled (spherical cows in a void, right?). With this article it just occured to me that Deep Learning may be the tool to record this type of empirical knowledge. And it's going to scale out - unlike the human version never did - because digital copying is cheap, and the knowledge doesn't die with the artisan that developed it - it only gets more accurate. The models we build about reality will get more and more accurate - the spherical cows will grow legs in the air, not in a void. Humanity will start doing more and more things without understanding why, but because "the computer said so", and things work out when the computer says they will. Black boxes will explode in usage, and God forgive those that may be on the side where The computer says No.

Sleepytime 5y ago
> Humanity will start doing more and more things without understanding why, but because "the computer said so", and things work out when the computer says they will. Black boxes will explode in usage, and God forgive those that may be on the side where The computer says No. This paragraph scares me. I'm not convinced that technology getting good enough to where it doesn't need to be understood to be used is a good thing in most cases. Especially when it's a black box.
- Gibbon1 5y ago
  What should scare you is it's becoming apparent procedures are being put in place so that when the 'computer says no' the person affected isn't given the information they need to fix the problem they have. Banking computer closed your account. Why? We can't tell you why. Google or Apple rejected your app from their app store. Why, won't tell you why. Me trying to get my prescription refilled at Walgreens. Walgreens computer shows they never got it from the doctor. Doctor sent it 5 times. Turned out the computer was marking it invalid each time. Pharmacist isn't allowed to tell neither me or my doctor why.
  - ddalex 5y ago
    They will not tell you not out of malice, but because they don't know. It's literally a black box, and we don't understand whys. And it doesn't take a deep CNN to become a black box - any sufficient complex algorithm will do. I doubt anybody in the world understands all the details of how the latest CPU actually works, for example.
- 444throwaway 5y ago
  If we can't ask the AI to explain how it came to its conclusion it is not really intelligent, is it? You would not believe a human is intelligent if he just tells you what to do without being able to explain why, would you?
  - dotancohen 5y ago
    Pick ten random people that you know. How many of them can explain to you how their Facebook post gets to grandma?
    - 444throwaway 5y ago
      True, but they did not decide how to do it and did not implement it. I would expect the facebook engineer who implemented it to be able to explain it to me, at least the part which he did.
  - 5y ago
na85 5y ago
>Humanity will start doing more and more things without understanding why, but because "the computer said so", and things work out when the computer says they will. Black boxes will explode in usage, and God forgive those that may be on the side where The computer says No. That sounds like a hellish dystopia.
- PoignardAzur 5y ago
  I don't have empirical evidence, but I think people are overstating the harm of opaque AIs. On the one hand, opaque bureaucratic processes already exist today. It's not like the bank that refuses you a loan will tell you "oh, but we would totally have granted it if you were 20% richer and also not a woman, so come back after you've achieved that and we'll give you the loan"! On the other hand, even opaque models can be studied and systematized. You can't run a simulation of a judge on 100 sample cases, then on the same 100 sample cases with names changed to sound like immigrants, and numerically measure the judge's bias. You can do that with a ML model, and compensate in various ways.
  - dagw 5y ago
    It's not like the bank that refuses you a loan will tell you That's because they don't want to tell you, not because they don't know. The bank knows exactly why they refused to give you a loan and exactly which series of policy changes led to that outcome. They also know exactly how to change the policy to achieve a different outcome. None of those things are true with AIs.
moab 5y ago
We have been using objects of the kind described in your last paragraph, called compilers since the 1950s, and with the increasing number of portability-focused high-performance DSLs / frameworks like tensorflow or OneAPI, we are only going further down this direction. But yet 70 years after the advent of compilers, there are still people who know how to open-up the machine, improve it, and fix it, and there probably always will be. I don't see how machine learning, at least in its current non-AGI state, will be any different. It's just that your average end-user will have no idea how to "open up the machine", but that's also true for compiler technology today.
- adrianN 5y ago
  There need not be material differences if there are sufficient differences in scale. Of course we already rely on algorithmic black boxes, in fact I'd argue that we have been relying on algorithmic black boxes since before we had computers (we just call them "traditions" instead). But if a technology like neural nets expands the applicability by a sufficient margin, the resulting societal change can be huge.
Anktionaer 5y ago
I was with you until the last sentence, could you be any more dramatic?
- ddalex 5y ago
  I am facing with this exact problem at work - I have a tool that scans thousands of files and tells me No. Why ? I don't know why. The algorithm it performs is split between 10-20 other subtools (microservices, right?) making following the decision tree almost impossible. What happens when this kind of tool will calculate your credit score, social score, or the proceeds of your savings ?
truth_ 5y ago
Your first paragraph is spot on. Some people are hell-bent on developing AGI (and these people should exist), and there are some doing SOTA-chasing by tweaking hyperparameters to the extreme and overfitting the data (these works are _mostly_ useless), but most people do not realize the amount of AI we have right now, right this day, is enough bring in fundamental and permanent paradigm changes in as many fields as you can think of. And you are onto something when you say that "empirical records" can be learned by ML models, and a huge amount of grunt work is required for that. Every tom, harry, and dick can overfit to MNIST today, it used to be hard someday. And note the amount of grunt work it took to build MNIST- thousands of human hours. Building Datasets does not pay you back instantly, but it has benefits for all. I know some people who are paying money out of their own pockets and creating niche Datasets and making them available under MIT Lisence. Hope that more and more companies and people do that for really niche fields. And I don't completely agree with not understanding things that DL models do and relying on them. We have started to understand much of it. ML interpretation is a field with mot much success but I am hopeful. We did not know jack about how very deep CNNs work, but that changed with the Zeiler-Fergus paper[0]. Later with things like Grad-CAM[1]. Now we are trying to understand latent representation fully. We (even I) can create GAN generated pictures with different haircolor, different kinds of glasses, etc. from scratch. I read not more than two days ago that Microsoft and Peking Uni researchers found a way to identify "knowledge neurons" in unsupervized pretrained embeddings in NLP and they can edit facts with that [2]. So, I am optimistic about our "interpretation" future. [0]: https://cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf https://cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf [1]: https://arxiv.org/pdf/1610.02391.pdf https://arxiv.org/pdf/1610.02391.pdf [2]: https://arxiv.org/pdf/2104.08696.pdf https://arxiv.org/pdf/2104.08696.pdf

by ddalex 5y ago

Sleepytime 5y ago

> Humanity will start doing more and more things without understanding why, but because "the computer said so", and things work out when the computer says they will. Black boxes will explode in usage, and God forgive those that may be on the side where The computer says No. This paragraph scares me. I'm not convinced that technology getting good enough to where it doesn't need to be understood to be used is a good thing in most cases. Especially when it's a black box.

Gibbon1 5y ago
What should scare you is it's becoming apparent procedures are being put in place so that when the 'computer says no' the person affected isn't given the information they need to fix the problem they have. Banking computer closed your account. Why? We can't tell you why. Google or Apple rejected your app from their app store. Why, won't tell you why. Me trying to get my prescription refilled at Walgreens. Walgreens computer shows they never got it from the doctor. Doctor sent it 5 times. Turned out the computer was marking it invalid each time. Pharmacist isn't allowed to tell neither me or my doctor why.
- ddalex 5y ago
  They will not tell you not out of malice, but because they don't know. It's literally a black box, and we don't understand whys. And it doesn't take a deep CNN to become a black box - any sufficient complex algorithm will do. I doubt anybody in the world understands all the details of how the latest CPU actually works, for example.
444throwaway 5y ago
If we can't ask the AI to explain how it came to its conclusion it is not really intelligent, is it? You would not believe a human is intelligent if he just tells you what to do without being able to explain why, would you?
- dotancohen 5y ago
  Pick ten random people that you know. How many of them can explain to you how their Facebook post gets to grandma?
  - 444throwaway 5y ago
    True, but they did not decide how to do it and did not implement it. I would expect the facebook engineer who implemented it to be able to explain it to me, at least the part which he did.
- 5y ago

na85 5y ago

PoignardAzur 5y ago
I don't have empirical evidence, but I think people are overstating the harm of opaque AIs. On the one hand, opaque bureaucratic processes already exist today. It's not like the bank that refuses you a loan will tell you "oh, but we would totally have granted it if you were 20% richer and also not a woman, so come back after you've achieved that and we'll give you the loan"! On the other hand, even opaque models can be studied and systematized. You can't run a simulation of a judge on 100 sample cases, then on the same 100 sample cases with names changed to sound like immigrants, and numerically measure the judge's bias. You can do that with a ML model, and compensate in various ways.
- dagw 5y ago
  It's not like the bank that refuses you a loan will tell you That's because they don't want to tell you, not because they don't know. The bank knows exactly why they refused to give you a loan and exactly which series of policy changes led to that outcome. They also know exactly how to change the policy to achieve a different outcome. None of those things are true with AIs.

moab 5y ago

We have been using objects of the kind described in your last paragraph, called compilers since the 1950s, and with the increasing number of portability-focused high-performance DSLs / frameworks like tensorflow or OneAPI, we are only going further down this direction. But yet 70 years after the advent of compilers, there are still people who know how to open-up the machine, improve it, and fix it, and there probably always will be. I don't see how machine learning, at least in its current non-AGI state, will be any different. It's just that your average end-user will have no idea how to "open up the machine", but that's also true for compiler technology today.

adrianN 5y ago
There need not be material differences if there are sufficient differences in scale. Of course we already rely on algorithmic black boxes, in fact I'd argue that we have been relying on algorithmic black boxes since before we had computers (we just call them "traditions" instead). But if a technology like neural nets expands the applicability by a sufficient margin, the resulting societal change can be huge.

Anktionaer 5y ago

I was with you until the last sentence, could you be any more dramatic?

ddalex 5y ago
I am facing with this exact problem at work - I have a tool that scans thousands of files and tells me No. Why ? I don't know why. The algorithm it performs is split between 10-20 other subtools (microservices, right?) making following the decision tree almost impossible. What happens when this kind of tool will calculate your credit score, social score, or the proceeds of your savings ?

truth_ 5y ago

Your first paragraph is spot on. Some people are hell-bent on developing AGI (and these people should exist), and there are some doing SOTA-chasing by tweaking hyperparameters to the extreme and overfitting the data (these works are _mostly_ useless), but most people do not realize the amount of AI we have right now, right this day, is enough bring in fundamental and permanent paradigm changes in as many fields as you can think of. And you are onto something when you say that "empirical records" can be learned by ML models, and a huge amount of grunt work is required for that. Every tom, harry, and dick can overfit to MNIST today, it used to be hard someday. And note the amount of grunt work it took to build MNIST- thousands of human hours. Building Datasets does not pay you back instantly, but it has benefits for all. I know some people who are paying money out of their own pockets and creating niche Datasets and making them available under MIT Lisence. Hope that more and more companies and people do that for really niche fields. And I don't completely agree with not understanding things that DL models do and relying on them. We have started to understand much of it. ML interpretation is a field with mot much success but I am hopeful. We did not know jack about how very deep CNNs work, but that changed with the Zeiler-Fergus paper[0]. Later with things like Grad-CAM[1]. Now we are trying to understand latent representation fully. We (even I) can create GAN generated pictures with different haircolor, different kinds of glasses, etc. from scratch. I read not more than two days ago that Microsoft and Peking Uni researchers found a way to identify "knowledge neurons" in unsupervized pretrained embeddings in NLP and they can edit facts with that [2]. So, I am optimistic about our "interpretation" future. [0]: https://cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf https://cs.nyu.edu/~fergus/papers/zeilerECCV2014.pdf [1]: https://arxiv.org/pdf/1610.02391.pdf https://arxiv.org/pdf/1610.02391.pdf [2]: https://arxiv.org/pdf/2104.08696.pdf https://arxiv.org/pdf/2104.08696.pdf