3 ms·
> I do not think there is any hard evidence to indicate it will suddenly stop getting better. We have only seen consistent progress, and the cost of infererence
by tivert 2y ago
> I do not think there is any hard evidence to indicate it will suddenly stop getting better. We have only seen consistent progress, and the cost of infererence per kwh keeps going down.
You could've literally said the exact same thing about Moore's law for decades and decades. Then progress fell off that curve. Eventually, it will hit physical limits and stop.
> I am agnostic to its success or continued development.
Then the question is why do you have the double standard? We don't have any hard evidence that AI will keep getting better just like we don't have any hard evidence that TMSC or Intel will pull off another major process shrink or two.
Past performance is not a guarantee of future results.
> A few years ago gpt3 scale models filled datacenters, now they fit on an iphone. We will probably see them sneak onboard drone flight controllers, and toys as ambulation chips, cheap security cameras, etc.
I don't think "more gpt3" is what people mean by AI "getting better."