3 ms·
>Human-level AI is not just around the corner. This is going to take a long time. And it’s going to require new scientific breakthroughs that we don’t know of y
by tim333 3y ago
>Human-level AI is not just around the corner. This is going to take a long time. And it’s going to require new scientific breakthroughs that we don’t know of yet.”
I basically agree but who knows how long the unknown breakthroughs will take given the large number of smart people working on it? Next week? Next century? It's hard to put a time on it.
That said it seems to be the pattern that as soon as the computing ability becomes cheap and powerful enough that individual researchers can muck around with it at home, the algorithms get figured out not long after.
- tonetegeatinst 3y agoThis has always been my stance in basically any field. Be it computer science or material science research or AGI.....I think its so hard to really say when we will hit the next breakthrough in a field. That sort of thing is hard to accurately predict. As in regards to hardware, I kinda agree disagree. Hardware is a big part of the bottleneck in most computer fields when it comes to AI or computer vision. These things are compute and memory intensive and hardware manufacturers are straddling the line between staying profitable by charging for premium features and just dumping their hardware on the market for cheap. Am I pretty pissed that most open source researchers and models are stuck using this extremely expensive hardware....yes I sometimes wish that we would stop using "GPU" for training and we got a dedicated hardware architecture that's open source like riskV but solely for AI and research purposed without costing more tha n my kidneys. I think its also a matter of discovering new ways to accelerate these workloads so that its feasible for them to be created by hobbyists on a small budget and not by large funded groups or companies. Were doing really good in some aspects but in other ways....we have much to work on
- alephxyz 3y agoYou can get an ML workstation with 2xRTX4090 for around 10k. A 4xA800 setup tops out at 100k and should last you a few years. I consider that fairly affordable to do bleeding edge research especially compared to other fields.
- byyoung3 3y agoMore like 3k for dual 4090
- haswell 3y agoA single 4090 FE retails for $1,599. Getting two of these in a capable enough workstation is going to cost a fair amount more than $3K.
- mitthrowaway2 3y agoYes, compared with equipment for biology, materials science, and so on, this is very cheap.
- throwaway09223 3y agoThe $5-$10k mark for a high end home workstation has held pretty firm since the 1980s. That's the buy-in price point for a very early PC, an SGI Indy, a low end Sun workstation, etc. We went through an amazing period of very cheap computers from 2000-2020. We just didn't need specialty or high end equipment for a while. Now we do again.
- pixl97 3y ago>I sometimes wish that we would stop using "GPU" for training and we got a dedicated hardware architecture that's open source like riskV but solely for AI and research purposed without costing more tha n my kidneys. At least for the time being there is no magic workaround for the amount of FLOPS and memory bandwidth needed. When you look at neural network architectures they tend to be massively parallel, and building out at that scale in hardware is going to cost a lot. And, when the hardware does show up, at least with the scaling laws we're seeing at this time, the groups that have massive amounts of this lower powered/accellerated hardware are going to be ahead of those without budgets.
- smohare 3y agoScientific progress almost always presents as series of iterations, not punctuated breakthroughs. Moreover, many significant advances appear nearly simultaneously. This tends to suggest a measured progress, though obviously still largely unpredictable at any scale. I don’t see why AGI would follow a different course, one where we are “just some breakthrough away”. Especially not given the current state of the field. Personally I’d wager neuromorphic computing is the prime candidate to yield AGI.
- pdimitar 3y agoWhy was your comment dead just 5 minutes after posting? Very puzzling. And it shouldn't be a controversial comment either.
- deleted 3y ago[deleted]
- jltsiren 3y agoThe idea of future breakthroughs assumes that the problem is conveniently human-sized. That it's possible to build an organization that's not too large be dysfunctional and populate it with experts. And that the experts will find the solution before dying of old age or before the organization degenerates into something else. It could be that the solution exists, but it's too large and too complex for humans and human organizations. Technological singularity is a popular trope in speculative discussions about AI. But the reality could also be the opposite. It could be that productivity will increase asymptotically slower than the effort required to achieve further increases in productivity.
- tim333 3y agoThe fact that we can be intelligent with a design based on 30k genes or so probably suggests a limit to the complexity needed.
- hyperthesis 3y agoTo find a needle in a haystack, looking at each straw needs to be a really cheap operation. Even if it was right there the whole time. "cheap and powerful enough that individual researchers can muck around with it at home" seems a pretty good measure of this, because of the explosion in width and pace of experimentation.
- deleted 3y ago[deleted]
- demondemidi 3y agoIf the big three suck up all the brain power in the race for $$$ AI will take even longer. The profit motive alone will stifle progress. Right now AI degrees pay 300-500k/yr. That’s causing a flood of mediocre engineers that will pollute the space and limit who can hire them. 25 years ago process engineers were the highest paid, and you have to jump through hoops to fit Moore’s law curves today.