5 ms·
> I am young, but still lived through several hype phases. My impression is that this is a tech revolution unlike any that has gone before allowing for absolut
by jacquesm 4y ago
> I am young, but still lived through several hype phases.
My impression is that this is a tech revolution unlike any that has gone before allowing for absolutely massive concentration of power and wealth. The previous tech revolutions have shown the downsides of such concentration and I'm quite sure that the people that are currently in the driving seat of how, when and where this tech gets used and/or weaponized are exactly the people that I would not want to see in that position.
The problem is not with the fact that the pig is dancing in a crappy way. The problem is that it is dancing at all, this is the thing that makes this a different kind of tech revolution. So far tech was doing what it was told, within certain boundaries. This is the kind of tech that will end up telling you what to do, either directly or through some intermediary, it is a substantial shift in the balance of power and has the potential to lead to even stronger divisions in our populations than what social media has been able to effect as well as to cause massive loss of jobs.
Extrapolating from the last two years of this development into the future over the span of say a decade (a reasonably short span of time for me) means that 'all bets are off' and that we can no longer meaningfully predict the outcome of the moves that are being made today. For me that is a warning to be cautious to get more understanding of how we will deal with the problems that it will generate rather than to jump in head first to see where it will lead.
- lukev 4y agoI agree with this 100%, while also disagreeing with the "robot god will kill us all" objections to AI which unfortunately tend to get most of the mindshare. I think it's important to realize that these are two _completely separate_ concerns. Unfortunately, a lot of the people who get the most air time on this topic are not at all worried about authoritarianism or economic collapse compared to a hypothetical singularity.
- Avicebron 4y ago[dead]
- JohnFen 4y agoPersonally, I'm worried that if the proponents of LLMs are correct, it will directly lead to authoritarianism and economic collapse.
- bvaisvil 4y agoWho's gonna pay for GPT's in an economic collapse?
- JohnFen 4y agoThe wealthy and powerful. Same as now.
- slowmovintarget 4y agoYou're presupposing the collapse touches the rich. "A quart of wheat for a denarius, and three quarts of barley for a denarius; but do not harm the oil and the wine!"
- ChatGTP 4y agoSo how does this situation actually look: Bill Gates sitting on a yacht controlling a robot army while we're all starving ?
- haberman 4y ago> So far tech was doing what it was told, within certain boundaries. This is the kind of tech that will end up telling you what to do, either directly or through some intermediary The financial crisis in 2008 was caused by investors who made risky bets based on models they built telling them that mortgage-backed securities were a safe investment. Our understanding of the world is guided by social science that seems to involve an incredible amount of p-hacking using statistics packages that make it easy to crunch through big datasets looking for something publication-worthy. It seems like tech already gives people plenty of tools to make poor decisions that hurt everybody.
- jacquesm 4y agoIndeed it does, and we haven't got that under control yet, not by a very long distance. So I figure better take it easy before adding an even more powerful tool to the mix.
- Ygg2 4y ago> Extrapolating from the last two years Therein lies the error. People forget reality is finite and just because it improved now doesn't mean it will continue indefinitely. An exponential curve is just a sigmoid curve in disguise. Most AI I've seen suffer from catastrophic errors in the tail end (famous example of two near identical cat pictures classified as cat and dog respectively).
- dwaltrip 4y agoWhy do you believe there will be no significant improvements beyond SOTA in the coming years / decades? That's an incredibly strong stance... I’d love to hear your assessment of the improvements from gpt-3.5 to gpt-4. Do you not think it is a large jump?
- jacquesm 4y agoWhy is that an error? This is very new tech, if anything the rate of change is accelerating and nowhere near slowing down. That it will flatten at some point goes without saying (you'd hope!), but for the time being it looks like we're on the increasing first derivative part of the sigmoid, not on the flattening part, and from two years to a decade takes you roughly from '2 kg luggable' to 'iphone' and that was a sea change.
- Ygg2 4y ago> Why is that an error? First. It seems like these AI models depend on the underlying hardware acceleration doubling, which is not really the case anymore. Second. All AI's I've seen suffer from the same works fine until it just flips the fuck out behavior (and starts hallucinating). You wouldn't tollerate a programmer that worked fine except he would ocassionally come to work high enough on bath salts to start claiming the sky is red and aliens have inflitrated the Wall of China. AI's that don't suffer from this aren't general purpose. Third. I'm not convinced in we'll make AI whose job will be to make smarter AI which will make smarter AI argument. A smart enough AI could just rewire its reward mechanism to get reward without work (or collude with other AIs meant to monitor it to just do nothing).
- dTal 4y agoI wish this viewpoint were more common. It's frightening to see how rapidly the "AI safety / alignment" discourse is being co-opted into arguments that AI should follow the whims of large centralized corporations. We have no idea what secret instructions OpenAI or the others are giving their "helpful" assistants. I find the notion that AI will spontaneously become a paperclip maximizer much less immediately terrifying than the clear and present danger of it being co-opted by our existing soulless paperclip maximizers, corporations, to devastating effect.
- wrycoder 4y agoYeah, the LLMs at the three letter agencies communicating directly with their LLM counterparts at FB and Google. And Twitter, once Musk moves on, and that site gets brought back into the fold. The social issues need to be addressed now.
- michaelmior 4y ago> AI should follow the whims of large centralized corporations I'm not arguing that AI should follow the whims of large centralized corporations, but given the cost of training large models such as GPT-4, what's the alternative? Do we need large language models as a taxpayer-funded public utility? Perhaps a non-profit foundation? I'm not sure what the solution is here, but I am concerned that right now, large corporations may be the only ones capable of training such models.
- evrydayhustling 4y agoI'm surprised by your impression that there are people "currently in the driving seat of how, when and where this tech gets used". I think we are in the grip of a wonderful, highly creative dis-order. The most comparable moment in my lifetime was the late 90s, where the inevitability and transformative power of the Internet (through the web) became mainstream over a couple of years. This time that transition seems to be taking weeks! And yet, it is FAR more broadly accessible than the Web was in the late 90s. In America at least, where 85% of individuals have smart phones, ChatGPT is instantly accessible to a huge portion of the population. And unlike other advances it doesn't require specialized expertise to begin extracting value. Meanwhile, LLM owners are being compelled by competition to continue offering services for free and release research into the public domain. The engineering advances that power their platforms face a sideways challenge from research like LORA that makes them less relevant. And because the training data and methods are ubiquitous, public institutions of many kinds can potentially build their own LLMs if rents get too high. Outside the runaway-superintelligence scenario, the current accessibility of LLMs is one of the best ways this could have played out. I'm afraid those attempting to slow research will be unwitting accomplices for people who use the opportunity to reduce competition and consolidate power over the new technology.