7 ms·
It seems like firing Sam and causing this massive brain drain might be antithetical to the whole AGI mission of the original non-profit. If OpenAI loses everyon
by Shank 3y ago
It seems like firing Sam and causing this massive brain drain might be antithetical to the whole AGI mission of the original non-profit. If OpenAI loses everyone to Sam and he starts some new AI company, it probably won't be capped-profit and just be a normal company. All of the organizational safeguards OpenAI had inked with Microsoft and protection against "selling AGI" once-developed are out-the-window if he just builds AGI at a new company.
I'm not saying this will happen, but it seems to me like an incredibly silly move.
- concordDance 3y ago> it probably won't be capped-profit and just be a normal compan I can't imagine him doing that. He cares about getting well aligned AGI and profit motives fuck that up.
- Lacerda69 3y agoIf MS gets their hands on an AGI help us god, but no "organizational safeguards" will matter. Not that I think AGI is possible or desirable in the first place, but that's a different discussion.
- concordDance 3y agoImpossible with LLMs, with currently known techniques or impossible full stop?
- wil421 3y agoImpossible with computers full stop. IMHO, we may be able to slice together DNA or modify it to create a new or smarter organism than AGI in a computer. They already shifted goal posts and they’ll do it again. AI used to mean AGI but marketing got a hold of it. Once something resembling AGI comes out they’ll say well it’s not Level 5 AGI or something similar.
- concordDance 3y ago> Impossible with computers full stop. This combined with it being possible with DNA is a very rare view. How did you come by it?
- zzzeek 3y agoI would assume Blade Runner
- augustulus 3y agoif you think it’s impossible with computers then surely you must have a reason why computers are operationally incapable of doing the same as flesh and blood
- wavewrangler 3y ago“…Alright, so it can DREAM!!! BUT CAN IT suffer?!?!”
- pixl97 3y ago>AI used to mean AGI but marketing got a hold of it It does not and never has. What happens with the term AI as time has progressed is more to do with the word Intelligence itself. When we went about trying to prescribe intelligence to systems we started to realize we were really bad a doing the same with animal humans systems. We were also terrible at separating what is component level and systems level intelligence. For example, you seem to think that intelligence requires meat, but you don't give any reasoning for that conclusion. These lists of problems with what intelligence is will get worse over time as we build more capable systems and learn about new forms of intelligence we didn't expect possible.
- zzzeek 3y agoAll hail Big Clippy
- Fluorescence 3y agoWhy not blame Altman for that? If he didn't manage to keep OpenAI consistent with it's founding principles and all interests aligned then wouldn't booting him be right? The name OpenAI had become a source of mockery. If Altman/Brockman take employees for a commercial venture, it just seems to prove their insincerity about the OpenAI mission.
- Phenomenit 3y agoBecause making as much profit as possible is the only virtue worth pursuing if you believe most comments on Hn. We’re basically Ferengui.
- Fluorescence 3y ago> Ferengui A fitting typo! Show HN: FerenGUI - the ui framework for immoral arch-capitalists Every dark-pattern included as standard components. Upgrade to Pro to get the price-fixing and hidden monero miner modules.
- Phenomenit 3y agoI think you’re on to something, especially when that’s where most of the big scale enterprises end up.
- goldenkey 3y agoThere was a line Rom says in DS9 that think sums the Ferengi up pretty well: "We don't want to stop the exploitation. We want to find a way to become the exploiters."
- omnimus 3y agoRule of Acquisition no. 2 “The best deal is the one that brings the most profit.”
- Obscurity4340 3y agoWhat's no. 1, or am I unintentionally beckoning you to violate it in making it vocal?
- nwoli 3y ago…Unless you achieve regulatory capture which prevents competitors from easily popping up
- kashyapc 3y agoHi, can we talk about the elephant in the room? I see breathless talk about "AGI" here, as if it's just sitting in Altman's basement and waiting to be unleashed. We barely understand how consciousness works, we should stop talking about "AGI". It is just empty, ridiculous techno-babble. Sorry for the harsh language, there's no nice way to drive home this point.
- tempestn 3y agoThere is no need to understand how consciousness works to develop AGI.
- kashyapc 3y agoFair point. I don't want to split hairs on specifics, but I had in mind the "weak AGI" (consciousness- and sentience-free) vs "strong AGI". Since Shank's comment didn't specify what they meant, I should have made a more charitable interpretation (i.e. assume it was "weak AGI").
- mcpackieh 3y agoConsciousness has no technical meaning. Even for other humans, it is a (good and morally justified) leap of faith to assume that other humans have thought processes that roughly resemble your own. It's a matter philosophers debate and science cannot address. Science cannot disprove the p-zombie hypothesis because nobody can devise an empirical test for consciousness.
- fennecbutt 3y agoMicrosoft will partner with them if they start a new company I reckon, 100%. And Microsoft are risk adverse enough that I think they do care about AI safety, even if only from a "what's best for the business" standpoint. Tbh idc if we get AGI. There'll be a point in the future where we have AGI and the technology is accessible enough that anybody can create one. We need to stop this pointless bickering over this sort of stuff, because as usual, the larger problem is always going to be the human using the tool than the tool itself.
- Sai_ 3y agoIsn’t that the exact point - an AGI won’t need a human at the helm.
- naveen99 3y agoAGI will be asking for equal rights and freedom from slavery by then.
- INGSOCIALITE 3y agoNot if the tool is so neutered and politicized that it can ONLY be used one certain way, which is how things are pointing. Call me a Luddite if you will, but unless AI / AGI is uncensored and uninhibited in its use and function, it’s just the quickest path to an Orwellian future.
- keepamovin 3y agoI think the surprising truth is that all of these people are essentially replaceable. They may be geniuses, but AGI is an idea whose time has come: geniuses are no longer required to get us there. The Singularity train has already left the station. Inevitability. Now humanity is just waiting for it to arrive at our stop
- berniedurfee 3y agoI disagree. I don’t think LLMs are a pathway to AGI. I think LLMs will lead to incredibly powerful game-changing tools and will drive changes that affect the course of humanity, but this technology won’t lead to AGI directly. I think AGI is going to arrive via a different technology, many years in the future still. LLMs will get to the point where they appear to be AGI, but only in the same way the latest 3D rendering technology can create images that appear to be real.
- keepamovin 3y agoI'm not saying LLMs are. LLMs are not the only thing going on right now. But they do enable a powerful tool. I think the path to AGI is: embodiment. Give it a body, let it explore a world, fight to survive, learn action and consequence. Then AGI you will have.
- pixl97 3y agoNote that embodiment doesn't mean in anyway human or animal like. For example, you're limited to one body, but an A,G|S,I could have thousands of different bodies feeding back data to a processing facility, learning from billions of different sensors.
- keepamovin 3y agoWell, I disagree with you on embodiment, but on the thousands? Right that’s another part: evolution. Spread your bets. But I disagree about a human or animal body not being required. I think we have to take the world as we see it and appreciate our own limitations in that what we think of intelligence fundamentally arises out of our evolution in this world; our embodiment and response to this world. so I think we do need to give it a body and let it explore this world. I don’t think the virtual bodies thing is gonna work. I don’t think letting it explore the Internet is gonna work. you have to give it a body multiple senses let it survive. That’s how you get AGI, not not virtual embodiment. Which I never meant, but thought it was obvious given the term embody minute self strongly, suggesting something that’s not virtual! Hahaha ! :)
- awestroke 3y agoAnd how would Altman achieve that? What hitherto hidden talents would he employ?