14 ms·
Yeah, memory implies persisted state in the model, this is static lookups separate from the transformer. Still superb, though, there's no reason you can't use
by robbedpeter 5y ago
Yeah, memory implies persisted state in the model, this is static lookups separate from the transformer.
Still superb, though, there's no reason you can't use other gofai tools vs a static database, to trigger expert systems or formalized reasoning.
- neom 5y agoI got into a very long debate with an openai person 4/5 years ago about this + adversarial learning + access to a quantum computer (think just straight up world class abacus) was close to the primitives required for more generalized AI. They didn't agree with me, but that's ok! :)
- torbTurret 5y agoWhat’s your argument?
- neom 5y agoI hope I didn't come off like I think know anything about this field, because I don't. A friend who use to work for openai (Jack Clark) and I spend some time once discussing over beers some stuff around general purpose AI, and I proposed that I believe quantum is a dark horse on the road to general purpose AI, and he disagreed.
- stavros 5y agoSounds like a fun debate to me.
- netizen-936824 5y agoI think the person you're replying to is asking for your specific argument. As in what exactly do you think is the advantage gained by quantum computing and why is it important.
- torbTurret 5y agoYeah I have no horse in this race, just curious of your viewpoint as someone who works in the field!
- neom 5y agoWell, as weird as it is, I took the approach of AI itself deciding it wants to utilize quantum computing to, itself, realize a more generalized intelligence. I like Nick Bostrom so that should give you a sense of the direction I come at this stuff from. My understanding is that quantum computing is quite good around combinatoric challenges, as we're not to shabby there...I was thinking it would be helpful.. anyway, it would take a long time to explain the conversation but generally my thought was that AI operating classically will probably want to outsource some of that thinking, especially probabilistic.... it's "future thought" if you will, to something more like QC.
- ummonk 5y agoYeah he's right, you're wrong.
- bawolff 5y ago> + access to a quantum computer Yeah... i think i already agree with the person disagreeing with you just based on this description. "world class abacus" is not an accurate description of what a quantum computer is.
- justinpombrio 5y agoThat poor researcher.
- neom 5y agoThankfully we're very good friends, so it was a few hours well spent over beers (I hope...?)
- saltyfamiliar 5y agoDoes anyone know if we understand enough about natural, generally intelligent brains to dismiss the idea that they are using quantum phenomenon for computation? Is it unlikely for any reason?
- jowday 5y agoSomeone asked this question to Leonard Susskind once at a Q&A and he said the chances are basically zero. When the guy kept pressing on the idea Susskind got kind of exasperated and seemed like he was on the verge of calling the idea woo.
- visarga 5y agoNot necessary. Quantum AI is basically explaining something mysterious by something else mysterious, even when there is no indication they are related.
- HPsquared 5y agoAren't a lot of AI breakthroughs like this though? "It works, but we don't know why"
- runnerup 5y agoI believe plenty of "quantum phenomenon" are utilized in humans' biochemistry[0]. Whether the brain "calculates" things using a method that is particularly similar to the methods used in today's quantum computers is...unlikely. It probably is "quantum" in other ways though. 0: https://www.the-scientist.com/infographics/infographic--quantum-explanations-for-biological-phenomena-65917 https://www.the-scientist.com/infographics/infographic--quan...
- visarga 5y agoIt's not gofai. It's locality sensitive hashing published in 2008.
- YeGoblynQueenne 5y agoAn external knowledge base plugged in to an inference engine? Well, that is 100% pure GOFAI, distilled and bottled, ready to go. Sorry.