3 ms·
> I'm pretty sure you have misunderstood what he was talking about in terms of what sparsey does That is quite possible. > It's pretty clear what you meant, t
by lisper 8y ago
> I'm pretty sure you have misunderstood what he was talking about in terms of what sparsey does
That is quite possible.
> It's pretty clear what you meant, to be honest.
What I meant was exactly what I said: evaluating Sparsey makes a good exercise. I believe it is bogus, but I could be wrong. I am basing my judgement on very sparse (no pun intended) data.
> I'll let him comment on what you guys were talking about
Here are the relevant quotes from our correspondence:
Gerard: I just watched your 2011 "Quantum Conspiracy.." talk and thought you might be interested in an idea I've had concerning quantum theory and how information is represented. The core idea is briefly described in my 2012 paper. "Quantum Computation via Sparse Distributed Representation". I have to related Medium articles as well, "Quantum Computing in the Offing" and "Not Copenhagen, not Everett, a New Interpretation of Quantum Reality". The essential idea is this. To my knowledge, in all quantum theory (QT) and quantum computing (QC) models published to date, prob. amplitudes (PAs) are represented in localist fashion. That is, each PA is represented in its own physically unique memory location (e.g., 64-bits, 32 for real, 32 for imag.) that is physically disjoint from every other PA. In principal, the number of PAs needed to describe a system is of exponential order, so a localist representation requires exponential memory. BUT, if instead, PAs are represented as sparse distributed representations (SDRs), i.e., small subsets of binary units chosen from a much larger field, then they can all exist (be physically stored) in physical (and classical superposition): each PA is just a different subset of the units and the subsets can overlap. Thus, the exponential number of PAs can be represented in sub-exponential (polynomial) memory, Basically, we're leveraging a third fundamental resource, "code space", which is formally orthogonal to the other two, time and (physical) space (i.e., amount of memory). That is, the code space of an SDR coding field is of combinatorial (exponential) order.
Me: Thanks for bringing this intriguing work to my attention. You say "the exponential number of PAs can be represented in sub-exponential (polynomial) memory”. This makes it sound as if you claiming that SDRs allow you to achieve quantum supremacy in a classical machine. Am I reading you correctly? Because if that’s what you’re claiming, then you are almost certainly wrong. Since you don’t seem like a quack, it seems more likely that I’m just misinterpreting what you’re saying, so I thought I should get that cleared up before going any further.
Gerard: Actually, you are interpreting correctly and thank you for being open to the possibility that I'm not a quack :) [Lots of details about Sparsey elided.]
Me: OK, but in the interests of full disclosure you should know that my Bayesian prior on this [not being a quack] is still not very high :-) So let me ask you another “top-level filter” type question: can Sparsey run Schor’s algorithm? If so, have you done it?
Gerard: No I've never tried to run Shor's algorithm. [Lots more details elided.] What d'ya think?
Me: I think you should try to run Shor’s algorithm, because if you succeed that will be a slam-dunk proof that your claims are correct.
Gerard: Well, I don't really understand Shor's algorithm (from wikipedia). I'd have to study it. I never really have so far.
I never responded to that because at that point I was pretty convinced he was a quack. It's possible I'm wrong about that. But I'm very confident that he doesn't understand quantum supremacy, and that his claims about it are wrong.
- CodiePetersen 8y agoWell like I said I have no clue about any of the quantum mechanics side of it, I only know what sparsey does. But yes, one state is represented by an SDR (not just and SDR but probabilities that have triggered an SDR), but not just that state all of the states leading up to the current represented state as well. Changing the representation changes not just what is currently represented but again an entire history and past representations. The code space he is talking about is utilizing time. So say I have 10 bits, and one of them is on, then I can represent 10 things. Now if my system also takes into account the code of the last time step I can represent 100 different things. 10 things in 10 different temporal contexts each, is 100 unique spatio-temporal states, and that goes on for however many layers you make. Hence exponential. Now I don't know what quantum supremacy is, but you brought it up it seems, he didn't. In general I know he thinks specialized hardware is not needed, and he has stated to me he thinks SDR or sparsey based systems tailored to do quantum computing problems could be a reality. So I think he might have thought you meant quantum supremacy in that sense. As he has told me. But I won't comment too much on that because he'll be responding tomorrow most likely. It's past midnight where he is at. But that's what I know Sparsey does, whether or not its better than quantum computing, I couldn't say. I've tried to understand what he is getting at but I just don't know enough quantum mechanics to come to any aha moments. What I do know is that the state representation in sparsey is massive and can represent many many high order concepts from low order concepts/features and find correlation between concepts both spatially and temporally. The math is very simple for that and not really hard to wrap your head around. You should start with the 2010 paper and 2014 paper of his if you are actually going to do the mental exercise you suggested. I don't know how you can claim someone is a quack if you don't even know the basic principles of the idea. As for his theory on the quantum part of it, I know he says its a developing theory of his and he just hasn't had the time to work on the idea like he has wanted, and he has always been 100% with me on that. Which is fair enough considering he has been working on Artificial General Intelligence and in that category alone there are so many things we haven't been able to try yet. Which is one of the reasons we are in the works of making this a profitable company rather than a research company. Getting more minds on the ideas. But I would wager that if you did more than 3 responses to him being a bit more clear on what you thought was wrong with the theory he probably could have given his thoughts to you about those specific concepts/critiques. But you really didn't say anything, at least in the responses I can see. But again I have practically no insight to your guys' full conversation so I'll let him clarify tomorrow. This will be my last response tonight, I have to be in a meeting in an hour with a colleague overseas then I'm crashing but I might respond tomorrow and Rinkus probably will as well.