6 ms·

Scott Aaronson, when reached for comment, said

53 points by feross 5y ago

dekhn 5y ago
unsurprisingly, supercomputers still beat quantum computers, and will for 20 years
- st00 5y ago
  Could you expand your thoughts a bit? Scott writes... “5 minutes refers to the time needed to calculate a single amplitude (or perhaps, several correlated amplitudes) using tensor network contraction. It doesn’t refer to the time needed to generate millions of independent noisy samples, which is what Google’s Sycamore chip does in 3 minutes. For the latter task, more like a week still seems to be needed on the supercomputer." ...but you seem to have a different interpretation?
  - dekhn 5y ago
    A week on a supercomputer is a typical length for a large job. For my PhD work I had supercomputer jobs running for an entire year. Supercomputer time is somethign you can simply buy, and no scientist needs answers that quickly. As long as the problem is classically solvable within a month for less than a few million dollars, you're way ahead of the best QCs. The QC folks promoting fast solutions for problems that don't need them are selling snake oil.
    - ameliaquining 5y ago
      This is a science project, not a commercial offering. The goal is to prove that it's possible to build a quantum computer that can do something that's intractable on a classical computer. Unrelatedly, I find it hard to believe that, if a technology were invented that could do quantum simulations in a few minutes that take a week on a classical supercomputer, people wouldn't find economically valuable applications for it.
  - andreareina 5y ago
    Not the GP, but unless you need verifiably independent noisy samples, quantum computers are too noisy to work at practical problem sizes, and afaik there's no clear path to fixing that. I wouldn't say they're 20 years away, but it's an r&d problem not an engineering problem so it's probably not going to be very soon
- xxpor 5y ago
  as someone not involved in HPC at all but hears things about it occasionally, is there really anything that defines a supercomputer these days? Or is a supercomputer basically just a whole bunch of servers with low latency networking and running MPI?
  - dekhn 5y ago
    depends who you talk to, I would say "a supercomputer is a machine designed for high performance computing that has capabilities several standard deviations above the mean". There really are only about 10 supercomputers in the world at any time (the most that multiple nations can afford to run) and the capabilities keep being pushed up. So no, I don't think it's just a bunch of servers with low latency network. Typically much more integration has to be done to achieve peak performance.
  - TOMDM 5y ago
    I think the scale of compute speed really muddies the water with what we traditionally consider a super computer. A DGX pod is probably a super computer imo. But with some problems we're seeing that we can solve them with petabyte scale lookup tables. Is that a super computer? I'd really like to hear if there even is a coherent definition anymore or if that line is just blurred forever.
    - dekhn 5y ago
      A full DGX pod, like full TPU pod is a "ML supercomputer". The big detail being that they don't typically support all CPU functionality, and tend to have support only for smaller datatypes (float instead of double). However, neither can act as a full replacement for current HPC codes, although that is a very exciting area of research.
  - nabla9 5y ago
    Supercomputers can be differentiated from server farms in two ways: 1. Performance measured in FLOP's. Think supercomputers as gigantic graphics cards. The bandwidth between the nodes is incredible. Network topology is different. 2. Problem type is one with lots of interaction between partial solutions. 3. Problem solving capability instead of problem solving capacity. Supercomputer design is a whole system design for the capability to solve one huge problem in a short time. With just a 'bunch of servers,' you add more servers and get more capacity to solve a larger number of limited-sized problems. The supercomputer has usually the maximum problem size level and every aspect of the system is optimized and balanced together to reach that maximum. Even if the supercomputer is sold in pieces and can be extended, extensions scale only towards this maximum design where the capability peaks. Installing two maxed-out supercomputers side-by-side does not double the capability for most problems. This way supercomputer is like a single computer. You can add components until you reach the limits. If you need a bigger computer to solve bigger problems, you build a bigger supercomputer from scratch.
- lacker 5y ago
  I mean, an iPhone CPU outperforms quantum computers at almost any task you can imagine. The only exception so far is tasks designed specifically so that only quantum computers can perform them efficiently. In 20 years this may no longer be the case, though... I think back to 2001 and how little of the modern tech scene I was able to predict then.
stevespang 5y ago
Ahhhhh yes, the gate fidelities. Will IBM pony them up, fair and honest ?
Jun8 5y ago
Here are few thoughts on Aaranson's comments: 1) I have absolutely zero understanding of quantum computers (even after watching this video: https://www.youtube.com/watch?v=OWJCfOvochA https://www.youtube.com/watch?v=OWJCfOvochA), though I like to read up on quantum physics. However, it seems to me that I've lived through many "breakthroughs" in this technology. For example, here's an excerpt from a NYT article from 4/28/1998: https://www.nytimes.com/1998/04/28/science/quantum-computing-is-becoming-more-than-just-a-good-idea.html https://www.nytimes.com/1998/04/28/science/quantum-computing...: The discovery has touched off a wave of excitement among physicists and computer scientists and is leading dozens of research centers worldwide to embark on similar experiments heralding the advent of an era of so-called quantum computers, specialized machines that may one day prove thousands or even millions of times faster than today's most powerful supercomputers. It seems quantum computers that can kick ass is always 10-15 years away. 2) Here's a writeup from Pano Kanelos, President of the University of Austin of University of Austin, where he explains the motivation: https://bariweiss.substack.com/p/we-cant-wait-for-universities-to https://bariweiss.substack.com/p/we-cant-wait-for-universiti.... Others can debate the anti-wokeness, but this part is pretty much fact: Over the last three decades, the cost of a degree from a four-year private college has nearly doubled; the cost of a degree from a public university has nearly tripled. Colleges in the US are insanely expensive! If the new UoA starts fixing that I'm all of it, but I'll believe it when I see their tuition rates and first batch of graduates. This is the first question listed here (along with the high cost of healthcare in the US): https://patrickcollison.com/questions https://patrickcollison.com/questions 3) The blog post he mentions is interesting. Of course, the same argument may be made for any job area for which demographic stats does not match the society at large. The argument is irrefutable because any point against it is labeled as offensive or biased, which makes it funny coming from a mathematician.
- romwell 5y ago
  >The blog post he mentions is interesting And he misses the point of the blog post by a mile.
  - ryan93 5y ago
    Wanna explain?

53 points by feross 5y ago

dekhn 5y ago

unsurprisingly, supercomputers still beat quantum computers, and will for 20 years

st00 5y ago
Could you expand your thoughts a bit? Scott writes... “5 minutes refers to the time needed to calculate a single amplitude (or perhaps, several correlated amplitudes) using tensor network contraction. It doesn’t refer to the time needed to generate millions of independent noisy samples, which is what Google’s Sycamore chip does in 3 minutes. For the latter task, more like a week still seems to be needed on the supercomputer." ...but you seem to have a different interpretation?
- dekhn 5y ago
  A week on a supercomputer is a typical length for a large job. For my PhD work I had supercomputer jobs running for an entire year. Supercomputer time is somethign you can simply buy, and no scientist needs answers that quickly. As long as the problem is classically solvable within a month for less than a few million dollars, you're way ahead of the best QCs. The QC folks promoting fast solutions for problems that don't need them are selling snake oil.
  - ameliaquining 5y ago
    This is a science project, not a commercial offering. The goal is to prove that it's possible to build a quantum computer that can do something that's intractable on a classical computer. Unrelatedly, I find it hard to believe that, if a technology were invented that could do quantum simulations in a few minutes that take a week on a classical supercomputer, people wouldn't find economically valuable applications for it.
- andreareina 5y ago
  Not the GP, but unless you need verifiably independent noisy samples, quantum computers are too noisy to work at practical problem sizes, and afaik there's no clear path to fixing that. I wouldn't say they're 20 years away, but it's an r&d problem not an engineering problem so it's probably not going to be very soon
xxpor 5y ago
as someone not involved in HPC at all but hears things about it occasionally, is there really anything that defines a supercomputer these days? Or is a supercomputer basically just a whole bunch of servers with low latency networking and running MPI?
- dekhn 5y ago
  depends who you talk to, I would say "a supercomputer is a machine designed for high performance computing that has capabilities several standard deviations above the mean". There really are only about 10 supercomputers in the world at any time (the most that multiple nations can afford to run) and the capabilities keep being pushed up. So no, I don't think it's just a bunch of servers with low latency network. Typically much more integration has to be done to achieve peak performance.
- TOMDM 5y ago
  I think the scale of compute speed really muddies the water with what we traditionally consider a super computer. A DGX pod is probably a super computer imo. But with some problems we're seeing that we can solve them with petabyte scale lookup tables. Is that a super computer? I'd really like to hear if there even is a coherent definition anymore or if that line is just blurred forever.
  - dekhn 5y ago
    A full DGX pod, like full TPU pod is a "ML supercomputer". The big detail being that they don't typically support all CPU functionality, and tend to have support only for smaller datatypes (float instead of double). However, neither can act as a full replacement for current HPC codes, although that is a very exciting area of research.
- nabla9 5y ago
  Supercomputers can be differentiated from server farms in two ways: 1. Performance measured in FLOP's. Think supercomputers as gigantic graphics cards. The bandwidth between the nodes is incredible. Network topology is different. 2. Problem type is one with lots of interaction between partial solutions. 3. Problem solving capability instead of problem solving capacity. Supercomputer design is a whole system design for the capability to solve one huge problem in a short time. With just a 'bunch of servers,' you add more servers and get more capacity to solve a larger number of limited-sized problems. The supercomputer has usually the maximum problem size level and every aspect of the system is optimized and balanced together to reach that maximum. Even if the supercomputer is sold in pieces and can be extended, extensions scale only towards this maximum design where the capability peaks. Installing two maxed-out supercomputers side-by-side does not double the capability for most problems. This way supercomputer is like a single computer. You can add components until you reach the limits. If you need a bigger computer to solve bigger problems, you build a bigger supercomputer from scratch.
lacker 5y ago
I mean, an iPhone CPU outperforms quantum computers at almost any task you can imagine. The only exception so far is tasks designed specifically so that only quantum computers can perform them efficiently. In 20 years this may no longer be the case, though... I think back to 2001 and how little of the modern tech scene I was able to predict then.

stevespang 5y ago

Ahhhhh yes, the gate fidelities. Will IBM pony them up, fair and honest ?

Jun8 5y ago

Here are few thoughts on Aaranson's comments: 1) I have absolutely zero understanding of quantum computers (even after watching this video: https://www.youtube.com/watch?v=OWJCfOvochA https://www.youtube.com/watch?v=OWJCfOvochA), though I like to read up on quantum physics. However, it seems to me that I've lived through many "breakthroughs" in this technology. For example, here's an excerpt from a NYT article from 4/28/1998: https://www.nytimes.com/1998/04/28/science/quantum-computing-is-becoming-more-than-just-a-good-idea.html https://www.nytimes.com/1998/04/28/science/quantum-computing...: The discovery has touched off a wave of excitement among physicists and computer scientists and is leading dozens of research centers worldwide to embark on similar experiments heralding the advent of an era of so-called quantum computers, specialized machines that may one day prove thousands or even millions of times faster than today's most powerful supercomputers. It seems quantum computers that can kick ass is always 10-15 years away. 2) Here's a writeup from Pano Kanelos, President of the University of Austin of University of Austin, where he explains the motivation: https://bariweiss.substack.com/p/we-cant-wait-for-universities-to https://bariweiss.substack.com/p/we-cant-wait-for-universiti.... Others can debate the anti-wokeness, but this part is pretty much fact: Over the last three decades, the cost of a degree from a four-year private college has nearly doubled; the cost of a degree from a public university has nearly tripled. Colleges in the US are insanely expensive! If the new UoA starts fixing that I'm all of it, but I'll believe it when I see their tuition rates and first batch of graduates. This is the first question listed here (along with the high cost of healthcare in the US): https://patrickcollison.com/questions https://patrickcollison.com/questions 3) The blog post he mentions is interesting. Of course, the same argument may be made for any job area for which demographic stats does not match the society at large. The argument is irrefutable because any point against it is labeled as offensive or biased, which makes it funny coming from a mathematician.

romwell 5y ago
>The blog post he mentions is interesting And he misses the point of the blog post by a mile.
- ryan93 5y ago
  Wanna explain?