First off, this is not a "quantum computer" as defined by the field. Instead it is a "quantum annealer" that relies on the quantum adiabatic theorem, though it'

First off, this is not a "quantum computer" as defined by the field. Instead it is a "quantum annealer" that relies on the quantum adiabatic theorem, though it's pretty clear it is impossible for these spins devices to remain completely adiabatic. They look at mostly combinatorial optimization problems, and largely they can not do anything faster than a classical (non-quantum) computer (i.e. a single laptop). I read in future versions they may embed classical chips into their D-wave black box. Benchmarks at that point will be sort of silly.