2 ms·
To be clear about one thing: When LINPACK measures FLOPS, it doesn't count how many instructions the computer executed. It uses a formula for how many floating
by jcranmer 8y ago
To be clear about one thing:
When LINPACK measures FLOPS, it doesn't count how many instructions the computer executed. It uses a formula for how many floating-point operations it takes to solve an NxN linear equation and combines that with how long it took the computer to execute. So NVidia's tensor instructions actually contribute tens of operations per instruction retired.
The prediction is attempting to model when a computer will exceed human computational power, which was estimated by Ray Kurzweil at 20PFLOPS, although it's unclear to me if we was specifically thinking of LINPACK Rmax or some other metric.