This has happened (is happening). Intel's latest FPGA's have potentially thousands of floating point multiply/add blocks and Xilinx have a "many cores + on-chip

This has happened (is happening). Intel's latest FPGA's have potentially thousands of floating point multiply/add blocks and Xilinx have a "many cores + on-chip network" design on its way.