4 ms·
Conversely, there are many problems, most notably in the low-level mathematics, which can be parallelised. Matrix multiplication for example...
by alexchamberlain 14y ago
Conversely, there are many problems, most notably in the low-level mathematics, which can be parallelised. Matrix multiplication for example...
- josephlord 14y agoYes there are infinitely* many problems that can be parallelised but even in the best case they will only equal the single processor at double the speed. http://home.wlu.edu/~whaleyt/classes/parallel/topics/amdahl.html http://home.wlu.edu/~whaleyt/classes/parallel/topics/amdahl.... I should have referenced Amdahl's law in the previous post but didn't want to misspell it and bother to look it up. *Infinite numbers exist of both parallel and serial computing requirements. Practically there will almost always be additional cost in parallel implementation even if the extra is insignificant such as higher start up cost and coordination for shutdown.
- mclarkk 14y agoAmdahl's Law did throw a damp cloth over the fire of enthusiasm about parallel computing...for a while. But then we got Gustafson's Law: http://en.wikipedia.org/wiki/Gustafson%27s_Law http://en.wikipedia.org/wiki/Gustafson%27s_Law Gustafson and Barsis pointed out that Amdahl assumed a fixed input size. If instead you grow the problem size along with the number of processors, the speedup from parallelism grows indefinitely. Of course, like Amdahl, they assume perfect load balancing and don't factor in communication overhead. But parallel still beats the pants off of serial if we want to keep solving larger and larger problems.