3 ms·

Wallace Tree

61 points by eternalban 7y ago

ars 7y ago
What method do modern CPU's actually use?
- SuperscalarMeme 7y ago
  Radix-4 modified Booth encoding to reduce the number of partial products and then a sort of modified Wallace tree using 4:2 compressors (or some sort of 3:2 & 4:2 compressor combination based on technology node). There is another type of multiplier sometimes used for maximum performance: unlike Wallace trees where you go through steps of tree reduction, the "Three Dimensional Method" looks at each output bit and generates the fastest possible tree from the partial product matrix. The problem with this method (besides area) is that the wiring and layout of cells is highly irregular. However, now that we are in the age of automated tools, this type of design is more feasible. Paper here: https://www.ece.ucdavis.edu/~vojin/CLASSES/EEC280/Web-page/papers/Arithmetic/A%20Method%20for%20speed%20Optimized%20Partial%20product.pdf https://www.ece.ucdavis.edu/~vojin/CLASSES/EEC280/Web-page/p... If you're interested, this paper from Synopsys has some neat information about datapath synthesis: https://guest.iis.ee.ethz.ch/~zimmi/publications/datapath_synthesis.pdf https://guest.iis.ee.ethz.ch/~zimmi/publications/datapath_sy...
- Taniwha 7y ago
  Wallace trees if you want performance
ggm 7y ago
I always wanted to beleive somebody would make a coherent case for a real decimal encoded adder/multiplier: use voltages or phase or frequency or something in ways which were strictly additive, subtractive over 10 discrete values, and compute the sum by .. doing decimal. Not decimal BCD but real decimal in the logic. 10 distinct voltage levels. Not to be totally surprised, my hardware lecturers said "notachance"
- graphpapa 7y ago
  I understand enough to think the proposal sounds reasonable, but not enough to know why it is apparently, in fact, unreasonable.
  - fanf2 7y ago
    Digital logic is built from amplifiers with the gain set right up, so that any voltage above the threshold goes to max and any voltage below goes to zero. Very little tuning is needed to get a working circuit, compared to multi-level or analog circuitry. In CMOS, current basically only flows when the circuit is switching between two states, whereas in an analogue circuit it flows all the time, so digital logic can be more efficient. In digital signal transmission, “eye diagrams” are used to visualise the quality of the signal: the eye is the gap between low and high and it needs to be clearly open for receivers to be able to detect the signal with decent integrity. https://www.onsemi.com/pub/Collateral/AND9075-D.PDF https://www.onsemi.com/pub/Collateral/AND9075-D.PDF
- ethn 7y ago
  Traditionally you have error correction issues which require frequent and specific manual tuning on a case by case basis. This was the age of the analog machine. However there are some recent works which have introduced compromises to continue to do just that: https://www.nature.com/articles/s41928-018-0100-6 https://www.nature.com/articles/s41928-018-0100-6
- zokier 7y ago
  If you go that direction might as well go full analog computing, I suspect quantizing into 10 values would not bring much benefits
- pjc50 7y ago
  So as the other comments are going to say, this doesn't work because of noise and linearity issues, temperature sensitivity etc. But there is one place which is trying to bring this back: there have been attempts to do analogue neural networks, where getting the exact value isn't so critical and the system has a certain amount of noise correction by its very operation. The last greatest flight of pure-analogue control systems was Concorde! (There are a few places where multiple signalling levels are widely used; things like MLC flash and some of the faster ethernet specs. I don't think anyone's dared to do arithmetic on them before quantizing to digital, though.)
londons_explore 7y ago
TL;DR: Multiply numbers in hardware by multiplying as you would in school - each digit by each other digit, then add up all the results. The apparant speedup comes from the fact that adding a list of N integers doesn't take O(n) time because it can be parallelized (for example by adding pairs of numbers first to make a list half as long). The hardware specific tricks are that multiplication by 1 or 0 is simply a very cheap and operation, and that adding 3 numbers to make two results is much faster in hardware than adding 2 numbers to make one result.
- klodolph 7y ago
  This summary has some important errors in it. If you added each partial product in parallel, you would get O((log N)^2) delay, because each addition has O(log N) and there are O(log N) levels in the tree. The Wallace tree has total delay O(log N), which is smaller. The way you learned in school is to add each number up in series, which doesn’t give the correct parallel structure to multiply numbers quickly in parallel. For example, 1234 x 5678 ------- 9872 8638 7404 6170 ------- 7006652 In school, you would add each part column by column, and keep track of a carry digit. This gives a fairly bad delay from right to left, since the result of a carry from the right-hand columns will affect the results of the left-hand columns, many operations later. If you add pairs of numbers in parallel, it will be faster, but you will still have to propagate carry from right to left. The key insight in the Wallace tree is to reduce these numbers hierarchically, but only bitwise. Three bits in the same position are reduced to two bits in different positions, at each level. Eventually, there are only two levels left, and we do a single addition. This process for addition is completely alien to the way humans do it. > (for example by adding pairs of numbers first to make a list half as long). That is absolutely not how it works. There is only one pair of numbers being added here—at the end, the very last two numbers are added together normally. If you try to add each pair of numbers in parallel, you will add more gate delay as the carry bit has to propagate all the way from the right side to the left at each level in the tree (instead of only once at the end). With the Wallace tree, the carry bit only has to propagate the width of the numbers once, at the very end. This is much faster. At the beginning, again, bits are being added with full adders which shrinks the tree at a rate of 3:2 (not 2:1) where possible. You will notice that the height of the numbers goes from 8 to 6 (not 4), then 6 to 4, 4 to 3, and then 3 to 2. The final two numbers are then added normally.

Wallace Tree

61 points by eternalban 7y ago

ars 7y ago

What method do modern CPU's actually use?

SuperscalarMeme 7y ago
Radix-4 modified Booth encoding to reduce the number of partial products and then a sort of modified Wallace tree using 4:2 compressors (or some sort of 3:2 & 4:2 compressor combination based on technology node). There is another type of multiplier sometimes used for maximum performance: unlike Wallace trees where you go through steps of tree reduction, the "Three Dimensional Method" looks at each output bit and generates the fastest possible tree from the partial product matrix. The problem with this method (besides area) is that the wiring and layout of cells is highly irregular. However, now that we are in the age of automated tools, this type of design is more feasible. Paper here: https://www.ece.ucdavis.edu/~vojin/CLASSES/EEC280/Web-page/papers/Arithmetic/A%20Method%20for%20speed%20Optimized%20Partial%20product.pdf https://www.ece.ucdavis.edu/~vojin/CLASSES/EEC280/Web-page/p... If you're interested, this paper from Synopsys has some neat information about datapath synthesis: https://guest.iis.ee.ethz.ch/~zimmi/publications/datapath_synthesis.pdf https://guest.iis.ee.ethz.ch/~zimmi/publications/datapath_sy...
Taniwha 7y ago
Wallace trees if you want performance

ggm 7y ago

I always wanted to beleive somebody would make a coherent case for a real decimal encoded adder/multiplier: use voltages or phase or frequency or something in ways which were strictly additive, subtractive over 10 discrete values, and compute the sum by .. doing decimal. Not decimal BCD but real decimal in the logic. 10 distinct voltage levels. Not to be totally surprised, my hardware lecturers said "notachance"

graphpapa 7y ago
I understand enough to think the proposal sounds reasonable, but not enough to know why it is apparently, in fact, unreasonable.
- fanf2 7y ago
  Digital logic is built from amplifiers with the gain set right up, so that any voltage above the threshold goes to max and any voltage below goes to zero. Very little tuning is needed to get a working circuit, compared to multi-level or analog circuitry. In CMOS, current basically only flows when the circuit is switching between two states, whereas in an analogue circuit it flows all the time, so digital logic can be more efficient. In digital signal transmission, “eye diagrams” are used to visualise the quality of the signal: the eye is the gap between low and high and it needs to be clearly open for receivers to be able to detect the signal with decent integrity. https://www.onsemi.com/pub/Collateral/AND9075-D.PDF https://www.onsemi.com/pub/Collateral/AND9075-D.PDF
ethn 7y ago
Traditionally you have error correction issues which require frequent and specific manual tuning on a case by case basis. This was the age of the analog machine. However there are some recent works which have introduced compromises to continue to do just that: https://www.nature.com/articles/s41928-018-0100-6 https://www.nature.com/articles/s41928-018-0100-6
zokier 7y ago
If you go that direction might as well go full analog computing, I suspect quantizing into 10 values would not bring much benefits
pjc50 7y ago
So as the other comments are going to say, this doesn't work because of noise and linearity issues, temperature sensitivity etc. But there is one place which is trying to bring this back: there have been attempts to do analogue neural networks, where getting the exact value isn't so critical and the system has a certain amount of noise correction by its very operation. The last greatest flight of pure-analogue control systems was Concorde! (There are a few places where multiple signalling levels are widely used; things like MLC flash and some of the faster ethernet specs. I don't think anyone's dared to do arithmetic on them before quantizing to digital, though.)

londons_explore 7y ago

TL;DR: Multiply numbers in hardware by multiplying as you would in school - each digit by each other digit, then add up all the results. The apparant speedup comes from the fact that adding a list of N integers doesn't take O(n) time because it can be parallelized (for example by adding pairs of numbers first to make a list half as long). The hardware specific tricks are that multiplication by 1 or 0 is simply a very cheap and operation, and that adding 3 numbers to make two results is much faster in hardware than adding 2 numbers to make one result.

klodolph 7y ago
This summary has some important errors in it. If you added each partial product in parallel, you would get O((log N)^2) delay, because each addition has O(log N) and there are O(log N) levels in the tree. The Wallace tree has total delay O(log N), which is smaller. The way you learned in school is to add each number up in series, which doesn’t give the correct parallel structure to multiply numbers quickly in parallel. For example, 1234 x 5678 ------- 9872 8638 7404 6170 ------- 7006652 In school, you would add each part column by column, and keep track of a carry digit. This gives a fairly bad delay from right to left, since the result of a carry from the right-hand columns will affect the results of the left-hand columns, many operations later. If you add pairs of numbers in parallel, it will be faster, but you will still have to propagate carry from right to left. The key insight in the Wallace tree is to reduce these numbers hierarchically, but only bitwise. Three bits in the same position are reduced to two bits in different positions, at each level. Eventually, there are only two levels left, and we do a single addition. This process for addition is completely alien to the way humans do it. > (for example by adding pairs of numbers first to make a list half as long). That is absolutely not how it works. There is only one pair of numbers being added here—at the end, the very last two numbers are added together normally. If you try to add each pair of numbers in parallel, you will add more gate delay as the carry bit has to propagate all the way from the right side to the left at each level in the tree (instead of only once at the end). With the Wallace tree, the carry bit only has to propagate the width of the numbers once, at the very end. This is much faster. At the beginning, again, bits are being added with full adders which shrinks the tree at a rate of 3:2 (not 2:1) where possible. You will notice that the height of the numbers goes from 8 to 6 (not 4), then 6 to 4, 4 to 3, and then 3 to 2. The final two numbers are then added normally.