3 ms·

20% is a huge amount in terms of high end performance. For example, 20% more transistors / compute units / etc does not give 20% more performance at the top end

20% is a huge amount in terms of high end performance. For example, 20% more transistors / compute units / etc does not give 20% more performance at the top end unless your execution is excellent.

shaklee3 3y ago
OP's point is that the hardware specs are 2-3x higher in many places, but all their benchmarks are 20-30% higher. The article mentions this as well. It means AMD couldn't even utilize their own hardware very well at this point.
- zaptrem 3y ago
  Transformers are heavily memory bandwidth bound on modern hardware, and these chips only have 60% higher memory bandwidth.
  - shaklee3 3y ago
    Their own slides show a 20-30% speedup on attention tasks.