3 ms·
At the SEMICON Taiwan CEO Summit, Dr. Jung Bae Lee, Corporate President and Head of Memory Business at Samsung Electronics, stressed that the rapid growth of AI
by fsndz 2y ago
At the SEMICON Taiwan CEO Summit, Dr. Jung Bae Lee, Corporate President and Head of Memory Business at Samsung Electronics, stressed that the rapid growth of AI models is being constrained by a growing disparity between compute performance and memory bandwidth. While next-generation models like GPT-5 are expected to reach an unprecedented scale of 3-5 trillion parameters, the technical bottleneck of memory bandwidth is becoming a critical obstacle to realizing their full potential.
Dr. Lee’s slide, titled "Growing Disparity Between Compute Performance and Memory Bandwidth," underscored that although AI compute power has advanced significantly in recent years, memory systems are struggling to keep pace. This widening gap, often referred to as the "memory wall," threatens to diminish the returns of future AI advancements, despite the exponential increase in model size and complexity.