4 ms·
'Cerebras Systems is an eight-year-old Sunnyvale, Calif.-based semiconductor company that has long been known for making the world’s biggest computer chips. The
by Bostonian 3y ago
'Cerebras Systems is an eight-year-old Sunnyvale, Calif.-based semiconductor company that has long been known for making the world’s biggest computer chips. These babies aren’t only enormous, not quite the size of a first-base bag, they are super powerful, which makes them perfect for training and leveraging generative AI models.
On Wednesday, Cerebras unveiled its third-generation processor, known as the Wafer Scale Engine 3, or the WSE-3. It is the company’s most powerful chip yet. The specifications are startling.
The WSE-3 has 4 trillion transistors, which gives it 50 times the computing power of the Nvidia H100 graphics processor, at 80 billion transistors. The chip is 46,255 square millimeters, or about 72 square inches. The H100, by contrast, is a little over 1 square inch.
The WSE-3 has 125 petaflops of AI computing power, vs. 4 petaflops for the Nvidia H100. The WSE-3 is 57 times larger, and it has 52 times as many cores as the H100.'