3 ms·

Absolutely blown away by dojo and their chip design. It seems that they are on the way to building the most powerful machine learning supercomputer in the world

Absolutely blown away by dojo and their chip design. It seems that they are on the way to building the most powerful machine learning supercomputer in the world in house. Where do these chips get made? TSMC? I would love to know how their new chip compares with the FSD chip in terms of power usage per teraflop. Also, it seems that what they call "vector space" is really a 2d plane, so how do they deal with 3d scenarios such as parking garages and complex overpasses. They are rare, but they do exist. The news will of course be all about the humanoid robot and the somewhat silly dancer, giving ammo to the detractors...

cogman10 5y ago
ditto. Was definitely the most impressive part of the presentation (IMO). Also, did I catch it right? One of those plates is 15kW of power? That's some crazy heat dissipation!
raghavkhanna 5y ago
That was my question too. It seems they have a deal with Samsung, atleast for the FSD computer chips[1]. [1] https://electrek.co/2021/05/03/how-tesla-pivoted-avoid-global-chip-shortage/#:~:text=Tesla%20uses%20several%20chips%20inside,chip%20is%20produced%20by%20Samsung https://electrek.co/2021/05/03/how-tesla-pivoted-avoid-globa....
jeffbee 5y ago
Blown away by a prototype clamped to a bench, eh? If this thing existed they'd have MLPerf benchmarks to show.
- sidibe 5y ago
  Yup, stick around for the QA. During the presentation it sounded like it was practically ready. Someone asked about memory locality when actually putting them together and the infra guy started saying it's a really hard problem. Finally Elon said "This will be ready next year" The whole presentation (not just dojo) felt like the kind of presentation you give internally to a VP when you haven't been making much progress. Flood them with challenges and implementation detail decisions they can't follow and don't talk about results.
  - jeffbee 5y ago
    Other than being hypothetical vaporware, how is it different from a cabinet full of google TPUs?
  - dragontamer 5y ago
    > The whole presentation felt like the kind of presentation you give internally to a VP when you haven't been making much progress. Flood them with challenges and implementation detail decisions they can't follow and don't talk about results. That hurts me a bit, because I feel like I've done that sometimes. But that's what makes it easy for me to pick up on, when other people do that sort of stuff. Good presentations are more direct. Ex: Here's our ResNet-50 benchmark numbers. Or at very least, "We didn't run ResNet50, because we don't think its realistic. Instead, we ran this other benchmark along with NVidia A100 GPUs and are proving that our system is faster " ---------- You need to prove your system has a benchmark score worth considering before diving into architectural details... at least if you're trying to attract engineering talent to your project.

cogman10 5y ago

ditto. Was definitely the most impressive part of the presentation (IMO). Also, did I catch it right? One of those plates is 15kW of power? That's some crazy heat dissipation!

raghavkhanna 5y ago

That was my question too. It seems they have a deal with Samsung, atleast for the FSD computer chips[1]. [1] https://electrek.co/2021/05/03/how-tesla-pivoted-avoid-global-chip-shortage/#:~:text=Tesla%20uses%20several%20chips%20inside,chip%20is%20produced%20by%20Samsung https://electrek.co/2021/05/03/how-tesla-pivoted-avoid-globa....

jeffbee 5y ago

Blown away by a prototype clamped to a bench, eh? If this thing existed they'd have MLPerf benchmarks to show.

sidibe 5y ago
Yup, stick around for the QA. During the presentation it sounded like it was practically ready. Someone asked about memory locality when actually putting them together and the infra guy started saying it's a really hard problem. Finally Elon said "This will be ready next year" The whole presentation (not just dojo) felt like the kind of presentation you give internally to a VP when you haven't been making much progress. Flood them with challenges and implementation detail decisions they can't follow and don't talk about results.
- jeffbee 5y ago
  Other than being hypothetical vaporware, how is it different from a cabinet full of google TPUs?
- dragontamer 5y ago
  > The whole presentation felt like the kind of presentation you give internally to a VP when you haven't been making much progress. Flood them with challenges and implementation detail decisions they can't follow and don't talk about results. That hurts me a bit, because I feel like I've done that sometimes. But that's what makes it easy for me to pick up on, when other people do that sort of stuff. Good presentations are more direct. Ex: Here's our ResNet-50 benchmark numbers. Or at very least, "We didn't run ResNet50, because we don't think its realistic. Instead, we ran this other benchmark along with NVidia A100 GPUs and are proving that our system is faster " ---------- You need to prove your system has a benchmark score worth considering before diving into architectural details... at least if you're trying to attract engineering talent to your project.