4 ms·
If this stuff is any good, Tesla should make it available for everyone to use colab-style. A hosted Jupyter notebook in a sandboxed VM able to send jobs to thi
by londons_explore 4y ago
If this stuff is any good, Tesla should make it available for everyone to use colab-style.
A hosted Jupyter notebook in a sandboxed VM able to send jobs to this new silicon is something that might be possible to set up by a small team in a few months, and could turn into a billion dollar business.
As a bonus, Tesla can use revenue from that to grow this supercomputer, while using any spare/unsold capacity for themselves.
- kjksf 4y agoIt is already Tesla's plan to build AWS-style paid access to Dojo. I think they said that during the first AI Day. Here's a 19 minute supercut of AI Day: https://www.youtube.com/watch?v=keWEE9FwS9o https://www.youtube.com/watch?v=keWEE9FwS9o
- londons_explore 4y agoI suspect they've just deprioritized it for other work. But I think that was the wrong strategic move - they should have opened it up, together with some 'Tesla AI' demo models, in a colab environment. They can hire new employees to do that - it is separate work from that involved in making the self driving car, and will not block or interfere. The only reason I think they might not is that they don't want to step on Googles toes - there are very close links between Musk companies and Google, and a direct competitor to Googles TPU product might hurt that relationship more than it generates in revenue.
- schiffern 4y ago> They can hire new employees The bottleneck isn't employees, it's chips.
- londons_explore 4y agoIf that were the case, they'd have already launched a 'demo' version with very low usage limits. Users can start building/porting their models, and then run them in a few months when the next batch of chips arrives.
- epgui 4y agoSometimes R&D just takes time.
- londons_explore 4y agoThe idea of having it publicly accessible has been public for 3 years. Maybe internally for more than that. Yet, building a basic colab-like interface, using opensource tools, shouldn't take more than a few people a few months. Obviously, they might not want to launch that before their hardware is ready, but their hardware has been in production for over a year now. Clearly something hasn't gone to plan.
- epgui 4y agoWhat makes you think they deprioritized “it”?
- itsoktocry 4y ago>and a direct competitor to Googles TPU product might hurt that relationship more than it generates in revenue. There is approximately zero chance that this is a consideration. My guess would be that, like a lot of things under the Elon Musk umbrella, what they claim they are able to do in theory diverges far from reality. We've seen similar slideshows.
- extheat 4y agoI’m almost certain that Google/Amazon/Apple et al have similar specialized computing hardware, but at smaller scales. We don’t publicly know much about their internal hardware. If they had the infra, I think it would be interesting to see some Tesla cloud service offering indeed. [1] https://cloud.google.com/blog/products/ai-machine-learning/google-breaks-ai-performance-records-in-mlperf-with-worlds-fastest-training-supercomputer https://cloud.google.com/blog/products/ai-machine-learning/g...
- m00x 4y agoGoogle has had TPUs for a while. Most of the incredibly powerful transformer architectures like Parti and PaLM are trained on it. They even merge TPU pods with Pathways so they can go up to 540B parameters (gpt-3 is only 175B) https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/ https://blog.google/technology/ai/introducing-pathways-next-...
- freemint 4y agoTesla should focus on making full self driving cars finally work. If you listened to their talk their silicon comes without support for access control and multi tenancy. Letting random people run on this will be an unlimited disaster.
- clouddrover 4y agoTesla should aim for full self parking first. They're behind other manufacturers on that: https://www.youtube.com/watch?v=nsb2XBAIWyA https://www.youtube.com/watch?v=nsb2XBAIWyA