2 ms·
There’s semi lock-in. You can use torch, but you also have to use their framework. Not much different than using cuda I guess.
by pram 3y ago
There’s semi lock-in. You can use torch, but you also have to use their framework. Not much different than using cuda I guess.
- belval 3y agoIt's a bit of a mixed bag. NeuronSDK is implemented with Torch XLA so there's not real lock-in there. Your code will usually just work on CUDA if it works in Trainium. However for larger models (ZeRO, Sharding, etc...) they have their own libraries that are more coupled to the actual accelerator topology because using something like DeepSpeed was not possible. Overall the challenge is often more with making your code work on their accelerator, not porting it away from their accelerators so I wouldn't be too concerned about lock-in.