2 ms·
> But I'm sure they have a good reason for this. CUDA and ROCM make this an intractable problem. Basically there is no way to sanely package everything users n
by brucethemoose2 3y ago
> But I'm sure they have a good reason for this.
CUDA and ROCM make this an intractable problem. Basically there is no way to sanely package everything users need, and the absolutely enormous, cude/rocm versioned pytorch packages with missing libs are already a compromise.
TBH the whole ecosystem is not meant to be for end user inference anyway.