4 ms·
Does AMD have a library like TensorRT that optimizes inference with operator fusions and kernel optimizations though? TensorRT can halve the inference compute
by LarsDu88 2y ago
Does AMD have a library like TensorRT that optimizes inference with operator fusions and kernel optimizations though?
TensorRT can halve the inference compute for certain Nvidia inference workloads
- ipsum2 2y agoYeah their equivalent is MIGraphX. There's also support for Triton for custom kernels.