2 ms·
NVAIE aka Nvidia AI enterprise, https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platform-overview.html https://docs.nvidia.com/ai-enterprise/overview/0.1
by homarp 3y ago
NVAIE aka Nvidia AI enterprise,
https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platform-overview.html https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platfor...
RIVA: NVIDIA® Riva, a premium edition of NVIDIA AI Enterprise software, is a GPU-accelerated speech and translation AI SDK
FasterTransformer: https://github.com/NVIDIA/FasterTransformer https://github.com/NVIDIA/FasterTransformer an
highly optimized transformer-based encoder and decoder component, supported on pytorch, tensorflow and triton
TensorRT, custom ml framework/ inference runtime from nvidia, https://developer.nvidia.com/tensorrt https://developer.nvidia.com/tensorrt, but you have to port your models