dwaiba

4 ms·

1. 1.▲
   by dwaiba 2y ago

   1. I tried with L40 for inference in MON1 with BentoML [@bentoml.service(resources={"gpu": 1}) class MyService: def __init__(self): import torch self.model = torch.load('model.pth').to('cuda:0&#x
2. 2.▲
   by dwaiba 2y ago

   Thanks. Looks good but do the GPUs like "1x H100 80GB NVLINK" support Infiniband?. Are these HGX Modules? (Since standard HGX comes in pairs of 4 or 8). Also, when will H200 be available? Great Stuff !
3. 3.▲
   by dwaiba 2y ago

   This is super! Best of luck ! BILLING PROFILE: bp7cc3b60e5ce167e99b1ce77