4 ms·
Looks great. It appears aimed at the inference use case rather than training, yes?
by aaronharnly 3y ago
Looks great. It appears aimed at the inference use case rather than training, yes?
- edunteman 3y agoyeah, we're optimizing the infra for realtime inference, though people definitely still do run training on us, with a weights upload implemented at the end of your handler.
- silksowed 3y agohow were you able to tell this? still trying to understand what infra is better used for inference (say realtime image category matching) vs training (feeding a chatbot huge sums of data)