4 ms·
The models in our catalog are all pre-loaded before requests come in.
by celso 3y ago
The models in our catalog are all pre-loaded before requests come in.
- lampington 3y agoMakes sense. A bring-your-own-model feature would be awesome, but would make it impossible to do that for rarely-used models without using valuable GPU RAM.