SIE exposes 4 task oriented primitives: encode, score, extract, generate. The application calls the relevant primitive with a supported model, while SIE automat

SIE exposes 4 task oriented primitives: encode, score, extract, generate. The application calls the relevant primitive with a supported model, while SIE automatically handles the model specific runtime, loading, batching and GPU sharing. Models load on demand, and the least recently used ones are evicted when GPU memory is needed. So the "100+ models" refers to the supported catalog, not 100 models loaded simultaneously.