4 ms·
Yeah, inference[1] is our open source package for running locally (either directly in Python or via a Docker container). It works with all the models on Univers
by yeldarb 3y ago
Yeah, inference[1] is our open source package for running locally (either directly in Python or via a Docker container). It works with all the models on Universe, models you train yourself (assuming we support the architecture; we have a bunch of notebooks available[2]), or train in our platform, plus several more general foundation models[3] (for things like embeddings, zero-shot detection, question answering, OCR, etc).
We also have a hosted API[4] you can hit for most models we support (except some of the large vision models that are really GPU-heavy) if you prefer.
[1] https://github.com/roboflow/inference https://github.com/roboflow/inference
[2] https://github.com/roboflow/notebooks https://github.com/roboflow/notebooks
[3] https://inference.roboflow.com/foundation/about/ https://inference.roboflow.com/foundation/about/
[4] https://docs.roboflow.com/deploy/hosted-api https://docs.roboflow.com/deploy/hosted-api
- anhner 3y agoAppreciate the explanation and links, thanks.