2 ms·
Olive is a tool that optimizes models to ONNX format, making them suitable for deployment in Foundry Local. It uses techniques like quantization and graph optim
by homarp 1y ago
Olive is a tool that optimizes models to ONNX format, making them suitable for deployment in Foundry Local. It uses techniques like quantization and graph optimization to improve performance.
https://github.com/microsoft/Olive https://github.com/microsoft/Olive