4 ms·
what's the difference between onnx and ggml style?
by taminka 3y ago
what's the difference between onnx and ggml style?
- FL33TW00D 3y agoONNX consumes a .onnx file, which is a definition of the network and weights. GGML instead just consumes the weights, and defines the network in code. Being bound to ONNX means moving at a slower velocity - the field moves so fast that you need complete control.
- michaelmior 3y agoI haven't used ONNX or GGML, but presumably using GGML means you need to reimplement the network architecture?
- FL33TW00D 3y agoYou do! But it offers quite a fluid API making it pretty simple. You can see my attempt at a torchesque API here: https://twitter.com/fleetwood___/status/1679889450623459328 https://twitter.com/fleetwood___/status/1679889450623459328