3 ms·
Even small models can be a headache to export if they have even they use anything custom. I can't even imagine something the size of GPT-3.
by machinevision 6y ago
Even small models can be a headache to export if they have even they use anything custom. I can't even imagine something the size of GPT-3.
- Voloskaya 6y agoLarger models aren't really more complicated than smaller ones though. GPT-2 is already supported, I believe only difference with GPT-3 is sparse attention.
- minimaxir 6y agoThe GPT-2 models included with Transformers can export to ONNX fine w/ a helper included with the Python onnxruntime.