3 ms·
Does the ONNX thing actually work? I'm super skeptical of these interchanges, because it seems very difficult to avoid train/test skew. Any difference in detai
by syllogism 9y ago
Does the ONNX thing actually work?
I'm super skeptical of these interchanges, because it seems very difficult to avoid train/test skew. Any difference in detail between the two implementations is a potential problem. I can imagine different order of operations putting out some values by 0.1%, causing 1% eventual loss of accuracy.
- Marat_Dukhan 9y agoIt should, if you find that converted model doesn't work, it is a bug, please file it with PyTorch and/or Caffe2. Implementation details of course differ between frameworks, but luckily neural networks are very robust to noise. In my experience, changes like using Winograd/Fourier for convolutions, or even running the whole thing in FP16 do not result in noticeable artifacts, and these are among the biggest differences you could have between frameworks.