3 ms·
Do the same optimizations apply to tensorflow/tensorflow serving?
by elephantum 5y ago
Do the same optimizations apply to tensorflow/tensorflow serving?
- Marat_Dukhan 5y agoTensorFlow doesn't support quantized inference (it supports only mimicking quantization in floating-point for quantization-aware training), so it can't immediately benefit from these optimizations.