4 ms·

From my experience T5 is currently the best publicly available model for NLG.

• ghenson2 6y ago
  Did you use it already in some production environment?
  • FL33TW00D 6y ago
    Not yet but I am working on it!
    • ghenson2 6y ago
      Nice, will you use it via huggingface?
      • FL33TW00D 6y ago
        Yeah currently experimenting with T5 large in FP16. Will then use the ONNX conversion script to decrease inference time and deploy it!