5 ms·

Why is Google's T5 not mentioned? https://github.com/google-research/text-to-text-transfer-transformer https://github.com/google-research/text-to-text-transfer

Why is Google's T5 not mentioned? https://github.com/google-research/text-to-text-transfer-transformer https://github.com/google-research/text-to-text-transfer-tra...

riku_iki 6y ago
curious if there any examples of using it for text generation, since it has different model structure from GPT.
- ghenson2 6y ago
  Check out the T5 models at huggingface for this. Main NLG use cases with T5 are translations, summarization and question generation. Latter is sophisticated + nothing trivial and "NLG", so yeah.
- FL33TW00D 6y ago
  From my experience T5 is currently the best publicly available model for NLG.
  - ghenson2 6y ago
    Did you use it already in some production environment?
    - FL33TW00D 6y ago
      Not yet but I am working on it!
      - ghenson2 6y ago
        Nice, will you use it via huggingface?
        FL33TW00D 6y ago
        Yeah currently experimenting with T5 large in FP16. Will then use the ONNX conversion script to decrease inference time and deploy it!
- pigscantfly 6y ago
  I've been using a finetuned T5 model for commercial text generation for the past six months. The volume of discussion around the model on github and elsewhere leads me to believe others are as well, although people tend to be circumspect about implementation details.
  - ghenson2 6y ago
    How are you using it, through huggingface or directly?