4 ms·Did you use it already in some production environment?by ghenson2 6y agoDid you use it already in some production environment?FL33TW00D 6y agoNot yet but I am working on it!ghenson2 6y agoNice, will you use it via huggingface?FL33TW00D 6y agoYeah currently experimenting with T5 large in FP16. Will then use the ONNX conversion script to decrease inference time and deploy it!