joshreini

4 ms·

1. 1.▲
   by joshreini 3y ago

   Hey @sirspacey - I'm a TruLens/TruEra dev. If we're not in contact already, feel free to shoot me an email or join our slack community if you need assistance or want to talk through how to best leverage TruEra for this. email
2. 2.▲
   by joshreini 3y ago

   Bias up front: I'm a TruLens developer ------ We've built all of these considerations: 1) Support for standard metrics like BLEU, ROUGE, BERT similarity, and model-graded evals; we serialize the entire LLM app call so you can test
3. 3.▲
   by joshreini 3y ago

   Developer on the trulens team here. We just put out a pretty cool new release (0.1.2). Integration with huggingface pipelines in langchain and asynchronous feedback management are just some of the useful updates in this release. Real evalua