2 ms·
Thanks, this post was insightful. I laughed at the reason why you rejected Arize Phoenix, I had similar thoughts while going through their site!=) > "Another n
by unnikrishnan_r 2y ago
Thanks, this post was insightful. I laughed at the reason why you rejected Arize Phoenix, I had similar thoughts while going through their site!=)
> "Another notable feature of Langfuse is the use of a model as a judge ... this is not enabled in the free version/self-hosted version"
I think you can add LLM-as-judge to the self-hosted version of Langfuse by defining your own evaluation pipeline: https://langfuse.com/docs/scores/external-evaluation-pipelines https://langfuse.com/docs/scores/external-evaluation-pipelin...
- suninsight 2y agoThanks for the pointer ! We are actually toying with building out a prompt evaluation platform and were considering extending langfuse. Maybe just use this instead.