4 ms·
I was looking to see what the actual metrics would be for a completion, to see if this is something of interest to me. So I tried to run the example here: http
by epistasis 3y ago
I was looking to see what the actual metrics would be for a completion, to see if this is something of interest to me. So I tried to run the example here:
https://www.traceloop.com/openllmetry https://www.traceloop.com/openllmetry
Problem 1 (very minor): it's missing an `import os`
Problem 2: I need an API key.
Problem 3: The link that it tells me to go to for an API key is malformed: https://https//app.traceloop.com/settings/api-keys https://https//app.traceloop.com/settings/api-keys
Is there a way to see what the output is like without getting an account, and presumably also connecting to an observability platform like Grafana? I already made a venv and installed the package, so I'm not sure if I'm ready for even more steps just to see if this is something that might be useful to me.
- nirga 3y agoThanks for the issues - I'll fix it! :sweat_smile: Reg. Grafana and others - it's simple, just set the env vars - https://www.traceloop.com/docs/openllmetry/integrations/introduction https://www.traceloop.com/docs/openllmetry/integrations/intr...
- epistasis 3y agoThanks for effort of a reply, however I'm not quite willing to jump through hoops of creating accounts on two different services, plus the effort of integration, merely to see what the outputs might be. Shouldn't the benefit, the potential win to customers, be the selling point? Maybe others are willing to put in lots more effort than I am to see what the benefit is, but I've already spent a ton of time and am no closer to even understanding the concrete benefits of your product. I might revisit if a trusted friend tells me it's useful, but it will take that sort of recommendation in order for me to spend more time on this. Seems like some example outputs would the thing you should show, at least somewhere prominently.
- nirga 3y agoYou don't need to create an account in 2 services - you can just connect the SDK directly to Grafana - https://traceloop.com/docs/integration/grafana https://traceloop.com/docs/integration/grafana Happy to assist if needed over slack - https://traceloop.com/slack https://traceloop.com/slack