marcklingen

7 ms·

31.
by marcklingen 3y ago
co-author here we put in a lot of effort into our docs and we'd greatly appreciate any criticism or feedback! Langfuse is powerful but the docs should help beginners to quickly get started and then incrementally use more features. docs
32.
OSS Observability for Vercel AI SDK(langfuse.com)
6 points by marcklingen 3y ago|0 comments
33.
by marcklingen 3y ago
Fully agree - even as a founder of an ‘LLM observability company’. Observability does not need to be reinvented to get detailed traces/metrics/logs of the LLM part of an application. LLM Observability usually means: prompts and co
34.
by marcklingen 3y ago
We struggled with this ourselves while building LLM-based products and then open-sourced our observability/monitoring tool [1]. Many use it to track RAG and agents in production, run custom evals on the production traces (focused on ha
35.
by marcklingen 3y ago
Agree – Langfuse stores all prompts/completions, model configuration and metadata. Currently the GET API can be used to use the data for finetuning and we build a wrapper to access a filtered sample via the Python SDK.
36.
by marcklingen 3y ago
Langfuse founder here Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this. If that's not why you use multiple API keys, you can add an api key id/hash (to not store th
37.
by marcklingen 3y ago
Many great points/ideas here and on Discord, thanks HN! For those reading this thread later, feel free to reach out with any feedback or questions marc at langfuse dot com
38.
by marcklingen 3y ago
Got it, appreciate the clarification. (1) yes, that's what many of our users are doing while swapping might refer to changing model parameters, prompts, embedding stores, embedding parameters, or splitting a "layer" into mult
39.
by marcklingen 3y ago
Thx. Currently looking deeply into how we can make it as dynamic as possible to help people experiment with configurations and test on production samples. What do you exactly refer to with levels/layer in stack? See multiple meanings t
40.
by marcklingen 3y ago
Currently the project is all Postgres and the managed version is on Supabase. No scalability issues yet, we consider different OLAP options as we are mostly interested in faster analytical queries
41.
by marcklingen 3y ago
Thanks for the hint. Having only one fully managed db seems to be interesting to reduce needs for joining across databases and less operations overhead (managing uptime, setting up infra for testing, CI etc.) on our 2 people engineering &qu
42.
Show HN: Langfuse – Open-source observability and analytics for LLM apps(github.com)
143 points by marcklingen 3y ago|35 comments
43.
by marcklingen 3y ago
Next 12 to 13 migration could be interesting for our (open source) code base. Currently using tRPC, page router and next auth. Until now I did not push for the migration as it seemed rather complex and non-urgent. Do you have learnings on f
44.
GPT-3.5/4 response times are linear with output tokens(taivo.ai)
9 points by marcklingen 3y ago|7 comments
45.
by marcklingen 3y ago
Congrats on the launch! Played around with fastgen some weeks ago and liked the focus on creating APIs and workflows. I have built many API endpoints with Make.com in the past as it made it easier to manage external connections compared to