21 ms·
"... and I don't see if I would be able to track usage from individual end-users through a header". Currently we have a unified concept of User-Paths. Once you
by santiago-pl 6mo ago
"... and I don't see if I would be able to track usage from individual end-users through a header".
Currently we have a unified concept of User-Paths. Once you add a specific header OR assign User-Path to an API key, you can track the usage based on this. The User-Path might be youe end-user, internal user or some service. Examples:
/client1/app1
/agents/agent1
/team2/john
/team2/adam
Would this work for you?
https://gomodel.enterpilot.io/docs/features/user-path https://gomodel.enterpilot.io/docs/features/user-path
PS Thanks for the feedback on the Vault integration. Noted.
- hgo 6mo agoAh, seems like the right thing. To be more clear on what I'm looking for is this: the system using the LLM gateway would present an arbitrary user id. Let's say the system has thousands of end-users (completely managed by that system and not configured in the LLM proxy). The admin is interested in blocking end-users from using more than a certain allowed quota.