2 ms·
I have written and maintained AI proxies. They are not terribly complex except the inconsistent structure of input and output that changes on each model and pro
by pizzafeelsright 6mo ago
I have written and maintained AI proxies. They are not terribly complex except the inconsistent structure of input and output that changes on each model and provider release. I figure that if there is a not a < 24 hour turn around for new model integration the project is not properly maintained.
Governance is the biggest concern at this point - with proper logging, and integration to 3rd party services that provide inspection and DLP type threat mitigation.
- ijk 6mo agoGiven the LiteLLM Supply Chain Incident, threat mitigation and governance are definitely major concerns.
- santiago-pl 6mo ago[dead]