2 ms·
Implementing LLM Gateways and Policy Enforcers (PE) is the only way to contain against these attacks. We discover that we needed to use PE across all our intera
by orbitalventures 3mo ago
Implementing LLM Gateways and Policy Enforcers (PE) is the only way to contain against these attacks. We discover that we needed to use PE across all our interactions client or developer facing.
We also had to create Enforcer policies in Lite llm versions and re-enforce with ML for threat detection.
The approach substantially reduce the amount of data leak, and errors.
My advise for all the ones that are looking into commercial AI applications, USE a PE and an LLM Gateway, do not let your clients reach LLM directly without checking it first.