Great to know this! I have come across Portkey's Open-source AI Gateway which kind of does the same. https://github.com/portkey-ai/gateway https://github.com/

Great to know this! I have come across Portkey's Open-source AI Gateway which kind of does the same. https://github.com/portkey-ai/gateway https://github.com/portkey-ai/gateway It looks like with more LLM adoption, resiliency and cost related aspects take off sooner than expected unlike other technological trends in the past. I'm also thinking that there is a chance if something like this could help build a better RAG pipeline or evals for the GenAI App. Because end of the day you want to reduce hallucinations but still get good generative responses.