3 ms·
That’s a deep question. Under the hood we use some LLM gateways like Helicone and https://usevelvet.com https://usevelvet.com to track cost per request and opti
by philip1209 2y ago
That’s a deep question. Under the hood we use some LLM gateways like Helicone and https://usevelvet.com https://usevelvet.com to track cost per request and optimize it.