3 ms·

For inference? Not really. LLM observability startups are a thing. Arize.ai probably the most well known.