4 ms·
Semantic caching can reduce Voice AI latency, but it doesn't work well without building contextual awareness in the caching mechanism. The cache needs to unders
by tmshapland 2y ago
Semantic caching can reduce Voice AI latency, but it doesn't work well without building contextual awareness in the caching mechanism. The cache needs to understand the context of what someone is saying in order to know if the response can be served from the cache. This blog post describes more about why context is important for semantic caching and how we're building it.