Is that not just caching? If you have the same query just return the same response. You could even put a simpler AI in front to decide if it was effectively th

Is that not just caching? If you have the same query just return the same response. You could even put a simpler AI in front to decide if it was effectively the same query.