How do you reduce latency in real-time AI applications?

Multiple issues can be the cause. some fixes 1. Semantic caching 2. Since it’s real time application are you using pub/sub. Check the region. Put it as close as possible to your deployments. 3. Use asynchronous tool calls if multiple agents and where possible. Really an audit of your application is required. Question is vague.