Latency improvement advise for Manager and Employee Concierge Agent
Summary:
We are facing an issue with latency for Manager and Employee Concierge Agent. For Manager Concierge one of the problems is that agent performs sequential calls per assigned employee to fetch information as a result - increased latency, instead the agent could have fetched info for all assigned employees at the same time, but this is not the case.
Content (please ensure you mask any confidential information):
We are facing an issue with latency for Manager and Employee Concierge Agent. For Manager Concierge one of the problems is that agent performs sequential calls per assigned employee to fetch information as a result - increased latency, instead the agent could have fetched info for all assigned employees at the same time, but this is not the case. Latency takes up to 30 sec per query which is not acceptable. Please advise how to improve latency. I have trimmed the prompt and removed tools that are out of scope for subagents, removed out of scope subagents but it did