AI Agent Studio: Handling Large Datasets with REST APIs
Summary:
Is the AI Agent Studio is suitable for building an agent that requires analyzing a large volume of data?
Content (please ensure you mask any confidential information):
Hello,
I've been working in AI Agent Studio to build an agent for procurement spend analysis. The goal is to let procurement managers ask questions about spend data based on criteria like quarter, year, Business Unit, category, buyer, etc.
I'm calling the Fusion REST API for purchase orders to get the data, but I've noticed a problem: the API seems to have a limitation and isn't fetching all the records. For instance, if there are over 4,000 purchase orders that match the criteria, the API only returns a subset, like 500. This means the AI agent's analysis and responses are based on incomplete data, leading to