Token Consumption for delivered AI Agents
Summary:
Hello Team,
Could you please let us know on the below:
- Will an agent consume more tokens if invoked through REST API (from an external source) compared to being run from Oracle Fusion application.
- What are the ways in which we can optimize token consumption
- How do we estimate the number of requests that can realistically be served based on an average token consumption.
- If the 20000 AI units depend on both input & output token or only output token
Thanks,
Vidya
Content (please ensure you mask any confidential information):
Version (include the version you are using, if applicable):
Code Snippet (add any code snippets that support your topic, if applicable):
Tagged:
0