Agent Studio - Evaluation - Exact values vs Generic values in evaluation' answers
Hi all,
when creating answers for an evaluation in AI Agent Studio, do you provide exact values in the answer or generic ones / placeholders?
Let my try to explain with an example. Suppose I am evaluating the "Compensation Advisor" agent and I'm asking him "What is my current salary?"
In the answer of this question, do you provide the actual salary of the employee linked to the user who is running the evaluation (e.g. 80.000$) or do you provide a generica value (e.g. ##.####$)?
In the first case, if we run the evaluation with different users who have different salaries, how will the answer be evaluated? In the latter case, i.e. when providing a generic value, will the answer be ever evaluated as correct?
0