AI Applicant Ratings: Inconsistent Candidate Ratings and Missing Education Ratings.
We are currently evaluating Oracle Recruiting AI Matching Ratings(Calculate Candidate Matching Score) and have identified two behaviors that we would like to understand.
Issue 1 – Rating Consistency
When reviewing candidates within the same requisition, the generated Experience Rating, Profile Rating, and Skill Rating do not always appear consistent when compared against the visible candidate qualifications, work experience, education, skills, parsed application data, and requisition requirements.
During testing, we observed situations where candidates with similar or apparently stronger qualifications received lower ratings than other candidates within the same requisition.
We are trying to better understand:
- How these ratings are calculated.
- Whether ratings are expected to be deterministic and consistent across comparable candidates.
Tagged:
0