Redwood 25C: Unable to convert pending worker

Users we have in the seeded Human Resources Specialist role are receiving the "You need permission to modify the PWTermsDEO object" for pending workers they have visibility to based off their work location using AORs. However, we switched "Personal Security Profile" to view all and then they were able to convert but now have visibility to all pending workers and can transact on all employees instead of the employees only at their location.

Is there a way to fix this conversion error without giving them the "view all" person security profile?