How to create Role with Person Management access for limited function

Summary

How to create Role with Person Management access for limited function

Content

We have required to create HR role for with Personal Manager access with Manage person and Manage Employment access.

Step Taken:

1. We have copy role "Human resource Specialist" using security console and  removed unwanted duties like absence, success, Payroll.

Problem:

Result we are not able get. some action are not able removed like Manage Direct report even we have removed respective duties using APM

Please suggest what approach we should take?

Thanks, Avaneesh