How to Restrict workforce compensation plan based on Admin level ?

SummarIy: I have a requirement where we have to set up four workforce plans based on different admins, for example, talent administration for calibration plans & payroll administration for salary increments. The requirement is that both admins should not be able to see or view each other's plan setup and should not be allowed to make any changes in workforce compensation plans. I tried to make the changes in plan restrict based on role restrictions, but still I am not able to generate the desired output.

NOTE: I have given the custom role of compensation admin to talent & payroll admin.

Kindly help if anyone has gone through with this kind of scenario in there related project.