Restricting Access to Org Charts within the Directory

Summary

Has anyone had any experience restricting access for a sub-set of Employees?

Content

Afternoon all,

We are potentially looking in to restricting access to the Organisation Structures within the Directory for a small subset of employees. They will be split out via either a separate Legal Entity or Business Unit (we haven't decided which as of yet).

Is this possible? Does anyone have any guidelines they'd be willing to share with me, or Lessons Learnt from when they did the same activity?

For reference, we are just using the standard Employee role for all employees.

Evan