Delegated Access Restriction

Summary:

We have number employees you have delegated access from Managers.
Is it possible that the delegated access is set up for Manager's direct reports only?
We have cases where a Manager has 5 direct reports. The 5 direct reports have sometimes their own direct reportees and so own. When a Manager sets up delegated access, the person who the access is set up for has access to data for the 5 direct reportees and also further to their direct reports. Is it possible to set up a delegated access for Manager's 5 direct reportees only and no one else that could be in the structure tree (the same unit, department)? I'm happy to provide examples.