How to fetch the 2nd level manager in the AOR based Comp Hierarchy FF based on the worker's location

We have a requirement were we need to have the hierarchy based on the worker's location. 

The first level manager is the HR (based on AOR) for that worker's location while the second level manager is the Director (based on AOR) for the same worker's location. 

The HR and Director belongs to a headquarter location. When were are processing the FF, the first level (HR) is being fetched as we are checking the employee's assignment and location to fetch the HR (based on AOR) but for the second level manager, the FF is considering the HR's assignment (and location) to bring the Director (second level manager).