How to restrict user to see Journeys of all employee in one particular department

Summary:

we have requirement to restrict user to see journeys of employees who are part of his Department only. we have created a AOR based security profile and this is working fine in all transactions like Promote, Change assignment e.t.c. but in Journey's Organization tab user is able to all employees who are not part of his department. can we restrict the user to see journeys of employees from his department? in case if any one has solutioned for the same kindly share your approach.

we have created an person security profile with AOR and assigned the AOR to the user scope at department level this is working for all transactions as mentioned earlier except for Journeys.