Restriction of list of employees that can be seen when "reassigning a task" in Journeys

Summary:

Is there a way that we can restrict the list of people reflecting whenever we are reassigning task with the same specific department/legal entity only?

Content (required):

Based on the current behavior, we have successfully restricted the list of people reflecting on the "Assigned Journey" page with the same department/legal entity. The only problem is whenever we are reassigning a task, we can still see all the employees from different department/organization/legal entity.

Version (include the version you are using, if applicable):

23A

Code Snippet (add any code snippets that support your topic, if applicable):

Restriction of Data