Restrict list of persons assignment type from some users

Summary:

I've raised this in the main HR area, but sharing here too in case it's a journeys specific answer

We have created a Filtered List to be able to use in assigning journeys using the List of Persons option - this profile option has been enabled with L, O value so that these options are available to end users for assigning journeys to others. This List of Persons contains a whole org list of active workers and employees because there is one journey that requires it for scheduling.

In some cases however, the user (depending on their role) should NOT be able assign a journey to a List of Persons, but they SHOULD be allowed to assign to others in general e.g. a single person/manually selected people