Restricted access to users via reference datasets for Manage Locations

We have a requirement for selective set of users to create and maintain locations for patient home addresses. However we dont want these users to have accessibility to other locations like HR Locations or converted Ship-to Locations.

We are trying to restrict this user's access by assigning only one reference dataset. But still the user is able to create locations for other dataset as well as modify locations created with other datasets.

Question is how can we restrict such users to view/modify locations that they have created and not be able to access other locations. Is this achievable by restricting through reference dataset? If yes, then how? Reference documentations would be very helpful.