How to restrict value set to a certain responsibility

A group of users need access to add values to a value set. We dont want them to access all available value sets. So how can I restrict the responsiblity to access only one value set? can we create a function or something and pass the value set name? or does it need form personalization?
Thanks.