Pricing Security using Reference Set

Summary: Can I use Reference Set to enable Pricing Security at user level

Content (please ensure you mask any confidential information):

Business Requirement: There are multiple pricelists per BU created. One of these pricelist should be only accessible to one user and not all users who will get pricing role for this BU. Can I achieve this using Reference Sets? Are Reference sets work per BU or combination of BUs? and not with only limited data from one BU?

Steps Done to test the same:

I have created a custom Reference Set, assigned this reference set to pricing determinant 'Pricing Rule'. Attached this reference set to a BU.