IB Asset Customer Address Location is not limited to the chosen Customer

Summary:

IB Asset Customer Address Location is not limited to the chosen Customer

Content (required):

When choosing a specific customer on the Asset, then choosing Location Type as 'Customer Location' and then going to "Location field"- it is open to all locations of all customers, not only to the customer which was chosen on the Asset.

We expect it to behave as any other form where we choose customer and customer address- such as sales orders, subscriptions, etc.. where the site is limited to the accounts and it's relationship accounts only

Is there a setup we need to do to limit this?