Ship to site is picked for a different account address set

Ship to sites are one-to-one mapped with account address set and is linked with Business Unit.

In case of multiple Business Unit, ship to site of one account address set/Business unit is picked up for another account address set/Business unit while creation of AR Invoice or Sales order, merely because of the fact that the same is set as Primary in Customer Data management (CDM).

Oracle SR for the same has also been raised and they confirmed that it will always pick that ship to site which is set as Primary for all the Business Units.

Want to know is there any solution or option, where we can restrict the selection of ship to site at AR Invoice or sales order based on the account address set or business unit.