Manage Inter-Org Transfer screen allows the storekeeper to transfer quantities to any destination or

The destination organizations list on the Manage Inter-Org Transfer screen allows the storekeeper to transfer quantities to any destination organization, even though the storekeeper has access only to his own warehouse. The access restriction currently applies only to the Source Organization, not the Destination Organization.
My question is: Is there a way to restrict the Destination Organization list on the Inter-Org Transfer screen by user? If not, is there any workaround to ensure the user can transfer items only to a specific destination organization?