Ability to restrict access based on Subinventories

Summary:

We have subinventories that are managed by people who should only be able to see their inventory at the subinventory location not for the entire organization. These subinventories are within the same (Large) building as the local warehouse but managed by different groups of people. To say each subinventory would need to be a separate organization is unrealistic. We do not need a person who is responsible for a subset of inventory to be able to see or have access to the larger warehouse inventory at the same site. How can this be accomplished?

Content (please ensure you mask any confidential information):