Can you restrict a segment value for a specific ledger if you have multiple ledgers?

Summary: Is there any way to restrict a specific chart of account segment value (in this case a Site Location value) to be used with a specific ledger or secondary ledger. The Entity segment is what is considered in the system to be our primary balancing segment, and I believe those values get assigned or associated with specific ledgers. I don't know if it's possible to do something similar to other segments or otherwise restrict other segment values to being used only with specific ledgers.

Content (please ensure you mask any confidential information):

Version (include the version you are using, if applicable):