Access to modify Sales Territory

Summary: Access to modify Sales Territory

Content (please ensure you mask any confidential information): We granted access to users to modify the teams members of territories, we expected the user could modify only the territories and child territories in the hierarchy but they can view the entire territory hierarchy. How we can restrict the access only for the territories that they are team members?

Version (include the version you are using, if applicable): 23D