How to restrict users creating Key terms to have access to Setup & Maintenance

There is a Issue were the users creating the Key terms are allowed with the Privilege to access Setup & Maintenance area. when we create the Key terms and link it to the contract type users need to go into Setup & Maintenance area. There is also a Risk that users will also be able to access the other Areas. Is there a way to restrict that ?