How can I not see "Contacts not in Sales" in the Outlook Plugin side panel

Summary:

In the Outlook Side Panel, people who are part of our company show up as "Contacts not in Sales"
Is there a way to not show contacts from our organization who are not sales people in the side panel

Content (please ensure you mask any confidential information):

Version (include the version you are using, if applicable):

Latest

Code Snippet (add any code snippets that support your topic, if applicable):