Check Duplicates Action after removing action

Summary:

We have removed from the IRC_PERFORM_CANDIDATE_DUPLICATE_CHECK_AND_MERGE_PRIV privilege from a custom role. However, the action is still showing in the actions menu when using the custom role. They are not able to take the action as they receive permissions error. My assumption was that removing the privilege would remove the Action. Is there a way to remove? Thank you.

Content (please ensure you mask any confidential information):

Version (include the version you are using, if applicable):

Code Snippet (add any code snippets that support your topic, if applicable):