Removal of duplicate rows from extract output

Summary:

Content (required):

Our extracts consist of bottom nodes from the primary and alternate hierarchy without the Parent column hence the extract generated has many duplicate nodes which shouldn't be sent to the downstream. Is there a check that we can do to avoid duplicates in the extract generated?

Version (include the version you are using, if applicable):

Code Snippet (add any code snippets that support your topic, if applicable):