Remove duplicates in TCC export

Summary

Remove duplicates in TCC export

Content

Hi,

I have a request to apply filters on job posted on multiple career pages. 

For example - 

If a requisition 123 is posted on career section A,

If a req 234 is posted on career section B,

if a req 456 is posted on career section A and B both then my export script should fetch the posted jobs file like:

Req 123, A

Req 234, B

Req 456, A

 

We don't want the duplicate entries of jobs posted on multiple career sections(req 456 posted on career page B, should not get picked). Any suggestion will be really helpful.