You're almost there! Please answer a few more questions for access to the Applications content. Complete registration
Interested in joining? Complete your registration by providing Areas of Interest here. Register

Remove Duplicate Records from CSV using OIC

Received Response
33
Views
7
Comments
edited Jun 14, 2021 1:29PM in Integration 7 comments

Summary

Remove Duplicate records from CSV

Content

Hi Team,

We have a csv file which we download from source ( EPM Cloud). We need to remove duplicate records from the csv in OIC before we insert the data in target. File is sorted and hence duplicate records will be present one after the other

The only option I think of is to read file record by record using for-each and compare current and previous record. However, since the file is huge, we have to read it in segments and do record by record comparison.

Is there any other simpler way of doing this?

Tagged:

Howdy, Stranger!

Log In

To view full details, sign in.

Register

Don't have an account? Click here to get started!