Data got corrupted while processing through stage file segments action
Hello All,
Using Opaque schema we are converting the BIP encoded file into text data and storing in memory using stage file action.
We are reading using stage file - read in segments (as the file size is around 25 MB and record count is around 40K), applying row level transformations and writing into target file using stage file action. Finally this is being transferred to OIC file server.
In today's run, the file had some junk characters for some segments. May i know why this issue occurred? And we got correct file when we reran the job.
Any additional validations that can be performed in order to prevent this issue? Kindly advise. Thanks.
Tagged:
0