Performance issue while grouping in HCM Extract

Summary:

We have a requirement to build a compensation interface to send 3 months of payroll earnings data from run results to third party vendor.

The xml size getting generated from the HCM Extract is about 3-4 GB.

Interface output needs to be written by grouping xml data for a combination of 5 columns(all text). We tried multiple approaches as mentioned below but unable to generate the final output since BIP job is timing out.

Content (required):

We have a requirement to build a compensation interface to send 3 months of payroll earnings data from run results to third party vendor.

The xml size getting generated from the HCM Extract is about 3-4 GB.