We'd love to hear from you! Provide  feedback  to earn a badge today. Take our quick survey
You're almost there! Please answer a few more questions for access to the Applications content. Complete registration
Interested in joining? Complete your registration by providing Areas of Interest here. Register

Data management processing insert/delete statement

Received Response
11
Views
3
Comments

Summary:

We are loading two large files, one file takes significantly more time.


Content (required):

For a customer we are loading actual files per month with a large number of records:

File 1: +/- 680.000 records (170k rows, with 4 amounts as columns)

File 2: +/- 2.600.000 records (650k rows, with 4 amounts as columns)


File 1 takes about 5 minutes to load, where file 2 takes more than 45 min to load.

From the logs I see that data management for the second file uses batch method for the delete and insert statement:

"Executing delete statement using batch method"

I suspect that this batch methods takes significantly more time.

Howdy, Stranger!

Log In

To view full details, sign in.

Register

Don't have an account? Click here to get started!