Increase the datadirect driver limit from 100,000 to 1,000,000

Cathye A. Pendley

Organization Name

Sacramento County

Description

In OAC we created a connection to Oracle Service Cloud. When loading data either via a data flow or just the connection directly, he is limited to only bring in 100,000 rows of data. It doesn't matter whether he is brining in 1 column or 20 columns.  We do not get any errors, it just returns 100K rows and nothing more. This only appears to be an issue with the Oracle Service Cloud. If the customer loads from an Excel file or load directly from ADW, he can bring in 200K+ rows of data.

We submitted an SR, # 3-25330734981, and support said it was a limitation with the datadirect driver configuration, and we needed to request to have this limit raised.  Right now we are loading around 350,000 records from Oracle Service Cloud to Oracle Analytic Cloud data sets. This number will grow daily.  Since this is data sets we have to reload the entire set daily.   

Can we get this limit raised to 1,000,000 to meet the future needs of Sacramento County?

Thanks,

Cathye Pendley
 

Use Case and Business Need

Sacramento County cannot do their monthly reporting.  Once it loads the first 100,000 records it stops.  They only have data from March 2020 (when the data starts) to July 3, 2020.  Sacramento County needs data through yesterday for the reporting.   They can't go live with OAC until this limit is increased.

 

Thanks so much!

Original Idea Number: cfde5dc838