Context:
I'm build a pipeline to extract the data from Netsuite to our database. I'm connecting to SuiteAnalytics Connector with JDBC (by Python).
The list table include some large tables (transaction ~ 3 million records). So, I tried to execute the query (select * from transaction) and keep the ResultSet.
After that, I have a loop to retrieve the data from result_set.next(). Like this
However, I only can retrieve around 170,000 records from result_set and got the error:
Traceback (most recent call last):
File "com.netsuite.jdbc.oabase.oaca.java", line -1, in com.netsuite.jdbc.oabase.oaca.next
Exception: Java Exception
…
…
while result_set.next():
java.sql.java.sql.SQLException: java.sql.SQLException: [NetSuite][SuiteAnalytics Connect JDBC Driver][OpenAccess SDK SQL Engine]Failed to retrieve data. Error ticket# m0cm2yai2fsdxb9r8nyq[400]
The questions:
- Do you think what could be the cause? Ex: some limit configuration on SuiteAnalytics Connector, timeout to keep cursor (Result Set), etc.