I am analysing the data in my company for operational purposes which uses NetSuite, besides the other tools’ exports, I export 3 searches and 1 report from NetSuite on daily basis to connect them with the other data sources and prepare the insights for our stakeholders.
The mentioned NetSuite exports are for all the transactions data on the company level, so, they are CSV files with thousands of rows. Exporting such big files takes good time from my work day, hence, I was chasing an automation solution enabling me to connect the Power Bi to the NetSuite data sources.
I found out about the possibility of subscribing to these 3 searches and 1 report so I receive them in my mailbox on daily basis, this was an optimal solution as Power Bi could be connected to my mailbox and get the sent subscription from there every day, however, I discovered that I receive CSVs with fixed limit of 10,000 rows only, well, one of the searches here is generated in +141,000 rows CSV (for the billable items).
So, I guess my question here is, first, could something be done to lift this limit even for the internal users? I mean, I know we could activate the searches subscription to external customers, but this is not the case here, the subscriptions are used mainly by a very limited number of internal staff.
If the above is not an option, I would say that the searches and reports subscriptions are not a good option for data analysing purposes and would lead me to the next question, how could I automate the connection between Power Bi and NetSuite data? Definitely, you came across this requirement before, is there a kind of API that could be used to connect, for instance? Or any other way you may suggest will be more than welcome.