BI Publisher report with cashing multi-million records query and staggered upload to FTP

Summary

BIP Maximum Rows for CSV output limit is 2 million. need elegant solution to query database only once for bigger record count and then have staggered upload of records to destination folder

Content

Is it possible for BI Publisher to run SQL query for data set larger than 2m records, cache results, and then produce multiple CSV outputs with 2m records each until whole data set is processed?

 

there is documented feature in Fusion Applications Release 13 and later that allows to directly generate a CSV output from an SQL query without the intermediate step of generating XML data, but it is limited to 2 million records.