Categories
- All Categories
- Oracle Analytics and AI Learning Hub
- 43 Oracle Analytics and AI Sharing Center
- 19 Oracle Analytics and AI Lounge
- 281 Oracle Analytics and AI News
- 57 Oracle Analytics and AI Videos
- 16.2K Oracle Analytics and AI Forums
- 6.4K Oracle Analytics and AI Labs
- Oracle Analytics and AI User Groups
- 105 Oracle Analytics and AI Trainings
- 20 Oracle Analytics and AI Challenge
- Find Partners
- For Partners
Dataflow Failing with “User Exceeded Per File or Overall Quota Limit” Despite Low Storage Usage
Hi,
We are facing repeated failures when executing a Dataflow in Oracle Analytics Cloud (OAC).
The error message is as follows:
[nQSError: 46267] Failed to stream data in chunk through HTTP request - {"prefix":"DSS","code":400301,"message":"User exceeded per file or overall quota limit","subMessage":"User has exceeded maximum allowed quota limit"}[nQSError: 46275] Failed to send the last data chunk through HTTP request to Server.[nQSError: 43232] Failed to populate data through HTTP request.[nQSError: 43267] Failed to finish parquet data chunked transfer in HTTP request.[nQSError: 43224] The Dataflow "Candidate Conversion 12th Mar_Current status" failed during execution.[nQSError: 43204] Asynchronous Job Manager failed to execute the asynchronous job.
However, the user who has utilized s only 6 GB of data usage out of the 50 GB default user quota, so I think the quota should not have been exceeded.
Any suggestions to fix this issue?
Thanks in advance.
Regards,
Subhakara Netala
Best Answers
-
Check if your dataflow is attempting to process more than five million rows from a single source. If it is, you may need to filter the data earlier in the flow or split the processing into multiple stages.
1 -
We have split this into multiple dataflows and created a union report at the Analysis and Workbook level.
1
Answers
-
@Subhakara Netala-Oracle - If you have chosen "Data Set Storage" to save the output data in the "Save Data" step in the data flow editor. It stores the data on to a file.
File size limit is 250M to save the output data in a data set in Oracle Analytics Cloud.Kindly verify the same as well. Hope this helps!
Reference: Create Datasets from Files0 -
Thanks for your reply @Sumanth V -Oracle. File size is around 150MB, so I think file size is not an issue. Below screenshot from the last refresh time, a week back.
0 -
Are you merging rows (with a union)?
0 -
Yes, there is are unions in Dataflow.
0 -
Ok, then I think the combined file size is over the limit (and it may not seem obvious ) and not the final output.
This is documented in the Oracle Support Knowledge Base
"User exceeded per file or overall quota limit" Error may Occur When Running a Data Flow [Video Content] KB14970 -
Not sure if you have option of external db , if yes You can try following…
- Edit the Dataflow and change its output from “Internal Data Set” (in OAC storage) to writing to an external database or a different “Database” target.
1 -
Our users do not have permissions to load the data into database. We loaded the data into database table, it is working fine. Unfortunately our users can not do that. So we will need to work on Internal Data set storage.
0 -
What did you finally do to resolve your problem? I am experiencing the same issue.
0
