Oracle Analytics Cloud and Server

Home› Oracle Analytics› Oracle Analytics Forums› Oracle Analytics Cloud and Server› Oracle Analytics Cloud and Server

Categories

Welcome to the Oracle Analytics Community: Please complete your User Profile and upload your Profile Picture

Dataflow Failing with “User Exceeded Per File or Overall Quota Limit” Despite Low Storage Usage

Received Response
37
Views
7
Comments
Subhakara Netala-Oracle
Subhakara Netala-Oracle Rank 6 - Analytics & AI Lead
in Oracle Analytics Cloud and Server

Hi,

We are facing repeated failures when executing a Dataflow in Oracle Analytics Cloud (OAC).


The error message is as follows:

[nQSError: 46267] Failed to stream data in chunk through HTTP request - {"prefix":"DSS","code":400301,"message":"User exceeded per file or overall quota limit","subMessage":"User has exceeded maximum allowed quota limit"}[nQSError: 46275] Failed to send the last data chunk through HTTP request to Server.[nQSError: 43232] Failed to populate data through HTTP request.[nQSError: 43267] Failed to finish parquet data chunked transfer in HTTP request.[nQSError: 43224] The Dataflow "Candidate Conversion 12th Mar_Current status" failed during execution.[nQSError: 43204] Asynchronous Job Manager failed to execute the asynchronous job.

However, the user who has utilized s only 6 GB of data usage out of the 50 GB default user quota, so I think the quota should not have been exceeded.

Any suggestions to fix this issue?

Thanks in advance.

Regards,

Subhakara Netala

Tagged:

Answers

  • Sumanth V -Oracle
    Sumanth V -Oracle Rank 8 - Analytics & AI Strategist

    @Subhakara Netala-Oracle - If you have chosen "Data Set Storage" to save the output data in the "Save Data" step in the data flow editor. It stores the data on to a file.
    File size limit is 250M to save the output data in a data set in Oracle Analytics Cloud.

    Kindly verify the same as well. Hope this helps!
    Reference: Create Datasets from Files

  • Subhakara Netala-Oracle
    Subhakara Netala-Oracle Rank 6 - Analytics & AI Lead

    Thanks for your reply @Sumanth V -Oracle. File size is around 150MB, so I think file size is not an issue. Below screenshot from the last refresh time, a week back.

    image.png
  • SteveF-Oracle
    SteveF-Oracle Mod

    Are you merging rows (with a union)?

  • Subhakara Netala-Oracle
    Subhakara Netala-Oracle Rank 6 - Analytics & AI Lead

    Hi @SteveF-Oracle

    Yes, there is are unions in Dataflow.

  • SteveF-Oracle
    SteveF-Oracle Mod

    Ok, then I think the combined file size is over the limit (and it may not seem obvious ) and not the final output.


    This is documented in the Oracle Support Knowledge Base

    "User exceeded per file or overall quota limit" Error may Occur When Running a Data Flow [Video Content] KB1497

  • RVohra
    RVohra Rank 7 - Analytics & AI Coach

    Not sure if you have option of external db , if yes You can try following…

    • Edit the Dataflow and change its output from “Internal Data Set” (in OAC storage) to writing to an external database or a different “Database” target.
  • Subhakara Netala-Oracle
    Subhakara Netala-Oracle Rank 6 - Analytics & AI Lead

    @RVohra

    Our users do not have permissions to load the data into database. We loaded the data into database table, it is working fine. Unfortunately our users can not do that. So we will need to work on Internal Data set storage.