nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

Oracle Communities

Oracle AI and Analytics

Child Item

Granular Data Pipeline Reprocessing (Selective Entity & Date Range Reload)

Yagnesh_Analytics

The Inspiration: Partitioned Pipeline Orchestration

In enterprise ETL/ELT pipeline management (e.g., Informatica, legacy ODI), targeted data recovery is a fundamental capability. When source data is corrected in an upstream ERP/HCM system, pipeline operators re-run only the affected partition. FDI needs this same Selective Reprocessing control within its Data Pipeline management console.

Problem Statement

Currently, when a data correction occurs in Oracle Fusion Cloud (eg. GL adjustment, or a recalculated payroll):

Excessive Resource Consumption: To fix a data gap in a single Legal Entity or date range, admins often have to trigger a Reload. This re-extracts millions of unchanged rows, spiking ADW compute.
Extended Downtime: A full reset can take hours to complete. During this window, business users experience stale data, data inconsistencies, or degraded report performance across the entire functional area.

Proposed Solution: Selective Pipeline Reload Controls

Introduce a Granular Pipeline Reprocessing utility within the FDI Console for pipeline data loads:

Targeted Filter Controls: Allow administrators to trigger an ad-hoc pipeline refresh using specific filter criteria:
- Date Range / Period: (e.g., Reload only Q2 2026 or 15-SEP-2026 to 20-SEP-2026)
- Organizational Boundary: (e.g., Reload only Legal Entity UK or US Operations)
- Source Batch / Extract ID: Re-run a specific failed extraction slice.
Delta Merge Logic: Ensure the pipeline target tables in ADW selectively delete and replace only the matching records, leaving all other historical data intact.
Execution Preview: Display an estimate of impacted record counts and processing time before launching the targeted reload.

Business Value

80%+ Faster Recovery: Cuts pipeline recovery times from hours to minutes by focusing processing power strictly on the affected data slice.
Significant ADW Cost Savings: Reduces unnecessary database compute consumption by eliminating redundant global re-extracts.
High System Availability: Keeps reports and workbooks available for business users while localised data updates run silently in the background.

Find more posts tagged with

Submitted

Parameter

FDI Front End

Fusion Data Intelligence

ADW

Fusion Data Intelligence Pipeline

Status: Submitted

Comments

There are no comments yet

Top Leaders

Top Ideas

Make Expenditure Comment Available in Configurable Account Analysis (CAA) Subject Area
We would like to request an enhancement to make Expenditure Comment (PJC_EXP_COMMENTS.EXPENDITURE_COMMENT) available in the Configurable Account Analysis (CAA) subject area in Oracle Fusion Data Intelligence (FDI). Currently: Expenditure Comment is available in the PPM - Project Costs subject area. Expenditure Class is…
Affected Object Views on Workflows should have a Data Presence Indicator (DPI) around other pending
Since this functionality is already available in Agile, we would like to have a similar Data Presence Indicator (DPI) available in Affected Object Views within Workflows. The DPI would provide a visual indication when there are other pending changes associated with an affected object, allowing users to quickly identify…
Target vs. Incoming Security Bundle Comparison & Diff Utility
While historical security reporting (such as the Security Audit History Subject Area) provides invaluable hindsight into past changes, release managers and Security leads need real-time visibility into the active security state - both when reporting on current environments and before importing new security packages.…
Enable Source Change Tracking for Configurable Account Analysis
Description Our organization uses Oracle Fusion Data Intelligence (FDI) Configurable Account Analysis (CAA) as a foundational data source for financial reporting, reconciliation, and analytics. We extensively leverage the following tables within our reporting architecture: DW_FA_GL_ACCOUNT_ANALYSIS_CF…
Content Explorer to be moved to consumers console
In recent updates of FDI the AI based content explorer was introduced and tile available in FDI console however it would more useful to have this tile available on DV url which is available to all users and not just the Administrators.