Temporal Analysis enablement
Introduce a guided feature or wizard in Oracle AI Data Platform (AIDP) to simplify the configuration of Type 2 Slowly Changing Dimensions (SCDs) within the Silver layer of the medallion architecture.
Currently, users can manually create Type 2 SCDs to enable temporal and point-in-time analysis, but the process requires detailed technical setup and is prone to inconsistency. This idea proposes a wizard-driven process that automates key steps in the workflow such as:
- Defining business keys and change detection logic
- Managing surrogate and effective date fields
- Generating history-tracking and merge logic automatically
The feature would provide a clear, guided workflow for enabling temporal analysis and historical data tracking, reducing complexity for users and ensuring adherence to best practices. It could integrate seamlessly with existing AIDP data pipeline orchestration and metadata management components, generating the necessary transformations and metadata automatically.
Benefits:
- Simplifies setup of Type 2 SCDs in the Silver layer
- Reduces manual effort, errors, and configuration time
- Accelerates time-to-value for point-in-time and historical reporting
- Ensures consistent and auditable temporal modelling across datasets