This discussion is archived
1 Reply Latest reply: Jan 24, 2013 9:45 AM by Srini VEERAVALLI RSS

Schedule Full ETL, Incremental ETL and Refresh Dates

user10920449 Newbie
user10920449 Jan 24, 2013 6:00 AM
Currently Being Moderated
Hi - I'm trying to set up a schedule that runs a weekly execution plan on Saturday am. This weekly etl needs to be a full load always. I have a similar execution plan that I want to run all the other mornings as an incremental etl. I have the weekly plan set to run as 'Full Load Always'. Since it is set to run as 'Full Load Always', the refresh dates are not being set on the source tables. The second daily plan then initially runs as a full etl since the refresh dates are null. Is there a way I can accomplish scheduling the weekly execution plan to run as a full and then the daily execution plan to run as incremental without any manual intervention (such as manually resetting the source dates each week) ?

Thank you.
  • 34 Views
  • 1. Re: Schedule Full ETL, Incremental ETL and Refresh Dates
    Srini VEERAVALLI Guru
    Srini VEERAVALLI Jan 24, 2013 9:45 AM (in response to user10920449)
    Currently Being Moderated
    You have to execute only 1 EP for both Incr and Full loads, followed by another custom EP which set the DAC refresh table(W_ETL_REFRESH_DT) column as NULL.
    ex:UPDATE W_ETL_REFRESH_DT SET LAST_REFRESH_DT =NULL

    You need to schedule the custom ep to run on only Saturdays just before your actual EP start time so that you can have DAC refresh dates are null and follow load would be full load.

    You need to create a custom etl mapping so that you can set this.. that might be a command from session or workflow.

    If helps pls mark as correct :)

    Edited by: Srini VEERAVALLI on Jan 24, 2013 8:22 AM

Actions

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points