In current data pipeline scheduling systems, refresh frequencies are typically fixed or limited to simple scheduling options. This leads to inefficiencies, especially during peak business activity hours when data needs to be more current.
Introducing a dynamic refresh frequency configuration that allows users to define custom time windows with variable refresh intervals and the ability to specify dates and have multiple schedules.
