Applying a date filter on a PVO extract

Summary:

As we have been using ERP, some of our PVO tables are getting quite large, while the data extracts normally have less than 1 million rows in them, the PECSV validation files are now spanning dozens of files, etc.

This leaves me with a couple of options,

a) only import the validation files once a week (variable of course) - this is a workable solution, but I worry about extracted data integrity. I don't want downstream business decisions impacted by non-current data.

b) implement a data filter on the PVO.

I experimented on option B with some success, i.e.