Missing data due to a column shift caused by an extra pipe delimiter
We imported a Reverb Merchant file, which is a pipe delimited file, but this particular file had an extra pipe in one of the fields which caused the data to shift. We did not see this data come into the system (Data Integration Workbench), BUT the system also did not throw an error to notify us of the shifted data, even though we currently have DATE and numeric columns that would now be wrong.
How can we force an error to the whole file to avoid bringing in partial data and alert us of a file issue before we import. For example, we have the last column in the file as the accounting date. If there is a column shift, this now becomes text data. Shouldn't this cause the file to error because it now doesn't have an Accounting Date for one of the records?