5 Replies Latest reply on Oct 30, 2019 11:36 AM by JohnGoodwin

    Data Management - Import Error

    AbanoubZaki

      Dears,

       

      There is a warning appears while importing the data using "Multi-Column All Data Type" File type, and the Account as a driver.

      because of the period mapping.

      but when I change it to "Delimited All Data type" it works properly.

       

      any advice?.

       

      Thank you,

        • 1. Re: Data Management - Import Error
          JohnGoodwin

          AbanoubZaki wrote:

           

          any advice?.

          Maybe if you provide more information you will get help, for example source data, import format, warning/errors

           

          Cheers

           

          John

          • 2. Re: Data Management - Import Error
            AbanoubZaki

            The data source is a flat file, i am using Multi column-All data type for the import format, and the Account as a driver.

             

            please find the log file below:

             

            2019-10-29 14:20:21,882 INFO  [AIF]: FDMEE Process: 1066, Log Level: 4

            2019-10-29 14:20:21,882 INFO  [AIF]: Location     : Dole_SalesOrder (Partitionkey:60)

            2019-10-29 14:20:21,883 INFO  [AIF]: Period Name  : BegBalance-19 (Period Key:1/31/99 12:00 AM)

            2019-10-29 14:20:21,883 INFO  [AIF]: Category Name: Actual (Category key:2)

            2019-10-29 14:20:21,883 INFO  [AIF]: Rule Name    : Sales_Order (Rule ID:49)

            2019-10-29 14:20:23,919 INFO  [AIF]: Log File Encoding: UTF-8

            2019-10-29 14:20:24,942 INFO  [AIF]: -------START IMPORT STEP-------

            2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds

            2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds

            2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds

            2019-10-29 14:20:25,271 INFO  [AIF]: File Name: SalesOrderSample.csv

            2019-10-29 14:20:25,461 INFO  [AIF]: EPMFDM-140274:Message - LOADID:PARTKEY:CATKEY:RULEID:CURRENCYKEY:FILEPATH:IMPGROUPFILETYPE::1066;60:2:49:[NONE]:/u03/inbox/:MULTIDATA

            2019-10-29 14:20:25,468 INFO  [AIF]: EPMFDM-140274:Message - File CharEncoding as per settings: UTF-8

            2019-10-29 14:20:25,468 INFO  [AIF]: EPMFDM-140274:Message - ImportTextData - Start

            2019-10-29 14:20:25,542 ERROR [AIF]: Array index out of bounds

            2019-10-29 14:20:25,542 ERROR [AIF]: Array index out of bounds

            2019-10-29 14:20:25,542 ERROR [AIF]: Array index out of bounds

            2019-10-29 14:20:25,592 INFO  [AIF]: EPMFDM-140274:Message - Initialize error maps

            2019-10-29 14:20:25,592 INFO  [AIF]: EPMFDM-140274:Message - File Name SalesOrderSample.csv

            periodKey1999-01-31

            2019-10-29 14:20:25,596 INFO  [AIF]: EPMFDM-140274:Message -  PROCESS ID: 1066

            PARTITIONKEY: 60

            IMPORT GROUP: D_SalesOrder

            FILE TYPE: FIXED

            SOURCE FILE: SalesOrderSample.csv

            PROCESSING CODES:

            -----------------------------------------------------------------------------------

            BLANK............. Line is blank or empty.

            NN................ Non-Numeric, Amount field contains non numeric characters.

            TC................ Type Conversion, Amount field could not be converted to a number.

            ZP................ Zero Suppress, Amount field contains a 0 value and zero suppress is ON.

            SKIP FIELD.............. SKIP field value was found

            NULL ACCOUNT VALUE.............. Account Field is null

            SKIP FROM SCRIPT.............. Skipped through Script

            HEADER ROW.............. Header Row

            ERROR_INVALID_PERIOD.............. Invalid period specified in the file.

             

             

            [HEADER_ROW] "REF #

            [NULL ACCOUNT VALUE] WK & SHPT & CX CODE",VERSION,YEAR-DEP,YEAR-ARVL,PD-DEP,ITC Week ,PD-ARVL,WK-DEP,WEEK-ARVL,SHIP NO,PORT OF DEPARTURE,ORIGIN,CARRIER,DEPARTED VESSEL,MARKET,PORT OF DESTINATION,CUSTOMER,ETD ,ETA,SKU,EST VOLUME / QUANTITY,UNIT

            Rows Loaded: 0

            Rows Rejected: 1

             

            2019-10-29 14:20:25,597 INFO  [AIF]: EPMFDM-140274:Message - ARCHIVE MODE: Copy

            2019-10-29 14:20:25,597 INFO  [AIF]: EPMFDM-140274:Message - Start archiving file:

            2019-10-29 14:20:25,598 INFO  [AIF]: EPMFDM-140274:Message - Archive file name: 106619990131.csv

            2019-10-29 14:20:25,600 INFO  [AIF]: EPMFDM-140274:Message - Deleting the source file: SalesOrderSample.csv

            2019-10-29 14:20:25,600 INFO  [AIF]: EPMFDM-140274:Message - File not deleted: /u03/inbox/SalesOrderSample.csv

            2019-10-29 14:20:25,609 INFO  [AIF]: EPMFDM-140274:Message - ImportTextData - End

            2019-10-29 14:20:25,609 INFO  [AIF]: EPMFDM-140274:Message - Total time taken for the import in ms = 141

            2019-10-29 14:20:25,702 INFO  [AIF]:

            Import Data from Source for Period 'BegBalance-19'

            2019-10-29 14:20:25,774 INFO  [AIF]: Executing delete statement:

            2019-10-29 14:20:25,776 INFO  [AIF]: Successfully executed delete statement

            2019-10-29 14:20:25,785 INFO  [AIF]:

            Map Data for Period 'BegBalance-19'

            2019-10-29 14:20:25,789 WARN  [AIF]: Warning: No records exist for Period 'BegBalance-19'

            2019-10-29 14:20:25,795 INFO  [AIF]:

            Stage Data for Period 'BegBalance-19'

            2019-10-29 14:20:25,796 INFO  [AIF]: Number of Rows deleted from TDATAMAPSEG: 0

            2019-10-29 14:20:25,797 INFO  [AIF]: Number of Rows inserted into TDATAMAPSEG: 0

            2019-10-29 14:20:25,798 INFO  [AIF]: Number of Rows deleted from TDATAMAP_T: 0

            2019-10-29 14:20:25,800 INFO  [AIF]: Executing delete statement:

            2019-10-29 14:20:25,802 INFO  [AIF]: Successfully executed delete statement

            2019-10-29 14:20:25,802 INFO  [AIF]: Number of Rows deleted from TDATASEG: 0

            2019-10-29 14:20:25,804 INFO  [AIF]: Number of Rows deleted from TDATAMEMOITEMS: 0

            2019-10-29 14:20:25,805 INFO  [AIF]: Number of Rows deleted from TDATAARCHIVE: 0

            2019-10-29 14:20:25,807 INFO  [AIF]: Executing insert statement:

            2019-10-29 14:20:25,809 INFO  [AIF]: Successfully executed insert statement

            2019-10-29 14:20:25,809 INFO  [AIF]: Number of Rows inserted into TDATASEG: 0

            2019-10-29 14:20:25,811 INFO  [AIF]: Executing delete statement:

            2019-10-29 14:20:25,813 INFO  [AIF]: Successfully executed delete statement

            2019-10-29 14:20:25,813 INFO  [AIF]: Number of Rows deleted from TDATASEG_T: 0

            2019-10-29 14:20:25,844 INFO  [AIF]: -------END IMPORT STEP-------

            2019-10-29 14:20:25,871 INFO  [AIF]: -------START VALIDATE STEP-------

            2019-10-29 14:20:25,901 WARN  [AIF]: Warning: The Import step has not been completed for period BegBalance-19

            2019-10-29 14:20:25,903 WARN  [AIF]: Warning: The Import step has not been completed for period BegBalance-19

            2019-10-29 14:20:25,930 INFO  [AIF]: -------END VALIDATE STEP-------

            2019-10-29 14:20:26,166 INFO  [AIF]: FDMEE Process End, Process ID: 1066

            • 3. Re: Data Management - Import Error
              JohnGoodwin

              From that I can see that your record of data has been rejected which looks due to the import format mappings. As I said you need to provide the information like your import format.

              • 4. Re: Data Management - Import Error
                AbanoubZaki

                Please check the below screenshot:

                Untitled.png

                • 5. Re: Data Management - Import Error
                  JohnGoodwin

                  First of all there is something wrong with your file, in the log you have

                   

                  [HEADER_ROW] "REF #

                  [NULL ACCOUNT VALUE] WK & SHPT & CX CODE",VERSION,YEAR-DEP,YEAR-ARVL,PD-DEP,ITC Week ,PD-ARVL,WK-DEP,WEEK-ARVL,SHIP NO,PORT OF DEPARTURE,ORIGIN,CARRIER,DEPARTED VESSEL,MARKET,PORT OF DESTINATION,CUSTOMER,ETD ,ETA,SKU,EST VOLUME / QUANTITY,UNIT

                  Rows Loaded: 0

                  Rows Rejected: 1

                   

                  It looks like you only have one record in the file and account is not being mapped correctly.


                  Next the errors

                  2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds


                  This sounds like you are trying to access fields which are greater than the number of fields in your source file.

                  Probably worth focusing on your source file and getting it correct, increase the log level and go through it.

                  1 person found this helpful