Forum Stats

  • 3,838,844 Users
  • 2,262,406 Discussions
  • 7,900,768 Comments

Discussions

Data Management - Import Error

AbanoubZaki
AbanoubZaki Member Posts: 144 Red Ribbon
edited Oct 30, 2019 7:41AM in Financial Data Management

Dears,

There is a warning appears while importing the data using "Multi-Column All Data Type" File type, and the Account as a driver.

because of the period mapping.

but when I change it to "Delimited All Data type" it works properly.

any advice?.

Thank you,

AbanoubZaki

Best Answer

  • JohnGoodwin
    JohnGoodwin Member Posts: 30,471 Blue Diamond
    edited Oct 30, 2019 7:36AM Answer ✓

    First of all there is something wrong with your file, in the log you have

    [HEADER_ROW] "REF #

    [NULL ACCOUNT VALUE] WK & SHPT & CX CODE",VERSION,YEAR-DEP,YEAR-ARVL,PD-DEP,ITC Week ,PD-ARVL,WK-DEP,WEEK-ARVL,SHIP NO,PORT OF DEPARTURE,ORIGIN,CARRIER,DEPARTED VESSEL,MARKET,PORT OF DESTINATION,CUSTOMER,ETD ,ETA,SKU,EST VOLUME / QUANTITY,UNIT

    Rows Loaded: 0

    Rows Rejected: 1

    It looks like you only have one record in the file and account is not being mapped correctly.


    Next the errors

    2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds


    This sounds like you are trying to access fields which are greater than the number of fields in your source file.

    Probably worth focusing on your source file and getting it correct, increase the log level and go through it.

    AbanoubZakiAbanoubZaki

Answers

  • JohnGoodwin
    JohnGoodwin Member Posts: 30,471 Blue Diamond
    edited Oct 30, 2019 3:39AM
    AbanoubZaki wrote:any advice?.

    Maybe if you provide more information you will get help, for example source data, import format, warning/errors

    Cheers

    John

    AbanoubZaki
  • AbanoubZaki
    AbanoubZaki Member Posts: 144 Red Ribbon
    edited Oct 30, 2019 3:55AM

    The data source is a flat file, i am using Multi column-All data type for the import format, and the Account as a driver.

    please find the log file below:

    2019-10-29 14:20:21,882 INFO  [AIF]: FDMEE Process: 1066, Log Level: 4

    2019-10-29 14:20:21,882 INFO  [AIF]: Location     : Dole_SalesOrder (Partitionkey:60)

    2019-10-29 14:20:21,883 INFO  [AIF]: Period Name  : BegBalance-19 (Period Key:1/31/99 12:00 AM)

    2019-10-29 14:20:21,883 INFO  [AIF]: Category Name: Actual (Category key:2)

    2019-10-29 14:20:21,883 INFO  [AIF]: Rule Name    : Sales_Order (Rule ID:49)

    2019-10-29 14:20:23,919 INFO  [AIF]: Log File Encoding: UTF-8

    2019-10-29 14:20:24,942 INFO  [AIF]: -------START IMPORT STEP-------

    2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds

    2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds

    2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds

    2019-10-29 14:20:25,271 INFO  [AIF]: File Name: SalesOrderSample.csv

    2019-10-29 14:20:25,461 INFO  [AIF]: EPMFDM-140274:Message - LOADID:PARTKEY:CATKEY:RULEID:CURRENCYKEY:FILEPATH:IMPGROUPFILETYPE::1066;60:2:49:[NONE]:/u03/inbox/:MULTIDATA

    2019-10-29 14:20:25,468 INFO  [AIF]: EPMFDM-140274:Message - File CharEncoding as per settings: UTF-8

    2019-10-29 14:20:25,468 INFO  [AIF]: EPMFDM-140274:Message - ImportTextData - Start

    2019-10-29 14:20:25,542 ERROR [AIF]: Array index out of bounds

    2019-10-29 14:20:25,542 ERROR [AIF]: Array index out of bounds

    2019-10-29 14:20:25,542 ERROR [AIF]: Array index out of bounds

    2019-10-29 14:20:25,592 INFO  [AIF]: EPMFDM-140274:Message - Initialize error maps

    2019-10-29 14:20:25,592 INFO  [AIF]: EPMFDM-140274:Message - File Name SalesOrderSample.csv

    periodKey1999-01-31

    2019-10-29 14:20:25,596 INFO  [AIF]: EPMFDM-140274:Message -  PROCESS ID: 1066

    PARTITIONKEY: 60

    IMPORT GROUP: D_SalesOrder

    FILE TYPE: FIXED

    SOURCE FILE: SalesOrderSample.csv

    PROCESSING CODES:

    -----------------------------------------------------------------------------------

    BLANK............. Line is blank or empty.

    NN................ Non-Numeric, Amount field contains non numeric characters.

    TC................ Type Conversion, Amount field could not be converted to a number.

    ZP................ Zero Suppress, Amount field contains a 0 value and zero suppress is ON.

    SKIP FIELD.............. SKIP field value was found

    NULL ACCOUNT VALUE.............. Account Field is null

    SKIP FROM SCRIPT.............. Skipped through Script

    HEADER ROW.............. Header Row

    ERROR_INVALID_PERIOD.............. Invalid period specified in the file.

    [HEADER_ROW] "REF #

    [NULL ACCOUNT VALUE] WK & SHPT & CX CODE",VERSION,YEAR-DEP,YEAR-ARVL,PD-DEP,ITC Week ,PD-ARVL,WK-DEP,WEEK-ARVL,SHIP NO,PORT OF DEPARTURE,ORIGIN,CARRIER,DEPARTED VESSEL,MARKET,PORT OF DESTINATION,CUSTOMER,ETD ,ETA,SKU,EST VOLUME / QUANTITY,UNIT

    Rows Loaded: 0

    Rows Rejected: 1

    2019-10-29 14:20:25,597 INFO  [AIF]: EPMFDM-140274:Message - ARCHIVE MODE: Copy

    2019-10-29 14:20:25,597 INFO  [AIF]: EPMFDM-140274:Message - Start archiving file:

    2019-10-29 14:20:25,598 INFO  [AIF]: EPMFDM-140274:Message - Archive file name: 106619990131.csv

    2019-10-29 14:20:25,600 INFO  [AIF]: EPMFDM-140274:Message - Deleting the source file: SalesOrderSample.csv

    2019-10-29 14:20:25,600 INFO  [AIF]: EPMFDM-140274:Message - File not deleted: /u03/inbox/SalesOrderSample.csv

    2019-10-29 14:20:25,609 INFO  [AIF]: EPMFDM-140274:Message - ImportTextData - End

    2019-10-29 14:20:25,609 INFO  [AIF]: EPMFDM-140274:Message - Total time taken for the import in ms = 141

    2019-10-29 14:20:25,702 INFO  [AIF]:

    Import Data from Source for Period 'BegBalance-19'

    2019-10-29 14:20:25,774 INFO  [AIF]: Executing delete statement:

    2019-10-29 14:20:25,776 INFO  [AIF]: Successfully executed delete statement

    2019-10-29 14:20:25,785 INFO  [AIF]:

    Map Data for Period 'BegBalance-19'

    2019-10-29 14:20:25,789 WARN  [AIF]: Warning: No records exist for Period 'BegBalance-19'

    2019-10-29 14:20:25,795 INFO  [AIF]:

    Stage Data for Period 'BegBalance-19'

    2019-10-29 14:20:25,796 INFO  [AIF]: Number of Rows deleted from TDATAMAPSEG: 0

    2019-10-29 14:20:25,797 INFO  [AIF]: Number of Rows inserted into TDATAMAPSEG: 0

    2019-10-29 14:20:25,798 INFO  [AIF]: Number of Rows deleted from TDATAMAP_T: 0

    2019-10-29 14:20:25,800 INFO  [AIF]: Executing delete statement:

    2019-10-29 14:20:25,802 INFO  [AIF]: Successfully executed delete statement

    2019-10-29 14:20:25,802 INFO  [AIF]: Number of Rows deleted from TDATASEG: 0

    2019-10-29 14:20:25,804 INFO  [AIF]: Number of Rows deleted from TDATAMEMOITEMS: 0

    2019-10-29 14:20:25,805 INFO  [AIF]: Number of Rows deleted from TDATAARCHIVE: 0

    2019-10-29 14:20:25,807 INFO  [AIF]: Executing insert statement:

    2019-10-29 14:20:25,809 INFO  [AIF]: Successfully executed insert statement

    2019-10-29 14:20:25,809 INFO  [AIF]: Number of Rows inserted into TDATASEG: 0

    2019-10-29 14:20:25,811 INFO  [AIF]: Executing delete statement:

    2019-10-29 14:20:25,813 INFO  [AIF]: Successfully executed delete statement

    2019-10-29 14:20:25,813 INFO  [AIF]: Number of Rows deleted from TDATASEG_T: 0

    2019-10-29 14:20:25,844 INFO  [AIF]: -------END IMPORT STEP-------

    2019-10-29 14:20:25,871 INFO  [AIF]: -------START VALIDATE STEP-------

    2019-10-29 14:20:25,901 WARN  [AIF]: Warning: The Import step has not been completed for period BegBalance-19

    2019-10-29 14:20:25,903 WARN  [AIF]: Warning: The Import step has not been completed for period BegBalance-19

    2019-10-29 14:20:25,930 INFO  [AIF]: -------END VALIDATE STEP-------

    2019-10-29 14:20:26,166 INFO  [AIF]: FDMEE Process End, Process ID: 1066

  • JohnGoodwin
    JohnGoodwin Member Posts: 30,471 Blue Diamond
    edited Oct 30, 2019 5:10AM

    From that I can see that your record of data has been rejected which looks due to the import format mappings. As I said you need to provide the information like your import format.

  • AbanoubZaki
    AbanoubZaki Member Posts: 144 Red Ribbon
    edited Oct 30, 2019 5:16AM

    Please check the below screenshot:

    Untitled.png

  • JohnGoodwin
    JohnGoodwin Member Posts: 30,471 Blue Diamond
    edited Oct 30, 2019 7:36AM Answer ✓

    First of all there is something wrong with your file, in the log you have

    [HEADER_ROW] "REF #

    [NULL ACCOUNT VALUE] WK & SHPT & CX CODE",VERSION,YEAR-DEP,YEAR-ARVL,PD-DEP,ITC Week ,PD-ARVL,WK-DEP,WEEK-ARVL,SHIP NO,PORT OF DEPARTURE,ORIGIN,CARRIER,DEPARTED VESSEL,MARKET,PORT OF DESTINATION,CUSTOMER,ETD ,ETA,SKU,EST VOLUME / QUANTITY,UNIT

    Rows Loaded: 0

    Rows Rejected: 1

    It looks like you only have one record in the file and account is not being mapped correctly.


    Next the errors

    2019-10-29 14:20:25,225 ERROR [AIF]: Array index out of bounds


    This sounds like you are trying to access fields which are greater than the number of fields in your source file.

    Probably worth focusing on your source file and getting it correct, increase the log level and go through it.

    AbanoubZakiAbanoubZaki