8 Replies Latest reply on Dec 14, 2017 7:12 AM by Rabi P

    Validating Data in Workbench Time

    HFar

      Hi All,

       

      Does anyone have a fair idea regrading validation time in workbench??

       

      We are importing approximately 1million results in workbench from a Custom View. Current time is around 2 hrs but as long as we remember, with 0.7 million records, time was around 20mins. We don't know what went wrong.

       

      FDM version is 11.1.2.4.210

      HFM version is 11.1.2.4.205

       

       

      Response is appreciated.

        • 1. Re: Validating Data in Workbench Time
          Vishnu V Reddy-Oracle

          You might need to review the level 5 log to see which step has taken more time.

           

          Regards

          Vishnu

          1 person found this helpful
          • 2. Re: Validating Data in Workbench Time
            SH_INT

            To get a more detailed breakdown of the timings I would log into ODI studio and look at the Session logs in the Operator. You will then be able to see where exactly you have your bottleneck

            1 person found this helpful
            • 3. Re: Validating Data in Workbench Time
              HFar

              Thanks. I ll get back after reviewing logs.

              Just a quick question: Does heap size settings can change validation time??

              • 4. Re: Validating Data in Workbench Time
                Vishnu V Reddy-Oracle

                You can also review if there were any map changes after which if you got the performance issue.

                Bad maps can cause this issue and you would need to optimize them.

                • 5. Re: Validating Data in Workbench Time
                  Vishnu V Reddy-Oracle

                  Regarding heap size setting,unless you see any memory errors,that does not matter ,means there is no heap memory shortage.Ideally that shouldn't cause the slowness for validation.

                  You can also monitor physical memory/cpu on FDMEE server while doing the test to see if there are any memory issues.

                  1 person found this helpful
                  • 6. Re: Validating Data in Workbench Time
                    USER1211

                    As other members of the board have correctly stated you need increase the logging and confirm where the bottleneck in your process is then seek action to address.

                     

                    The belief is you have already done the standard Oracle FDMEE tuning as per the Oracle guidance documentation.

                     

                    You can also review the Oracle FDMEE documentation in regards to processing impact based on the mapping types(e.g Like maps are more resource intensive that explicit maps) which is a common area of performance issues, hence you would want to review with your  team if mapping updates occurred recently.

                     

                    If possible you would also want to do several test run of the process during non peak hours to ensure that it is not a resource contention with any other process in your enviroment.

                     

                    As always it may also be worthwhile to go ahead and open an Oracle SR to have the Oracle Engineers look at your enviroment/setup to get another opinion as to what the issue could be if the above does not produce any clear results.

                     

                    Good luck and let us know how you make out.

                    1 person found this helpful
                    • 7. Re: Validating Data in Workbench Time
                      Caniut Alex

                      HFar : Try Indexing the column in TDATASEG_T and TDATASEG table also try increasing the Array Size and Batch Size from ODI for the custom view connection in Topology

                      Its like increase the Array size upto 50000 and Batch to 500 then try loading from FDMEE and keep on increasing until you see the performance  , These are all detailed in tuning guide and this helped me one of the implementations

                       

                      Regards,

                      C

                      1 person found this helpful
                      • 8. Re: Validating Data in Workbench Time
                        Rabi P

                        Hi,

                         

                        What's the database FDMEE hosted on. If its SQL server then try indexing all the backend table except temp tables. If you index the temp tables as well then the very first load will take a long time for loading.

                         

                        Thanks

                        Rabi