5 Replies Latest reply: Aug 12, 2014 11:57 AM by 1453829 RSS

    Goldengate Initial Load

    927790

      Hi All,

       

      GG Version: 11.2

      source RDBMS: 11.2.0.4

      Target DB: Teradata 13

       

      we have 6 TB of data to be copied to Target teradata as part of Initial load.

      We are planning to use GG initial load for this. Please suggest best ways for GG inital load.

      Please suggest if anybody has done such huge data moment by using GG initial load and expected time for 6TB.

       

      Appreciate your support ..

       

       

      Thanks

      Mvk

        • 1. Re: Goldengate Initial Load
          927790

          Hi All,

           

          Please reply ...

           

          Regards

          Mvk

          • 2. Re: Goldengate Initial Load
            Kgronau-Oracle

            Yes, in general it is possible to use initial load for the first time data load. Regarding the performance it's always difficult to decide whether it is fast enough  as it depends on many factors. Generally speaking the replication process is single threaded process that applies one statement at a time right after the other using normal SQL statements. So you see the 6GB replication will take a while. There's an option that allows you to process the whole inserts faster by grouping them for large tables and using more then just one replicat process.

            Another possibility would be to use the initial load extract, put the data into ASCII fomratted text file and then load it with multiload Teradato in parallel into the Terdata database. Unformtunately there are no scripts ready to use for the MLOAD tool - you need to write them on your own based on the formatted output.

            • 3. Re: Goldengate Initial Load
              927790

              Hi Kgronau,

               

              Thank you very much for the inputs.

              It 6TB of data actually. Can you please provide any approximate time it takes for initial load with Direct GG and ASCII to MLOAD tool.

               

              Thanks a lot again.

              Regards

              Mvk

              • 4. Re: Goldengate Initial Load
                Kgronau-Oracle

                Sorry, but I don't have that sort of information. It would be better to get in touch with Oracle Sales. They might have that sort of information you're looking at or they will request it from the Product Managers. As an alternative you could post it at the Teradata blog: https://blogs.oracle.com/dataintegration/entry/what_s_new_for_oracle1


                - Klaus

                • 5. Re: Goldengate Initial Load
                  1453829

                  Oracle GoldenGate for initial load is usually not the fastest method but it is 'easy'.
                  If you use that method I would strongly suggest that you have multiple parallel paths
                  Extract A ---> Replicat A   Tables A, B, C, D
                  Extract B----> Replicat B   Tables E, F,G, H
                  Extract C ----> Replicat C  Table I (big table)
                  etc

                   

                   

                  I don't think anyone (including the Oracle PMs) will give you any timings as it will depend on the network, how busy the Teradata Database is, type of data etc.
                  Strongly suggest you use the parameter BATCHSQL parameter and you may have to make some adjustments to the subparameters within it for Teradata.