Forum Stats

  • 3,874,832 Users
  • 2,266,778 Discussions
  • 7,911,973 Comments

Discussions

Multiple Extract Process for Schema Replication

837734
837734 Member Posts: 49
edited Mar 8, 2011 8:00AM in GoldenGate
Hi
I have one Schema that needs to be replicated in real time. There are around 4000 tables in the Oracle Source Schema.

(1) How can I define / start multiple Extract & Replicat Process for schema replication in order to improve performance ?

for e.g. 10 Extract and Multiple Process working concurrently for a given schema.

Thanks
Hiren Pandya

Best Answer

  • stevencallan
    stevencallan Member Posts: 3,459
    Answer ✓
    Page 148 Admin Guide:

    Process topology
    ● If using parallel Extract and/or Replicat processes, keep related DDL and DML
    together in the same process stream to ensure data integrity. Configure the processes
    so that:
    ❍ all DDL and DML for any given object are processed by the same Extract group and
    by the same Replicat group.
    ❍ all objects that are relational to an object are processed by the same group as the
    parent object.
    For example, if ReplicatA processes DML for Table1, then it should also process the DDL
    for Table1. If Table2 has a foreign key to Table1, then its DML and DDL operations also
    should be processed by ReplicatA.

Answers

  • stevencallan
    stevencallan Member Posts: 3,459
    If the table names were named A_whatever, B_whatever ... D_whatever, you could use 4 extracts with wildcarding:

    --whatever parameters in the extract parameter file, then
    table owner.A*;

    And then three more just like the one above, using owner.B* and so on

    More than likely your table names are not named like this, so you are stuck with listing the tables you want in a particular extract.

    You will want to keep related tables together (those with referential integrity constraints).

    As to the number of extract, data pump (use this), replicat processes, you can have up to 300 processes per GoldenGate instance.
    stevencallan
  • 837734
    837734 Member Posts: 49
    Hi Steve

    Thank you so much for sharing your knowledge. The problem is table names are not same !!! So it is difficult for me to use wild card characters. Can you please elaborate your point : "You will want to keep related tables together"

    Thanks
    Hiren Pandya
  • stevencallan
    stevencallan Member Posts: 3,459
    Answer ✓
    Page 148 Admin Guide:

    Process topology
    ● If using parallel Extract and/or Replicat processes, keep related DDL and DML
    together in the same process stream to ensure data integrity. Configure the processes
    so that:
    ❍ all DDL and DML for any given object are processed by the same Extract group and
    by the same Replicat group.
    ❍ all objects that are relational to an object are processed by the same group as the
    parent object.
    For example, if ReplicatA processes DML for Table1, then it should also process the DDL
    for Table1. If Table2 has a foreign key to Table1, then its DML and DDL operations also
    should be processed by ReplicatA.
  • 837734
    837734 Member Posts: 49
    Okay got it Steve. Thanks
This discussion has been closed.