4 Replies Latest reply: Oct 28, 2013 7:29 AM by User378604 RSS

    Duplicate Check in OEDQ

    User378604

      Hi All,

      In OEDQ, when we use Duplicate audit tool, it will filter both actual as well as duplicated record, Is there any way in OEDQ through which we can retain the original record

      Any help will be really appreciated.

       

      Thanks,

      VT

        • 1. Re: Duplicate Check in OEDQ
          Mikematthews-Oracle

          Hi,

           

          The question is not very clear. Which processor are you using (Duplicate Check?), and what are you trying to do?

           

          Mike

          • 2. Re: Duplicate Check in OEDQ
            User378604

            Hi Mike,

             

            Thanks for the quick response.

            The following is the detailed explanation:

            We have a data file where we can have duplicate records. for ex

            Name Dept Manager

            John   20     James

            John   20     James

            Here in OEDQ when we use Duplicate check tool (Audit section), it will consider 2 records as duplicate.

            We would like to process only one record and avoid the duplicated record.

            Please let us know whether this can be done through OEDQ using any other tool.

             

            Please let me know if the above description is not clear or any other information is required.

             

            Thanks,

            VT

            • 3. Re: Duplicate Check in OEDQ
              Mikematthews-Oracle

              Hi,

               

              You need to take the duplicate records into a Group and Merge processor to merge the duplicates into single records. If you then need to reunite them with the non-duplicated records, use Merge Data Streams.

               

              Normally duplicates found in Duplicate Check are not duplicated across the full record, only on the attribute or attributes you are checking. Therefore you need to decide how to construct a single record from multiple using the normal Merge logic (also available from Match processors).

               

              Group and Merge effectively offers a way to run 'fast' exact matching, without the need for clustering, comparisons or match rules but keeping the ability to merge.

               

              Regards,

               

              Mike

              • 4. Re: Duplicate Check in OEDQ
                User378604

                Hi Mike,

                 

                Thanks a lot for the update. Really appreciate the help. We are able to merge the duplicate records to one record and is working fine.

                 

                Need one more help in aciving sum functionality in having duplicate rows for ex

                Material      Quantity      Cost         Location

                =====         =======   ====       ======

                ABC101          10             100          X1

                ABC101       10           100        X1
                ABC101        10           100       

                X1

                 

                From the above rows we need to group and merge to one row as below;

                ABC101        30               100         X1

                 

                Quantity needs to summed up as 30 for material : ABC101

                 

                We saw in the OEDQ help, following is the statement:

                ********************************************************

                There are sometimes other reasons to group records, for example to sum all records with the same attribute value. Group and Merge can be used to do this, in conjunction with the ability to create custom output selectors.

                **********************************************************

                 

                Could you plz help us by providing information on 'create custom output selectors' and also help us whether we have any other tool in OEDQ which can be used to perform the quantity sum for same set of material, cost and Location.

                 

                Thanks in advance

                 

                Thanks,

                VT