12 Replies Latest reply: Feb 28, 2013 4:28 AM by CKPT RSS

    Please help with Data Guard setup in a RAC Environment.

    963732
      Hi everyone,

      I am trying to setup Data Guard in a RAC clusterd environment, the problem I am facing is that
      the Auxiliary instance gets shut off as aparantly the RMAN tries to restart the Auxiliary Instance
      based on the SPFILE created by it, and the Instance fails because the SPFILE created by RMAN has
      references to the ASM Disk Groups which the Auxiliary Instance does not have access to.

      The Disk Groups for the Primary (Target) RAC are:
      [xml]1. +OCR
      2. +DATA
      3. +FRA[xml]

      The Disk Groups for the Standby (Auxiliary) RAC are:
      [xml]1. +DGOCR
      2. +DGDATA
      3. +DGFRA[xml]

      Here are the contents from the SPFILE created by the RMAN on Auxiliary:

      [xml]^@^A^Dh~^@^@Sol1.__db_cache_size=226492416
      Sol2.__db_cache_size=255852544
      Sol2.__java_pool_size=4194304
      Sol1.__java_pool_size=4194304
      Sol2.__large_pool_size=12582912
      Sol1.__large_pool_size=12582912
      Sol2.__oracle_base='/u01/app/oracle'#ORACLE_BASE set from environment
      Sol2.__pga_aggregate_target=327155712
      Sol1.__pga_aggregate_target=327155712
      Sol2.__sga_target=616562688
      Sol1.__sga_target=616562688
      Sol2.__shared_io_pool_size=0
      Sol1.__shared_io_pool_size=0
      Sol1.__shared_pool_size=360710144
      Sol2.__s^AC^@^@C"^@^@^C^@^@^@^@^@^@^@^@^@^A^D^Y^Y^@^@hared_pool_size=327155712
      Sol2.__streams_pool_size=4194304
      Sol1.__streams_pool_size=0
      *.audit_file_dest='/u01/app/oracle/admin/Sols/adump'
      *.audit_trail='db'
      *.cluster_database=true
      *.compatible='11.2.0.0.0'
      *.control_files='+DATA/sol/controlfile/current.256.807733739','+FRA/sol/controlfile/current.256.807733745'
      *.db_block_size=8192
      *.db_create_file_dest='+DATA'
      *.db_domain='localdomain'
      *.db_file_name_convert='+DATA/Sol','+DGDATA/Sols'
      *.db_name='Sol'
      *.db_recovery_file_dest='+FRA'^AC^@^@C"^@^@^D^@^@^@^@^@^@^@^@^@^A^DWz^@^@
      *.db_recovery_file_dest_size=15728640000
      *.db_unique_name='Sols'
      *.diagnostic_dest='/u01/app/oracle'
      *.dispatchers='(PROTOCOL=TCP) (SERVICE=SolsXDB)'
      *.fal_client='Sols'
      *.fal_server='Sol'
      Sol1.instance_number=1
      Sol2.instance_number=2
      *.log_archive_config='dg_config=(Sol,Sols)'
      *.log_archive_dest_2='service=Sol SYNC valid_for=(ONLINE_LOGFILE,PRIMARY_ROLE) db_unique_name=Sol'
      *.log_archive_format='%t_%s_%r.dbf'
      *.log_file_name_convert='+DATA/Sol','+DGDATA/Sols'
      *.memory_target=943718^AC^@^@C"^@^@^E^@^@^@^@^@^@^@^@^@^A^D1^P^@^@400
      *.open_cursors=300
      *.processes=150
      *.remote_listener='sol-scan:1521'
      *.remote_login_passwordfile='exclusive'
      *.standby_file_management='AUTO'
      Sol2.thread=2
      Sol1.thread=1
      Sol2.undo_tablespace='UNDOTBS2'
      Sol1.undo_tablespace='UNDOTBS1'[xml]

      Here are the contents of PFILE that I am using to startup Auxiliary Instance :

      [xml]Sols2.__db_cache_size=222298112
      Sols1.__db_cache_size=226492416
      Sols2.__java_pool_size=4194304
      Sols1.__java_pool_size=4194304
      Sols2.__large_pool_size=12582912
      Sols1.__large_pool_size=12582912
      Sols2.__oracle_base='/u01/app/oracle'#ORACLE_BASE set from environment
      Sols2.__pga_aggregate_target=327155712
      Sols1.__pga_aggregate_target=327155712
      Sols2.__sga_target=616562688
      Sols1.__sga_target=616562688
      Sols2.__shared_io_pool_size=0
      Sols1.__shared_io_pool_size=0
      Sols2.__shared_pool_size=360710144
      Sols1.__shared_pool_size=360710144
      Sols2.__streams_pool_size=4194304
      Sols1.__streams_pool_size=0
      *.audit_file_dest='/u01/app/oracle/admin/Sols/adump'
      *.audit_trail='db'
      *.cluster_database=false
      *.compatible='11.2.0.0.0'
      *.control_files='+DGDATA/sols/controlfile/current.256.807733739','+DGFRA/sols/controlfile/current.256.807733745'
      *.db_block_size=8192
      *.db_create_file_dest='+DGDATA'
      *.db_domain='localdomain'
      *.db_name='Sols'
      *.db_recovery_file_dest='+DGFRA'
      *.db_recovery_file_dest_size=15728640000
      *.diagnostic_dest='/u01/app/oracle'
      *.dispatchers='(PROTOCOL=TCP) (SERVICE=SolsXDB)'
      Sols1.instance_number=1
      Sols2.instance_number=2
      *.dg_broker_config_file1='+DGDATA/Sols/dr1Sols.dat'
      *.dg_broker_config_file2='+DGDAta/Sols/dr2Sols.dat'
      *.dg_broker_start=TRUE
      *.log_archive_config='dg_config=(Sol,Sols)'
      *.log_archive_format='%t_%s_%r.dbf'
      *.memory_target=943718400
      *.open_cursors=300
      *.processes=150
      *.remote_listener='sols-scan:1521'
      *.remote_login_passwordfile='exclusive'
      Sols2.thread=2
      Sols1.thread=1
      Sols2.undo_tablespace='UNDOTBS2'
      Sols1.undo_tablespace='UNDOTBS1'[xml]

      After connecting to the Target and Auxiliary DBs I am trying to run the following script :

      [xml]run {
      allocate channel Sol type disk;
      allocate channel Sol2 type disk;
      allocate auxiliary channel Sols type disk;
      duplicate target database for standby from active database DORECOVER
      spfile
      parameter_value_convert "Sol","Sols"
      set db_unique_name="Sols"
      set db_file_name_convert="+DATA/Sol","+DGDATA/Sols"
      set log_file_name_convert="+DATA/Sol","+DGDATA/Sols"
      set fal_client="Sols"
      set fal_server="Sol"
      set standby_file_management="AUTO"
      set log_archive_config="dg_config=(Sol,Sols)"
      set log_archive_dest_2="service=Sol SYNC valid_for=(ONLINE_LOGFILE,PRIMARY_ROLE) db_unique_name=Sol";}[xml]

      I have also created the password file for the Auxiliary and authentication does not seem to be the problem.

      I would very much appreciate your suggestions and solutions to the issue I am having.

      Regards
      Terry
        • 1. Re: Please help with Data Guard setup in a RAC Environment.
          CKPT
          I have also created the password file for the Auxiliary and authentication does not seem to be the problem.
          Checking in detail, What is the error you are facing from the restore log or alert log?

          >
          set db_file_name_convert="+DATA/Sol","+DGDATA/Sols"
          set log_file_name_convert="+DATA/Sol","+DGDATA/Sols"
          >
          When you managing with ASM/OMF, You no need to mention the directory names. Just use disk groups. It will take care based on the DB_UNIQUE_NAME you have been set

          >
          set db_file_name_convert="+DATA","+DGDATA"
          set log_file_name_convert="+DATA","+DGDATA"
          >

          If you use RMAN duplicate script using your script it will create spfile, But instead of that you can also create SPFILE/PFILE earlier and simply use example below command
          run
          {
          allocate channel prim1 type disk;
          allocate auxiliary channel standby1 type disk;
          duplicate target database for standby from active database nofilenamecheck;
          release channel prim1;
          release channel standby1;
          }
          When the questions are answered, Please close the threads as answered.
          >
          960729      
               Newbie
               
          Handle:      960729
          Status Level:      Newbie
          Registered:      Sep 22, 2012
          Total Posts:      26
          Total Questions:      15 (12 unresolved)
          >

          Edited by: CKPT on Feb 26, 2013 7:08 PM
          • 2. Re: Please help with Data Guard setup in a RAC Environment.
            963732
            Hi there,

            Thank you for your reply.

            I tried what you suggested and got the following error :

            [xml]RMAN> run
            {
            allocate channel prim1 type disk;
            allocate auxiliary channel standby1 type disk;
            duplicate target database for standby from active database nofilenamecheck;
            release channel prim1;
            release channel standby1;
            }
            2> 3> 4> 5> 6> 7> 8>
            using target database control file instead of recovery catalog
            allocated channel: prim1
            channel prim1: SID=160 instance=Sol2 device type=DISK

            allocated channel: standby1
            channel standby1: SID=18 device type=DISK

            Starting Duplicate Db at 27-FEB-2013 01:12:21

            contents of Memory Script:
            {
            backup as copy reuse
            targetfile '/u01/app/oracle/product/11.2.0/dbhome_1/dbs/orapwSol2' auxiliary format
            '/u01/app/oracle/product/11.2.0/dbhome_1/dbs/orapwSols1' ;
            }
            executing Memory Script

            Starting backup at 27-FEB-2013 01:12:23
            Finished backup at 27-FEB-2013 01:12:35
            RMAN-00571: ===========================================================
            RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
            RMAN-00571: ===========================================================
            RMAN-03002: failure of Duplicate Db command at 02/27/2013 01:13:23
            RMAN-05501: aborting duplication of target database
            RMAN-06136: ORACLE error from auxiliary database: ORA-03113: end-of-file on communication channel
            Process ID: 23221
            Session ID: 138 Serial number: 5[xml]

            Can you please let me know what to do.

            Thanks again for your help!

            Regards
            Terry
            • 3. Re: Please help with Data Guard setup in a RAC Environment.
              CKPT
              RMAN-00571: ===========================================================
              RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
              RMAN-00571: ===========================================================
              RMAN-03002: failure of Duplicate Db command at 02/27/2013 01:13:23
              RMAN-05501: aborting duplication of target database
              RMAN-06136: ORACLE error from auxiliary database: ORA-03113: end-of-file on communication channel
              Process ID: 23221
              Session ID: 138 Serial number: 5[xml]
              Whenever you got such errors, You must visit not only the restore log file, Have to check database alert log file also for more and valuable information.
              With this errors, there can be many scenarios (or) if you dont find any thing, enable debug trace of RMAN restore.
              Simply you have to add "debug trace=rman.trc" in your RMAN command before you connect.
              Ex: rman target / debug trace=rman.trc
              • 4. Re: Please help with Data Guard setup in a RAC Environment.
                963732
                Hi,

                Thanks for getting back to me again!, its a permission issue on +DGDATA and I checked the permissions on the ASM Disk Groups they look ok to me, you can also see it as under :

                iscsiadm list target -S|grep "OS Device Name:"
                [xml] OS Device Name: /dev/rdsk/c9t13d0s2
                OS Device Name: /dev/rdsk/c9t12d0s2
                OS Device Name: /dev/rdsk/c9t11d0s2[xml]

                cd /devices/iscsi && ls -ltr | grep grid :
                [xml]crw-rw---- 1 grid asmadmin 217, 833 Feb 27 14:15 disk@0000iqn.2006-01.com.openfiler%3Atsn.ccf5ead2502d0001,2:b,raw
                crw-rw---- 1 grid asmadmin 217, 769 Feb 27 14:15 disk@0000iqn.2006-01.com.openfiler%3Atsn.ccf5ead2502d0001,1:b,raw
                crw-rw---- 1 grid asmadmin 217, 705 Feb 27 14:15 disk@0000iqn.2006-01.com.openfiler%3Atsn.ccf5ead2502d0001,0:b,raw[xml]


                Here are the contents of alert.log from adrci:
                [xml]Starting background process ASMB
                ASMB started with pid=30, OS id=6233
                Starting background process RBAL
                RBAL started with pid=31, OS id=6238
                NOTE: initiating MARK startup
                Starting background process MARK
                MARK started with pid=34, OS id=6240
                NOTE: MARK has subscribed
                2013-02-27 03:33:37.987000 +05:00
                ORA-15025: could not open disk "/dev/rdsk/c9t12d0s1" <<<----------
                ORA-27041: unable to open file
                Solaris-AMD64 Error: 13: Permission denied <<<----------
                Additional information: 9
                SUCCESS: diskgroup DGDATA was mounted
                Errors in file /u01/app/oracle/diag/rdbms/sols/Sols1/trace/Sols1_ora_6037.trc (incident=4981):
                ORA-00600: internal error code, arguments: [kfioTranslateIO03], [], [], [], [], [], [], [], [], [], [], []
                Incident details in: /u01/app/oracle/diag/rdbms/sols/Sols1/incident/incdir_4981/Sols1_ora_6037_i4981.trc
                Use ADRCI or Support Workbench to package the incident.
                See Note 411.1 at My Oracle Support for error and packaging details.
                2013-02-27 03:33:41.201000 +05:00
                Errors in file /u01/app/oracle/diag/rdbms/sols/Sols1/trace/Sols1_ora_6037.trc (incident=4982):
                ORA-00600: internal error code, arguments: [17090], [], [], [], [], [], [], [], [], [], [], []
                Incident details in: /u01/app/oracle/diag/rdbms/sols/Sols1/incident/incdir_4982/Sols1_ora_6037_i4982.trc
                Dumping diagnostic data in directory=[cdmp_20130227033341], requested by (instance=1, osid=6037), summary=[incident=4981].[xml]

                Output from trace files

                vi /u01/app/oracle/diag/rdbms/sols/Sols1/trace/Sols1_ora_6037.trc
                [xml]NOTE: disk 0 is missing from group 1
                Incident 4981 created, dump file: /u01/app/oracle/diag/rdbms/sols/Sols1/incident/incdir_4981/Sols1_ora_6037_i4981.trc
                ORA-00600: internal error code, arguments: [kfioTranslateIO03], [], [], [], [], [], [], [], [], [], [], []

                Incident 4982 created, dump file: /u01/app/oracle/diag/rdbms/sols/Sols1/incident/incdir_4982/Sols1_ora_6037_i4982.trc
                ORA-00600: internal error code, arguments: [17090], [], [], [], [], [], [], [], [], [], [], []

                Error ORA-600 signaled at ksedsts()+686<-kgepop()+476<-kgesic0()+161<-kfioTranslateIO()+4599<-kfioRqSetPrepare()+1229<-kfioSubmitIO()+1850<-kfioRequestPriv()+128<-kfioRequest()+382<-ksfd_kfioRequest()+1054<-ksfd_osmcrt()+3019<-ksfd_create1()+6420<-ksfd_create()+241<-ksfdcre()+132<-krbiprm()+942<-pevm_icd_call_common()+673<-pfrinstr_ICAL()+158<-pfrrun_no_tool()+194<-pfrrun()+1186<-plsql_run()+632<-peicnt()+335<-kkxexe()+541<-opiexe()+11064<-kpoal8()+2157<-opiodr()+935<-ttcpip()+1271<-opitsk()+1544<-opiino()+821<-opiodr()+935<-opidrv()+742<-sou2o()+88<-opimai_real()+522<-ssthrdmain()+293<-main()+212<-_start()+108
                ERROR: unrecoverable error ORA-600 raised in ASM I/O path; terminating process 6037
                ----- Abridged Call Stack Trace -----
                ksedsts()+850<-kfioRequest()+1321<-ksfd_kfioRequest()+1054<-ksfd_osmcrt()+3019<-ksfd_create1()+6420<-ksfd_create()+241<-ksfdcre()+132<-krbiprm()+942<-pevm_icd_call_common()+673<-pfrinstr_ICAL()+158<-pfrrun_no_tool()+194<-pfrrun()+1186<-plsql_run()+632<-peicnt()+335
                <-kkxexe()+541<-opiexe()+11064<-kpoal8()+2157<-opiodr()+935<-ttcpip()+1271<-opitsk()+1544<-opiino()+821<-opiodr()+935<-opidrv()+742<-sou2o()+88<-opimai_real()+522<-ssthrdmain()+293<-main()+212<-_start()+108
                ----- End of Abridged Call Stack Trace -----[xml]

                vi /u01/app/oracle/diag/rdbms/sols/Sols1/incident/incdir_7457/Sols1_ora_3856_i7457.trc
                [xml]Dump file /u01/app/oracle/diag/rdbms/sols/Sols1/incident/incdir_7457/Sols1_ora_3856_i7457.trc
                Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
                With the Partitioning, Real Application Clusters, Automatic Storage Management, Oracle Label Security,
                OLAP, Data Mining, Oracle Database Vault and Real Application Testing option
                ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_1
                System name: SunOS
                Node name: Sol3
                Release: 5.11
                Version: 11.1
                Machine: i86pc
                Instance name: Sols1
                Redo thread mounted by this instance: 0 <none>
                Oracle process number: 31
                Unix process pid: 3856, image: oracle@Sol3


                *** 2013-02-27 04:26:55.480
                *** SESSION ID:(140.7) 2013-02-27 04:26:55.480
                *** CLIENT ID:() 2013-02-27 04:26:55.480
                *** SERVICE NAME:() 2013-02-27 04:26:55.480
                *** MODULE NAME:(rman@Sol2 (TNS V1-V3)) 2013-02-27 04:26:55.480
                *** ACTION NAME:(0000003 STARTED66) 2013-02-27 04:26:55.480

                Dump continued from file: /u01/app/oracle/diag/rdbms/sols/Sols1/trace/Sols1_ora_3856.trc
                ORA-00600: internal error code, arguments: [kfioTranslateIO03], [], [], [], [], [], [], [], [], [], [], []

                ========= Dump for incident 7457 (ORA 600 [kfioTranslateIO03]) ========
                ----- Beginning of Customized Incident Dump(s) -----
                kfioRqSet=0xffff80ffbd2a7160 parent=0xffff80ffbfff7320 gn=(64.0) cnt=0
                size=2048 vxn=0 byte offset=0 buf offset=0
                skipped[0]=0 skipped[1]=0 skipped[2]=0 skipped[3]=0 skipped[4]=0 skipped[5]=0
                failed[0]=0 failed[1]=0 failed[2]=0 failed[3]=0 failed[4]=0 failed[5]=0
                parent <kfiorq>:
                =========Start of 'kfiorq = [0xffff80ffbfff7320]' dumping =========
                Status = UNKWOWN
                Flags = WRITE | SYNC
                Mirror side = 0
                Fib = 0xb49fd398
                Offset = 0
                buffer ptr = 0xffff80ffbd706800
                Rcount = 2048
                err_kfiorq = 600
                Inflight disk IO = 0
                Completed disk IO = 0
                Oracle error = 0
                Intended zone = 0
                ===Dump of all attached kfiodrq's===
                =========End of 'kfiorq = [0xffff80ffbfff7320]' dumping =========

                parent <kfiofib>:
                ############# kfiofib = 0xb49fd398 #################
                Diskgroup Name =
                File number = 256.808424815
                File type = 1
                Flags = 12
                Blksize = 2048
                File size = 1 blocks
                Blk one offset = 0
                Redundancy = 17
                Physical blocksz = 512
                Open name = +DGDATA
                Fully-qualified nm =+DGDATA/sols/controlfile/current.256.808424815
                Mapid = 2
                Slave ID = 0
                Connection = 0x0x
                ############################################
                ----- End of Customized Incident Dump(s) -----[xml]


                Looking at above information can you kindly suggest to me what to do.

                Is it safe to assign "asmadmin" group to oracle user ?

                Appreciate your help.
                Regards
                Terry

                Edited by: 960729 on Feb 27, 2013 1:35 AM
                • 5. Re: Please help with Data Guard setup in a RAC Environment.
                  CKPT
                  *** ACTION NAME:(0000003 STARTED66) 2013-02-27 04:26:55.480

                  Dump continued from file: /u01/app/oracle/diag/rdbms/sols/Sols1/trace/Sols1_ora_3856.trc
                  ORA-00600: internal error code, arguments: [kfioTranslateIO03], [], [], [], [], [], [], [], [], [], [], []
                  So problem is here, Use ora-600/7445 error look up tool "ORA-600/ORA-7445/ORA-700 Error Look-up Tool [ID 153788.1]"
                  and there is an bug listed already, please check ORA-00600 [kfioTranslateIO03] [17090] [ID 1336846.1]     

                  if you haven't matched , then raise an SR to oracle support by submitting alert and trace files.
                  • 6. Re: Please help with Data Guard setup in a RAC Environment.
                    963732
                    Hi,

                    I added oracle user to asmadmin group and then ran your RMAN command and it went through this time however it did not create control files and spfile and the database does not mount complaining about the control files location.

                    [xml]SQL> startup;
                    ORACLE instance started.

                    Total System Global Area 939495424 bytes
                    Fixed Size 2231592 bytes
                    Variable Size 704643800 bytes
                    Database Buffers 226492416 bytes
                    Redo Buffers 6127616 bytes
                    ORA-00205: error in identifying control file, check alert log for more info[xml]

                    Here is the output from alert.log
                    [xml]ORACLE_BASE from environment = /u01/app/oracle
                    2013-02-27 20:16:36.140000 +05:00
                    ALTER DATABASE MOUNT
                    2013-02-27 20:16:37.159000 +05:00
                    NOTE: Loaded library: System
                    SUCCESS: diskgroup DGDATA was mounted
                    2013-02-27 20:16:40.730000 +05:00
                    SUCCESS: diskgroup DGFRA was mounted
                    ORA-00210: cannot open the specified control file
                    ORA-00202: control file: '+DGFRA/sols/controlfile/current.256.807733745'
                    ORA-17503: ksfdopn:2 Failed to open file +DGFRA/sols/controlfile/current.256.807733745
                    ORA-15012: ASM file '+DGFRA/sols/controlfile/current.256.807733745' does not exist
                    ORA-00210: cannot open the specified control file
                    ORA-00202: control file: '+DGDATA/sols/controlfile/current.256.807733739'
                    ORA-17503: ksfdopn:2 Failed to open file +DGDATA/sols/controlfile/current.256.807733739
                    ORA-15012: ASM file '+DGDATA/sols/controlfile/current.256.807733739' does not exist
                    ORA-205 signalled during: ALTER DATABASE MOUNT...
                    Checker run found 2 new persistent data failures
                    2013-02-27 20:16:43.820000 +05:00
                    SUCCESS: diskgroup DGFRA was dismounted
                    SUCCESS: diskgroup DGDATA was dismounted
                    2013-02-27 10:16:54.188000 -05:00
                    ALTER SYSTEM SET local_listener='(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.22)(PORT=1521))))' SCOPE=MEMORY SID='Sols1';
                    2013-02-27 20:19:44.155000 +05:00
                    NOTE: ASMB process exiting due to lack of ASM file activity for 187 seconds
                    Stopping background process RBAL
                    Stopping background process MARK
                    2013-02-27 20:19:45.376000 +05:00
                    NOTE: Shutting down MARK background process
                    2013-02-27 20:21:05.998000 +05:00
                    Time drift detected. Please check VKTM trace file for more details.[xml]

                    Can you please help me create these files to be stored in the ASM Disk Groups the way they are in the Primary RAC Database.

                    Thanks for your help!
                    Regards
                    Terry.
                    • 7. Re: Please help with Data Guard setup in a RAC Environment.
                      CKPT
                      >
                      ORA-00210: cannot open the specified control file
                      ORA-00202: control file: '+DGFRA/sols/controlfile/current.256.807733745'
                      ORA-17503: ksfdopn:2 Failed to open file +DGFRA/sols/controlfile/current.256.807733745
                      ORA-15012: ASM file '+DGFRA/sols/controlfile/current.256.807733745' does not exist
                      >

                      Can you check in diskgroup, whether the specified file exist or not? in "+DGFRA/sols/controlfile" ?
                      if exist, Then may be you have issue in accessing or connectivity between rdbms/ASM.
                      If allowed, once try to mount disk group with force then retry
                      • 8. Re: Please help with Data Guard setup in a RAC Environment.
                        963732
                        Hi CKPT,

                        I finally resolved all the issues, the script I used is as under :

                        [xml]run {
                        allocate channel Sol type disk;
                        allocate channel Sol2 type disk;
                        allocate auxiliary channel Sols type disk;
                        duplicate target database for standby from active database DORECOVER
                        spfile
                        parameter_value_convert "Sol","Sols"
                        set db_unique_name="Sols"
                        set instance_number="1"
                        set db_file_name_convert="+DATA/Sol","+DGDATA/Sols"
                        set log_file_name_convert="+DATA/Sol","+DGDATA/Sols"
                        set db_recovery_file_dest="+DGFRA"
                        set control_files="+DGDATA/sols/controlfile/current.256.807733739","+DGFRA/sols/controlfile/current.256.807733745"
                        set fal_client="Sols"
                        set fal_server="Sol"
                        set standby_file_management="AUTO"
                        set log_archive_config="dg_config=(Sol,Sols)"
                        set log_archive_dest_2="service=Sol SYNC valid_for=(ONLINE_LOGFILE,PRIMARY_ROLE) db_unique_name=Sol";}[xml]

                        And thank you so much for your quick replies, you were the only one responding to my issues and I really appreciate it.

                        Have a good one !!!

                        Best regards
                        Terry
                        • 9. Re: Please help with Data Guard setup in a RAC Environment.
                          963732
                          All thumbs up for CKPT !!!
                          • 10. Re: Please help with Data Guard setup in a RAC Environment.
                            CKPT
                            I finally resolved all the issues, the script I used is as under :
                            So many questions here, You saying after changing the script it got resolved.
                            Before that i asked you to use "PFILE/SPFILE" and then to start simple duplicate command as below

                            >
                            run
                            {
                            allocate channel prim1 type disk;
                            allocate auxiliary channel standby1 type disk;
                            duplicate target database for standby from active database nofilenamecheck;
                            release channel prim1;
                            release channel standby1;
                            }
                            >

                            Now question is, What all are the parameters you put in PFILE?

                            I verified your script before and after successful, There is only difference of parameter settings 1) FRA 2) Control_files, So it mean even though you set those parameters still unable to perform duplicate? I dont think so.

                            I got some more time to look at those errors of "permission denied & ORA-600", It looks more issue from the ASM, When i preferred to mount disk groups properly. Have you performed it again?

                            *Database Will Not Mount: ORA-15025, ORA-27041, 'Permission denied', ORA-15081 [ID 1378747.1]*+
                            *Asm Is not Discovering Disks On Solaris: ORA-15025 ORA-27041 SVR4 Error: 5: I/O error (Doc ID 1300393.1) [ID 1300393.1]*+

                            Above, both metalink noes are related to Solaris and which suits your environment, Please let me know what are the changes you did before using the script, such as modifying permissions (or) dismount & mounting disks again? In detail..
                            • 11. Re: Please help with Data Guard setup in a RAC Environment.
                              963732
                              Hi CKPT,

                              The actual problem was with the static listener configuration on the standby which was preventing the RMAN to restart the Auxiliary instance, so I kept modifying the static listener until RMAN was able to reconnect and restart the Auxiliary instance, so once it was done, everything went through smoothly.

                              For permissions issue on the ASM disk groups on standby, I added oracle user to the asmadmin group.

                              That's it.

                              Thanks and best regards.
                              Terry
                              • 12. Re: Please help with Data Guard setup in a RAC Environment.
                                CKPT
                                For permissions issue on the ASM disk groups on standby, I added oracle user to the asmadmin group.

                                That's it.
                                Now, it makes sense to me. Got it.