1 2 Previous Next 17 Replies Latest reply: Mar 3, 2013 2:10 AM by TSharma-Oracle RSS

    RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013

    994358
      Hi all
      I am new to oracle RAC(dbA) i am having issue in RMAN backup failure,pls help me regarding this error.

      RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013 22:00:24_
      ORA-00242: maximum allowed filename records used up in control file_

      my rman script

      rman target / log=/RMANADHOC/PTUIM/PTUIMl1_`date '+%d%m%y'`.log <<EOF
      run
      {
      allocate channel backup_disk1 type disk;
      allocate channel backup_disk2 type disk;
      allocate channel backup_disk3 type disk;
      allocate channel backup_disk4 type disk;
      backup incremental level 1 cumulative as compressed BACKUPSET tag=Daily_PTUIM_DBBACKUP format '/RMANADHOC/PTUIM/Databasefiles_%d_%u_%s_%T' database;
      backup as compressed backupset tag=ARCHIVE_PTUIM_Daily_LOGBACKUP archivelog all not backed up format '/RMANADHOC/PTUIM/Archivelog_%d_%u_%s_%T' ;
      delete noprompt archivelog all backed up 2 times to device type disk;
      backup current controlfile tag=CONTROLFILE_Daily_PTUIM format '/RMANADHOC/PTUIM/Controlfile_%d_%u_%s_%T';
      crosscheck backupset;
      crosscheck archivelog all;
      delete noprompt expired backup;
      delete noprompt obsolete;
      release channel backup_disk1;
      release channel backup_disk2;
      release channel backup_disk3;
      release channel backup_disk4;
      }
      exit
      EOF

      RMAN backup log-file results


      RMAN> 2> 3> 4> 5> 6> 7> 8> 9> 10> 11> 12> 13> 14> 15> 16> 17> 18> 19>
      using target database control file instead of recovery catalog
      allocated channel: backup_disk1
      channel backup_disk1: SID=2402 instance=PTUIM1 device type=DISK

      allocated channel: backup_disk2
      channel backup_disk2: SID=2450 instance=PTUIM1 device type=DISK

      allocated channel: backup_disk3
      channel backup_disk3: SID=2500 instance=PTUIM1 device type=DISK

      allocated channel: backup_disk4
      channel backup_disk4: SID=2547 instance=PTUIM1 device type=DISK

      Starting backup at 01-MAR-13
      channel backup_disk1: starting compressed incremental level 1 datafile backup set
      channel backup_disk1: specifying datafile(s) in backup set
      input datafile file number=00009 name=+DATA2/ptuim/datafile/undotbs6.295.767471295
      input datafile file number=00013 name=+DATA2/ptuim/datafile/large_index.420.784231855
      input datafile file number=00019 name=+DATA2/ptuim/datafile/large_data.547.793452655
      input datafile file number=00017 name=+DATA2/ptuim/datafile/large_index.510.789463565
      input datafile file number=00022 name=+DATA2/ptuim/datafile/large_data.561.804409283
      input datafile file number=00023 name=+DATA2/ptuim/datafile/large_index.562.804409425
      input datafile file number=00024 name=+DATA2/ptuim/datafile/large_data.565.804765469
      channel backup_disk1: starting piece 1 at 01-MAR-13
      channel backup_disk2: starting compressed incremental level 1 datafile backup set
      channel backup_disk2: specifying datafile(s) in backup set
      input datafile file number=00010 name=+DATA2/ptuim/datafile/large_data.359.767536421
      input datafile file number=00014 name=+DATA2/ptuim/datafile/large_data.486.788251665
      input datafile file number=00015 name=+DATA2/ptuim/datafile/large_index.501.789018937
      input datafile file number=00020 name=+DATA2/ptuim/datafile/large_index.548.793453639
      input datafile file number=00026 name=+DATA2/ptuim/datafile/large_data.569.807604785
      input datafile file number=00027 name=+DATA2/ptuim/datafile/large_data.570.807798147
      channel backup_disk2: starting piece 1 at 01-MAR-13
      channel backup_disk3: starting compressed incremental level 1 datafile backup set
      channel backup_disk3: specifying datafile(s) in backup set
      input datafile file number=00003 name=+DATA2/ptuim/datafile/undotbs1.288.767471015
      input datafile file number=00011 name=+DATA2/ptuim/datafile/large_index.360.767536515
      input datafile file number=00016 name=+DATA2/ptuim/datafile/large_data.509.789462983
      input datafile file number=00021 name=+DATA2/ptuim/datafile/large_data.553.794306959
      input datafile file number=00005 name=+DATA2/ptuim/datafile/undotbs2.291.767471285
      input datafile file number=00002 name=+DATA2/ptuim/datafile/sysaux.287.767471015
      input datafile file number=00001 name=+DATA2/ptuim/datafile/system.286.767471013
      channel backup_disk3: starting piece 1 at 01-MAR-13
      channel backup_disk4: backup set complete, elapsed time: 00:57:33
      channel backup_disk4: starting compressed incremental level 1 datafile backup set
      channel backup_disk4: specifying datafile(s) in backup set
      including current SPFILE in backup set
      channel backup_disk4: starting piece 1 at 01-MAR-13
      channel backup_disk1: finished piece 1 at 01-MAR-13
      piece handle=/RMANADHOC/PTUIM/Databasefiles_PTUIM_q2o3f8j1_3906_20130301 tag=DAILY_PTUIM_DBBACKUP comment=NONE
      channel backup_disk1: backup set complete, elapsed time: 00:58:47
      RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013 22:00:24
      ORA-00242: maximum allowed filename records used up in control file
      continuing other job steps, job failed will not be re-run
      channel backup_disk4: finished piece 1 at 01-MAR-13
      piece handle=/RMANADHOC/PTUIM/Databasefiles_PTUIM_q7o3fbvr_3911_20130301 tag=DAILY_PTUIM_DBBACKUP comment=NONE
      channel backup_disk4: backup set complete, elapsed time: 00:02:06
      channel backup_disk3: finished piece 1 at 01-MAR-13
      piece handle=/RMANADHOC/PTUIM/Databasefiles_PTUIM_q4o3f8j3_3908_20130301 tag=DAILY_PTUIM_DBBACKUP comment=NONE
      channel backup_disk3: backup set complete, elapsed time: 01:04:40
      released channel: backup_disk1
      released channel: backup_disk2
      released channel: backup_disk3
      released channel: backup_disk4
      RMAN-00571: ===========================================================
      RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
      RMAN-00571: ===========================================================

      RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013 22:00:24
      ORA-00242: maximum allowed filename records used up in control file

      RMAN>
        • 2. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
          TSharma-Oracle
          Also, post the result of these queries

          select type, record_size, RECORDS_TOTAL, RECORDS_USED from v$controlfile_record_section;
          select FNNAME, FNFLG from x$kccfn;
          show parameter db_flashback_retention_target
          • 3. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
            994358
            here is the result of querry


            SQL> show parameter db_flashback_retention_target

            NAME TYPE VALUE
            ------------------------------------ ----------- ------------------------------
            db_flashback_retention_target integer 1440

            SQL> select type, record_size, RECORDS_TOTAL, RECORDS_USED from v$controlfile_record_section;

            TYPE RECORD_SIZE RECORDS_TOTAL RECORDS_USED
            ---------------------------- ----------- ------------- ------------
            DATABASE 316 1 1
            CKPT PROGRESS 8180 51 0
            REDO THREAD 256 48 6
            REDO LOG 72 288 12
            DATAFILE 520 1024 27
            FILENAME 524 65535 65535
            TABLESPACE 68 1024 12
            TEMPORARY FILENAME 56 1024 2
            RMAN CONFIGURATION 1108 50 1
            LOG HISTORY 56 2336 2336
            OFFLINE RANGE 200 1063 0
            ARCHIVED LOG 584 3584 3584
            BACKUP SET 40 1227 1227
            BACKUP PIECE 736 1000 1000
            BACKUP DATAFILE 200 1063 1063
            BACKUP REDOLOG 76 12900 1743
            DATAFILE COPY 736 1000 0
            BACKUP CORRUPTION 44 1115 0
            COPY CORRUPTION 40 1227 0
            DELETED OBJECT 20 3272 3272
            PROXY COPY 928 1004 0
            BACKUP SPFILE 124 131 131
            DATABASE INCARNATION 56 292 2
            FLASHBACK LOG 84 65535 65482
            RECOVERY DESTINATION 180 1 1
            INSTANCE SPACE RESERVATION 28 1055 6
            REMOVABLE RECOVERY FILES 32 2000 205
            RMAN STATUS 116 141 141
            THREAD INSTANCE NAME MAPPING 80 48 48
            MTTR 100 48 6
            DATAFILE HISTORY 568 57 0
            STANDBY DATABASE MATRIX 400 31 31
            GUARANTEED RESTORE POINT 212 2048 0
            RESTORE POINT 212 2083 0
            DATABASE BLOCK CORRUPTION 80 8384 0
            ACM OPERATION 104 64 6
            FOREIGN ARCHIVED LOG 604 1002 0

            37 rows selected.
            • 4. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
              TSharma-Oracle
              Post the version of the database and OS

              Also post the result of

              select * from v$recovery_file_dest;

              We had this error when we had too many files in our flashback area. This is what I am trying to figure if this is the case with you.
              • 5. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                994358
                SQL> select count(*) from v$recovery_file_dest;

                COUNT(*)
                ----------
                1
                • 6. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                  994358
                  db version

                  BANNER
                  --------------------------------------------------------------------------------
                  Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
                  PL/SQL Release 11.2.0.2.0 - Production
                  CORE 11.2.0.2.0 Production
                  TNS for Linux: Version 11.2.0.2.0 - Production
                  NLSRTL Version 11.2.0.2.0 - Production


                  linux version

                  Red Hat Enterprise Linux Server release 5.6
                  • 7. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                    TSharma-Oracle
                    Sorry I meant

                    select * from v$recovery_file_dest;

                    please post the result.
                    • 8. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                      994358
                      SQL> select * from v$recovery_file_dest;

                      NAME
                      --------------------------------------------------------------------------------
                      SPACE_LIMIT SPACE_USED SPACE_RECLAIMABLE NUMBER_OF_FILES
                      ----------- ---------- ----------------- ---------------
                      +RECO
                      1.2885E+12 8.3378E+11 3.4289E+11 67049


                      SQL> col NAME for a20
                      SQL> /

                      NAME SPACE_LIMIT SPACE_USED SPACE_RECLAIMABLE NUMBER_OF_FILES
                      -------------------- ----------- ---------- ----------------- ---------------
                      RECO                 1.2885E12 8.3378E+11 3.4289E+11 67049
                      • 9. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                        TSharma-Oracle
                        See now your value from your first query

                        FLASHBACK LOG 84 65535 65482

                        and

                        Total number of files in your flash log are 67049 which is more than controlfile parameter. You need to delete unnecessary files from flashback area...you will be good than.
                        • 10. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                          TSharma-Oracle
                          You need to go to the RMAN
                          Crosscheck backup
                          Delete expired backup

                          You should be good after that. Try it. After than check the number of files in v$recovery_file_dest.
                          • 12. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                            994358
                            hi i need one more favor regarding error raised in while taking backup


                            my backup script
                            export ORACLE_BASE=/opt/oracle/aia
                            export ORACLE_HOME=/opt/oracle/aia/product/11.2.0/dbhome_1
                            export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:$PATH
                            export LD_LIBRARY_PATH=$ORACLE_HOME/lib
                            export ORACLE_SID=PTAS10G2
                            rman target / log=/RMANADHOC/PTAS10G/PTAS10Gl1_`date '+%d%m%y'`.log <<EOF
                            run
                            {
                            allocate channel backup_disk1 type disk;
                            allocate channel backup_disk2 type disk;
                            allocate channel backup_disk3 type disk;
                            allocate channel backup_disk4 type disk;
                            backup incremental level 1 cumulative as compressed BACKUPSET tag=Daily_PTAS10G_DBBACKUP format '/RMANADHOC/PTAS10G/Databasefiles_%d_%u_%s_%T' database;
                            backup as compressed backupset tag=ARCHIVE_PTAS10G_Daily_LOGBACKUP archivelog all not backed up format '/RMANADHOC/PTAS10G/Archivelog_%d_%u_%s_%T' ;
                            delete noprompt archivelog all backed up 2 times to device type disk;
                            backup current controlfile tag=CONTROLFILE_Daily_PTAS10G format '/RMANADHOC/PTAS10G/Controlfile_%d_%u_%s_%T';
                            crosscheck backupset;
                            crosscheck archivelog all;
                            delete noprompt expired backup;
                            delete noprompt obsolete;
                            release channel backup_disk1;
                            release channel backup_disk2;
                            release channel backup_disk3;
                            release channel backup_disk4;
                            }
                            exit
                            EOF




                            backup status


                            Recovery Manager: Release 11.2.0.2.0 - Production on Fri Mar 1 21:00:01 2013

                            Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.

                            connected to target database: PTAS10G (DBID=2216521727)

                            RMAN> 2> 3> 4> 5> 6> 7> 8> 9> 10> 11> 12> 13> 14> 15> 16> 17> 18> 19>
                            using target database control file instead of recovery catalog
                            allocated channel: backup_disk1
                            channel backup_disk1: SID=993 instance=PTAS10G2 device type=DISK

                            allocated channel: backup_disk2
                            channel backup_disk2: SID=961 instance=PTAS10G2 device type=DISK

                            allocated channel: backup_disk3
                            channel backup_disk3: SID=965 instance=PTAS10G2 device type=DISK

                            allocated channel: backup_disk4
                            channel backup_disk4: SID=186 instance=PTAS10G2 device type=DISK

                            Starting backup at 01-MAR-13
                            channel backup_disk1: starting compressed incremental level 1 datafile backup set
                            channel backup_disk1: specifying datafile(s) in backup set
                            input datafile file number=00003 name=+DATA2/ptas10g/datafile/undotbs1.269.767436573
                            input datafile file number=00027 name=+DATA2/ptas10g/datafile/orabpel.425.784280049
                            input datafile file number=00011 name=+DATA2/ptas10g/datafile/oraesb.284.767441445
                            input datafile file number=00024 name=+DATA2/ptas10g/datafile/oraesb.415.784228661
                            input datafile file number=00029 name=+DATA2/ptas10g/datafile/users.427.784987211
                            input datafile file number=00033 name=+DATA2/ptas10g/datafile/orabpel.446.785651391
                            input datafile file number=00037 name=+DATA2/ptas10g/datafile/oraesb.457.785874547
                            input datafile file number=00041 name=+DATA2/ptas10g/datafile/orabpel.461.785875051
                            input datafile file number=00045 name=+DATA2/ptas10g/datafile/users.517.790229333
                            input datafile file number=00050 name=+DATA2/ptas10g/datafile/orabpel.544.793448871
                            input datafile file number=00054 name=+DATA2/ptas10g/datafile/users.555.795006317
                            input datafile file number=00013 name=+DATA2/ptas10g/datafile/orabpel_s.397.768049323
                            input datafile file number=00016 name=+DATA2/ptas10g/datafile/orawsm_s.400.768049483
                            input datafile file number=00055 name=+DATA2/ptas10g/datafile/users.563.804409839
                            channel backup_disk1: starting piece 1 at 01-MAR-13
                            channel backup_disk2: starting compressed incremental level 1 datafile backup set
                            channel backup_disk2: specifying datafile(s) in backup set
                            input datafile file number=00019 name=+DATA2/ptas10g/datafile/orabpel.409.783491371
                            input datafile file number=00005 name=+DATA2/ptas10g/datafile/undotbs2.272.767436833
                            input datafile file number=00007 name=+DATA2/ptas10g/datafile/undotbs4.274.767436841
                            input datafile file number=00020 name=+DATA2/ptas10g/datafile/oraesb.410.783491539
                            input datafile file number=00025 name=+DATA2/ptas10g/datafile/oraesb.417.784230675
                            input datafile file number=00030 name=+DATA2/ptas10g/datafile/oraesb.428.785082343
                            input datafile file number=00034 name=+DATA2/ptas10g/datafile/oraesb.447.785651511
                            input datafile file number=00038 name=+DATA2/ptas10g/datafile/oraesb.458.785874665
                            input datafile file number=00042 name=+DATA2/ptas10g/datafile/users.462.785875587
                            input datafile file number=00046 name=+DATA2/ptas10g/datafile/undotbs1.535.792620149
                            input datafile file number=00051 name=+DATA2/ptas10g/datafile/orabpel.549.794304451
                            input datafile file number=00047 name=+DATA2/ptas10g/datafile/undotbs1.536.792621443
                            input datafile file number=00001 name=+DATA2/ptas10g/datafile/system.267.767436571
                            channel backup_disk2: starting piece 1 at 01-MAR-13
                            channel backup_disk3: starting compressed incremental level 1 datafile backup set
                            channel backup_disk3: specifying datafile(s) in backup set
                            input datafile file number=00010 name=+DATA2/ptas10g/datafile/orabpel.283.767441407
                            input datafile file number=00004 name=+DATA2/ptas10g/datafile/users.270.767436573
                            input datafile file number=00009 name=+DATA2/ptas10g/datafile/undotbs6.276.767436843
                            input datafile file number=00022 name=+DATA2/ptas10g/datafile/users.413.784034027
                            input datafile file number=00028 name=+DATA2/ptas10g/datafile/oraesb.426.784986761
                            input datafile file number=00032 name=+DATA2/ptas10g/datafile/users.445.785650847
                            input datafile file number=00036 name=+DATA2/ptas10g/datafile/oraesb.456.785874461
                            input datafile file number=00040 name=+DATA2/ptas10g/datafile/orabpel.460.785874909
                            input datafile file number=00044 name=+DATA2/ptas10g/datafile/users.464.785875905
                            input datafile file number=00049 name=+DATA2/ptas10g/datafile/orabpel.543.793448671
                            input datafile file number=00053 name=+DATA2/ptas10g/datafile/orabpel.551.794304711
                            input datafile file number=00012 name=+DATA2/ptas10g/datafile/jms.285.767441471
                            input datafile file number=00015 name=+DATA2/ptas10g/datafile/oraesb_s.399.768049437
                            input datafile file number=00017 name=+DATA2/ptas10g/datafile/snpm_tbl.375.769344495
                            channel backup_disk3: starting piece 1 at 01-MAR-13
                            channel backup_disk4: starting compressed incremental level 1 datafile backup set
                            channel backup_disk4: specifying datafile(s) in backup set
                            input datafile file number=00023 name=+DATA2/ptas10g/datafile/orabpel.414.784228445
                            input datafile file number=00006 name=+DATA2/ptas10g/datafile/undotbs3.273.767436841
                            input datafile file number=00008 name=+DATA2/ptas10g/datafile/undotbs5.275.767436843
                            input datafile file number=00021 name=+DATA2/ptas10g/datafile/users.411.784011029
                            input datafile file number=00026 name=+DATA2/ptas10g/datafile/users.418.784231147
                            input datafile file number=00031 name=+DATA2/ptas10g/datafile/orabpel.429.785151433
                            input datafile file number=00035 name=+DATA2/ptas10g/datafile/users.448.785651623
                            input datafile file number=00039 name=+DATA2/ptas10g/datafile/orabpel.459.785874783
                            input datafile file number=00043 name=+DATA2/ptas10g/datafile/users.463.785875775
                            input datafile file number=00048 name=+DATA2/ptas10g/datafile/orabpel.542.793448469
                            input datafile file number=00052 name=+DATA2/ptas10g/datafile/orabpel.550.794304573
                            input datafile file number=00002 name=+DATA2/ptas10g/datafile/sysaux.268.767436573
                            input datafile file number=00014 name=+DATA2/ptas10g/datafile/orawsm.398.768049367
                            input datafile file number=00018 name=+DATA2/ptas10g/datafile/snpw_tbl.373.769344521
                            channel backup_disk4: starting piece 1 at 01-MAR-13
                            channel backup_disk2: finished piece 1 at 01-MAR-13
                            piece handle=/RMANADHOC/PTAS10G/Databasefiles_PTAS10G_10o3f8iv_4128_20130301 tag=DAILY_PTAS10G_DBBACKUP comment=NONE
                            channel backup_disk2: backup set complete, elapsed time: 01:15:37
                            channel backup_disk2: starting compressed incremental level 1 datafile backup set
                            channel backup_disk2: specifying datafile(s) in backup set
                            RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013 22:16:07
                            ORA-00245: control file backup operation failed
                            continuing other job steps, job failed will not be re-run
                            channel backup_disk2: starting compressed incremental level 1 datafile backup set
                            channel backup_disk2: specifying datafile(s) in backup set
                            including current SPFILE in backup set
                            channel backup_disk2: starting piece 1 at 01-MAR-13
                            channel backup_disk2: finished piece 1 at 01-MAR-13
                            piece handle=/RMANADHOC/PTAS10G/Databasefiles_PTAS10G_14o3fd17_4132_20130301 tag=DAILY_PTAS10G_DBBACKUP comment=NONE
                            channel backup_disk2: backup set complete, elapsed time: 00:00:01
                            channel backup_disk4: finished piece 1 at 01-MAR-13
                            piece handle=/RMANADHOC/PTAS10G/Databasefiles_PTAS10G_12o3f8j0_4130_20130301 tag=DAILY_PTAS10G_DBBACKUP comment=NONE
                            channel backup_disk4: backup set complete, elapsed time: 01:19:36
                            channel backup_disk1: finished piece 1 at 01-MAR-13
                            piece handle=/RMANADHOC/PTAS10G/Databasefiles_PTAS10G_0vo3f8it_4127_20130301 tag=DAILY_PTAS10G_DBBACKUP comment=NONE
                            channel backup_disk1: backup set complete, elapsed time: 01:21:19
                            channel backup_disk3: finished piece 1 at 01-MAR-13
                            piece handle=/RMANADHOC/PTAS10G/Databasefiles_PTAS10G_11o3f8iv_4129_20130301 tag=DAILY_PTAS10G_DBBACKUP comment=NONE
                            channel backup_disk3: backup set complete, elapsed time: 01:21:28
                            released channel: backup_disk1
                            released channel: backup_disk2
                            released channel: backup_disk3
                            released channel: backup_disk4
                            RMAN-00571: ===========================================================
                            RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
                            RMAN-00571: ===========================================================

                            RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013 22:16:07
                            ORA-00245: control file backup operation failed

                            RMAN>

                            Recovery Manager complete.
                            • 13. Re: RMAN-03009: failure of backup command on backup_disk2 channel at 03/01/2013
                              TSharma-Oracle
                              Take the controlfile backup on the shared location instead of local disk.

                              CONFIGURE SNAPSHOT CONTROLFILE NAME TO '+<DiskGroup>/snapcf_<DBNAME>.f';

                              or it could be the big too in 11.2

                              RMAN BACKUP TO LOCAL DEVICE WITH SNAPSHOT ON SHARED FAILS ORA-00245 [ID 1516654.1]
                              1 2 Previous Next