Forum Stats

  • 3,828,179 Users
  • 2,260,870 Discussions
  • 7,897,506 Comments

Discussions

Too many Rman Backup files generated while performing full database backup

user7993571
user7993571 Member Posts: 40 Blue Ribbon
edited Apr 8, 2020 11:17AM in Recovery Manager (RMAN)

Hi

While performing rman full database backup with compression the backup generates small set of many files

even though the following configurations are used

Rman Configuration

CONFIGURE DEVICE TYPE DISK PARALLELISM 2 BACKUP TYPE TO BACKUPSET;

CONFIGURE CHANNEL DEVICE TYPE DISK MAXPIECESIZE 32 G;

CONFIGURE CHANNEL 1 DEVICE TYPE DISK MAXPIECESIZE 32 G;

CONFIGURE CHANNEL 2 DEVICE TYPE DISK MAXPIECESIZE 32 G;

CONFIGURE MAXSETSIZE TO UNLIMITED; # default

Backup command

run {

backup as compressed backupset incremental level 0 tag DB_FULL_$TDAY format '$backup_dir/DB_INCFULL_%U_$TDAY.Bkp' database;

sql 'alter system archive log current';

backup as compressed backupset archivelog all tag = ARCH_FULL_$TDAY format '$backup_dir/ARCH_%U_$TDAY.Bkp' delete all input;

backup current controlfile tag = CTL_FULL_$TDAY format '$backup_dir/CTL_%d_DBID%I_%U_$TDAY.Bkp';

CROSSCHECK BACKUP;

DELETE FORCE NOPROMPT OBSOLETE DEVICE TYPE DISK;

DELETE NOPROMPT EXPIRED BACKUP;

delete noprompt archivelog until time 'sysdate-1/24';

}

Backup Files

DB_INCFULL_gqusgohh_1_1_31032020.Bkp,DB_INCFULL_gsusgot4_1_1_31032020.Bkp ... like 132 files

Could any one help to find the root cause for it

We require to keep backup piece in a large file up ,say 32GB in size that is easy manage the files.

Thanks

yoonas
«13

Answers

  • Marco Mischke
    Marco Mischke Member Posts: 97 Bronze Badge
    edited Apr 2, 2020 12:55AM

    Hi,

    could you please post the log of such a RMAN backup and a directory listing? Either your database is quite large or your database creates a lot of archivelog or maybe both.

    Cheers,

    Marco

    yoonas
  • Hemant K Chitale
    Hemant K Chitale Member Posts: 15,759 Blue Diamond
    edited Apr 2, 2020 2:02AM

    Is the file name format DB_FULL.... or  DB_iNCFULL ?  

    Do you have a different script and settings for DB_INCFULL ?   Do you have FILESPERSET specified in that script ?

    How many datafiles does the database have.

    What is the total size of all the datafiles ?

    Hemant K Chitale

  • Dude!
    Dude! Member Posts: 22,829 Black Diamond
    edited Apr 2, 2020 3:44AM

    MAXPIECESIZE and MAXSETSIZE do not specify the minimum size. Please provide an RMAN SHOW ALL command output.

    As far as your script concerns, I suggest to remove "delete noprompt archivelog", which puts your database recovery at risk if there is any trouble.

  • user7993571
    user7993571 Member Posts: 40 Blue Ribbon
    edited Apr 2, 2020 10:27AM

    Hi

    The DB_FULL is a typo DB_INCFULL is the right one FILESPERSET is not specified

    datafiles - 168

    db size 1.4 TB

  • user7993571
    user7993571 Member Posts: 40 Blue Ribbon
    edited Apr 2, 2020 10:29AM

    Hi

    here is the output for show all

    RMAN> show all;

    using target database control file instead of recovery catalog

    RMAN configuration parameters for database with db_unique_name ESATG are:

    CONFIGURE RETENTION POLICY TO RECOVERY WINDOW OF 7 DAYS;

    CONFIGURE BACKUP OPTIMIZATION OFF; # default

    CONFIGURE DEFAULT DEVICE TYPE TO DISK; # default

    CONFIGURE CONTROLFILE AUTOBACKUP ON;

    CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK TO '/oracle/backup/rman/rman_prod/arch_bkp//2020-Apr-02-13-31/AUTO_CTL_%F';

    CONFIGURE DEVICE TYPE DISK PARALLELISM 2 BACKUP TYPE TO BACKUPSET;

    CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default

    CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default

    CONFIGURE CHANNEL DEVICE TYPE DISK MAXPIECESIZE 32 G;

    CONFIGURE CHANNEL 1 DEVICE TYPE DISK MAXPIECESIZE 32 G;

    CONFIGURE CHANNEL 2 DEVICE TYPE DISK MAXPIECESIZE 32 G;

    CONFIGURE MAXSETSIZE TO UNLIMITED; # default

    CONFIGURE ENCRYPTION FOR DATABASE OFF; # default

    CONFIGURE ENCRYPTION ALGORITHM 'AES128'; # default

    CONFIGURE COMPRESSION ALGORITHM 'BASIC' AS OF RELEASE 'DEFAULT' OPTIMIZE FOR LOAD TRUE ; # default

    CONFIGURE ARCHIVELOG DELETION POLICY TO NONE; # default

  • Mustafa_KALAYCI
    Mustafa_KALAYCI Member Posts: 3,383 Bronze Crown
    edited Apr 6, 2020 7:04AM

    instead of deleting archivelogs manually (as @Dude! said) configure "archivelog deletion policy". Please list directory here. maybe you are looking many files which does not belong to you backup. for example, you are using FORMAT clause to specify path as "$backup_dir/" there might be other databases putting their backup into this location maybe?

  • Dude!
    Dude! Member Posts: 22,829 Black Diamond
    edited Apr 6, 2020 6:41AM
    Mustafa KALAYCI wrote:instead of deleting archivelogs manually (as Dude! said) configure "archivelog deletion policy". Please list directory here. maybe you are looking many files which does not belong to you backup. for example, you are using FORMAT clause to specify path as "$backup_dir/" there might be other databases putting their backup into this location maybe?

    Where did I mention to delete archivelogs?

    Quite the opposite:

    As far as your script concerns, I suggest to remove "delete noprompt archivelog", which puts your database recovery at risk if there is any trouble.

  • user7993571
    user7993571 Member Posts: 40 Blue Ribbon
    edited Apr 6, 2020 7:18AM

    Hi

    We will change the archive deletion clause

    here are the directory structure and files

    /oracle/backup/rman/rman_prod/rman_bkp/2020-Apr-05-23-00

    ls

    ARCH_causuc8v_1_1_05042020.Bkp                     DB_INCFULL_9iustvro_1_1_05042020.Bkp  DB_INCFULL_auusu796_1_1_05042020.Bkp

    ARCH_cbusuc90_1_1_05042020.Bkp                     DB_INCFULL_9jusu05a_1_1_05042020.Bkp  DB_INCFULL_avusu7c5_1_1_05042020.Bkp

    AUTO_CTL_c-210436801-20200406-00                   DB_INCFULL_9kusu06n_1_1_05042020.Bkp  DB_INCFULL_b0usu7m0_1_1_05042020.Bkp

    AUTO_CTL_c-210436801-20200406-01                   DB_INCFULL_9lusu0g8_1_1_05042020.Bkp  DB_INCFULL_b1usu7mp_1_1_05042020.Bkp

    DB_INCFULL_9musu0hv_1_1_05042020.Bkp  DB_INCFULL_b2usu826_1_1_05042020.Bkp

    DB_INCFULL_8bustp81_1_1_05042020.Bkp               DB_INCFULL_9nusu0qs_1_1_05042020.Bkp  DB_INCFULL_b3usu839_1_1_05042020.Bkp

    DB_INCFULL_8custp81_1_1_05042020.Bkp               DB_INCFULL_9ousu0t7_1_1_05042020.Bkp  DB_INCFULL_b4usu8bs_1_1_05042020.Bkp

    DB_INCFULL_8dustpbl_1_1_05042020.Bkp               DB_INCFULL_9pusu15q_1_1_05042020.Bkp  DB_INCFULL_b5usu8cl_1_1_05042020.Bkp

    DB_INCFULL_8eustpk8_1_1_05042020.Bkp               DB_INCFULL_9qusu185_1_1_05042020.Bkp  DB_INCFULL_b6usu8l8_1_1_05042020.Bkp

    DB_INCFULL_8fustpmt_1_1_05042020.Bkp               DB_INCFULL_9rusu1e8_1_1_05042020.Bkp  DB_INCFULL_b7usu8na_1_1_05042020.Bkp

    DB_INCFULL_8gustptb_1_1_05042020.Bkp               DB_INCFULL_9susu1gk_1_1_05042020.Bkp  DB_INCFULL_b8usu8tn_1_1_05042020.Bkp

    DB_INCFULL_8hustq4c_1_1_05042020.Bkp               DB_INCFULL_9tusu1mn_1_1_05042020.Bkp  DB_INCFULL_b9usu8ve_1_1_05042020.Bkp

    DB_INCFULL_8iustqap_1_1_05042020.Bkp               DB_INCFULL_9uusu1qa_1_1_05042020.Bkp  DB_INCFULL_bausu981_1_1_05042020.Bkp

    DB_INCFULL_8justqhq_1_1_05042020.Bkp               DB_INCFULL_9vusu21l_1_1_05042020.Bkp  DB_INCFULL_bbusu99o_1_1_05042020.Bkp

    DB_INCFULL_8kustqnt_1_1_05042020.Bkp               DB_INCFULL_a0usu232_1_1_05042020.Bkp  DB_INCFULL_bcusu9i1_1_1_05042020.Bkp

    DB_INCFULL_8lustqqs_1_1_05042020.Bkp               DB_INCFULL_a1usu2bb_1_1_05042020.Bkp  DB_INCFULL_bdusu9jo_1_1_05042020.Bkp

    DB_INCFULL_8mustr51_1_1_05042020.Bkp               DB_INCFULL_a2usu2d2_1_1_05042020.Bkp  DB_INCFULL_beusu9p7_1_1_05042020.Bkp

    DB_INCFULL_8nustr64_1_1_05042020.Bkp               DB_INCFULL_a3usu2l1_1_1_05042020.Bkp  DB_INCFULL_bfusu9ri_1_1_05042020.Bkp

    DB_INCFULL_8oustree_1_1_05042020.Bkp               DB_INCFULL_a4usu2o0_1_1_05042020.Bkp  DB_INCFULL_bgusu9v6_1_1_05042020.Bkp

    DB_INCFULL_8pustrgf_1_1_05042020.Bkp               DB_INCFULL_a5usu2tf_1_1_05042020.Bkp  DB_INCFULL_bhusua4l_1_1_05042020.Bkp

    DB_INCFULL_8qustrrs_1_1_05042020.Bkp               DB_INCFULL_a6usu33j_1_1_05042020.Bkp  DB_INCFULL_biusua7k_1_1_05042020.Bkp

    DB_INCFULL_8rustrtt_1_1_05042020.Bkp               DB_INCFULL_a7usu3a0_1_1_05042020.Bkp  DB_INCFULL_bjusua83_1_1_05042020.Bkp

    DB_INCFULL_8susts6q_1_1_05042020.Bkp               DB_INCFULL_a8usu3fp_1_1_05042020.Bkp  DB_INCFULL_bkusuaa4_1_1_05042020.Bkp

    DB_INCFULL_8tusts9f_1_1_05042020.Bkp               DB_INCFULL_a9usu3j2_1_1_05042020.Bkp  DB_INCFULL_blusuadd_1_1_05042020.Bkp

    DB_INCFULL_8uustsfs_1_1_05042020.Bkp               DB_INCFULL_aausu3rb_1_1_05042020.Bkp  DB_INCFULL_bmusuafo_1_1_05042020.Bkp

    DB_INCFULL_8vustsmj_1_1_05042020.Bkp               DB_INCFULL_abusu3ri_1_1_05042020.Bkp  DB_INCFULL_bnusuafr_1_1_05042020.Bkp

    DB_INCFULL_90uststa_1_1_05042020.Bkp               DB_INCFULL_acusu43r_1_1_05042020.Bkp  DB_INCFULL_bousualv_1_1_05042020.Bkp

    DB_INCFULL_91ustt42_1_1_05042020.Bkp               DB_INCFULL_adusu47f_1_1_05042020.Bkp  DB_INCFULL_bpusualv_1_1_05042020.Bkp

    DB_INCFULL_92ustt5p_1_1_05042020.Bkp               DB_INCFULL_aeusu4fo_1_1_05042020.Bkp  DB_INCFULL_bqusuar4_1_1_05042020.Bkp

    DB_INCFULL_93ustth6_1_1_05042020.Bkp               DB_INCFULL_afusu4id_1_1_05042020.Bkp  DB_INCFULL_brusuart_1_1_05042020.Bkp

    DB_INCFULL_94ustti9_1_1_05042020.Bkp               DB_INCFULL_agusu4o6_1_1_05042020.Bkp  DB_INCFULL_bsusub12_1_1_05042020.Bkp

    DB_INCFULL_95usttu0_1_1_05042020.Bkp               DB_INCFULL_ahusu4qr_1_1_05042020.Bkp  DB_INCFULL_btusub3d_1_1_05042020.Bkp

    DB_INCFULL_96usttup_1_1_05042020.Bkp               DB_INCFULL_aiusu53o_1_1_05042020.Bkp  DB_INCFULL_buusub6m_1_1_05042020.Bkp

    DB_INCFULL_97ustu64_1_1_05042020.Bkp               DB_INCFULL_ajusu54h_1_1_05042020.Bkp  DB_INCFULL_bvusubbh_1_1_05042020.Bkp

    DB_INCFULL_98ustu77_1_1_05042020.Bkp               DB_INCFULL_akusu5gs_1_1_05042020.Bkp  DB_INCFULL_c0usubd9_1_1_05042020.Bkp

    DB_INCFULL_99ustuej_1_1_05042020.Bkp               DB_INCFULL_alusu5ia_1_1_05042020.Bkp  DB_INCFULL_c1usubi4_1_1_05042020.Bkp

    DB_INCFULL_9austufm_1_1_05042020.Bkp               DB_INCFULL_amusu5pl_1_1_05042020.Bkp  DB_INCFULL_c2usubjh_1_1_05042020.Bkp

    DB_INCFULL_9bustuq5_1_1_05042020.Bkp               DB_INCFULL_anusu602_1_1_05042020.Bkp  DB_INCFULL_c3usubm6_1_1_05042020.Bkp

    DB_INCFULL_9custur8_1_1_05042020.Bkp               DB_INCFULL_aousu62n_1_1_05042020.Bkp  DB_INCFULL_c4usubnt_1_1_05042020.Bkp

    DB_INCFULL_9dustv4f_1_1_05042020.Bkp               DB_INCFULL_apusu694_1_1_05042020.Bkp  DB_INCFULL_c5usubtc_1_1_05042020.Bkp

    DB_INCFULL_9eustv58_1_1_05042020.Bkp               DB_INCFULL_aqusu6gf_1_1_05042020.Bkp  DB_INCFULL_c6usubtj_1_1_05042020.Bkp

    DB_INCFULL_9fustvfd_1_1_05042020.Bkp               DB_INCFULL_arusu6i6_1_1_05042020.Bkp  DB_INCFULL_c7usuc3c_1_1_05042020.Bkp

    DB_INCFULL_9gustvgg_1_1_05042020.Bkp               DB_INCFULL_asusu6u7_1_1_05042020.Bkp  DB_INCFULL_c8usuc3c_1_1_05042020.Bkp

    DB_INCFULL_9hustvq1_1_1_05042020.Bkp               DB_INCFULL_atusu6vu_1_1_05042020.Bkp  rman_level0_05042020.log

  • Dude!
    Dude! Member Posts: 22,829 Black Diamond
    edited Apr 6, 2020 7:02AM

    Again, why are you setting MAXSETSIZE and MAXPIECESIZE? These are maximum values. Arbitrarily reducing the size and then complaining you see too many files doesn't make sense. I suggest to remove your custom settings and try with the defaults.

  • Mustafa_KALAYCI
    Mustafa_KALAYCI Member Posts: 3,383 Bronze Crown
    edited Apr 6, 2020 7:08AM

    you mentioned about removing "delete archivelog" command, I was referencing that. manual deletion is not a best practice. My first sentence was different and I was writing about removing "delete archivelog" command but instead I suggest using archivelog deletion policy. so "as dude said" part might not suits well. Since OP is backing up his archive logs it is not a great danger but deletion should be managed by controlfile (rman).

    so again, by saying "as dude said" I meant manual archivelog deletion but I will edit my post if it disturbs you.

    edit: also archivelogs longer than 8 days are not necessary and should be deleted on this system since they have a recovery window of 7 days. previous archivelogs will be obsolete but won't be deleted because of archivelog deletion policy is not set as you know.

    sorry for the confusion by the way.