11 Replies Latest reply: Aug 8, 2014 8:36 AM by Maran Viswarayar RSS

    Migrate the Database from Storage A to Storage B

    Maran Viswarayar

      Hi,

       

      Existing details:

      Oracle ZFS on RAID 1

      Oracle 11.2.0.3

      Oracle GRID 11.2.0.3

       

      EMC VNX 5400 : RAID 10 ( with FAST Cache 2 TB)

       

      We are planning to migrate the database from one storage to another storage. Diskgroups are currently in EXTERNAL redundancy mode and voting disk is in Normal Redundancy. We are moving from RAID1 to RAID 10 in the new storage as a part of refreshing the Hardware.

       

      A similiar luns will be carved out of new storage and presented to same host. Plan is to create new diskgroups and then copy the datafile(backup as copy ) to new diskgroup and do a switch to update control files(438580.1)

       

      I have over 200 data files.

       

      My challenges

      1. I have 4 data diskgroup each 1 TB and almost full occupied

      2. Voting disk in Normaly redundancy mode.

       

      Should i create one Diskgroup of 4TB or matching the current DG Size

      How much is performance impact if we have 1 bigger diskgroup, Never experienced before- Need advise.

       

      If i create multiple DG like i have now , i have move atleast at tablespace level to separate diskgroups, if  not at datafile level.

      If its a single diskgroup, it makes life easier by just backup the whole database to the new DG.

       

      Shutdown is planned. I have a window and it will be a RMAN backup to new DG( No other options )

       

      Your suggestions would be much appreciated

       

      Regards

      Maran.

        • 1. Re: Migrate the Database from Storage A to Storage B
          Aritra-Oracle

          Hi Maran,

           

          With all disks of same size and same sized allocation unit ,there should not be much impact of ASM performance.

          Also rather keeping different diskgroup ,I would suggest to keep one diskgroup for data and another one for FRA.

          With multiplexed control file and redo log files on these diskgroups.

           

          Regards,
          Aritra    

          • 2. Re: Migrate the Database from Storage A to Storage B
            Natik Ameen

            Hi Maran,

             

            The size of DG does not have an impact on the performance as long as the luns carved out are across all disks available on the array. From the operational support  perspective it is much easier to manage the usage of one diskgroup with all datafiles in the DG. The FRA should have it's own diskgroup to keep the recovery related files in a seperate area.

             

            Thanks.

             

            - Natik Ameen

            • 3. Re: Migrate the Database from Storage A to Storage B
              Mihael

              You have an option to migrate online within the same disk group just by adding/removing disks.

              • 4. Re: Migrate the Database from Storage A to Storage B
                Maran Viswarayar

                Thanks All.

                 

                We are doing an external redundancy and i am hearing from Storage vendor , Its better to restrict the LUN to less than 2TB to OS Queue depth size.

                • 5. Re: Migrate the Database from Storage A to Storage B
                  Mihael

                  ASM disk cannot be more than 2Tb.

                  • 6. Re: Migrate the Database from Storage A to Storage B
                    Aritra-Oracle

                    Hi Maran,

                     

                    ASM do validation while adding the disk ,if disk size is more than 2Tb ,it will fail with ORA-15099  error.

                     

                    Regards,

                    Aritra

                    • 7. Re: Migrate the Database from Storage A to Storage B
                      Billy~Verreynne

                      Voting/OCR diskgroup is typically a normal redundancy dg (2 x failgroups) plus quorum - which means a minimum of 3 disks.

                       

                      I move storage (and have done numerous times) between storage servers and SANs by using the following basic ASM command:

                      alter diskgroup <DG_NAME> add failgroup <FG_NAME> disk '<NEW_DISK>' drop disk <DISK_NAME> rebalance power <SETTING>

                       

                      So basically (for normal or high redundancy) add the new disk(s) to the failgroup, and drop the existing disk(s) from the failgroup, and rebalance. For external redundancy omit the failgroup and simply add the new disk(s) and drop the old disk(s).

                       

                      It works. Works well. And works without requiring a single second downtime from any of the db instances using ASM/that diskgroup.

                      • 8. Re: Migrate the Database from Storage A to Storage B
                        Maran Viswarayar

                        Hi Billy

                         

                        Really thanks for your inputs- i will try on uat tomorrow and will let you know

                         

                        Below is my approach. please have your inputs as well.

                        We have created new DG(normal) for voting disk/ocr

                        OCR:

                        $GRID_HOME/bin/ocrconfig -add +ASM_VOCR

                        $GRID_HOME/bin/ocrcheck

                        $GRID_HOME/bin/ocrconfig -delete +ASM_OCRVOTE

                        VOTING

                        $GRID_HOME/bin/crsctl replace votedisk  +ASM_VOCR

                         

                        I have a RAC one DB.

                         

                        I have 7 diskgroups - very uneven sized luns - 200GB,250GB,500GB and 1TB Luns. Since i have a downtime to carry out the activity i am doing the migration in the following manner

                         

                        1. Create 1 TB luns new diskgroups from the new storage

                        2. Mount the DB

                        3. Backup datafile as copy format  "NEWDG"

                        4. Switch

                        5. Restore

                        plus thecontrolfile/ logfile/temfile/archive and so on

                         

                         

                        Best Regards

                        Maran.

                        • 9. Re: Migrate the Database from Storage A to Storage B
                          Levi Pereira

                          I have performed this task hundreds times.


                          Why not map new luns, reabalance and remove old luns?


                          if you can map the new and old luns on same host. You can perform this work without downtime.

                           

                          1) Map New Luns

                          2) Configure Permission of New Luns

                          3) Add New Lun a existing Diskgroup

                          4) After rebalance process finished, remove old Luns from ASM

                          5) Remove Luns from host.

                           

                          You can do it in one step:

                          alter diskgroup <dg_name> add disk <path..> ## new luns drop disk <asmdisk_name...> ## old asmdisk rebalance power 9 wait;

                          Or:

                          1 Set rebalance power of 0 for diskgroup

                          2 Add New Luns

                          3 Drop Old Luns

                          4 Set rebalance power to 9 for diskgroup with "wait" option

                          5 Wait rebalance process finish, so you can remove the old Luns


                          No Change necessary on database.

                           

                          The only necessary step on cluster is move voting disk and must be done online with all nodes active.

                           

                          1) Diskgroup +VOTE: 3 Luns (old)

                           

                          2) Move Votedisk from +VOTE to Diskgroup +DATA

                           

                          3) Change diskgroup  +VOTE Adding New Luns on Diskgroup and Removingl Old Luns

                           

                          4) Move Voting Disk from +DATA to +VOTE

                           

                          Easy task with no downtime and no reconfiguration except add/remove asmdisk and move votedisk.


                          • 10. Re: Migrate the Database from Storage A to Storage B
                            Billy~Verreynne

                            I moved OCR and voting files last week (on an ASM diskgroup) from one storage chassis to another. And want to echo Levi's and my previous comments - it is easy using the ASM alter diskgroup command.

                             

                            3 basic steps - move the 2 normal redundancy disk groups disks, move the quorum disk. E.g.

                            - alter diskgroup add failgroup <mirror1> disk .. drop .. rebalance ..

                            - alter diskgroup add failgroup <mirror2> disk .. drop .. rebalance ..

                            - alter diskgroup add quorum disk .. drop .. rebalance ..

                            • 11. Re: Migrate the Database from Storage A to Storage B
                              Maran Viswarayar

                              Excellent thanks Billy/Levi

                               

                              Much Appreciated.