Forum Stats

  • 3,724,451 Users
  • 2,244,761 Discussions
  • 7,851,017 Comments

Discussions

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Patching Exadata - Problem with cells: 'ASMDeactivationOutcome' output

DBA84
DBA84 Member Posts: 68 Red Ribbon
edited April 2020 in Exadata

Hi guys,

Yesterday I have tried to apply latest patch for Exadata. First of all I will explain you the all information about structure.

Exadata: X8-2 Eighth Rack HC 14TB with 2 compute nodes and 3 cells

OS:Oracle Linux 7.7

DB:Oracle Database 19.0.0.0.0 (patched to latest 19.7.0.0.200414)

Target: Upgrade from 19.3.3.0.0.191211.1 to 19.3.6.0.0.200317.

I patched compute nodes hardware and software (grid and db) successfully.

I also patched cells. Patching done in NON-ROLLING MANNER. Patching output seems successfull and cluster starts successfully. Patching output:

   NOTE Cells will reboot during the patch or rollback process.

    NOTE For non-rolling patch or rollback, ensure all ASM instances using

    NOTE the cells are shut down for the duration of the patch or rollback.

    NOTE For rolling patch or rollback, ensure all ASM instances using

    NOTE the cells are up for the duration of the patch or rollback.

    WARNING Do not interrupt the patchmgr session.

    WARNING Do not alter state of ASM instances during patch or rollback.

    WARNING Do not resize the screen. It may disturb the screen layout.

    WARNING Do not reboot cells or alter cell services during patch or rollback.

    WARNING Do not open log files in editor in write mode or try to alter them.

    NOTE All time estimates are approximate.

    ********************************************************************************

    2020-04-17 18:06:09 +0400        :Working: Check cells have ssh equivalence for root user. Up to 10 seconds per cell ...

    2020-04-17 18:06:10 +0400        :SUCCESS: Check cells have ssh equivalence for root user.

    2020-04-17 18:06:13 +0400        :Working: Initialize files. Up to 1 minute ...

    2020-04-17 18:06:14 +0400        :Working: Setup work directory

    2020-04-17 18:06:23 +0400        :SUCCESS: Setup work directory

    2020-04-17 18:06:26 +0400        :SUCCESS: Initialize files.

    2020-04-17 18:06:26 +0400        :Working: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction. Up to 40 minutes ...

    2020-04-17 18:06:40 +0400        :INFO   : Wait correction of degraded md11 due to md partner size mismatch. Up to 30 minutes.

    2020-04-17 18:06:41 +0400        :SUCCESS: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction.

    2020-04-17 18:06:41 +0400        :Working: Check space and state of cell services. Up to 20 minutes ...

    2020-04-17 18:07:30 +0400        :SUCCESS: Check space and state of cell services.

    2020-04-17 18:07:30 +0400        :Working: Check prerequisites on all cells. Up to 2 minutes ...

    2020-04-17 18:07:32 +0400        :SUCCESS: Check prerequisites on all cells.

    2020-04-17 18:07:32 +0400        :Working: Copy the patch to all cells. Up to 3 minutes ...

    2020-04-17 18:08:12 +0400        :SUCCESS: Copy the patch to all cells.

    2020-04-17 18:08:14 +0400        :Working: Execute plugin check for Patch Check Prereq ...

    2020-04-17 18:08:14 +0400        :INFO   : Patchmgr plugin start: Prereq check for exposure to bug 22909764 v1.0.

    2020-04-17 18:08:14 +0400        :INFO   : Details in logfile /u01/installnew/p31027642/patch_19.3.6.0.0.200317/patchmgr.stdout.

    2020-04-17 18:08:14 +0400        :INFO   : Patchmgr plugin start: Prereq check for exposure to bug 17854520 v1.3.

    2020-04-17 18:08:14 +0400        :INFO   : Details in logfile /u01/installnew/p31027642/patch_19.3.6.0.0.200317/patchmgr.stdout.

    2020-04-17 18:08:14 +0400        :SUCCESS: No exposure to bug 17854520 with non-rolling patching

    2020-04-17 18:08:14 +0400        :INFO   : Patchmgr plugin start: Prereq check for exposure to bug 22468216 v1.0.

    2020-04-17 18:08:14 +0400        :INFO   : Details in logfile /u01/installnew/p31027642/patch_19.3.6.0.0.200317/patchmgr.stdout.

    2020-04-17 18:08:14 +0400        :SUCCESS: Patchmgr plugin complete: Prereq check passed for the bug 22468216

    2020-04-17 18:08:14 +0400        :INFO   : Patchmgr plugin start: Prereq check for exposure to bug 24625612 v1.0.

    2020-04-17 18:08:14 +0400        :INFO   : Details in logfile /u01/installnew/p31027642/patch_19.3.6.0.0.200317/patchmgr.stdout.

    2020-04-17 18:08:15 +0400        :SUCCESS: Patchmgr plugin complete: Prereq check passed for the bug 24625612

    2020-04-17 18:08:15 +0400        :SUCCESS: No exposure to bug 22896791 with non-rolling patching

    2020-04-17 18:08:15 +0400        :INFO   : Patchmgr plugin start: Prereq check for exposure to bug 22651315 v1.0.

    2020-04-17 18:08:15 +0400        :INFO   : Details in logfile /u01/installnew/p31027642/patch_19.3.6.0.0.200317/patchmgr.stdout.

    2020-04-17 18:08:19 +0400        :SUCCESS: Patchmgr plugin complete: Prereq check passed for the bug 22651315

    2020-04-17 18:08:20 +0400        :SUCCESS: Execute plugin check for Patch Check Prereq.

    2020-04-17 18:08:20 +0400        :Working: check if MS SOFTWAREUPDATE is scheduled. up to 5 minutes...

    2020-04-17 18:08:20 +0400        :NO ACTION NEEDED: No cells found with SOFTWAREUPDATE scheduled by MS

    2020-04-17 18:08:21 +0400        :SUCCESS: check if MS SOFTWAREUPDATE is scheduled

    2020-04-17 18:08:24 +0400 1 of 5 :Working: Initiate patch on cells. Cells will remain up. Up to 5 minutes ...

    2020-04-17 18:08:28 +0400 1 of 5 :SUCCESS: Initiate patch on cells.

    2020-04-17 18:08:28 +0400 2 of 5 :Working: Waiting to finish pre-reboot patch actions. Cells will remain up. Up to 45 minutes ...

    2020-04-17 18:09:28 +0400        :INFO   : Wait for patch pre-reboot procedures

    2020-04-17 18:10:17 +0400 2 of 5 :SUCCESS: Waiting to finish pre-reboot patch actions.

    2020-04-17 18:10:17 +0400        :Working: Execute plugin check for Patching ...

    2020-04-17 18:10:17 +0400        :SUCCESS: Execute plugin check for Patching.

    2020-04-17 18:10:17 +0400 3 of 5 :Working: Finalize patch on cells. Cells will reboot. Up to 5 minutes ...

    2020-04-17 18:10:26 +0400 3 of 5 :SUCCESS: Finalize patch on cells.

    2020-04-17 18:10:42 +0400 4 of 5 :Working: Wait for cells to reboot and come online. Up to 120 minutes ...

    2020-04-17 18:11:42 +0400        :INFO   : Wait for patch finalization and reboot

    2020-04-17 18:36:01 +0400 4 of 5 :SUCCESS: Wait for cells to reboot and come online.

    2020-04-17 18:36:01 +0400 5 of 5 :Working: Check the state of patch on cells. Up to 5 minutes ...

    2020-04-17 18:36:09 +0400 5 of 5 :SUCCESS: Check the state of patch on cells.

    2020-04-17 18:36:09 +0400        :Working: Execute plugin check for Pre Disk Activation ...

    2020-04-17 18:36:10 +0400        :SUCCESS: Execute plugin check for Pre Disk Activation.

    2020-04-17 18:36:10 +0400        :Working: Activate grid disks...

    2020-04-17 18:36:11 +0400        :INFO   : Wait for checking and activating grid disks

    2020-04-17 18:36:18 +0400        :SUCCESS: Activate grid disks.

    2020-04-17 18:36:20 +0400        :Working: Execute plugin check for Post Patch ...

    2020-04-17 18:36:21 +0400        :SUCCESS: Execute plugin check for Post Patch.

    2020-04-17 18:36:21 +0400        :Working: Cleanup

    2020-04-17 18:36:34 +0400        :SUCCESS: Cleanup

    2020-04-17 18:36:35 +0400        :SUCCESS: Completed run of command: ./patchmgr -cells /root/cell_group -patch

    2020-04-17 18:36:35 +0400        :INFO   : patch attempted on nodes in file /root/cell_group: [dm1cel1 dm1cel2 dm1cel3]

    2020-04-17 18:36:35 +0400        :INFO   : Current image version on cell(s) is:

    2020-04-17 18:36:35 +0400        :INFO   : dm1cel1: 19.3.6.0.0.200317

    2020-04-17 18:36:35 +0400        :INFO   : dm1cel2: 19.3.6.0.0.200317

    2020-04-17 18:36:35 +0400        :INFO   : dm1cel3: 19.3.6.0.0.200317

    2020-04-17 18:36:35 +0400        :INFO   : For details, check the following files in /u01/installnew/p31027642/patch_19.3.6.0.0.200317:

    2020-04-17 18:36:35 +0400        :INFO   :  - <cell_name>.log

    2020-04-17 18:36:35 +0400        :INFO   :  - patchmgr.stdout

    2020-04-17 18:36:35 +0400        :INFO   :  - patchmgr.stderr

    2020-04-17 18:36:35 +0400        :INFO   :  - patchmgr.log

    2020-04-17 18:36:35 +0400        :INFO   :  - patchmgr.trc

    2020-04-17 18:36:35 +0400        :INFO   : Exit status:0

    2020-04-17 18:36:35 +0400        :INFO   : Exiting.

   

But when I check the griddisk status in each cell there is problem as seen in output:

    CellCLI> list griddisk attributes name, ASMDeactivationOutcome,  ASMModeStatus, disktype

     DATAC1_CD_00_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     DATAC1_CD_01_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     DATAC1_CD_02_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     DATAC1_CD_03_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     DATAC1_CD_04_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     DATAC1_CD_05_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     RECOC1_CD_00_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     RECOC1_CD_01_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     RECOC1_CD_02_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     RECOC1_CD_03_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     RECOC1_CD_04_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

     RECOC1_CD_05_dm1cel1     "Cannot deactivate because ASM is in rolling upgrade mode"     ONLINE     HardDisk

The problem is with ASMDeactivationOutcome ouptut "Cannot deactivate because ASM is in rolling upgrade mode". How can I solve this problem?

P.S. Although successful ROLLBACK of cells, the problem is same.

PLEASE GIVE ME YOUR RECOMMENDATIONS TO SOLVE THE PROBLEM.

THANKS

Best Answer

Answers

Sign In or Register to comment.