Local Quorum Disks In '/dev/exadata_quorum' Are Missing

AsankaG

Hi, while trying to troubleshoot patch prerequisite failure, we found below quorum disks are missing need help to know why and how to fix this

SQL> select NAME,GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,MODE_STATUS,STATE,FAILGROUP,FAILGROUP_TYPE,VOTING_FILE from v$asm_disk;

NAME                           GROUP_NUMBER DISK_NUMBER MOUNT_STATUS MODE_STATUS  STATE    FAILGROUP                      FAILGROUP_TYP VOTING_FILE
------------------------------ ------------ ----------- ------------ ------------ -------- ------------------------------ ------------- ---------------
QD_DATAC1_PRODDBADM01                     1          18 MISSING      OFFLINE      NORMAL   PRODDBADM01                    QUORUM        N
QD_DATAC1_PRODDBADM02                     1          14 MISSING      OFFLINE      NORMAL   PRODDBADM02                    QUORUM        N
DATAC1_CD_04_PRODCELADM03                 1          17 CACHED       ONLINE       NORMAL   PRODCELADM03                   REGULAR       N

[[email protected] ~]$ kfod asm_diskstring='o/*/*' disks=all

--------------------------------------------------------------------------------

Disk          Size Path                                     User     Group

================================================================================

   1:        128 MB /dev/exadata_quorum/QD_DATAC1_PRODDBADM01 grid     asmadmin

   2:        128 MB /dev/exadata_quorum/QD_DATAC1_PRODDBADM02 grid     asmadmin

   3:    7474176 MB o/192.168.60.5;192.168.60.6/DATAC1_CD_00_prodceladm01

The system specification is as below

Exadata Version - 19.2.3.0.0

OS - Oracle Linux 7 (64)

Kernel - LINUX X86-64 OELRHEL 7 4.1.12-124.26.12.el7uek.x86_64

Grid and Db version - 12.2.0.1.0

AsankaG

Hi All, we had to drop all the missing disks and add them back to fi the issue, and same was Oracle advice!

Regards

AsankaG

Hi All,

We did a reboot for the effected nodes and the output as below

SQL> select NAME,GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,MODE_STATUS,STATE,FAILGROUP,FAILGROUP_TYPE,VOTING_FILE from v$asm_disk;

NAME                                  GROUP_NUMBER  DISK_NUMBER MOUNT_STATUS  MODE_STATUS   STATE     FAILGROUP                      FAILGROUP_TYP VOTING_FILE

------------------------------ ------------ ----------- ------------ ------------ -------- ------------------------------ ------------- ---------------

                         0          0 CLOSED       ONLINE        NORMAL                     REGULAR        Y

                         0          1 CLOSED       ONLINE        NORMAL                     REGULAR        Y

_DROPPED_0018_DATAC1                       1          18 MISSING       OFFLINE        FORCING    PRODDBADM01                    QUORUM        N

_DROPPED_0014_DATAC1                       1          14 MISSING       OFFLINE        FORCING    PRODDBADM02                    QUORUM        N

DATAC1_CD_04_PRODCELADM03               1          17 CACHED        ONLINE         NORMAL    PRODCELADM03                   REGULAR       N

Any help is appreciated

Kind Regards

Asanka

AsankaG

HI All, we tried below

1 we try to add the disk back as

SQL> alter diskgroup DATAC1 add quorum failgroup PRODDBADM01 disk '/dev/exadata_quorum/QD_DATAC1_PRODDBADM01';

failed saying the disks are alerdy there

2. we tried

SQL> alter diskgroup DATAC1 add quorum failgroup PRODDBADM01 disk '/dev/exadata_quorum/QD_DATAC1_PRODDBADM01'; force;

ERROR at line 1:

ORA-15032: not all alterations performed

ORA-15075: disk /dev/exadata_quorum/QD_DATAC1_PRODDBADM01 is not visible on

instance number 4

ORA-15075: disk /dev/exadata_quorum/QD_DATAC1_PRODDBADM01 is not visible on

instance number 3

up on quaruing the V$ASM_DISK, it shows below

SQL> select NAME,GROUP_NUMBER,DISK_NUMBER,MOUNT_STATUS,MODE_STATUS,STATE,FAILGROUP,FAILGROUP_TYPE,VOTING_FILE from v$asm_disk;

NAME                                  GROUP_NUMBER  DISK_NUMBER MOUNT_STATUS  MODE_STATUS   STATE     FAILGROUP                      FAILGROUP_TYP VOTING_FILE

------------------------------ ------------ ----------- ------------ ------------ -------- ------------------------------ ------------- ---------------

                       

DATAC1_CD_04_PRODCELADM03               1          17 CACHED        ONLINE         NORMAL    PRODCELADM03                   REGULAR       N

AsankaG

Hi All, we had to drop all the missing disks and add them back to fi the issue, and same was Oracle advice!

Regards