The +ASM1 instance and listener on RAC1 was not started when I checked. So i started them manually.
[oracle@rac1 bin]$ ./crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE OFFLINE rac1 ora....C1.lsnr application ONLINE OFFLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip application ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip application ONLINE ONLINE rac2
I was unable to dismount and remount the disk. It was giving an error saying
WARNING: cache failed to read fn=3 indblk=0 from disk(s): 2 ORA-15196: invalid ASM block header [kfc.c:7910] [endian_kfbh]   [0 != 1] NOTE: a corrupted block was dumped to the trace file System State dumped to trace file /u01/app/oracle/admin/+ASM/bdump/+asm1_lgwr_12518.trc NOTE: cache initiating offline of disk 2 group 1 WARNING: offlining disk 2.3912953495 (DATA_0002) with mask 0x3 NOTE: PST update: grp = 1, dsk = 2, mode = 0x6 Wed Sep 12 22:43:44 2012 ERROR: too many offline disks in PST (grp 1) Wed Sep 12 22:43:44 2012 NOTE: PST not enabling heartbeating (grp 1): group dismounted
First of all can anyone tell me what "ora....SM1.asm" and "ora....C1.lsnr" are? Why was the TARGET column showing as online?
ORA-15130: diskgroup "DISK" is being dismounted
I checked oracle support doc ID 1054033.1 and tried checking the permissions. But I don't see the file asmadmin present in $ORACLE_HOME/bin
Errors in file /u01/app/oracle/admin/+ASM/bdump/+asm1_rbal_9071.trc: ORA-15183: ASMLIB initialization error [/opt/oracle/extapi/32/asm/orcl/1/libasm.so] ORA-15183: ASMLIB initialization error [driver/agent not installed]
Solution 1. Manually change the oracle binary ownership and permission: as root user: # cd $ORACLE_HOME/bin # chgrp asmadmin oracle # chmod 6751 oracle # ls -l oracle
did I miss anything?
While setting up RAC using a version of Oracle currently in desupport in a virtual environment never certified or supported by Oracle with an operating system never certified or supported by Oracle, you ran into a few issues.