1 Reply Latest reply: May 9, 2012 4:15 AM by rukbat RSS

    I am getting following errors "errors were retryable:

    935604
      I have out putted the following but have no idea what to do. I am thinking it might be a hba, fiber cable or hhd on storage.

      root@xxxxxzner01p-gz[~]# dmesg

      Monday, May 7, 2012 2:14:38 PM EDT
      May 7 13:14:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:14:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:14:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:14:35 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:14:35 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1587374867 Error Block: 1587374867
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1587374867 Error Block: 1587374867
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f00000a00 (ssd33):
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f00000a00 (ssd33):
      May 7 13:14:35 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:14:35 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1809006156 Error Block: 1809006156
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1809006156 Error Block: 1809006156
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F0A00
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F0A00
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:14:35 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:14:35 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1589392402 Error Block: 1589392402
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1589392402 Error Block: 1589392402
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:14:35 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:17:33 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:17:33 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1580228200 Error Block: 1580228200
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1580228200 Error Block: 1580228200
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:17:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:21:03 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:21:03 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1584839052 Error Block: 1584839052
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1584839052 Error Block: 1584839052
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:21:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000070e (ssd89):
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000070e (ssd89):
      May 7 13:22:33 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:22:33 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 443306111 Error Block: 443306111
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 443306111 Error Block: 443306111
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F070E
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F070E
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:22:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:24:03 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:24:03 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1587910407 Error Block: 1587910407
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1587910407 Error Block: 1587910407
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:24:03 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:29:33 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:29:33 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 837188597 Error Block: 837188597
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 837188597 Error Block: 837188597
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:29:33 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:32:19 xxxxxzner01p-gz scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
      May 7 13:32:19 xxxxxzner01p-gz /scsi_vhci/ssd@g60060e8005632f000000632f00001010 (ssd78): Command failed to complete (3) on path fp0/ssd@w50060e8005632f31,52
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:33:19 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:33:19 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 834850503 Error Block: 834850503
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 834850503 Error Block: 834850503
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:33:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:33:49 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:33:49 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 836551349 Error Block: 836551349
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 836551349 Error Block: 836551349
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:33:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f00000a00 (ssd33):
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f00000a00 (ssd33):
      May 7 13:43:50 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:43:50 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1810038035 Error Block: 1810038035
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1810038035 Error Block: 1810038035
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F0A00
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F0A00
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:43:50 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:48:49 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:48:49 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 836209124 Error Block: 836209124
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 836209124 Error Block: 836209124
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:48:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:49:19 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:49:19 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 830384056 Error Block: 830384056
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 830384056 Error Block: 830384056
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:49:19 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000210f (ssd35):
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000210f (ssd35):
      May 7 13:52:49 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:52:49 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1732780778 Error Block: 1732780778
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 1732780778 Error Block: 1732780778
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F210F
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F210F
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:52:49 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:59:21 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:59:21 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 330926295 Error Block: 330926295
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 330926295 Error Block: 330926295
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:59:21 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8005632f000000632f0000200f (ssd37):
      May 7 13:59:22 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:59:22 xxxxxzner01p-gz Error for Command: write(10) Error Level: Retryable
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 331846913 Error Block: 331846913
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Requested Block: 331846913 Error Block: 331846913
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Vendor: HITACHI Serial Number: 50 0632F200F
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] Sense Key: Aborted Command
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0
      May 7 13:59:22 xxxxxzner01p-gz scsi: [ID 107833 kern.notice] ASC: 0xc0 (<vendor unique code 0xc0>), ASCQ: 0x0, FRU: 0x0


      root@xxxxxzner01p-gz[~]# fcinfo hba-port
      HBA Port WWN: 21000024ff003071
      OS Device Name: /dev/cfg/c3
      Manufacturer: QLogic Corp.
      Model: 375-3355-02
      Firmware Version: 05.04.03
      FCode/BIOS Version: BIOS: 2.02; fcode: 2.01; EFI: 2.00;
      Serial Number: 0402H00-1010769293
      Driver Name: qlc
      Driver Version: 20110321-3.05
      Type: N-port
      State: online
      Supported Speeds: 1Gb 2Gb 4Gb
      Current Speed: 1Gb
      Node WWN: 20000024ff003071
      HBA Port WWN: 21000024ff002f05
      OS Device Name: /dev/cfg/c2
      Manufacturer: QLogic Corp.
      Model: 375-3355-02
      Firmware Version: 05.04.03
      FCode/BIOS Version: BIOS: 2.02; fcode: 2.01; EFI: 2.00;
      Serial Number: 0402H00-1010769378
      Driver Name: qlc
      Driver Version: 20110321-3.05
      Type: N-port
      State: online
      Supported Speeds: 1Gb 2Gb 4Gb
      Current Speed: 2Gb
      Node WWN: 20000024ff002f05


      root@xxxxxzner01p-gz[~]# fcinfo remote-port -slp 21000024ff002f05
      Remote Port WWN: 50060e8005632f21
      Active FC4 Types: SCSI
      SCSI Target: yes
      Node WWN: 50060e8005632f21
      Link Error Statistics:
      Link Failure Count: 0
      Loss of Sync Count: 0
      Loss of Signal Count: 0
      Primitive Seq Protocol Error Count: 0
      Invalid Tx Word Count: 0
      Invalid CRC Count: 0

      root@xxxxxzner01p-gz[~]# fcinfo remote-port -slp 21000024ff003071
      Remote Port WWN: 50060e8005632f31
      Active FC4 Types: SCSI
      SCSI Target: yes
      Node WWN: 50060e8005632f31
      Link Error Statistics:
      Link Failure Count: 261
      Loss of Sync Count: 55337
      Loss of Signal Count: 60
      Primitive Seq Protocol Error Count: 0
      Invalid Tx Word Count: 4294967295
      Invalid CRC Count: 0

      root@xxxxxzner01p-gz[~]# fcinfo hba-port -l 21000024ff002f05
      HBA Port WWN: 21000024ff002f05
      OS Device Name: /dev/cfg/c2
      Manufacturer: QLogic Corp.
      Model: 375-3355-02
      Firmware Version: 05.04.03
      FCode/BIOS Version: BIOS: 2.02; fcode: 2.01; EFI: 2.00;
      Serial Number: 0402H00-1010769378
      Driver Name: qlc
      Driver Version: 20110321-3.05
      Type: N-port
      State: online
      Supported Speeds: 1Gb 2Gb 4Gb
      Current Speed: 2Gb
      Node WWN: 20000024ff002f05
      Link Error Statistics:
      Link Failure Count: 1
      Loss of Sync Count: 0
      Loss of Signal Count: 0
      Primitive Seq Protocol Error Count: 0
      Invalid Tx Word Count: 0
      Invalid CRC Count: 0

      root@xxxxxzner01p-gz[~]# fcinfo hba-port -l 21000024ff003071
      HBA Port WWN: 21000024ff003071
      OS Device Name: /dev/cfg/c3
      Manufacturer: QLogic Corp.
      Model: 375-3355-02
      Firmware Version: 05.04.03
      FCode/BIOS Version: BIOS: 2.02; fcode: 2.01; EFI: 2.00;
      Serial Number: 0402H00-1010769293
      Driver Name: qlc
      Driver Version: 20110321-3.05
      Type: N-port
      State: online
      Supported Speeds: 1Gb 2Gb 4Gb
      Current Speed: 1Gb
      Node WWN: 20000024ff003071
      Link Error Statistics:
      Link Failure Count: 1
      Loss of Sync Count: 0
      Loss of Signal Count: 0
      Primitive Seq Protocol Error Count: 0
      Invalid Tx Word Count: 0
      Invalid CRC Count: 0
      Need help thanks,
      Mauricio
        • 1. Re: I am getting following errors "errors were retryable:
          Need help thanks,
          Mauricio
          You have error entries in your logs for bad blocks on four disk drives.
          ssd33
          ssd35
          ssd37
          ssd89

          Just a guess but they're all probably part of a RAID and one of them is the actual culprit with the other three are victims that are mirroring the bad read/writes.

          What to do?
          You need to use your service contract and log a support request (SR) with Oracle. They will ask for copies of your logs and will be able to walk you through all the steps in isolating the root issue. That's why you have a support contract on a beast such as your Hitachi array.

          It could be as simple as guiding you through various procedusres to mark the offending blocks bad and then rebuilding the RAID. If it's not simple, you may need to replace the questionable disk (which requires a service engineer).

          All that is too complex for an online discussion forum.