0 Replies Latest reply: Mar 7, 2013 3:54 AM by 995410 RSS

    solaris 10 SCSI transport failed reason 'tran err' on host level

    995410
      Hello,

      we are frequently getting below errors on host, can any one please help to solve this issue?

      Mar 1 04:41:49 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 04:41:49 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 1 04:41:49 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 04:41:49 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 1 04:41:49 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 04:41:49 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 1 04:41:49 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 04:41:49 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 1 04:41:49 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 04:41:49 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 1 04:41:49 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 04:41:49 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 1 16:51:30 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 16:51:30 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 1 16:51:30 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 16:51:30 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 1 16:51:30 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 16:51:30 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 1 16:51:30 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 16:51:30 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 1 16:51:30 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 16:51:30 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 1 16:51:30 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 1 16:51:30 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 1 20:41:09 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,0 (ssd117):
      Mar 1 20:41:09 host SCSI transport failed: reason 'tran_err': retrying command
      Mar 2 00:30:14 host fctl: [ID 517869 kern.warning] WARNING: fp(3)::GPN_ID for D_ID=2e1400 failed
      Mar 2 00:30:14 host fctl: [ID 517869 kern.warning] WARNING: fp(3)::N_x Port with D_ID=2e1400, PWWN=50060e80164ed673 disappeared from fabric
      Mar 2 00:30:16 host fctl: [ID 517869 kern.warning] WARNING: fp(3)::N_x Port with D_ID=2e1400, PWWN=50060e80164ed673 reappeared in fabric
      Mar 2 00:30:16 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 2 00:30:16 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 2 00:30:16 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 2 00:30:16 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 2 00:30:16 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 2 00:30:16 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 2 00:30:16 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 2 00:30:16 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 2 00:30:16 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 2 00:30:16 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 2 00:30:16 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 2 00:30:16 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 2 00:30:18 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,0 (ssd117):
      Mar 2 00:30:18 host Error for Command: write(10) Error Level: Retryable
      Mar 2 00:30:18 host scsi: [ID 107833 kern.notice] Requested Block: 367501 Error Block: 367501
      Mar 2 00:30:18 host scsi: [ID 107833 kern.notice] Vendor: HP Serial Number: 50 14ED622B0
      Mar 2 00:30:18 host scsi: [ID 107833 kern.notice] Sense Key: Unit_Attention
      Mar 2 00:30:18 host scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
      Mar 2 00:30:36 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,5 (ssd112):
      Mar 2 00:30:36 host Error for Command: write(10) Error Level: Retryable
      Mar 2 00:30:36 host scsi: [ID 107833 kern.notice] Requested Block: 201152 Error Block: 201152
      Mar 2 00:30:36 host scsi: [ID 107833 kern.notice] Vendor: HP Serial Number: 50 14ED622B5
      Mar 2 00:30:36 host scsi: [ID 107833 kern.notice] Sense Key: Unit_Attention
      Mar 2 00:30:36 host scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
      Mar 2 00:31:40 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,2 (ssd115):
      Mar 2 00:31:40 host Error for Command: write(10) Error Level: Retryable
      Mar 2 00:31:40 host scsi: [ID 107833 kern.notice] Requested Block: 10063136 Error Block: 10063136
      Mar 2 00:31:40 host scsi: [ID 107833 kern.notice] Vendor: HP Serial Number: 50 14ED622B2
      Mar 2 00:31:40 host scsi: [ID 107833 kern.notice] Sense Key: Unit_Attention
      Mar 2 00:31:40 host scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
      Mar 2 00:32:31 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,4 (ssd113):
      Mar 2 00:32:31 host Error for Command: write(10) Error Level: Retryable
      Mar 2 00:32:31 host scsi: [ID 107833 kern.notice] Requested Block: 71274 Error Block: 71274
      Mar 2 00:32:31 host scsi: [ID 107833 kern.notice] Vendor: HP Serial Number: 50 14ED622B4
      Mar 2 00:32:31 host scsi: [ID 107833 kern.notice] Sense Key: Unit_Attention
      Mar 2 00:32:31 host scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
      Mar 2 03:41:29 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,3 (ssd114):
      Mar 2 03:41:29 host Error for Command: read(10) Error Level: Retryable
      Mar 2 03:41:29 host scsi: [ID 107833 kern.notice] Requested Block: 88112 Error Block: 88112
      Mar 2 03:41:29 host scsi: [ID 107833 kern.notice] Vendor: HP Serial Number: 50 14ED622B3
      Mar 2 03:41:29 host scsi: [ID 107833 kern.notice] Sense Key: Unit_Attention
      Mar 2 03:41:29 host scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
      Mar 2 06:00:00 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,1 (ssd116):
      Mar 2 06:00:00 host Error for Command: read(10) Error Level: Retryable
      Mar 2 06:00:00 host scsi: [ID 107833 kern.notice] Requested Block: 202608 Error Block: 202608
      Mar 2 06:00:00 host scsi: [ID 107833 kern.notice] Vendor: HP Serial Number: 50 14ED622B1
      Mar 2 06:00:00 host scsi: [ID 107833 kern.notice] Sense Key: Unit_Attention
      Mar 2 06:00:00 host scsi: [ID 107833 kern.notice] ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
      Mar 2 17:02:01 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,0 (ssd117):
      Mar 2 17:02:01 host SCSI transport failed: reason 'timeout': retrying command
      Mar 4 02:07:11 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130304020711-1
      Mar 4 02:07:21 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130304020711-2
      Mar 5 02:06:47 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130305020647-1
      Mar 5 02:06:57 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130305020647-2
      Mar 5 08:02:48 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 08:02:48 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 5 08:02:48 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 08:02:48 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 5 08:02:48 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 08:02:48 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 5 08:02:48 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 08:02:48 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 5 08:02:48 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 08:02:48 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 5 08:02:48 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 08:02:48 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 5 10:02:55 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,2 (ssd115):
      Mar 5 10:02:55 host SCSI transport failed: reason 'timeout': retrying command
      Mar 5 14:09:40 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 14:09:40 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 5 14:09:40 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 14:09:40 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 5 14:09:40 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 14:09:40 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 5 14:09:40 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 14:09:40 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 5 14:09:40 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 14:09:40 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 5 14:09:40 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 5 14:09:40 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 6 02:06:38 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130306020638-1
      Mar 6 02:06:48 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130306020638-2
      Mar 6 05:00:00 host explorer: [ID 702911 daemon.notice] Explorer started
      Mar 6 05:02:49 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[18043] core dumped: /ecmp/ecm/log/cores/luxadm.host.18043.core
      Mar 6 05:02:50 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[18046] core dumped: /ecmp/ecm/log/cores/luxadm.host.18046.core
      Mar 6 05:02:54 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[18331] core dumped: /ecmp/ecm/log/cores/luxadm.host.18331.core
      Mar 6 05:03:46 host explorer: [ID 702911 daemon.notice] Explorer finished
      Mar 6 06:01:22 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 06:01:22 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 6 06:01:22 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 06:01:22 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 6 06:01:22 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 06:01:22 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 6 06:01:22 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 06:01:22 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 6 06:01:22 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 06:01:22 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 6 06:01:22 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 06:01:22 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 6 12:27:02 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[28834] core dumped: /ecmp/ecm/log/cores/luxadm.host.28834.core
      Mar 6 12:27:33 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[28839] core dumped: /ecmp/ecm/log/cores/luxadm.host.28839.core
      Mar 6 15:24:11 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[5006] core dumped: /ecmp/ecm/log/cores/luxadm.host.5006.core
      Mar 6 15:30:52 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[5699] core dumped: /ecmp/ecm/log/cores/luxadm.host.5699.core
      Mar 6 15:31:57 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[5975] core dumped: /ecmp/ecm/log/cores/luxadm.host.5975.core
      Mar 6 15:32:39 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[5987] core dumped: /ecmp/ecm/log/cores/luxadm.host.5987.core
      Mar 6 15:36:16 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[6274] core dumped: /ecmp/ecm/log/cores/luxadm.host.6274.core
      Mar 6 15:36:38 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[6286] core dumped: /ecmp/ecm/log/cores/luxadm.host.6286.core
      Mar 6 16:18:20 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 16:18:20 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=5 ffffffff
      Mar 6 16:18:20 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 16:18:20 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=4 ffffffff
      Mar 6 16:18:20 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 16:18:20 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=3 ffffffff
      Mar 6 16:18:20 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 16:18:20 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=2 ffffffff
      Mar 6 16:18:20 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 16:18:20 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=1 ffffffff
      Mar 6 16:18:20 host scsi: [ID 243001 kern.info] /pci@8,600000/SUNW,qlc@1/fp@0,0 (fcp3):
      Mar 6 16:18:20 host ndi_devi_online: failed for scsa,00.bfcp: target=2e1400 lun=0 ffffffff
      Mar 6 18:23:44 host scsi: [ID 107833 kern.warning] WARNING: /pci@8,600000/SUNW,qlc@1/fp@0,0/ssd@w50060e80164ed673,0 (ssd117):
      Mar 6 18:23:44 host SCSI transport failed: reason 'tran_err': retrying command
      Mar 7 01:43:47 host xntpd[735]: [ID 774427 daemon.notice] time reset (step) 0.139069 s
      Mar 7 02:07:10 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130307020710-1
      Mar 7 02:07:20 host buxus: [ID 702911 daemon.notice] SYSLOG check 20130307020710-2
      Mar 7 02:07:58 host xntpd[735]: [ID 774427 daemon.notice] time reset (step) 0.152342 s
      Mar 7 07:23:29 host genunix: [ID 603404 kern.notice] NOTICE: core_log: luxadm[24350] core dumped: /ecmp/ecm/log/cores/luxadm.host.24350.core