Hello,
One of my servers suddenly started to show this error msg on SysLog
Code
Apr 28 07:35:15 server kernel: [3088280.320395] sd 0:0:0:0: [sda] Unhandled error code
Apr 28 07:35:15 server kernel: [3088280.320403] sd 0:0:0:0: [sda]
Apr 28 07:35:15 server kernel: [3088280.320405] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:15 server kernel: [3088280.320407] sd 0:0:0:0: [sda] CDB:
Apr 28 07:35:15 server kernel: [3088280.320408] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:15 server kernel: [3088280.380229] sd 0:0:0:0: [sda] Unhandled error code
Apr 28 07:35:15 server kernel: [3088280.380239] sd 0:0:0:0: [sda]
Apr 28 07:35:15 server kernel: [3088280.380241] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:15 server kernel: [3088280.380244] sd 0:0:0:0: [sda] CDB:
Apr 28 07:35:15 server kernel: [3088280.380246] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:15 server kernel: [3088280.527799] sd 0:0:2:0: [sdb] Unhandled error code
Apr 28 07:35:15 server kernel: [3088280.527809] sd 0:0:2:0: [sdb]
Apr 28 07:35:15 server kernel: [3088280.527812] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:15 server kernel: [3088280.527814] sd 0:0:2:0: [sdb] CDB:
Apr 28 07:35:15 server kernel: [3088280.527816] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:15 server kernel: [3088280.650201] sd 0:0:2:0: [sdb] Unhandled error code
Apr 28 07:35:15 server kernel: [3088280.650210] sd 0:0:2:0: [sdb]
Apr 28 07:35:15 server kernel: [3088280.650213] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:15 server kernel: [3088280.650215] sd 0:0:2:0: [sdb] CDB:
Apr 28 07:35:15 server kernel: [3088280.650216] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:16 server kernel: [3088281.812304] sd 0:0:3:0: [sdc] Unhandled error code
Apr 28 07:35:16 server kernel: [3088281.812309] sd 0:0:3:0: [sdc]
Apr 28 07:35:16 server kernel: [3088281.812312] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:16 server kernel: [3088281.812315] sd 0:0:3:0: [sdc] CDB:
Apr 28 07:35:16 server kernel: [3088281.812316] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:16 server kernel: [3088282.174214] sd 0:0:3:0: [sdc] Unhandled error code
Apr 28 07:35:16 server kernel: [3088282.174219] sd 0:0:3:0: [sdc]
Apr 28 07:35:16 server kernel: [3088282.174221] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:16 server kernel: [3088282.174223] sd 0:0:3:0: [sdc] CDB:
Apr 28 07:35:16 server kernel: [3088282.174225] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:17 server kernel: [3088282.674819] sd 0:0:4:0: [sdd] Unhandled error code
Apr 28 07:35:17 server kernel: [3088282.674829] sd 0:0:4:0: [sdd]
Apr 28 07:35:17 server kernel: [3088282.674832] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:17 server kernel: [3088282.674840] sd 0:0:4:0: [sdd] CDB:
Apr 28 07:35:17 server kernel: [3088282.674842] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:17 server kernel: [3088282.985772] sd 0:0:4:0: [sdd] Unhandled error code
Apr 28 07:35:17 server kernel: [3088282.985783] sd 0:0:4:0: [sdd]
Apr 28 07:35:17 server kernel: [3088282.985792] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:17 server kernel: [3088282.985794] sd 0:0:4:0: [sdd] CDB:
Apr 28 07:35:17 server kernel: [3088282.985796] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:18 server kernel: [3088283.585412] sd 0:0:5:0: [sde] Unhandled error code
Apr 28 07:35:18 server kernel: [3088283.585417] sd 0:0:5:0: [sde]
Apr 28 07:35:18 server kernel: [3088283.585420] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:18 server kernel: [3088283.585422] sd 0:0:5:0: [sde] CDB:
Apr 28 07:35:18 server kernel: [3088283.585424] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:18 server kernel: [3088283.940848] sd 0:0:5:0: [sde] Unhandled error code
Apr 28 07:35:18 server kernel: [3088283.940854] sd 0:0:5:0: [sde]
Apr 28 07:35:18 server kernel: [3088283.940857] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:18 server kernel: [3088283.940860] sd 0:0:5:0: [sde] CDB:
Apr 28 07:35:18 server kernel: [3088283.940862] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:19 server kernel: [3088284.312254] sd 0:0:6:0: [sdf] Unhandled error code
Apr 28 07:35:19 server kernel: [3088284.312258] sd 0:0:6:0: [sdf]
Apr 28 07:35:19 server kernel: [3088284.312260] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:19 server kernel: [3088284.312262] sd 0:0:6:0: [sdf] CDB:
Apr 28 07:35:19 server kernel: [3088284.312264] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:19 server kernel: [3088284.556585] sd 0:0:6:0: [sdf] Unhandled error code
Apr 28 07:35:19 server kernel: [3088284.556603] sd 0:0:6:0: [sdf]
Apr 28 07:35:19 server kernel: [3088284.556606] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:19 server kernel: [3088284.556609] sd 0:0:6:0: [sdf] CDB:
Apr 28 07:35:19 server kernel: [3088284.556611] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:19 server kernel: [3088284.895302] sd 0:0:7:0: [sdg] Unhandled error code
Apr 28 07:35:19 server kernel: [3088284.895311] sd 0:0:7:0: [sdg]
Apr 28 07:35:19 server kernel: [3088284.895314] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:19 server kernel: [3088284.895317] sd 0:0:7:0: [sdg] CDB:
Apr 28 07:35:19 server kernel: [3088284.895318] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:19 server kernel: [3088285.123012] sd 0:0:7:0: [sdg] Unhandled error code
Apr 28 07:35:19 server kernel: [3088285.123024] sd 0:0:7:0: [sdg]
Apr 28 07:35:19 server kernel: [3088285.123026] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK
Apr 28 07:35:19 server kernel: [3088285.123028] sd 0:0:7:0: [sdg] CDB:
Apr 28 07:35:19 server kernel: [3088285.123029] ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00
Apr 28 07:35:37 server monit[6167]: 'fs_pool' space usage 82.5% matches resource limit [space usage>80.0%]Server is : Dell PowerEdge T430
Intel Xeon E5-2620 v3
32GB memory
1 Samsung 840 EVO 250GB
6x 4TB WDC RED
Filesystem : ZFS Raid-Z2
Kernel : 2.2.13 (Stone burner)
RaidController : Dell Perc h330
I checked every drives SMART and they are perfect cleans, no crc errors or any kind :
1 Raw_Read_Error_Rate POSR-K 200 200 051 - 0
3 Spin_Up_Time POS--K 181 180 021 - 7925
4 Start_Stop_Count -O--CK 100 100 000 - 14
5 Reallocated_Sector_Ct PO--CK 200 200 140 - 0
7 Seek_Error_Rate -OSR-K 200 200 000 - 0
9 Power_On_Hours -O--CK 087 087 000 - 10075
10 Spin_Retry_Count -O--CK 100 253 000 - 0
11 Calibration_Retry_Count -O--CK 100 253 000 - 0
12 Power_Cycle_Count -O--CK 100 100 000 - 14
192 Power-Off_Retract_Count -O--CK 200 200 000 - 12
193 Load_Cycle_Count -O--CK 200 200 000 - 214
194 Temperature_Celsius -O---K 119 111 000 - 33
196 Reallocated_Event_Count -O--CK 200 200 000 - 0
197 Current_Pending_Sector -O--CK 200 200 000 - 0
198 Offline_Uncorrectable ----CK 100 253 000 - 0
199 UDMA_CRC_Error_Count -O--CK 200 200 000 - 0
200 Multi_Zone_Error_Rate ---R-- 100 253 000 - 0
Im clueless now what to do, or is it just a omv sided issue?