Allereerst mijn setup:
iSCSI host:
Xeon E5-2560v3
64GB RAM
4 NIC's met 4 ip's in 4 verschillende subnets
LUN 0: 2 * 128GB SSD's in een ZFS Mirror
LUN 1: 4 * 256GB SSD's in 2 ZFS Mirrors (RAID10 like dus)
iSCSI Client:
ESXi 6.0u1 host
Intel i5-3570
32GB RAM
4 NIC's
Mijn iSCSI Configuratie:
VH01 t/m VH04 zijn momenteel niet in gebruik
De ESXi host is voorzien van multipathing naar de 4 verschillende ip's van de iSCSI host.
Alles werkt perfect, en ik satureer bij benchmarks de 4 links, so far so good.
Na verloop van tijd (vooral als ik meerdere dingen tegelijk doe) crasht de hele ESXi host omdat de iSCSI verbinding wegvalt.
Laatste stuk van de logging:
Laatste stuk logging op ESXi host:
Ik zou niet weten waar het in zou kunnen zitten, kan iemand mij op weg helpen, met waar ik het in moet zoeken?
EDIT:
Als ik de sense data (0x05, 0x20, 0x00) op zoek (http://www.t10.org/lists/asc-num.txt) krijg ik dit resultaat:
Iemand die dit kan bevestigen? Debug ik dit op de goede manier? Want dit zegt mij vrij weinig dan dat ESXi iets probeert wat TargetCLI niet ondersteund.
iSCSI host:
Xeon E5-2560v3
64GB RAM
4 NIC's met 4 ip's in 4 verschillende subnets
LUN 0: 2 * 128GB SSD's in een ZFS Mirror
LUN 1: 4 * 256GB SSD's in 2 ZFS Mirrors (RAID10 like dus)
iSCSI Client:
ESXi 6.0u1 host
Intel i5-3570
32GB RAM
4 NIC's
Mijn iSCSI Configuratie:
[root@NAS thijs]# targetcli targetcli shell version 2.1.fb42 Copyright 2011-2013 by Datera, Inc and others. For help on commands, type 'help'. /> ls o- / ......................................................................................................................... [...] o- backstores .............................................................................................................. [...] | o- block .................................................................................................. [Storage Objects: 2] | | o- 840PRO_LUN0 ................................................... [/dev/zvol/VM_TIER_1/zvol0 (110.0GiB) write-thru activated] | | o- MX100_LUN0 .................................................... [/dev/zvol/VM_TIER_2/zvol0 (400.0GiB) write-thru activated] | o- fileio ................................................................................................. [Storage Objects: 0] | o- pscsi .................................................................................................. [Storage Objects: 0] | o- ramdisk ................................................................................................ [Storage Objects: 0] o- iscsi ............................................................................................................ [Targets: 1] | o- iqn.2003-01.org.linux-iscsi.nas.x8664:sn.80c34394d007 ............................................................. [TPGs: 1] | o- tpg1 ............................................................................................... [no-gen-acls, no-auth] | o- acls .......................................................................................................... [ACLs: 5] | | o- iqn.1998-01.com.vmware:vh01-38673156 ................................................................. [Mapped LUNs: 2] | | | o- mapped_lun0 ........................................................................... [lun0 block/840PRO_LUN0 (rw)] | | | o- mapped_lun1 ............................................................................ [lun1 block/MX100_LUN0 (rw)] | | o- iqn.1998-01.com.vmware:vh02-33d4caa1 ................................................................. [Mapped LUNs: 2] | | | o- mapped_lun0 ........................................................................... [lun0 block/840PRO_LUN0 (rw)] | | | o- mapped_lun1 ............................................................................ [lun1 block/MX100_LUN0 (rw)] | | o- iqn.1998-01.com.vmware:vh03-7d421107 ................................................................. [Mapped LUNs: 2] | | | o- mapped_lun0 ........................................................................... [lun0 block/840PRO_LUN0 (rw)] | | | o- mapped_lun1 ............................................................................ [lun1 block/MX100_LUN0 (rw)] | | o- iqn.1998-01.com.vmware:vh04-77a89664 ................................................................. [Mapped LUNs: 2] | | | o- mapped_lun0 ........................................................................... [lun0 block/840PRO_LUN0 (rw)] | | | o- mapped_lun1 ............................................................................ [lun1 block/MX100_LUN0 (rw)] | | o- iqn.1998-01.com.vmware:vh05-5e200351 ................................................................. [Mapped LUNs: 2] | | o- mapped_lun0 ........................................................................... [lun0 block/840PRO_LUN0 (rw)] | | o- mapped_lun1 ............................................................................ [lun1 block/MX100_LUN0 (rw)] | o- luns .......................................................................................................... [LUNs: 2] | | o- lun0 .................................................................. [block/840PRO_LUN0 (/dev/zvol/VM_TIER_1/zvol0)] | | o- lun1 ................................................................... [block/MX100_LUN0 (/dev/zvol/VM_TIER_2/zvol0)] | o- portals .................................................................................................... [Portals: 4] | o- 10.0.1.1:3260 .................................................................................................... [OK] | o- 10.0.2.1:3260 .................................................................................................... [OK] | o- 10.0.3.1:3260 .................................................................................................... [OK] | o- 10.0.4.1:3260 .................................................................................................... [OK] o- loopback ......................................................................................................... [Targets: 0] o- vhost ............................................................................................................ [Targets: 0]
VH01 t/m VH04 zijn momenteel niet in gebruik
De ESXi host is voorzien van multipathing naar de 4 verschillende ip's van de iSCSI host.
Alles werkt perfect, en ik satureer bij benchmarks de 4 links, so far so good.
Na verloop van tijd (vooral als ik meerdere dingen tegelijk doe) crasht de hele ESXi host omdat de iSCSI verbinding wegvalt.
Laatste stuk van de logging:
code:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
| [< 1572.267304>] iSCSI/iqn.1998-01.com.vmware:vh05-5e200351: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. [< 0.002795>] iSCSI/iqn.1998-01.com.vmware:vh05-5e200351: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. [< 1800.179389>] iSCSI/iqn.1998-01.com.vmware:vh05-5e200351: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. [< 0.002613>] iSCSI/iqn.1998-01.com.vmware:vh05-5e200351: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. [< 881.961722>] iSCSI Login timeout on Network Portal 10.0.1.1:3260 [< 44.421173>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.000099>] Unexpected ret: -32 send data 48 [< 0.000035>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 15.041596>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.000100>] Unexpected ret: -32 send data 48 [< 0.000035>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 15.041565>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.000098>] Unexpected ret: -32 send data 48 [< 0.000037>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 15.041591>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.000095>] Unexpected ret: -32 send data 48 [< 0.000034>] tx_data returned -32, expecting 48. [< 0.000028>] iSCSI Login negotiation failed. [< 0.319868>] iSCSI Login timeout on Network Portal 10.0.3.1:3260 [< 0.000098>] Unexpected ret: -32 send data 48 [< 0.000035>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 14.721562>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.000099>] Unexpected ret: -32 send data 48 [< 0.000036>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 0.319842>] iSCSI Login timeout on Network Portal 10.0.3.1:3260 [< 0.000094>] Unexpected ret: -32 send data 48 [< 0.000035>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 14.721560>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.000068>] Unexpected ret: -32 send data 48 [< 0.000029>] tx_data returned -32, expecting 48. [< 0.000029>] iSCSI Login negotiation failed. [< 0.319880>] iSCSI Login timeout on Network Portal 10.0.3.1:3260 [< 0.000088>] Unexpected ret: -32 send data 48 [< 0.000035>] tx_data returned -32, expecting 48. [< 0.000031>] iSCSI Login negotiation failed. [< 14.465585>] iSCSI Login timeout on Network Portal 10.0.2.1:3260 [< 0.001118>] Unexpected ret: -32 send data 48 [< 0.001098>] tx_data returned -32, expecting 48. [< 0.001093>] iSCSI Login negotiation failed. [< 0.252709>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.001125>] Unexpected ret: -32 send data 48 [< 0.001087>] tx_data returned -32, expecting 48. [< 0.001062>] iSCSI Login negotiation failed. [< 0.316713>] iSCSI Login timeout on Network Portal 10.0.3.1:3260 [< 0.001132>] Unexpected ret: -32 send data 48 [< 0.001135>] tx_data returned -32, expecting 48. [< 0.001098>] iSCSI Login negotiation failed. [< 14.462361>] iSCSI Login timeout on Network Portal 10.0.2.1:3260 [< 0.001176>] Unexpected ret: -32 send data 48 [< 0.001145>] tx_data returned -32, expecting 48. [< 0.001120>] iSCSI Login negotiation failed. [< 0.252573>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.001171>] Unexpected ret: -32 send data 48 [< 0.001197>] tx_data returned -32, expecting 48. [< 0.001126>] iSCSI Login negotiation failed. [< 0.316538>] iSCSI Login timeout on Network Portal 10.0.3.1:3260 [< 0.001173>] Unexpected ret: -32 send data 48 [< 0.001146>] tx_data returned -32, expecting 48. [< 0.001090>] iSCSI Login negotiation failed. [< 14.462262>] iSCSI Login timeout on Network Portal 10.0.2.1:3260 [< 0.001177>] Unexpected ret: -32 send data 48 [< 0.001150>] tx_data returned -32, expecting 48. [< 0.001065>] iSCSI Login negotiation failed. [< 0.252641>] iSCSI Login timeout on Network Portal 10.0.4.1:3260 [< 0.001169>] Unexpected ret: -32 send data 48 [< 0.001153>] tx_data returned -32, expecting 48. [< 0.001129>] iSCSI Login negotiation failed. [< 0.316606>] iSCSI Login timeout on Network Portal 10.0.3.1:3260 [< 0.001161>] Unexpected ret: -32 send data 48 [< 0.001124>] tx_data returned -32, expecting 48. [< 0.001127>] iSCSI Login negotiation failed. [< 7.878775>] Unexpected ret: -32 send data 360 [< 0.000808>] tx_data returned -32, expecting 360. [< 0.000861>] iSCSI Login negotiation failed. [< 0.001140>] Unexpected ret: -32 send data 360 [< 0.001132>] tx_data returned -32, expecting 360. [< 0.001160>] iSCSI Login negotiation failed. [< 0.001335>] Unexpected ret: -32 send data 360 [< 0.000748>] tx_data returned -32, expecting 360. [< 0.000792>] iSCSI Login negotiation failed. [< 0.000955>] Unexpected ret: -32 send data 360 [< 0.000959>] tx_data returned -32, expecting 360. [< 0.001017>] iSCSI Login negotiation failed. [< 0.001176>] Unexpected ret: -32 send data 360 [< 0.000834>] tx_data returned -32, expecting 360. [< 0.001099>] iSCSI Login negotiation failed. [< 0.001349>] Unexpected ret: -32 send data 360 [< 0.001124>] tx_data returned -32, expecting 360. [< 0.001099>] iSCSI Login negotiation failed. [< 0.001168>] Unexpected ret: -32 send data 360 [< 0.000714>] tx_data returned -32, expecting 360. [< 0.000735>] iSCSI Login negotiation failed. [< 0.000897>] Unexpected ret: -32 send data 360 [< 0.000929>] tx_data returned -32, expecting 360. [< 0.000922>] iSCSI Login negotiation failed. [< 0.001130>] Unexpected ret: -32 send data 360 [< 0.001082>] tx_data returned -32, expecting 360. [< 0.001080>] iSCSI Login negotiation failed. [< 0.001220>] Unexpected ret: -32 send data 360 [< 0.000983>] tx_data returned -32, expecting 360. [< 0.000953>] iSCSI Login negotiation failed. [< 0.001181>] Unexpected ret: -32 send data 360 [< 0.001003>] tx_data returned -32, expecting 360. [< 0.000967>] iSCSI Login negotiation failed. [< 0.001249>] Unexpected ret: -32 send data 360 [< 0.000961>] tx_data returned -32, expecting 360. [< 0.000959>] iSCSI Login negotiation failed. [< 0.001185>] Unexpected ret: -32 send data 360 [< 0.000952>] tx_data returned -32, expecting 360. [< 0.000994>] iSCSI Login negotiation failed. [< 0.001331>] Unexpected ret: -32 send data 360 [< 0.000931>] tx_data returned -32, expecting 360. [< 0.000919>] iSCSI Login negotiation failed. [< 0.001125>] Unexpected ret: -32 send data 360 [< 0.000713>] tx_data returned -32, expecting 360. [< 0.000575>] iSCSI Login negotiation failed. [< 0.000778>] Unexpected ret: -32 send data 360 [< 0.000944>] tx_data returned -32, expecting 360. [< 0.000880>] iSCSI Login negotiation failed. [< 0.000970>] Unexpected ret: -32 send data 360 [< 0.000744>] tx_data returned -32, expecting 360. [< 0.000718>] iSCSI Login negotiation failed. [< 0.000908>] Unexpected ret: -32 send data 360 [< 0.000562>] tx_data returned -32, expecting 360. [< 0.000561>] iSCSI Login negotiation failed. [< 0.000736>] Unexpected ret: -32 send data 360 [< 0.000733>] tx_data returned -32, expecting 360. [< 0.000755>] iSCSI Login negotiation failed. [< 0.000883>] Unexpected ret: -32 send data 360 [< 0.000588>] tx_data returned -32, expecting 360. [< 0.000571>] iSCSI Login negotiation failed. [< 0.000696>] Unexpected ret: -32 send data 360 [< 0.000586>] tx_data returned -32, expecting 360. [< 0.000542>] iSCSI Login negotiation failed. [< 0.000712>] Unexpected ret: -32 send data 360 [< 0.000554>] tx_data returned -32, expecting 360. [< 0.000512>] iSCSI Login negotiation failed. [< 0.000678>] Unexpected ret: -32 send data 360 [< 0.000753>] tx_data returned -32, expecting 360. [< 0.000746>] iSCSI Login negotiation failed. [< 0.000874>] Unexpected ret: -32 send data 360 [< 0.000699>] tx_data returned -32, expecting 360. [< 0.000711>] iSCSI Login negotiation failed. [< 0.000947>] Unexpected ret: -32 send data 360 [< 0.000862>] tx_data returned -32, expecting 360. [< 0.000855>] iSCSI Login negotiation failed. [< 0.000954>] Unexpected ret: -32 send data 360 [< 0.000558>] tx_data returned -32, expecting 360. [< 0.000564>] iSCSI Login negotiation failed. [< 0.001085>] Unexpected ret: -32 send data 360 [< 0.000648>] tx_data returned -32, expecting 360. [< 0.000653>] iSCSI Login negotiation failed. [< 0.000762>] Unexpected ret: -32 send data 360 [< 0.000674>] tx_data returned -32, expecting 360. [< 0.000666>] iSCSI Login negotiation failed. [< 0.000808>] Unexpected ret: -32 send data 360 [< 0.000538>] tx_data returned -32, expecting 360. [< 0.000573>] iSCSI Login negotiation failed. [< 0.000637>] Unexpected ret: -32 send data 360 [< 0.000521>] tx_data returned -32, expecting 360. [< 0.000549>] iSCSI Login negotiation failed. [< 0.000636>] Unexpected ret: -32 send data 360 [< 0.000658>] tx_data returned -32, expecting 360. [< 0.000671>] iSCSI Login negotiation failed. [< 0.000828>] Unexpected ret: -32 send data 360 [< 0.000620>] tx_data returned -32, expecting 360. [< 0.000665>] iSCSI Login negotiation failed. [< 0.000754>] Unexpected ret: -32 send data 360 [< 0.000633>] tx_data returned -32, expecting 360. [< 0.000678>] iSCSI Login negotiation failed. [< 0.000737>] Unexpected ret: -32 send data 360 [< 0.000615>] tx_data returned -32, expecting 360. [< 0.000692>] iSCSI Login negotiation failed. [< 0.000757>] Unexpected ret: -32 send data 360 [< 0.000610>] tx_data returned -32, expecting 360. [< 0.000657>] iSCSI Login negotiation failed. [< 0.000746>] Unexpected ret: -32 send data 360 [< 0.000656>] tx_data returned -32, expecting 360. [< 0.000619>] iSCSI Login negotiation failed. [< 0.000706>] Unexpected ret: -32 send data 360 [< 0.000617>] tx_data returned -32, expecting 360. [< 0.000592>] iSCSI Login negotiation failed. [< 0.000705>] Unexpected ret: -32 send data 360 [< 0.000583>] tx_data returned -32, expecting 360. [< 0.000600>] iSCSI Login negotiation failed. [< 0.000723>] Unexpected ret: -32 send data 360 [< 0.000642>] tx_data returned -32, expecting 360. [< 0.000613>] iSCSI Login negotiation failed. [< 57.346452>] Detected MISCOMPARE for addr: ffff880fbf1f6000 buf: ffff8808ca09c200 [< 0.000006>] Target/iblock: Send MISCOMPARE check condition and sense [< 14.003937>] Detected MISCOMPARE for addr: ffff880dfd7ee000 buf: ffff8808ca09cc00 [< 0.000009>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.000032>] Detected MISCOMPARE for addr: ffff880faa2fd000 buf: ffff8808ca09e600 [< 0.000003>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.000138>] Detected MISCOMPARE for addr: ffff880ced7b3000 buf: ffff8808ca09dc00 [< 0.000003>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.011295>] Detected MISCOMPARE for addr: ffff880b79e22000 buf: ffff880ec9cf4c00 [< 0.000005>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.003822>] Detected MISCOMPARE for addr: ffff880c6520a000 buf: ffff880f5ddc7200 [< 0.000004>] Target/iblock: Send MISCOMPARE check condition and sense [< 250.175975>] Detected MISCOMPARE for addr: ffff880d827ae000 buf: ffff880e8fb9d400 [< 0.000006>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.000023>] Detected MISCOMPARE for addr: ffff880af1f30000 buf: ffff880e8fb9d400 [< 0.000002>] Target/iblock: Send MISCOMPARE check condition and sense [< 97.963759>] Detected MISCOMPARE for addr: ffff880e2862c000 buf: ffff880edef75e00 [< 0.000018>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.000058>] Detected MISCOMPARE for addr: ffff880e9e616000 buf: ffff880edef75e00 [< 0.000002>] Target/iblock: Send MISCOMPARE check condition and sense [< 114.546646>] Detected MISCOMPARE for addr: ffff880f860ea000 buf: ffff880edef75600 [< 0.000006>] Target/iblock: Send MISCOMPARE check condition and sense [< 0.000017>] Detected MISCOMPARE for addr: ffff880cd8ff6000 buf: ffff880edef75600 [< 0.000003>] Target/iblock: Send MISCOMPARE check condition and sense [< 328.102750>] iSCSI/iqn.1998-01.com.vmware:vh05-5e200351: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. [< 13.584736>] iSCSI/iqn.1998-01.com.vmware:vh05-5e200351: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. [< 216.688079>] Exiting Time2Retain handler because session_reinstatement=1 [< 298.662261>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000002 [< 0.001314>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000003 [< 27.133730>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000004 [< 0.001217>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000005 [< 27.146405>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000006 [< 0.001295>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000007 [< 0.001189>] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x00000008 |
Laatste stuk logging op ESXi host:
code:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
| 2016-06-10T14:09:16.960Z cpu3:33234)WARNING: iscsi_vmk: iscsivmk_StopConnection: Conn [CID: 0 L: 10.0.2.50:50453 R: 10.0.2.1:3260] 2016-06-10T14:09:16.960Z cpu1:33245)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6001405acd066c278cc4d64a27245fd6" state in doubt; requested fast path state update... 2016-06-10T14:09:16.960Z cpu1:33245)ScsiDeviceIO: 2613: Cmd(0x439d806d1540) 0x89, CmdSN 0x256f7 from world 32801 to dev "naa.6001405acd066c278cc4d64a27245fd6" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0. 2016-06-10T14:09:16.960Z cpu3:45608)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x89 (0x439d806a92c0, 32778) to dev "naa.60014059765db72798947069da81e525" on path "vmhba38:C1:T0:L1" Failed: H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL 2016-06-10T14:09:16.960Z cpu3:45608)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.60014059765db72798947069da81e525" state in doubt; requested fast path state update... 2016-06-10T14:09:16.960Z cpu3:45608)ScsiDeviceIO: 2651: Cmd(0x439d806a92c0) 0x89, CmdSN 0x244c2 from world 32778 to dev "naa.60014059765db72798947069da81e525" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. 2016-06-10T14:09:16.960Z cpu1:33245)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x28 (0x439d806b2c00, 34678) to dev "naa.60014059765db72798947069da81e525" on path "vmhba38:C1:T0:L1" Failed: H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. Act:EVAL 2016-06-10T14:09:16.960Z cpu1:33245)ScsiDeviceIO: 2613: Cmd(0x439d806b2c00) 0x28, CmdSN 0x244c1 from world 34678 to dev "naa.60014059765db72798947069da81e525" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. 2016-06-10T14:09:16.960Z cpu1:33245)ScsiDeviceIO: 2613: Cmd(0x439d806e4900) 0x28, CmdSN 0x8e from world 45781 to dev "naa.60014059765db72798947069da81e525" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. 2016-06-10T14:09:16.960Z cpu3:33234)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:1 T:0 L:1 : Task mgmt "Abort Task" with itt=0x940 (refITT=0x93f) timed out. 2016-06-10T14:09:16.986Z cpu1:36957)NMP: nmp_ThrottleLogForDevice:3231: last error status from device naa.60014059765db72798947069da81e525 repeated 10 times 2016-06-10T14:09:17.032Z cpu0:33295)NMP: nmp_ThrottleLogForDevice:3231: last error status from device naa.60014059765db72798947069da81e525 repeated 20 times 2016-06-10T14:09:17.125Z cpu1:36957)NMP: nmp_ThrottleLogForDevice:3231: last error status from device naa.60014059765db72798947069da81e525 repeated 40 times 2016-06-10T14:09:17.305Z cpu0:32851)NMP: nmp_ThrottleLogForDevice:3231: last error status from device naa.60014059765db72798947069da81e525 repeated 80 times 2016-06-10T14:09:17.355Z cpu1:45226)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6001405acd066c278cc4d64a27245fd6" state in doubt; requested fast path state update... 2016-06-10T14:09:17.355Z cpu1:45226)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.60014059765db72798947069da81e525" state in doubt; requested fast path state update... 2016-06-10T14:09:17.667Z cpu1:36956)NMP: nmp_ThrottleLogForDevice:3231: last error status from device naa.60014059765db72798947069da81e525 repeated 160 times 2016-06-10T14:09:18.351Z cpu1:32782)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.60014059765db72798947069da81e525" state in doubt; requested fast path state update... 2016-06-10T14:09:18.365Z cpu1:32892)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6001405acd066c278cc4d64a27245fd6" state in doubt; requested fast path state update... 2016-06-10T14:09:18.413Z cpu0:32787)ScsiDeviceIO: 2651: Cmd(0x439d806b1700) 0x89, CmdSN 0x244c3 from world 32778 to dev "naa.60014059765db72798947069da81e525" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. 2016-06-10T14:09:18.423Z cpu1:32788)ScsiDeviceIO: 2595: Cmd(0x439d806b2c00) 0x28, CmdSN 0x244c1 from world 34678 to dev "naa.60014059765db72798947069da81e525" failed H:0x8 D:0x0 P:0x0 2016-06-10T14:09:18.423Z cpu1:32788)ScsiDeviceIO: 2595: Cmd(0x439d806e4900) 0x28, CmdSN 0x8e from world 45781 to dev "naa.60014059765db72798947069da81e525" failed H:0x8 D:0x0 P:0x0 2016-06-10T14:09:18.423Z cpu1:32788)ScsiDeviceIO: 2595: Cmd(0x439d80699100) 0x28, CmdSN 0x8d from world 45779 to dev "naa.60014059765db72798947069da81e525" failed H:0x8 D:0x0 P:0x0 2016-06-10T14:09:18.423Z cpu1:32788)ScsiDeviceIO: 2595: Cmd(0x439d806c9300) 0x28, CmdSN 0x84 from world 45780 to dev "naa.60014059765db72798947069da81e525" failed H:0x8 D:0x0 P:0x0 2016-06-10T14:09:18.423Z cpu1:32788)ScsiDeviceIO: 2595: Cmd(0x439d806c1e80) 0x28, CmdSN 0x8b from world 32876 to dev "naa.60014059765db72798947069da81e525" failed H:0x8 D:0x0 P:0x0 2016-06-10T14:09:18.515Z cpu3:32803)NMP: nmp_ThrottleLogForDevice:3231: last error status from device naa.60014059765db72798947069da81e525 repeated 320 times 2016-06-10T14:09:18.515Z cpu3:32803)ScsiDeviceIO: 2613: Cmd(0x439d806c8b80) 0x28, CmdSN 0x244c4 from world 32803 to dev "naa.60014059765db72798947069da81e525" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. 2016-06-10T14:09:19.356Z cpu3:32782)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.60014059765db72798947069da81e525" state in doubt; requested fast path state update... 2016-06-10T14:09:19.356Z cpu1:33013)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6001405acd066c278cc4d64a27245fd6" state in doubt; requested fast path state update... 2016-06-10T14:09:19.414Z cpu1:32788)ScsiDeviceIO: 2651: Cmd(0x439d806d1540) 0x89, CmdSN 0x256f7 from world 32801 to dev "naa.6001405acd066c278cc4d64a27245fd6" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0. 2016-06-10T14:09:19.415Z cpu1:34689 opID=1450f3db)HBX: 2802: 'VM_TIER_1': HB at offset 3215360 - Waiting for timed out HB: 2016-06-10T14:09:19.415Z cpu1:34689 opID=1450f3db) [HB state abcdef02 offset 3215360 gen 1013 stampUS 11709584366 uuid 575a93cb-b4a2bff7-ffba-f4ce46a74f78 jrnl <FB 17800> drv 14.61 lockImpl 4] 2016-06-10T14:09:19.415Z cpu3:32802)ScsiDeviceIO: 2613: Cmd(0x439d806a95c0) 0x28, CmdSN 0x256f8 from world 32802 to dev "naa.6001405acd066c278cc4d64a27245fd6" failed H:0x2 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0. 2016-06-10T14:09:19.728Z cpu0:33234)iscsi_vmk: iscsivmk_ConnNetRegister: socket 0x430403ecf880 network resource pool netsched.pools.persist.iscsi associated 2016-06-10T14:09:19.728Z cpu0:33234)iscsi_vmk: iscsivmk_ConnNetRegister: socket 0x430403ecf880 network tracker id 16768 tracker.iSCSI.10.0.2.1 associated 2016-06-10T14:09:19.980Z cpu0:33234)WARNING: iscsi_vmk: iscsivmk_StartConnection: vmhba38:CH:1 T:0 CN:0: iSCSI connection is being marked "ONLINE" 2016-06-10T14:09:19.980Z cpu0:33234)WARNING: iscsi_vmk: iscsivmk_StartConnection: Sess [ISID: 00023d000002 TARGET: iqn.2003-01.org.linux-iscsi.nas.x8664:sn.80c34394d007 TPGT: 1 TSIH: 0] 2016-06-10T14:09:19.980Z cpu0:33234)WARNING: iscsi_vmk: iscsivmk_StartConnection: Conn [CID: 0 L: 10.0.2.50:16421 R: 10.0.2.1:3260] 2016-06-10T14:09:19.990Z cpu3:32803)HBX: 276: 'VM_TIER_2': HB at offset 3215360 - Reclaimed heartbeat [Timeout]: 2016-06-10T14:09:19.990Z cpu3:32803) [HB state abcdef02 offset 3215360 gen 1051 stampUS 13918638678 uuid 575a93cb-b4a2bff7-ffba-f4ce46a74f78 jrnl <FB 7400> drv 14.61 lockImpl 4] 2016-06-10T14:09:21.351Z cpu3:33139)NMP: nmp_ResetDeviceLogThrottling:3349: last error status from device naa.6001405acd066c278cc4d64a27245fd6 repeated 940 times |
Ik zou niet weten waar het in zou kunnen zitten, kan iemand mij op weg helpen, met waar ik het in moet zoeken?
EDIT:
Als ik de sense data (0x05, 0x20, 0x00) op zoek (http://www.t10.org/lists/asc-num.txt) krijg ik dit resultaat:
20h/00h DZTPROMAEBKVF INVALID COMMAND OPERATION CODE
Iemand die dit kan bevestigen? Debug ik dit op de goede manier? Want dit zegt mij vrij weinig dan dat ESXi iets probeert wat TargetCLI niet ondersteund.
Even niets...