Bug 248630
| Summary: | sesutil does not report all drives in an MSA60, locate LED is off by +1 | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | Base System | Reporter: | Mike Biesele <mike> | ||||||
| Component: | bin | Assignee: | freebsd-bugs (Nobody) <bugs> | ||||||
| Status: | New --- | ||||||||
| Severity: | Affects Some People | CC: | bapt, daniel, lwhsu, mav, pen, trasz | ||||||
| Priority: | --- | ||||||||
| Version: | 12.1-RELEASE | ||||||||
| Hardware: | amd64 | ||||||||
| OS: | Any | ||||||||
| Attachments: |
|
||||||||
|
Description
Mike Biesele
2020-08-12 16:47:56 UTC
My guess is that ses driver can not properly parse the Additional Element Status diagnostic page on this enclosure. Could you please show also output of `sg_ses -p 1 /dev/ses0`, `sg_ses -p 2 /dev/ses0`, `sg_ses -p 7 /dev/ses0` and `sg_ses -p 0xa /dev/ses0`. `sg_ses` tool is from sysutils/sg3_utils port. library ~ # sg_ses -p 1 /dev/ses0
HP MSA60 2.18
Configuration diagnostic page:
number of secondary subenclosures: 0
generation code: 0x0
enclosure descriptor list
Subenclosure identifier: 0 [primary]
relative ES process id: 1, number of ES processes: 1
number of type descriptor headers: 10
enclosure logical identifier (hex): 5001438001571280
enclosure vendor: HP product: MSA60 rev: 2.18
vendor-specific data:
48 50 20 4d 53 41 20 53 74 6f 72 61 67 65 20 45 HP MSA Storage E
6e 63 6c 6f 73 75 72 65 20 20 20 20 20 20 20 20 nclosure
20 00 00 00 ...
type descriptor header and text list
Element type: Array device slot, subenclosure id: 0
number of possible elements: 12
text: Bay
Element type: Power supply, subenclosure id: 0
number of possible elements: 2
text: Power Supply
Element type: Cooling, subenclosure id: 0
number of possible elements: 2
text: Fans
Element type: Cooling, subenclosure id: 0
number of possible elements: 2
text: Fans
Element type: Temperature sensor, subenclosure id: 0
number of possible elements: 4
text: Temperature Sensor
Element type: Enclosure services controller electronics, subenclosure id: 0
number of possible elements: 1
text: Enclosure Service Controller
Element type: Enclosure, subenclosure id: 0
number of possible elements: 1
text: Enclosure
Element type: SAS expander, subenclosure id: 0
number of possible elements: 1
text: SAS Expander
Element type: SAS connector, subenclosure id: 0
number of possible elements: 36
text: SAS Expander Phy
Element type: vendor specific [0x80], subenclosure id: 0
number of possible elements: 1
text: HP 7-Segment Display
library ~ # sg_ses -p 2 /dev/ses0
HP MSA60 2.18
Enclosure Status diagnostic page:
INVOP=0, INFO=0, NON-CRIT=0, CRIT=0, UNRECOV=0
generation code: 0x0
status descriptor list
Element type: Array device slot, subenclosure id: 0 [ti=0]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 1 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=1, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 2 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 3 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 4 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 5 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 6 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 7 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 8 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 9 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 10 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element 11 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
OK=0, Reserved device=0, Hot spare=0, Cons check=0
In crit array=0, In failed array=0, Rebuild/remap=0, R/R abort=0
App client bypass A=0, Do not remove=0, Enc bypass A=0, Enc bypass B=0
Ready to insert=0, RMV=0, Ident=0, Report=0
App client bypass B=0, Fault sensed=0, Fault reqstd=0, Device off=0
Bypassed A=0, Bypassed B=0, Dev bypassed A=0, Dev bypassed B=0
Element type: Power supply, subenclosure id: 0 [ti=1]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Do not remove=0, DC overvoltage=0, DC undervoltage=0
DC overcurrent=0, Hot swap=0, Fail=0, Requested on=0, Off=0
Overtmp fail=0, Temperature warn=0, AC fail=0, DC fail=0
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=1, status: OK
Ident=0, Do not remove=0, DC overvoltage=0, DC undervoltage=0
DC overcurrent=0, Hot swap=0, Fail=0, Requested on=1, Off=0
Overtmp fail=0, Temperature warn=0, AC fail=0, DC fail=0
Element 1 descriptor:
Predicted failure=0, Disabled=0, Swap=1, status: OK
Ident=0, Do not remove=0, DC overvoltage=0, DC undervoltage=0
DC overcurrent=0, Hot swap=0, Fail=0, Requested on=1, Off=0
Overtmp fail=0, Temperature warn=0, AC fail=0, DC fail=0
Element type: Cooling, subenclosure id: 0 [ti=2]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Do not remove=0, Hot swap=0, Fail=0, Requested on=0
Off=0, Actual speed=0 rpm, Fan stopped
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Do not remove=0, Hot swap=0, Fail=0, Requested on=1
Off=0, Actual speed=4200 rpm, Fan at lowest speed
Element 1 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Do not remove=0, Hot swap=0, Fail=0, Requested on=1
Off=0, Actual speed=3600 rpm, Fan at lowest speed
Element type: Cooling, subenclosure id: 0 [ti=3]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Do not remove=0, Hot swap=0, Fail=0, Requested on=0
Off=0, Actual speed=0 rpm, Fan stopped
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Do not remove=0, Hot swap=0, Fail=0, Requested on=1
Off=0, Actual speed=3600 rpm, Fan at lowest speed
Element 1 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Do not remove=0, Hot swap=0, Fail=0, Requested on=1
Off=0, Actual speed=3600 rpm, Fan at lowest speed
Element type: Temperature sensor, subenclosure id: 0 [ti=4]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Fail=0, OT failure=0, OT warning=0, UT failure=0
UT warning=0
Temperature: <reserved>
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Fail=0, OT failure=0, OT warning=0, UT failure=0
UT warning=0
Temperature=27 C
Element 1 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Fail=0, OT failure=0, OT warning=0, UT failure=0
UT warning=0
Temperature=27 C
Element 2 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Fail=0, OT failure=0, OT warning=0, UT failure=0
UT warning=0
Temperature=24 C
Element 3 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Fail=0, OT failure=0, OT warning=0, UT failure=0
UT warning=0
Temperature=24 C
Element type: Enclosure services controller electronics, subenclosure id: 0 [ti=5]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Fail=0, Do not remove=0, Report=0, Hot swap=0
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Fail=0, Do not remove=0, Report=1, Hot swap=0
Element type: Enclosure, subenclosure id: 0 [ti=6]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Time until power cycle=0, Failure indication=0
Warning indication=0, Requested power off duration=0
Failure requested=0, Warning requested=0
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Time until power cycle=0, Failure indication=0
Warning indication=0, Requested power off duration=0
Failure requested=0, Warning requested=0
Element type: SAS expander, subenclosure id: 0 [ti=7]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, Fail=0
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Fail=0
Element type: SAS connector, subenclosure id: 0 [ti=8]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 1 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 2 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 3 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 4 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 5 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 6 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 7 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 8 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 9 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 10 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 11 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, SAS Drive backplane receptacle (SFF-8482) [max 2 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 12 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 13 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 14 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 15 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 16 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 17 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 18 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 19 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 20 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 21 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 22 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 23 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 24 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 25 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 26 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 27 descriptor:
Predicted failure=0, Disabled=1, Swap=0, status: Unsupported
Ident=0, No information
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 28 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 29 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 30 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x2, Mated=0, Fail=0, OC=0
Element 31 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x3, Mated=0, Fail=0, OC=0
Element 32 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x0, Mated=0, Fail=0, OC=0
Element 33 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x1, Mated=0, Fail=0, OC=0
Element 34 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x2, Mated=0, Fail=0, OC=0
Element 35 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Ident=0, Mini SAS 4x receptacle (SFF-8088) [max 4 phys]
Connector physical link=0x3, Mated=0, Fail=0, OC=0
Element type: vendor specific [0x80], subenclosure id: 0 [ti=9]
Overall descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: Unsupported
Vendor specific element type, status in hex: 00 00 00 00
Element 0 descriptor:
Predicted failure=0, Disabled=0, Swap=0, status: OK
Vendor specific element type, status in hex: 01 20 ff ff
library ~ # sg_ses -p 7 /dev/ses0
HP MSA60 2.18
sg_ses failed: Illegal request
library ~ # sg_ses -p 0xa /dev/ses0
HP MSA60 2.18
Primary enclosure logical identifier (hex): 5001438001571280
Additional element status diagnostic page:
generation code: 0x0
additional element status descriptor list
Element type: Array device slot, subenclosure id: 0 [ti=0]
Element index: 1 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 1
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571281
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 2 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 2
phy index: 0
SAS device type: end device
initiator port for:
target port for: SSP
attached SAS address: 0x5001438001571280
SAS address: 0x5000c50034cd2731
phy identifier: 0x1
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 3 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 3
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571283
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 4 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 4
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571284
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 5 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 5
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571285
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 6 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 6
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571286
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 7 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 7
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571287
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 8 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 8
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571288
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 9 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 9
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x5001438001571289
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 10 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 10
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x500143800157128a
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 11 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 11
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x500143800157128b
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
Element index: 12 eiioe=0
Transport protocol: SAS
number of phys: 2, not all phys: 1, device slot number: 12
phy index: 0
SAS device type: no SAS device attached
initiator port for:
target port for: SATA_device
attached SAS address: 0x5001438001571280
SAS address: 0x500143800157128c
phy identifier: 0x0
phy index: 1
SAS device type: no SAS device attached
initiator port for:
target port for:
attached SAS address: 0x0
SAS address: 0x0
phy identifier: 0x0
It looks like a bug in Additional element status diagnostic page. You may see they use element indexes from 1 to 12, while with eiioe=0 it has to be 0 to 11. It would have sense if eiiie=1, but it is not. I don't know what they were thinking about. I would recommend to ask HPE about the firmware update. I don't see error from our side here, the only thing we could do is a workaround, that I hate to do. Unfortunately, I have other MSA60s that are on the latest firmware (2.28, according to https://support.hpe.com/hpsc/swd/public/detail?swItemId=co_119008_1#tab-history ) that exhibit this same behavior. I think they are past EOL/EOS so a firmware update is not possible. I assume this enclosure falls under the category described at http://sg.danny.cz/sg/sg_ses.html : "Prior to the EIIOE bit's introduction in ses3r06 several arrays acted as if this bit was present and set. If 'force' is given the Additional Element Status page's element index field is treated as if EIIOE=1. If 'auto' is given a heuristic is used to decide whether to set EIIOE or not." It looks like ses3r06 was introduced in August 2013, and the 2.28 firmware for this enclosure was released in May 2013. I think the heuristic described in the sg_ses documentation is documented in a large comment in sg_ses.c in sg3_utils : /* Join array has four "element index"ing stategies: * [1] based on all descriptors in the Enclosure Status (ES) dpage * [2] based on the non-overall descriptors in the ES dpage * [3] based on the non-overall descriptors of these element types * in the ES dpage: DEVICE_ETC, ARRAY_DEV_ETC, SAS_EXPANDER_ETC, * SCSI_IPORT_ETC, SCSI_TPORT_ETC and ENC_SCELECTR_ETC. * [4] based on the non-overall descriptors of the SAS_CONNECTOR_ETC * element type * * The indexes are all origin 0 with the maximum index being one less then * the number of status descriptors in the ES dpage. Table of supported * permutations follows: * * ==========|=============================================================== * Algorithm | Indexes | Notes * |Element|Connector element|Other element| * ==========|=======|=================|=============|======================= * [A] | [2] | [4] | [3] | SES-2, OR * [A] | [2] | [4] | [3] | SES-3,EIIOE=0 * ----------|-------|-----------------|-------------|----------------------- * [B] | [1] | [1] | [1] | SES-3, EIIOE=1 * ----------|-------|-----------------|-------------|----------------------- * [C] | [2] | [2] | [2] | SES-3, EIIOE=2 * ----------|-------|-----------------|-------------|----------------------- * [D] | [2] | [1] | [1] | SES-3, EIIOE=3 * ----------|-------|-----------------|-------------|----------------------- * [E] | [1] | [4] | [3] | EIIOE=0 and * | | | | --eiioe=force, OR * [E] | [1] | [4] | [3] | {HP JBOD} EIIOE=0 and * | | | | --eiioe=auto and * | | | | AES[desc_0].ei==1 . * ----------|-------|-----------------|-------------|----------------------- * [F] | [2->3]| [4] | [3] | "broken_ei" when any * | | | | of AES[*].ei invalid * | | | | using strategy [2] * ----------|-------|-----------------|-------------|----------------------- * [Z] | - | [4] | [3] | EIP=0, implicit * | | | | element index of [3] * ========================================================================== * * */ Which does look pretty cumbersome, and appears to call out some HP gear for specific treatment as well. Ugh. Would a sysctl tunable be plausible to implement? Something like dev.mps.ses.X.eiioe=1 to mimic the --eiioe=force behavior from ses_util and allow working around the broken behavior? I realize it may not be worth it at this point, of course. Created attachment 222110 [details]
sg_ses output from FreeBSD 12.2 for HP D6020 JBOX arrays
I'm having similar problems with sesutil on FreeBSD 12.2 with our HPE D6020 SAS JBOD arrays. Se attached tar.gz archive with the output from "sg_ses" -p 1, 2, 7 & 0xa and a "sesutil show".
Well, sort of. "sesutil locate da9" + "sesutil locate da11" seems to have activated the LEDs for the drives (not verified in real life that it actually is the right one lit up). But see the first line ({"Name":"Drive bay"}) that
probably shouldn't be there...
ses1: <HPE D6020 2.74>; ID: 5001438030897600
Desc Dev Model Ident Size/Status
{"Name":"Drive bay"} - - - OK, LED=locate
{"Name":"DriveBay1"} da0 HP MB010000JWAYK 7PH8L88G 10T
{"Name":"DriveBay2"} da1 HP MB010000JWAYK 7PH81MUG 10T
{"Name":"DriveBay3"} da2 HP MB010000JWAYK 7PH8LXMG 10T
{"Name":"DriveBay4"} da3 HP MB010000JWAYK 7PH8N26G 10T
{"Name":"DriveBay5"} da4 HP MB010000JWAYK 7PH93ZWG 10T
{"Name":"DriveBay6"} da5 HP MB010000JWAYK 7PH8LEVG 10T
{"Name":"DriveBay7"} da6 HP MB010000JWAYK 7PH8MYKG 10T
{"Name":"DriveBay8"} da7 HP MB010000JWAYK 7PH8MXRG 10T
{"Name":"DriveBay9"} da8 HP MB010000JWAYK 7PH4TB1G 10T
{"Name":"DriveBay10"} da9 HP MB010000JWAYK 7PH8G8XG 10T, LED=locate
{"Name":"DriveBay11"} da10 HP MB010000JWAYK 7PH9SP9G 10T
{"Name":"DriveBay12"} da11 HP MB010000JWAYK 7PH8LARG 10T, LED=locate
{"Name":"DriveBay13"} da12 HP MB010000JWAYK 7PH8KRYG 10T
{"Name":"DriveBay14"} da13 HP MB010000JWAYK 7PH1K7XG 10T
Created attachment 223202 [details]
Naïve patch
I'm posting this naïve patch to hopefully get a discussion going around what sort of workaround would be acceptable for the maintainers.
The problem is indeed that HP does not set the first EIIOE bit, and while the best solution would've been HP fixing it in firmware, that's not going to happen - certainly not considering the HW this affects is outside of support. It would be neat if maintainers could state what sort of workaround would be acceptable for inclusion - if any at all.
I've been running this for around a week, and it makes all the bays occur in sesutil show, with sesutil locate now not being off by one.
|
