Bug 231432

Summary: mfi 9420 no longer works on HEAD
Product: Base System Reporter: mike
Component: kernAssignee: freebsd-bugs (Nobody) <bugs>
Status: New ---    
Severity: Affects Only Me CC: emaste
Priority: --- Keywords: regression
Version: CURRENT   
Hardware: Any   
OS: Any   

Description mike 2018-09-17 14:50:54 UTC 
While trying to upgrade a RELENG11 box to 12.0 ALPHA5, I had to backout the change as disks off an 9420 controller no longer work.  The kernel would not boot as it would hang on timeouts.  The same behaviour was seen on the onboard  LSI 3108 MegaRAID on a SuperMicro MB SYS-7048R-C1RT4+


dmesg snippet from zoo (the SuperMicro SYS-7048R-C1RT4+)


pci1: <ACPI PCI bus> on pcib1
pci1: <dasp, performance counters> at device 8.2 (no driver attached)
pci1: <dasp, performance counters> at device 9.2 (no driver attached)
pci1: <dasp, performance counters> at device 11.1 (no driver attached)
pci1: <dasp, performance counters> at device 11.2 (no driver attached)
pci1: <dasp, performance counters> at device 16.1 (no driver attached)
pci1: <dasp, performance counters> at device 16.6 (no driver attached)
pci1: <dasp, performance counters> at device 18.1 (no driver attached)
pci1: <dasp, performance counters> at device 18.5 (no driver attached)
acpi_syscontainer0: <System Container> on acpi0
acpi_syscontainer1: <System Container> on acpi0
acpi_syscontainer2: <System Container> on acpi0
acpi_syscontainer3: <System Container> on acpi0
pcib2: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci2
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 06.712.04.00-fbsd
mfi0: <Invader> port 0x6000-0x60ff mem 0xc7300000-0xc730ffff,0xc7200000-0xc72fffff irq 26 at device 0.0 numa-domain 0 on pci3
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23 
mfi0: FW MaxCmds = 928, limiting to 128
mfi0: MaxCmd = 928, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c03a0
mfi0: 1309 (589112779s/0x0020/info) - Shutdown command received from host
mfi0: 1310 (boot + 8s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/0809/15d9)
mfi0: 1311 (boot + 8s/0x0020/info) - Firmware version 4.210.10-2910
mfi0: 1312 (boot + 10s/0x0020/info) - Package version 24.1.1-0001
mfi0: 1313 (boot + 10s/0x0020/info) - Board Revision 
mfi0: 1314 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6)
mfi0: 1315 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=4433221106000000,0000000000000000
mfi0: 1316 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7)
pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.0 numa-domain 0 on pci2
mfi0: 1317 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7) Info: enclPd=fc, scsiType=0, portMap=01, sasAddr=4433221107000000,0000000000000000
mfi0: 1318 (boot + 34s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 3a 38 60 2f 00 00 01 00, Sense: 6/29/00
mfi0: 1319 (boot + 34s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 3a 38 60 2f 00 00 01 00, Spci4: <ACPI PCI bus> numa-domain 0 on pcib4
ense: 6/29/00
mfi0: 1320 (590245504s/0x0020/info) - Time established as 09/14/18 13:05:04; (37 seconds since power on)
mfi0: 1321 (590245504s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 2e 00 3a 38 3d fb 00 00 01 00, Sense: 6/29/00
mfi0: 1322 (590245505s/0x0020/WARN) - Patrol Read can't be started, as PDs are either not ONLINE, or are in a VD with an active process, or are in an excluded VD
nvme0: <DC P3700 SSD> mem 0xc7410000-0xc7413fff irq 32 at device 0.0 numa-domain 0 on pci4
pcib5: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci2
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x5020-0x503f mem 0xc5c00000-0xc5dfffff,0xc5e04000-0xc5e07fff irq 40 at device 0.0 numa-domain 0 on pci5
ix0: using 2048 tx descriptors and 2048 rx descriptors
ix0: msix_init qsets capped at 16
ix0: pxm cpus: 10 queue msgs: 63 admincnt: 1
ix0: using 10 rx queues 10 tx queues 
ix0: Using MSIX interrupts with 11 vectors
ix0: allocated for 10 queues
ix0: allocated for 10 rx queues
ix0: Ethernet address: 0c:c4:7a:1f:2f:a0
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix0: netmap queues/slots: TX 10/2048, RX 10/2048
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x5000-0x501f mem 0xc5a00000-0xc5bfffff,0xc5e00000-0xc5e03fff irq 44 at device 0.1 numa-domain 0 on pci5
ix1: using 2048 tx descriptors and 2048 rx descriptors
ix1: msix_init qsets capped at 16
ix1: pxm cpus: 10 queue msgs: 63 admincnt: 1
ix1: using 10 rx queues 10 tx queues 
ix1: Using MSIX interrupts with 11 vectors
ix1: allocated for 10 queues
ix1: allocated for 10 rx queues
ix1: Ethernet address: 0c:c4:7a:1f:2f:a1
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: netmap queues/slots: TX 10/2048, RX 10/2048
pcib6: <ACPI PCI-PCI bridge> irq 40 at device 3.2 numa-domain 0 on pci2
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x4020-0x403f mem 0xc5600000-0xc57fffff,0xc5804000-0xc5807fff irq 42 at device 0.0 numa-domain 0 on pci6
ix2: using 2048 tx descriptors and 2048 rx descriptors
ix2: msix_init qsets capped at 16
ix2: pxm cpus: 10 queue msgs: 63 admincnt: 1
ix2: using 10 rx queues 10 tx queues 
ix2: Using MSIX interrupts with 11 vectors
ix2: allocated for 10 queues
ix2: allocated for 10 rx queues
ix2: Ethernet address: 0c:c4:7a:1f:2f:a2
ix2: PCI Express Bus: Speed 5.0GT/s Width x8
ix2: netmap queues/slots: TX 10/2048, RX 10/2048
ix3: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x4000-0x401f mem 0xc5400000-0xc55fffff,0xc5800000-0xc5803fff irq 45 at device 0.1 numa-domain 0 on pci6
ix3: using 2048 tx descriptors and 2048 rx descriptors
ix3: msix_init qsets capped at 16
ix3: pxm cpus: 10 queue msgs: 63 admincnt: 1
ix3: using 10 rx queues 10 tx queues 
ix3: Using MSIX interrupts with 11 vectors
ix3: allocated for 10 queues
ix3: allocated for 10 rx queues
ix3: Ethernet address: 0c:c4:7a:1f:2f:a3
ix3: PCI Express Bus: Speed 5.0GT/s Width x8
ix3: netmap queues/slots: TX 10/2048, RX 10/2048
pci2: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Wellsburg AHCI SATA controller> port 0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f mem 0xc7538000-0xc75387ff irq 16 at device 17.4 numa-domain 0 on pci2
ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <Intel Wellsburg USB 3.0 controller> mem 0xc7500000-0xc750ffff irq 19 at device 20.0 numa-domain 0 on pci2
xhci0: 32 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci2: <simple comms> at device 22.0 (no driver attached)
pci2: <simple comms> at device 22.1 (no driver attached)
ehci0: <Intel Wellsburg USB 2.0 controller> mem 0xc7534000-0xc75343ff irq 18 at device 26.0 numa-domain 0 on pci2
usbus1: EHCI version 1.0
usbus1 numa-domain 0 on ehci0
usbus1: 480Mbps High Speed USB v2.0
pcib7: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci2
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
pcib8: <ACPI PCI-PCI bridge> irq 16 at device 28.4 numa-domain 0 on pci2
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 0.0 numa-domain 0 on pci8
pci9: <ACPI PCI bus> numa-domain 0 on pcib9
vgapci0: <VGA-compatible display> port 0x3000-0x307f mem 0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 numa-domain 0 on pci9
vgapci0: Boot video device
ehci1: <Intel Wellsburg USB 2.0 controller> mem 0xc7533000-0xc75333ff irq 18 at device 29.0 numa-domain 0 on pci2
usbus2: EHCI version 1.0
usbus2 numa-domain 0 on ehci1
usbus2: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci2
isa0: <ISA bus> numa-domain 0 on isab0
ahci1: <Intel Wellsburg AHCI SATA controller> port 0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f mem 0xc7532000-0xc75327ff irq 16 at device 31.2 numa-domain 0 on pci2
ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
pcib10: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pci10: <ACPI PCI bus> numa-domain 1 on pcib10
pcib11: <ACPI PCI-PCI bridge> irq 56 at device 2.0 numa-domain 1 on pci10
pci11: <ACPI PCI bus> numa-domain 1 on pcib11
ix4: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0xf020-0xf03f mem 0xfbc80000-0xfbcfffff,0xfbd04000-0xfbd07fff irq 56 at device 0.0 numa-domain 1 on pci11
ix4: using 2048 tx descriptors and 2048 rx descriptors
ix4: msix_init qsets capped at 16
ix4: pxm cpus: 10 queue msgs: 63 admincnt: 1
ix4: using 10 rx queues 10 tx queues 
ix4: Using MSIX interrupts with 11 vectors
ix4: allocated for 10 queues
ix4: allocated for 10 rx queues
ix4: Ethernet address: 00:1b:21:47:3b:24
ix4: PCI Express Bus: Speed 5.0GT/s Width x8
ix4: netmap queues/slots: TX 10/2048, RX 10/2048
ix5: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0xf000-0xf01f mem 0xfbc00000-0xfbc7ffff,0xfbd00000-0xfbd03fff irq 60 at device 0.1 numa-domain 1 on pci11
ix5: using 2048 tx descriptors and 2048 rx descriptors
ix5: msix_init qsets capped at 16
ix5: pxm cpus: 10 queue msgs: 63 admincnt: 1
ix5: using 10 rx queues 10 tx queues 
ix5: Using MSIX interrupts with 11 vectors
ix5: allocated for 10 queues
ix5: allocated for 10 rx queues
ix5: Ethernet address: 00:1b:21:47:3b:25
ix5: PCI Express Bus: Speed 5.0GT/s Width x8
ix5: netmap queues/slots: TX 10/2048, RX 10/2048
pcib12: <ACPI PCI-PCI bridge> irq 64 at device 3.0 numa-domain 1 on pci10
pci12: <ACPI PCI bus> numa-domain 1 on pcib12
em0: <Intel(R) PRO/1000 Network Connection> port 0xe000-0xe01f mem 0xfbec0000-0xfbedffff,0xfbe00000-0xfbe7ffff,0xfbee0000-0xfbee3fff irq 64 at device 0.0 numa-domain 1 on pci12
em0: attach_pre capping queues at 2
Current cap: 0x460b
em0: using 1024 tx descriptors and 1024 rx descriptors
em0: msix_init qsets capped at 2
em0: pxm cpus: 10 queue msgs: 4 admincnt: 1
em0: using 2 rx queues 2 tx queues 
em0: Using MSIX interrupts with 3 vectors
em0: allocated for 2 tx_queues
em0: allocated for 2 rx_queues
em0: Ethernet address: 68:05:ca:06:ee:3e
em0: netmap queues/slots: TX 2/1024, RX 2/1024
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (115200,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcf7ff,0xcf800-0xd07ff,0xd0800-0xd17ff pnpid ORM0000 on isa0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ugen0.1: <0x8086 XHCI root HUB> at usbus0
ugen2.1: <Intel EHCI root HUB> at usbus2
ugen1.1: <Intel EHCI root HUB> at usbus1
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
mfid0 numa-domain 0 on mfi0
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD3003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada0: Serial Number WD-WCC137TALF5K
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 2861588MB (5860533168 512 byte sectors)
ada0: quirks=0x1<4K>
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD3003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada1: Serial Number WD-WCC134FU4DRY
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 2861588MB (5860533168 512 byte sectors)
ada1: quirks=0x1<4K>
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <WDC WD3003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada2: Serial Number WD-WCC137TALKU5
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 2861588MB (5860533168 512 byte sectors)
ada2: quirks=0x1<4K>
mfid0: 476416MB (975699968 sectors) RAID volume 'SSD1' is optimal
ada3 at ahcich4 bus 0 scbus5 target 0 lun 0
ada3: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada3: Serial Number WD-WCC5D2UU1U3Y
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 3815447MB (7814037168 512 byte sectors)
ada3: quirks=0x1<4K>
mfid1 numa-domain 0 on mfi0
mfid1: 476416MB (975699968 sectors) RAID volume 'SSD2' is optimal
ada4 at ahcich5 bus 0 scbus6 target 0 lun 0
ada4: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada4: Serial Number WD-WCC5D2UU1SF9
ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 3815447MB (7814037168 512 byte sectors)
ada4: quirks=0x1<4K>
ada5 at ahcich6 bus 0 scbus7 target 0 lun 0
ada5: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada5: Serial Number WD-WCC5D2UU18NK
ada5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 3815447MB (7814037168 512 byte sectors)
ada5: quirks=0x1<4K>
ada6 at ahcich7 bus 0 scbus8 target 0 lun 0
ada6: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada6: Serial Number WD-WCC5D2UU1N29
ada6: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada6: Command Queueing enabled
ada6: 3815447MB (7814037168 512 byte sectors)
ada6: quirks=0x1<4K>
ses0 at ahciem0 bus 0 scbus4 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
nvd0: <INTEL SSDPEDMD800G4> NVMe namespace
nvd0: 763097MB (1562824368 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0: 21 ports with 21 removable, self powered
ugen1.2: <vendor 0x8087 product 0x800a> at usbus1
uhub3 numa-domain 0 on uhub2
uhub3: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> on usbus1
ugen2.2: <vendor 0x8087 product 0x8002> at usbus2
uhub4 numa-domain 0 on uhub1
uhub4: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> on usbus2
uhub3: 6 ports with 6 removable, self powered
uhub4: 8 ports with 8 removable, self powered
ugen0.2: <vendor 0x04d9 product 0x1400> at usbus0
ukbd0 numa-domain 0 on uhub0
ukbd0: <vendor 0x04d9 product 0x1400, class 0/0, rev 1.10/1.43, addr 1> on usbus0
kbd2 at ukbd0
ugen0.3: <FTDI USB FAST SERIAL ADAPTER> at usbus0
ugen0.4: <vendor 0x0557 product 0x7000> at usbus0
uhub5 numa-domain 0 on uhub0
uhub5: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3> on usbus0
uhub5: 4 ports with 3 removable, self powered
ugen0.5: <vendor 0x0557 product 0x2419> at usbus0
ukbd1 numa-domain 0 on uhub5
ukbd1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
kbd3 at ukbd1
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 54 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 84 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 117 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 147 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 177 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 207 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 240 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 271 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 301 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 332 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 362 SECONDS
mfi0: COMMAND 0xfffffe017c17aec0 TIMEOUT AFTER 393 SECONDS

vs  RELENG11

pcib2: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pcib2: _OSC returned error 0x10
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci2
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 06.712.04.00-fbsd
mfi0: <Invader> port 0x6000-0x60ff mem 0xc7300000-0xc730ffff,0xc7200000-0xc72fffff irq 26 at device 0.0 numa-domain 0 on pci3
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23 
mfi0: FW MaxCmds = 928, limiting to 128
mfi0: MaxCmd = 928, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c03a0
mfi0: 1309 (589112779s/0x0020/info) - Shutdown command received from host
mfi0: 1310 (boot + 8s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/0809/15d9)
mfi0: 1311 (boot + 8s/0x0020/info) - Firmware version 4.210.10-2910
mfi0: 1312 (boot + 10s/0x0020/info) - Package version 24.1.1-0001
mfi0: 1313 (boot + 10s/0x0020/info) - Board Revision 
mfi0: 1314 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6)
mfi0: 1315 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=4433221106000000,0000000000000000
mfi0: 1316 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7)
mfi0: 1317 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7) Info: enclPd=fc, scsiType=0, portMap=01, sasAddr=4433221107000000,0000000000000000
mfi0: 1318 (boot + 34s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 3a 38 60 2f 00 00 01 00, Sense: 6/29/00
mfi0: pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.0 numa-domain 0 on pci2
1319 (boot + 34s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 3a 38 60 2f 00 00 01 00, Sense: 6/29/00
mfi0: 1320 (590245504s/0x0020/info) - Time established as 09/14/18 13:05:04; (37 seconds since power on)
mfi0: 1321 (590245504s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 2e 00 3a 38 3d fb 00 00 01 00, Spci4: <ACPI PCI bus> numa-domain 0 on pcib4
ense: 6/29/00
mfi0: 1322 (590245505s/0x0020/WARN) - Patrol Read can't be started, as PDs are either not ONLINE, or are in a VD with an active process, or are in an excluded VD
mfi0: 1323 (boot + 8s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/0809/15d9)
mfi0: 1324 (boot + 8s/0x0020/info) - Firmware version 4.210.10-2910
mfi0: 1325 (boot + 11s/0x0020/info) - Package version 24.1.1-0001
mfi0: 1326 (boot + 11s/0x0020/info) - Board Revision 
mfi0: 1327 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6)
mfi0: 1328 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=4433221106000000,0000000000000000
mfi0: 1329 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7)
mfi0: 1330 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7) Info: enclPd=fc, scsiType=0, portMap=01, sasAddr=4433221107000000,0000000000000000
nvme0: <DC P3700 SSD> mem 0xc7410000-0xc7413fff irq 32 at device 0.0 numa-domain 0 on pci4
mfi0: 1331 (590246103s/0x0020/info) - Time established as 09/14/18 13:15:03; (36 seconds since power on)
mfi0: 1332 (590246113s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1333 (590246113s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1334 (590246113s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1335 (590246113s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1336 (boot + 8s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/0809/15d9)
mfi0: 1337 (boot + 8s/0x0020/info) - Firmware version 4.210.10-2910
mfi0: 1338 (boot + 11s/0x0020/info) - Package version 24.1.1-0001
mfi0: 1339 (boot + 11s/0x0020/info) - Board Revision 
mfi0: 1340 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6)
mfi0: 1341 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=4433221106000000,0000000000000000
mfi0: 1342 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7)
mfi0: 1343 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7) Info: enclPd=fc, scsiType=0, portMap=01, sasAddr=4433221107000000,0000000000000000
mfi0: 1344 (590246486s/0x0020/info) - Time established as 09/14/18 13:21:26; (36 seconds since power on)
mfi0: 1345 (590246496s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1346 (590246496s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1347 (590246496s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1348 (590246496s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1349 (boot + 8s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/0809/15d9)
mfi0: 1350 (boot + 8s/0x0020/info) - Firmware version 4.210.10-2910
mfi0: 1351 (boot + 11s/0x0020/info) - Package version 24.1.1-0001
mfi0: 1352 (boot + 11s/0x0020/info) - Board Revision 
mfi0: 1353 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6)
mfi0: 1354 (boot + 33s/0x0002/info) - Inserted: PD 10(e0xfc/s6) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=4433221106000000,0000000000000000
mfi0: 1355 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7)
mfi0: 1356 (boot + 33s/0x0002/info) - Inserted: PD 11(e0xfc/s7) Info: enclPd=fc, scsiType=0, portMap=01, sasAddr=4433221107000000,0000000000000000
mfi0: 1357 (590246746s/0x0020/info) - Time established as 09/14/18 13:25:46; (36 seconds since power on)
mfi0: 1358 (590246756s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1359 (590246756s/0x0002/info) - Unexpected sense: PD 10(e0xfc/s6) Path 4433221106000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1360 (590246756s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
mfi0: 1361 (590246756s/0x0002/info) - Unexpected sense: PD 11(e0xfc/s7) Path 4433221107000000, CDB: 28 00 00 00 00 00 00 00 01 00, Sense: 6/29/00
pcib5: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci2
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x5020-0x503f mem 0xc5c00000-0xc5dfffff,0xc5e04000-0xc5e07fff irq 40 at device 0.0 numa-domain 0 on pci5
ix0: Using MSI-X interrupts with 9 vectors
ix0: Ethernet address: 0c:c4:7a:1f:2f:a0
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix0: netmap queues/slots: TX 8/2048, RX 8/2048
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x5000-0x501f mem 0xc5a00000-0xc5bfffff,0xc5e00000-0xc5e03fff irq 44 at device 0.1 numa-domain 0 on pci5
ix1: Using MSI-X interrupts with 9 vectors
ix1: Ethernet address: 0c:c4:7a:1f:2f:a1
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: netmap queues/slots: TX 8/2048, RX 8/2048
pcib6: <ACPI PCI-PCI bridge> irq 40 at device 3.2 numa-domain 0 on pci2
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x4020-0x403f mem 0xc5600000-0xc57fffff,0xc5804000-0xc5807fff irq 42 at device 0.0 numa-domain 0 on pci6
ix2: Using MSI-X interrupts with 9 vectors
ix2: Ethernet address: 0c:c4:7a:1f:2f:a2
ix2: PCI Express Bus: Speed 5.0GT/s Width x8
ix2: netmap queues/slots: TX 8/2048, RX 8/2048
ix3: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x4000-0x401f mem 0xc5400000-0xc55fffff,0xc5800000-0xc5803fff irq 45 at device 0.1 numa-domain 0 on pci6
ix3: Using MSI-X interrupts with 9 vectors
ix3: Ethernet address: 0c:c4:7a:1f:2f:a3
ix3: PCI Express Bus: Speed 5.0GT/s Width x8
ix3: netmap queues/slots: TX 8/2048, RX 8/2048
pci2: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Wellsburg AHCI SATA controller> port 0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f mem 0xc7538000-0xc75387ff irq 16 at device 17.4 numa-domain 0 on pci2
ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <Intel Wellsburg USB 3.0 controller> mem 0xc7500000-0xc750ffff irq 19 at device 20.0 numa-domain 0 on pci2
xhci0: 32 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci2: <simple comms> at device 22.0 (no driver attached)
pci2: <simple comms> at device 22.1 (no driver attached)
ehci0: <Intel Wellsburg USB 2.0 controller> mem 0xc7534000-0xc75343ff irq 18 at device 26.0 numa-domain 0 on pci2
usbus1: EHCI version 1.0
usbus1 numa-domain 0 on ehci0
usbus1: 480Mbps High Speed USB v2.0
pcib7: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci2
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
pcib8: <ACPI PCI-PCI bridge> irq 16 at device 28.4 numa-domain 0 on pci2
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 0.0 numa-domain 0 on pci8
pci9: <ACPI PCI bus> numa-domain 0 on pcib9
vgapci0: <VGA-compatible display> port 0x3000-0x307f mem 0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 numa-domain 0 on pci9
vgapci0: Boot video device
ehci1: <Intel Wellsburg USB 2.0 controller> mem 0xc7533000-0xc75333ff irq 18 at device 29.0 numa-domain 0 on pci2
usbus2: EHCI version 1.0
usbus2 numa-domain 0 on ehci1
usbus2: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci2
isa0: <ISA bus> numa-domain 0 on isab0
ahci1: <Intel Wellsburg AHCI SATA controller> port 0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f mem 0xc7532000-0xc75327ff irq 16 at device 31.2 numa-domain 0 on pci2
ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
pcib10: <ACPI Host-PCI bridge> numa-domain 1 on acpi0
pcib10: _OSC returned error 0x10
pci10: <ACPI PCI bus> numa-domain 1 on pcib10
pcib11: <ACPI PCI-PCI bridge> irq 56 at device 2.0 numa-domain 1 on pci10
pci11: <ACPI PCI bus> numa-domain 1 on pcib11
ix4: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xf020-0xf03f mem 0xfbc80000-0xfbcfffff,0xfbd04000-0xfbd07fff irq 56 at device 0.0 numa-domain 1 on pci11
ix4: Using MSI-X interrupts with 9 vectors
ix4: Ethernet address: 00:1b:21:47:3b:24
ix4: PCI Express Bus: Speed 5.0GT/s Width x8
ix4: netmap queues/slots: TX 8/2048, RX 8/2048
ix5: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xf000-0xf01f mem 0xfbc00000-0xfbc7ffff,0xfbd00000-0xfbd03fff irq 60 at device 0.1 numa-domain 1 on pci11
ix5: Using MSI-X interrupts with 9 vectors
ix5: Ethernet address: 00:1b:21:47:3b:25
ix5: PCI Express Bus: Speed 5.0GT/s Width x8
ix5: netmap queues/slots: TX 8/2048, RX 8/2048
pcib12: <ACPI PCI-PCI bridge> irq 64 at device 3.0 numa-domain 1 on pci10
pci12: <ACPI PCI bus> numa-domain 1 on pcib12
em0: <Intel(R) PRO/1000 Network Connection 7.6.1-k> port 0xe000-0xe01f mem 0xfbec0000-0xfbedffff,0xfbe00000-0xfbe7ffff,0xfbee0000-0xfbee3fff irq 64 at device 0.0 numa-domain 1 on pci12
em0: Using MSIX interrupts with 3 vectors
em0: Ethernet address: 68:05:ca:06:ee:3e
em0: netmap queues/slots: TX 1/1024, RX 1/1024
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (115200,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcf7ff,0xcf800-0xd07ff,0xd0800-0xd17ff on isa0
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
est8: <Enhanced SpeedStep Frequency Control> on cpu8
p4tcc8: <CPU Frequency Thermal Control> on cpu8
est9: <Enhanced SpeedStep Frequency Control> on cpu9
p4tcc9: <CPU Frequency Thermal Control> on cpu9
est10: <Enhanced SpeedStep Frequency Control> on cpu10
p4tcc10: <CPU Frequency Thermal Control> on cpu10
est11: <Enhanced SpeedStep Frequency Control> on cpu11
p4tcc11: <CPU Frequency Thermal Control> on cpu11
est12: <Enhanced SpeedStep Frequency Control> on cpu12
p4tcc12: <CPU Frequency Thermal Control> on cpu12
est13: <Enhanced SpeedStep Frequency Control> on cpu13
p4tcc13: <CPU Frequency Thermal Control> on cpu13
est14: <Enhanced SpeedStep Frequency Control> on cpu14
p4tcc14: <CPU Frequency Thermal Control> on cpu14
est15: <Enhanced SpeedStep Frequency Control> on cpu15
p4tcc15: <CPU Frequency Thermal Control> on cpu15
est16: <Enhanced SpeedStep Frequency Control> on cpu16
p4tcc16: <CPU Frequency Thermal Control> on cpu16
est17: <Enhanced SpeedStep Frequency Control> on cpu17
p4tcc17: <CPU Frequency Thermal Control> on cpu17
est18: <Enhanced SpeedStep Frequency Control> on cpu18
p4tcc18: <CPU Frequency Thermal Control> on cpu18
est19: <Enhanced SpeedStep Frequency Control> on cpu19
p4tcc19: <CPU Frequency Thermal Control> on cpu19
est20: <Enhanced SpeedStep Frequency Control> on cpu20
p4tcc20: <CPU Frequency Thermal Control> on cpu20
est21: <Enhanced SpeedStep Frequency Control> on cpu21
p4tcc21: <CPU Frequency Thermal Control> on cpu21
est22: <Enhanced SpeedStep Frequency Control> on cpu22
p4tcc22: <CPU Frequency Thermal Control> on cpu22
est23: <Enhanced SpeedStep Frequency Control> on cpu23
p4tcc23: <CPU Frequency Thermal Control> on cpu23
est24: <Enhanced SpeedStep Frequency Control> on cpu24
p4tcc24: <CPU Frequency Thermal Control> on cpu24
est25: <Enhanced SpeedStep Frequency Control> on cpu25
p4tcc25: <CPU Frequency Thermal Control> on cpu25
est26: <Enhanced SpeedStep Frequency Control> on cpu26
p4tcc26: <CPU Frequency Thermal Control> on cpu26
est27: <Enhanced SpeedStep Frequency Control> on cpu27
p4tcc27: <CPU Frequency Thermal Control> on cpu27
est28: <Enhanced SpeedStep Frequency Control> on cpu28
p4tcc28: <CPU Frequency Thermal Control> on cpu28
est29: <Enhanced SpeedStep Frequency Control> on cpu29
p4tcc29: <CPU Frequency Thermal Control> on cpu29
est30: <Enhanced SpeedStep Frequency Control> on cpu30
p4tcc30: <CPU Frequency Thermal Control> on cpu30
est31: <Enhanced SpeedStep Frequency Control> on cpu31
p4tcc31: <CPU Frequency Thermal Control> on cpu31
est32: <Enhanced SpeedStep Frequency Control> on cpu32
p4tcc32: <CPU Frequency Thermal Control> on cpu32
est33: <Enhanced SpeedStep Frequency Control> on cpu33
p4tcc33: <CPU Frequency Thermal Control> on cpu33
est34: <Enhanced SpeedStep Frequency Control> on cpu34
p4tcc34: <CPU Frequency Thermal Control> on cpu34
est35: <Enhanced SpeedStep Frequency Control> on cpu35
p4tcc35: <CPU Frequency Thermal Control> on cpu35
est36: <Enhanced SpeedStep Frequency Control> on cpu36
p4tcc36: <CPU Frequency Thermal Control> on cpu36
est37: <Enhanced SpeedStep Frequency Control> on cpu37
p4tcc37: <CPU Frequency Thermal Control> on cpu37
est38: <Enhanced SpeedStep Frequency Control> on cpu38
p4tcc38: <CPU Frequency Thermal Control> on cpu38
est39: <Enhanced SpeedStep Frequency Control> on cpu39
p4tcc39: <CPU Frequency Thermal Control> on cpu39
random: unblocking device.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen2.1: <Intel EHCI root HUB> at usbus2
ugen0.1: <0x8086 XHCI root HUB> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD3003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada0: Serial Number WD-WCC137TALF5K
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 2861588MB (5860533168 512 byte sectors)
ada0: quirks=0x1<4K>
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD3003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada1: Serial Number WD-WCC134FU4DRY
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 2861588MB (5860533168 512 byte sectors)
ada1: quirks=0x1<4K>
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <WDC WD3003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada2: Serial Number WD-WCC137TALKU5
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 2861588MB (5860533168 512 byte sectors)
ada2: quirks=0x1<4K>
ada3 at ahcich4 bus 0 scbus5 target 0 lun 0
ada3: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada3: Serial Number WD-WCC5D2UU1U3Y
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 3815447MB (7814037168 512 byte sectors)
mfid0 numa-domain 0 on mfi0
ada3: quirks=0x1<4K>
ada4 at ahcich5 bus 0 scbus6 target 0 lun 0
ada4: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada4: Serial Number WD-WCC5D2UU1SF9
ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
mfid0: 476416MB (975699968 sectors) RAID volume 'SSD1' is optimal
ada4: 3815447MB (7814037168 512 byte sectors)
ada4: quirks=0x1<4K>
ada5 at ahcich6 bus 0 scbus7 target 0 lun 0
ada5: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada5: Serial Number WD-WCC5D2UU18NK
ada5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytesmfid1 numa-domain 0 on mfi0
mfid1: 476416MB (975699968 sectors) RAID volume 'SSD2' is optimal
)
ada5: Command Queueing enabled
ada5: 3815447MB (7814037168 512 byte sectors)
ada5: quirks=0x1<4K>
ada6 at ahcich7 bus 0 scbus8 target 0 lun 0
ada6: <WDC WD4003FZEX-00Z4SA0 01.01A01> ACS-2 ATA SATA 3.x device
ada6: Serial Number WD-WCC5D2UU1N29
ada6: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada6: Command Queueing enabled
ada6: 3815447MB (7814037168 512 byte sectors)
ada6: quirks=0x1<4K>
ses0 at ahciem0 bus 0 scbus4 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
nvd0: <INTEL SSDPEDMD800G4> NVMe namespace
nvd0: 763097MB (1562824368 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 21 ports with 21 removable, self powered
ugen1.2: <vendor 0x8087 product 0x800a> at usbus1
uhub3 numa-domain 0 on uhub0
uhub3: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> on usbus1
ugen2.2: <vendor 0x8087 product 0x8002> at usbus2
uhub4 numa-domain 0 on uhub1
uhub4: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> on usbus2
ugen0.2: <vendor 0x04d9 product 0x1400> at usbus0
ukbd0 numa-domain 0 on uhub2
ukbd0: <vendor 0x04d9 product 0x1400, class 0/0, rev 1.10/1.43, addr 1> on usbus0
kbd2 at ukbd0
uhub3: 6 ports with 6 removable, self powered
uhub4: 8 ports with 8 removable, self powered
ugen0.3: <FTDI USB FAST SERIAL ADAPTER> at usbus0
ugen0.4: <vendor 0x0557 product 0x7000> at usbus0
uhub5 numa-domain 0 on uhub2
uhub5: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3> on usbus0
uhub5: 4 ports with 3 removable, self powered
Root mount waiting for: usbus0
ugen0.5: <vendor 0x0557 product 0x2419> at usbus0
ukbd1 numa-domain 0 on uhub5
ukbd1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
kbd3 at ukbd1
Setting hostuuid: 7aad0660-b83f-11dc-b276-10bf48ba3275.
Setting hostid: 0x31c65a78.
No suitable dump device was found.
Entropy harvesting:/etc/rc: WARNING: $harvest_interrupt is not set properly - see rc.conf(5).
sysctl: unknown oid 'kern.random.sys.harvest.interrupt'
/etc/rc: WARNING: $harvest_ethernet is not set properly - see rc.conf(5).
sysctl: unknown oid 'kern.random.sys.harvest.ethernet'
/etc/rc: WARNING: $harvest_p_to_p is not set properly - see rc.conf(5).
sysctl: unknown oid 'kern.random.sys.harvest.point_to_point'
/etc/rc: WARNING: $harvest_swi is not set properly - see rc.conf(5).
sysctl: unknown oid 'kern.random.sys.harvest.swi'
.
swapon: /dev/gpt/swap0: No such file or directory
swapon: /dev/gpt/swap1: No such file or directory
Starting file system checks:
Mounting local filesystems:.
Mounting ZFS filesystems: (36/78)(78/78)
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE
32-bit compatibility ldconfig path: /usr/lib32
Setting hostname: zoo.freebsd.org.
Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Feeding entropy: .
lo0: link state changed to UP
/etc/rc: WARNING: $ipv6_ifconfig_em0 is obsolete.   Use ifconfig_em0_ipv6 instead.
Starting Network: lo0 ix0 ix1 ix2 ix3 ix4 ix5 em0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8 
	inet 127.0.0.1 netmask 0xff000000 
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	groups: lo 
ix0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 0c:c4:7a:1f:2f:a0
	hwaddr 0c:c4:7a:1f:2f:a0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ix1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 0c:c4:7a:1f:2f:a1
	hwaddr 0c:c4:7a:1f:2f:a1
	inet 192.168.5.1 netmask 0xffffff00 broadcast 192.168.5.255 
	inet 192.168.7.1 netmask 0xffffff00 broadcast 192.168.7.255 
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ix2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 0c:c4:7a:1f:2f:a2
	hwaddr 0c:c4:7a:1f:2f:a2
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ix3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 0c:c4:7a:1f:2f:a3
	hwaddr 0c:c4:7a:1f:2f:a3
	inet 192.168.8.1 netmask 0xffffff00 broadcast 192.168.8.255 
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ix4: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:1b:21:47:3b:24
	hwaddr 00:1b:21:47:3b:24
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ix5: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:1b:21:47:3b:25
	hwaddr 00:1b:21:47:3b:25
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
	ether 68:05:ca:06:ee:3e
	hwaddr 68:05:ca:06:ee:3e
	inet 64.7.141.9 netmask 0xffffffe0 broadcast 64.7.141.31 
	inet6 fe80::6a05:caff:fe06:ee3e%em0 prefixlen 64 scopeid 0x7 
	inet6 2607:f3e0:0:2::4a1 prefixlen 64 
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
Starting devd.
Starting Network: ix0.
ix0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 0c:c4:7a:1f:2f:a0
	hwaddr 0c:c4:7a:1f:2f:a0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ix1: link state changed to UP
Starting Network: ix2.
ix2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 0c:c4:7a:1f:2f:a2
	hwaddr 0c:c4:7a:1f:2f:a2
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
em0: link state changed to UP
Starting Network: ix4.
ix4: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:1b:21:47:3b:24
	hwaddr 00:1b:21:47:3b:24
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
Starting Network: ix5.
ix5: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
	ether 00:1b:21:47:3b:25
	hwaddr 00:1b:21:47:3b:25
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
ums0 numa-domain 0 on uhub2
ums0: <vendor 0x04d9 product 0x1400, class 0/0, rev 1.10/1.43, addr 1> on usbus0
ums0: 5 buttons and [XYZ] coordinates ID=1
uftdi0 numa-domain 0 on uhub2
uftdi0: <USB FAST SERIAL ADAPTER> on usbus0
uftdi1 numa-domain 0 on uhub2
uftdi1: <USB FAST SERIAL ADAPTER> on usbus0
ums1 numa-domain 0 on uhub5
ums1: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
ums1: 3 buttons and [Z] coordinates ID=0
Starting pflog.
Enabling pfpflog0: promiscuous mode enabled
Sep 14 13:27:46 pflogd[983]: [priv]: msg PRIV_OPEN_LOG received
.
add host 127.0.0.1: gateway lo0 fib 0: route already in table
add net default: gateway 64.7.141.1
Additional inet routing options: gateway=YES.
add host ::1: gateway lo0 fib 0: route already in table
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
add net default: gateway 2607:f3e0:0:2::1
Additional inet6 routing options: gateway=YES.
Creating and/or trimming log files.
Starting syslogd.
ix3: link state changed to UP
Starting rpcbind.
NFS access cache time=60
Starting named.
Clearing /tmp (X related).
/etc/rc: WARNING: $ipxrouted_enable is not set properly - see rc.conf(5).
Starting mountd.
NFSv4 is disabled
Starting nfsd.
Starting statd.
Starting lockd.
Recovering vi editor sessions:.
Updating motd:.
Mounting late filesystems:.
Starting ntpd.
Writing entropy file:.
Writing early boot entropy file:.
Starting powerd.
Starting dhcpd.
Internet Systems Consortium DHCP Server 4.3.6
Copyright 2004-2017 Internet Systems Consortium.
All rights reserved.
For info, please visit https://www.isc.org/software/dhcp/
Config file: /usr/local/etc/dhcpd.conf
Database file: /var/db/dhcpd/dhcpd.leases
PID file: /var/run/dhcpd/dhcpd.pid
Wrote 0 deleted host decls to leases file.
Wrote 0 new dynamic host decls to leases file.
Wrote 98 leases to leases file.
Listening on BPF/ix1/0c:c4:7a:1f:2f:a1/192.168.5.0/24
Sending on   BPF/ix1/0c:c4:7a:1f:2f:a1/192.168.5.0/24
Sending on   Socket/fallback/fallback-net
Remounting user owned zfs filesystems
Starting conserver.
[Fri Sep 14 13:27:59 2018] conserver (1706): conserver.com version 8.2.1
[Fri Sep 14 13:27:59 2018] conserver (1706): started as `root' by `root'
[Fri Sep 14 13:27:59 2018] conserver (1706): daemonizing
Performing sanity check on sshd configuration.
Starting sshd.
Configuring vt: blanktime.
swapon: /dev/gpt/swap0: No such file or directory
swapon: /dev/gpt/swap1: No such file or directory
Starting sendmail_submit.
Sep 14 13:28:16 zoo ntpd[1281]: error resolving pool 0.freebsd.pool.ntp.org: hostname nor servname provided, or not known (8)
Starting sendmail_msp_queue.
Starting cron.
sysctl: unknown oid 'sysctl vfs.zfs.min_auto_ashift' at line 16
/etc/rc: WARNING: $mrouted_enable is not set properly - see rc.conf(5).
/etc/rc: WARNING: $kerberos5_server_enable is not set properly - see rc.conf(5).
Starting inetd.
Starting background file system checks in 60 seconds.

Fri Sep 14 13:28
FreeBSD/amd64 (zoo.freebsd.org) (ttyu0)