Bug 128514 - [zfs] [mpt] problems with ZFS and LSILogic SAS/SATA Adapter
Summary: [zfs] [mpt] problems with ZFS and LSILogic SAS/SATA Adapter
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: Unspecified
Hardware: Any Any
: Normal Affects Only Me
Assignee: freebsd-bugs (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-11-01 05:30 UTC by Novikov Eugene
Modified: 2017-12-31 22:35 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Novikov Eugene 2008-11-01 05:30:07 UTC
I have 2 Intel Servers.

The first:
bizon# dmesg
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.1-PRERELEASE #0: Mon Oct 27 08:06:49 VLAT 2008
    daddy@bizon.podryad.tv:/usr/obj/usr/src/sys/BIZON
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz (2339.15-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x10676  Stepping = 6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C                                                    MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xce3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,<                                                    b19>>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 4
usable memory = 4275474432 (4077 MB)
avail memory  = 4089028608 (3899 MB)
ACPI APIC Table: <INTEL  S5000PSL>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <INTEL S5000PSL> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
acpi_button0: <Sleep Button> on acpi0
acpi_button1: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xca2,0xca3,0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
pci4: <ACPI PCI bus> on pcib4
em0: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2020-0x203f mem 0xb8820                                                    000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 on pci4
em0: Using MSI interrupt
em0: [FILTER]
em0: Ethernet address: 00:15:17:55:7f:50
em1: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2000-0x201f mem 0xb8800                                                    000-0xb881ffff,0xb8000000-0xb83fffff irq 19 at device 0.1 on pci4
em1: Using MSI interrupt
em1: [FILTER]
em1: Ethernet address: 00:15:17:55:7f:51
pcib5: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci5: <ACPI PCI bus> on pcib5
pcib6: <PCI-PCI bridge> at device 3.0 on pci0
pci6: <PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pcib10: <PCI-PCI bridge> at device 7.0 on pci0
pci10: <PCI bus> on pcib10
pci0: <base peripheral> at device 8.0 (no driver attached)
pcib11: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci11: <ACPI PCI bus> on pcib11
uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x30a0-0x30bf irq                                                     23 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <Intel 631XESB/632XESB/3100 USB controller USB-1> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x3080-0x309f irq                                                     22 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <Intel 631XESB/632XESB/3100 USB controller USB-2> on uhci1
usb1: USB revision 1.0
uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x3060-0x307f irq                                                     23 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <Intel 631XESB/632XESB/3100 USB controller USB-3> on uhci2
usb2: USB revision 1.0
uhub2: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
uhci3: <Intel 631XESB/632XESB/3100 USB controller USB-4> port 0x3040-0x305f irq                                                     22 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
uhci3: [ITHREAD]
usb3: <Intel 631XESB/632XESB/3100 USB controller USB-4> on uhci3
usb3: USB revision 1.0
uhub3: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb3
uhub3: 2 ports with 2 removable, self powered
ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xb8b00400-0xb8b007ff irq 23 at de                                                    vice 29.7 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <Intel 63XXESB USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb4
uhub4: 8 ports with 8 removable, self powered
pcib12: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci12: <ACPI PCI bus> on pcib12
vgapci0: <VGA-compatible display> port 0x1000-0x10ff mem 0xb0000000-0xb7ffffff,0                                                    xb8a00000-0xb8a0ffff irq 17 at device 12.0 on pci12
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,                                                    0x376,0x30c0-0x30cf irq 20 at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <Intel AHCI controller> port 0x30d8-0x30df,0x30f4-0x30f7,0x30d0-0x30d7,                                                    0x30f0-0x30f3,0x3020-0x303f mem 0xb8b00000-0xb8b003ff irq 20 at device 31.2 on p                                                    ci0
atapci1: [ITHREAD]
atapci1: AHCI Version 01.10 controller with 6 ports detected
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci1
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci1
ata5: [ITHREAD]
ata6: <ATA channel 4> on atapci1
ata6: [ITHREAD]
ata7: <ATA channel 5> on atapci1
ata7: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model IntelliMouse, device ID 3
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
sio1: [FILTER]
cpu0: <ACPI CPU> on acpi0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1: <ACPI CPU> on acpi0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
cpu2: <ACPI CPU> on acpi0
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
cpu3: <ACPI CPU> on acpi0
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xc9000-0xcafff,0xcb000-0xcbfff                                                    ,0xcc000-0xccfff on isa0
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ad0: 58643MB <Maxtor 6Y060L0 YAR41BW0> at ata0-master UDMA100
ad4: 476940MB <Seagate ST3500630NS 3.AEK> at ata2-master SATA300
ad6: 476940MB <Seagate ST3500630NS 3.AEK> at ata3-master SATA300
ad8: 476940MB <Seagate ST3500630NS 3.AEK> at ata4-master SATA300
ad10: 476940MB <Seagate ST3500630NS 3.AEK> at ata5-master SATA300
ad12: 476940MB <Seagate ST3500630NS 3.AEK> at ata6-master SATA150
ad14: 476940MB <Seagate ST3500630NS 3.AEK> at ata7-master SATA300
lapic1: Forcing LINT1 to edge trigger
SMP: AP CPU #1 Launched!
lapic3: Forcing LINT1 to edge trigger
SMP: AP CPU #3 Launched!
lapic2: Forcing LINT1 to edge trigger
SMP: AP CPU #2 Launched!
Trying to mount root from ufs:/dev/ad0s1a
This module (opensolaris) contains code covered by the
Common Development and Distribution License (CDDL)
see http://opensolaris.org/os/licensing/opensolaris_license/
WARNING: ZFS is considered to be an experimental feature in FreeBSD.
ZFS filesystem version 6
ZFS storage pool version 6
em1: link state changed to UP
em0: link state changed to UP

Next lines are added to /boot/loader.
  
vm.kmem_size_max="1536M"
vm.kmem_size="1536M"

There is zfs.
bizon# zpool status
  pool: tank
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          raidz1    ONLINE       0     0     0
            ad14    ONLINE       0     0     0
            ad12    ONLINE       0     0     0
            ad10    ONLINE       0     0     0
            ad8     ONLINE       0     0     0
            ad6     ONLINE       0     0     0
            ad4     ONLINE       0     0     0

errors: No known data errors

bizon# zpool iostat -v
               capacity     operations    bandwidth
pool         used  avail   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
tank        2,13T   604G      0      0     55    559
  raidz1    2,13T   604G      0      0     55    559
    ad14        -      -      0      0    651    123
    ad12        -      -      0      0    677    112
    ad10        -      -      0      0    757    123
    ad8         -      -      0      0    731    114
    ad6         -      -      0      0    729    125
    ad4         -      -      0      0    808    116
----------  -----  -----  -----  -----  -----  -----

And there's no problem at all with zfs.

But second sever:
crocodile# dmesg
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.1-PRERELEASE #3: Wed Oct  8 12:32:37 VLAST 2008
    daddy@crocodile.podryad.tv:/usr/obj/usr/src/sys/CROC
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU           E5410  @ 2.33GHz (2339.15-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x10676  Stepping = 6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xce3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,<b19>>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 4
usable memory = 8569413632 (8172 MB)
avail memory  = 8256241664 (7873 MB)
ACPI APIC Table: <INTEL  S5000PSL>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
netsmb_dev: loaded
kqemu version 0x00010300
kqemu: KQEMU installed, max_locked_mem=4184284kB.
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <INTEL S5000PSL> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xca2,0xca3,0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 17 at device 1.0 on pci2
pci4: <ACPI PCI bus> on pcib4
mpt0: <LSILogic SAS/SATA Adapter> port 0x3000-0x30ff mem 0xb8910000-0xb8913fff,0xb8900000-0xb890ffff irq 17 at device 0.0 on pci4
mpt0: [ITHREAD]
mpt0: MPI Version=1.5.14.0
pcib5: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
pci5: <ACPI PCI bus> on pcib5
em0: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2020-0x203f mem 0xb8820000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 on pci5
em0: Using MSI interrupt
em0: [FILTER]
em0: Ethernet address: 00:15:17:65:78:c0
em1: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2000-0x201f mem 0xb8800000-0xb881ffff,0xb8000000-0xb83fffff irq 19 at device 0.1 on pci5
em1: Using MSI interrupt
em1: [FILTER]
em1: Ethernet address: 00:15:17:65:78:c1
pcib6: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci6: <ACPI PCI bus> on pcib6
pcib7: <PCI-PCI bridge> at device 3.0 on pci0
pci7: <PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci10: <ACPI PCI bus> on pcib10
pcib11: <PCI-PCI bridge> at device 7.0 on pci0
pci11: <PCI bus> on pcib11
pci0: <base peripheral> at device 8.0 (no driver attached)
pcib12: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci12: <ACPI PCI bus> on pcib12
uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x40a0-0x40bf irq 23 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <Intel 631XESB/632XESB/3100 USB controller USB-1> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x4080-0x409f irq 22 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <Intel 631XESB/632XESB/3100 USB controller USB-2> on uhci1
usb1: USB revision 1.0
uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x4060-0x407f irq 23 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <Intel 631XESB/632XESB/3100 USB controller USB-3> on uhci2
usb2: USB revision 1.0
uhub2: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
uhci3: <Intel 631XESB/632XESB/3100 USB controller USB-4> port 0x4040-0x405f irq 22 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
uhci3: [ITHREAD]
usb3: <Intel 631XESB/632XESB/3100 USB controller USB-4> on uhci3
usb3: USB revision 1.0
uhub3: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb3
uhub3: 2 ports with 2 removable, self powered
ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xb8c00400-0xb8c007ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <Intel 63XXESB USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb4
uhub4: 8 ports with 8 removable, self powered
pcib13: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci13: <ACPI PCI bus> on pcib13
vgapci0: <VGA-compatible display> port 0x1000-0x10ff mem 0xb0000000-0xb7ffffff,0xb8b00000-0xb8b0ffff irq 17 at device 12.0 on pci13
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x40c0-0x40cf irq 20 at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <Intel AHCI controller> port 0x40d8-0x40df,0x40f4-0x40f7,0x40d0-0x40d7,0x40f0-0x40f3,0x4020-0x403f mem 0xb8c00000-0xb8c003ff irq 20 at device 31.2 on pci0
atapci1: [ITHREAD]
atapci1: AHCI Version 01.10 controller with 6 ports detected
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci1
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci1
ata5: [ITHREAD]
ata6: <ATA channel 4> on atapci1
ata6: [ITHREAD]
ata7: <ATA channel 5> on atapci1
ata7: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
cpu0: <ACPI CPU> on acpi0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1: <ACPI CPU> on acpi0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
cpu2: <ACPI CPU> on acpi0
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
cpu3: <ACPI CPU> on acpi0
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
cpu4: <ACPI CPU> on acpi0
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
cpu5: <ACPI CPU> on acpi0
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
cpu6: <ACPI CPU> on acpi0
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
cpu7: <ACPI CPU> on acpi0
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
acpi_button0: <Sleep Button> on acpi0
acpi_button1: <Power Button> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model IntelliMouse, device ID 3
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
sio1: [FILTER]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xd1000-0xd1fff,0xd2000-0xd2fff on isa0
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ad4: 476940MB <Seagate ST3500630NS 3.AEK> at ata2-master SATA300
ad6: 476940MB <Seagate ST3500630NS 3.AEK> at ata3-master SATA300
GEOM_MIRROR: Device mirror/gm0 launched (2/2).
ses0 at mpt0 bus 0 target 19 lun 0
ses0: <ESG-SHV. SCA HSBP M1..... 2.02> Fixed Enclosure Services SCSI-3 device 
ses0: 300.000MB/s transfers
ses0: SCSI-3 SES Device
ses1 at mpt0 bus 0 target 26 lun 0
ses1: <ESG-SHV. SCA HSBP M2..... 2.02> Fixed Enclosure Services SCSI-3 device 
ses1: 300.000MB/s transfers
ses1: SCSI-3 SES Device
da0 at mpt0 bus 0 target 11 lun 0
da0: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da0: 300.000MB/s transfers
da0: Command Queueing Enabled
da0: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da1 at mpt0 bus 0 target 12 lun 0
da1: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da1: 300.000MB/s transfers
da1: Command Queueing Enabled
da1: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da2 at mpt0 bus 0 target 13 lun 0
da2: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da2: 300.000MB/s transfers
da2: Command Queueing Enabled
da2: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da3 at mpt0 bus 0 target 14 lun 0
da3: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da3: 300.000MB/s transfers
da3: Command Queueing Enabled
da3: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da4 at mpt0 bus 0 target 15 lun 0
da4: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da4: 300.000MB/s transfers
da4: Command Queueing Enabled
da4: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da5 at mpt0 bus 0 target 16 lun 0
da5: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da5: 300.000MB/s transfers
da5: Command Queueing Enabled
da5: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
lapic1: Forcing LINT1 to eddag6e  attr imgpgte0r b
us 0 target 20 lun 0
da6: <ATA ST3750330NS SN04> Fixed Direct Access SCSI-5 device 
da6: 300.000MB/s transfers
da6: Command Queueing Enabled
da6: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da7 at mpt0 bus 0 target 21 lun 0
da7: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da7: 300.000MB/s transfers
da7: Command Queueing Enabled
da7: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201CS)MP
: dAaP8  CaPtU  m#pt10  Lbauusn c0h etda!r
getl a2p2i cl3u:n  F0or
cdian8g:  L<IANTTA1  StTo3 7e5d0g3e3 0tNrSi gSgNe0r5
> Fixed Direct Access SCSI-5 device 
da8: 300.000MB/s transfers
da8: Command Queueing Enabled
da8: 715404MB (1465149168 512 byte sectors: 255H 63S/T 91201C)
da9 at mpt0 bus 0 target 23 lun 0
da9: <ATA ST3750330NS SN05> Fixed Direct Access SCSI-5 device 
da9: 300.000MB/s transfers
da9: Command Queueing Enabled
SdMaP:9 :A P7 1C5P4U0 4#MB3  (L1a4u6n5c1h4e9d1!6
8 l5a1pi2c b2y:t eF osreccitnogr sL:I N2T515 Ht o6 3eSd/gTe  9t1r2i0g1gCe)r

SMP: AP CPU #2 Launched!
lapic6: Forcing LINT1 to edge trigger
SMP: AP CPU #6 Launched!
lapic4: Forcing LINT1 to edge trigger
SMP: AP CPU #4 Launched!
lapic7: Forcing LINT1 to edge trigger
SMP: AP CPU #7 Launched!
lapic5: Forcing LINT1 to edge trigger
SMP: AP CPU #5 Launched!
Trying to mount root from ufs:/dev/mirror/gm0s1a
This module (opensolaris) contains code covered by the
Common Development and Distribution License (CDDL)
see http://opensolaris.org/os/licensing/opensolaris_license/
WARNING: ZFS is considered to be an experimental feature in FreeBSD.
ZFS filesystem version 6
ZFS storage pool version 6
tap0: Ethernet address: 00:bd:5d:1c:00:00
bridge0: Ethernet address: be:d2:f0:29:b9:14
mpt0: request 0xffffffff810527a0:32071 timed out for ccb 0xffffff00052cb000 (req->ccb 0xffffff00052cb000)
mpt0: request 0xffffffff81055e30:32072 timed out for ccb 0xffffff0004e39000 (req->ccb 0xffffff0004e39000)
mpt0: attempting to abort req 0xffffffff810527a0:32071 function 0
mpt0: request 0xffffffff81057780:32087 timed out for ccb 0xffffff00055c9400 (req->ccb 0xffffff00055c9400)

.........................................

mpt0: request 0xffffffff81050430:32599 timed out for ccb 0xffffff0005488000 (req->ccb 0xffffff0005488000)
mpt0: mpt_wait_req(1) timed out
mpt0: mpt_recover_commands: abort timed-out. Resetting controller
mpt0: mpt_cam_event: 0x0
mpt0: mpt_cam_event: 0x0
mpt0: completing timedout/aborted req 0xffffffff810527a0:32071
mpt0: completing timedout/aborted req 0xffffffff81055e30:32072
mpt0: completing timedout/aborted req 0xffffffff81057780:32087

.....................................................

mpt0: completing timedout/aborted req 0xffffffff81050430:32599
mpt0: mpt_cam_event: 0x16
mpt0: mpt_cam_event: 0x12
mpt0: mpt_cam_event: 0x12
mpt0: mpt_cam_event: 0x12
mpt0: mpt_cam_event: 0x1b
mpt0: mpt_cam_event: 0x12

......................................

mpt0: mpt_cam_event: 0x12
mpt0: mpt_cam_event: 0x12
mpt0: mpt_cam_event: 0x16
(da3:mpt0:0:14:0): WRITE(10). CDB: 2a 0 0 55 fb dd 0 0 80 0 
(da3:mpt0:0:14:0): CAM Status: SCSI Status Error
(da3:mpt0:0:14:0): SCSI Status: Check Condition
(da3:mpt0:0:14:0): UNIT ATTENTION asc:29,0
(da3:mpt0:0:14:0): Power on, reset, or bus device reset occurred
(da3:mpt0:0:14:0): Retrying Command (per Sense Data)
(da7:mpt0:0:21:0): WRITE(10). CDB: 2a 0 0 58 0 ea 0 0 4 0 
(da7:mpt0:0:21:0): CAM Status: SCSI Status Error
(da7:mpt0:0:21:0): SCSI Status: Check Condition
(da7:mpt0:0:21:0): UNIT ATTENTION asc:29,0
(da7:mpt0:0:21:0): Power on, reset, or bus device reset occurred
(da7:mpt0:0:21:0): Retrying Command (per Sense Data)
(da6:mpt0:0:20:0): WRITE(10). CDB: 2a 0 0 58 0 ea 0 0 4 0 
(da6:mpt0:0:20:0): CAM Status: SCSI Status Error
(da6:mpt0:0:20:0): SCSI Status: Check Condition
(da6:mpt0:0:20:0): UNIT ATTENTION asc:29,0
(da6:mpt0:0:20:0): Power on, reset, or bus device reset occurred
(da6:mpt0:0:20:0): Retrying Command (per Sense Data)
(da8:mpt0:0:22:0): WRITE(10). CDB: 2a 0 0 58 0 ea 0 0 4 0 
(da8:mpt0:0:22:0): CAM Status: SCSI Status Error
(da8:mpt0:0:22:0): SCSI Status: Check Condition
(da8:mpt0:0:22:0): UNIT ATTENTION asc:29,0
(da8:mpt0:0:22:0): Power on, reset, or bus device reset occurred
(da8:mpt0:0:22:0): Retrying Command (per Sense Data)
(da0:mpt0:0:11:0): WRITE(10). CDB: 2a 0 0 58 0 eb 0 0 4 0 
(da0:mpt0:0:11:0): CAM Status: SCSI Status Error
(da0:mpt0:0:11:0): SCSI Status: Check Condition
(da0:mpt0:0:11:0): UNIT ATTENTION asc:29,0
(da0:mpt0:0:11:0): Power on, reset, or bus device reset occurred
(da0:mpt0:0:11:0): Retrying Command (per Sense Data)
(da1:mpt0:0:12:0): WRITE(10). CDB: 2a 0 0 58 0 eb 0 0 4 0 
(da1:mpt0:0:12:0): CAM Status: SCSI Status Error
(da1:mpt0:0:12:0): SCSI Status: Check Condition
(da1:mpt0:0:12:0): UNIT ATTENTION asc:29,0
(da1:mpt0:0:12:0): Power on, reset, or bus device reset occurred
(da1:mpt0:0:12:0): Retrying Command (per Sense Data)
(da2:mpt0:0:13:0): WRITE(10). CDB: 2a 0 0 58 0 eb 0 0 4 0 
(da2:mpt0:0:13:0): CAM Status: SCSI Status Error
(da2:mpt0:0:13:0): SCSI Status: Check Condition
(da2:mpt0:0:13:0): UNIT ATTENTION asc:29,0
(da2:mpt0:0:13:0): Power on, reset, or bus device reset occurred
(da2:mpt0:0:13:0): Retrying Command (per Sense Data)
(da4:mpt0:0:15:0): WRITE(10). CDB: 2a 0 0 58 0 eb 0 0 4 0 
(da4:mpt0:0:15:0): CAM Status: SCSI Status Error
(da4:mpt0:0:15:0): SCSI Status: Check Condition
(da4:mpt0:0:15:0): UNIT ATTENTION asc:29,0
(da4:mpt0:0:15:0): Power on, reset, or bus device reset occurred
(da4:mpt0:0:15:0): Retrying Command (per Sense Data)
(da5:mpt0:0:16:0): WRITE(10). CDB: 2a 0 0 58 0 eb 0 0 4 0 
(da5:mpt0:0:16:0): CAM Status: SCSI Status Error
(da5:mpt0:0:16:0): SCSI Status: Check Condition
(da5:mpt0:0:16:0): UNIT ATTENTION asc:29,0
(da5:mpt0:0:16:0): Power on, reset, or bus device reset occurred
(da5:mpt0:0:16:0): Retrying Command (per Sense Data)

/boot/loader.conf has the same lines.
vm.kmem_size_max="1536M"
vm.kmem_size="1536M"

There is pool:
crocodile# zpool status
  pool: tank
 state: ONLINE
 scrub: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          da0       ONLINE       0     0     0
          da1       ONLINE       0     0     0
          da2       ONLINE       0     0     0
          da3       ONLINE       0     0     0
          da4       ONLINE       0     0     0
          da5       ONLINE       0     0     0
          da6       ONLINE       0     0     0
          da7       ONLINE       0     0     0
          da8       ONLINE       0     0     0
          da9       ONLINE       0     0     0

errors: No known data errors

crocodile# zpool list
NAME                    SIZE    USED   AVAIL    CAP  HEALTH     ALTROOT
tank                   6,80T   1,78T   5,02T    26%  ONLINE     -

It's work, but with many exeptions of mpt0.

If I made raidz pool, the system hangs up with kernel panic, duping copying files to the pool, with "kmem_map too small" and with the same exeptions of mpt0 around.

And there's no matter how many HDD are in the pool 4, 6, 9 or 10.

How to make raidz with LSILogic SAS/SATA Adapters?
Comment 1 Mark Linimon freebsd_committer freebsd_triage 2008-11-03 10:35:42 UTC
Responsible Changed
From-To: freebsd-bugs->freebsd-fs

Over to maintainer(s).
Comment 2 Pawel Jakub Dawidek freebsd_committer freebsd_triage 2014-06-01 06:56:39 UTC
State Changed
From-To: open->feedback

Could you try adding vfs.zfs.cache_flush_disable=1 to your /boot/loader.conf 
and see i that helps? It will prevent ZFS from sending write flush requests 
to the disks. 


Comment 3 Pawel Jakub Dawidek freebsd_committer freebsd_triage 2014-06-01 06:56:39 UTC
Responsible Changed
From-To: freebsd-fs->pjd

I'll take this one.
Comment 4 Eitan Adler freebsd_committer freebsd_triage 2017-12-31 08:00:41 UTC
For bugs matching the following criteria:

Status: In Progress Changed: (is less than) 2014-06-01

Reset to default assignee and clear in-progress tags.

Mail being skipped