Bug 139510 - [geom] [2tb] gmirror disappears after boot on 2T disks
Summary: [geom] [2tb] gmirror disappears after boot on 2T disks
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 7.2-STABLE
Hardware: Any Any
: Normal Affects Only Me
Assignee: freebsd-bugs (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-10-11 13:40 UTC by hsu
Modified: 2017-12-31 22:29 UTC (History)
0 users

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description hsu 2009-10-11 13:40:02 UTC 
I have a system which already has 2 mirrors using gmirror, one for
boot, two 250G disks, another with a pair of 1T disks.  Now, I am
trying to gmirror a 2T disk pair, with less success.

Labeling the disks works fine, and as long as the system will be up,
there is no apparent problem.  However, if I reboot, the new gmirror
disappears.  The partition tables and bsd label are all there, so it
seems to have been mirroring, so boot process is the first suspect
here.  The two other mirrors come up fine, and there are no boot-time
errors.

I partition I have been mirroring is live and has a filesystem, so I
first created a 1-disk gmirror, and inserted the other disk to it.  It
does not seem to matter whether reboot happens before or after the
mirror becomes COMPLETE.

Non-mirrored partitions on same type of disks seem to work fine.

How-To-Repeat: 
My first guess would be that this is related to disk size.  The
problem disks are WDC 2T disks.
Comment 1 Mark Linimon freebsd_committer freebsd_triage 2009-10-12 22:22:15 UTC 
Responsible Changed
From-To: freebsd-bugs->freebsd-geom

Over to maintainer(s).
Comment 2 heikki 2010-01-09 16:24:35 UTC 
pjd@FreeBSD.org wrote:
> Synopsis: [geom] [2tb] gmirror disappears after boot on 2T disks
>
> State-Changed-From-To: open->feedback
> State-Changed-By: pjd
> State-Changed-When: wto 13 pa¼ 2009 05:44:07 UTC
> State-Changed-Why:
> Please add kern.geom.mirrror.debug=2 to your /boot/loader.conf and send
> the additional output from the boot process.

See below for boot messages

> I'd also need the following:
>
> 	# gmirror dump /dev/ad1[48]

gmirror dump /dev/ad1[48]
Can't read metadata from /dev/ad14: Invalid argument.
Can't read metadata from /dev/ad18: Invalid argument.
gmirror: Not fully done.


> 	# diskinfo -v /dev/ad1[48]

diskinfo -v /dev/ad1[48] /dev/ad14
         512             # sectorsize
         2000398934016   # mediasize in bytes (1.8T)
         3907029168      # mediasize in sectors
         3876021         # Cylinders according to firmware.
         16              # Heads according to firmware.
         63              # Sectors according to firmware.
         ad:WD-WCAVY0207680      # Disk ident.

/dev/ad18
         512             # sectorsize
         2000398934016   # mediasize in bytes (1.8T)
         3907029168      # mediasize in sectors
         3876021         # Cylinders according to firmware.
         16              # Heads according to firmware.
         63              # Sectors according to firmware.
         ad:WD-WCAVY0226353      # Disk ident.



>
> Responsible-Changed-From-To: freebsd-geom->pjd
> Responsible-Changed-By: pjd
> Responsible-Changed-When: wto 13 pa¼ 2009 05:44:07 UTC
> Responsible-Changed-Why:
> I'll take this one.

Blow the boot messages:

Copyright (c) 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.2-STABLE #0: Fri Aug 21 20:00:56 EEST 2009
     root@news.bbnetworks.net:/usr/obj/usr/src/sys/BBNETWORKS7NEWS
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) 64 Processor 3000+ (1809.28-MHz K8-class CPU)
   Origin = "AuthenticAMD"  Id = 0x20ff2  Stepping = 2
 
Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
   Features2=0x1<SSE3>
   AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
   AMD Features2=0x1<LAHF>
usable memory = 2133803008 (2034 MB)
avail memory  = 2057379840 (1962 MB)
ACPI APIC Table: <Nvidia AWRDACPI>
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: <Nvidia AWRDACPI> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 7fef0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory> at device 0.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
pci0: <serial bus, SMBus> at device 1.1 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xdc004000-0xdc004fff irq 21 
at device 2.0 on pci0
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 10 ports with 10 removable, self powered
ehci0: <NVIDIA nForce4 USB 2.0 controller> mem 0xfeb00000-0xfeb000ff irq 
22 at device 2.1 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb1: EHCI version 1.0
usb1: companion controller, 4 ports each: usb0
usb1: <NVIDIA nForce4 USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1
uhub1: 10 ports with 10 removable, self powered
pci0: <multimedia, audio> at device 4.0 (no driver attached)
atapci0: <nVidia nForce CK804 UDMA133 controller> port 
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f at device 6.0 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <nVidia nForce CK804 SATA300 controller> port 
0x9f0-0x9f7,0xbf0-0xbf3,0x970-0x977,0xb70-0xb73,0xd800-0xd80f mem 
0xdc002000-0xdc002fff irq 21 at device 7.0 on pci0
atapci1: [ITHREAD]
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
atapci2: <nVidia nForce CK804 SATA300 controller> port 
0x9e0-0x9e7,0xbe0-0xbe3,0x960-0x967,0xb60-0xb63,0xc400-0xc40f mem 
0xdc001000-0xdc001fff irq 22 at device 8.0 on pci0
atapci2: [ITHREAD]
ata4: <ATA channel 0> on atapci2
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci2
ata5: [ITHREAD]
pcib1: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci5: <ACPI PCI bus> on pcib1
atapci3: <SiI SiI 3114 SATA150 controller> port 
0x8000-0x8007,0x8400-0x8403,0x8800-0x8807,0x8c00-0x8c03,0x9000-0x900f 
mem 0xdb008000-0xdb0083ff irq 19 at device 10.0 on pci5
atapci3: [ITHREAD]
ata6: <ATA channel 0> on atapci3
ata6: [ITHREAD]
ata7: <ATA channel 1> on atapci3
ata7: [ITHREAD]
ata8: <ATA channel 2> on atapci3
ata8: [ITHREAD]
ata9: <ATA channel 3> on atapci3
ata9: [ITHREAD]
fwohci0: <Texas Instruments TSB43AB22/A> mem 
0xdb009000-0xdb0097ff,0xdb000000-0xdb003fff irq 16 at device 11.0 on pci5
fwohci0: [FILTER]
fwohci0: OHCI version 1.10 (ROM=1)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 00:11:d8:00:00:5e:cf:a9
fwohci0: Phy 1394a available S400, 2 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
dcons_crom0: <dcons configuration ROM> on firewire0
dcons_crom0: bus_addr 0x7c314000
fwe0: <Ethernet over FireWire> on firewire0
if_fwe0: Fake Ethernet address: 02:11:d8:5e:cf:a9
fwe0: Ethernet address: 02:11:d8:5e:cf:a9
fwip0: <IP over FireWire> on firewire0
fwip0: Firewire address: 00:11:d8:00:00:5e:cf:a9 @ 0xfffe00000000, S400, 
maxrec 2048
sbp0: <SBP-2/SCSI over FireWire> on firewire0
fwohci0: Initiate bus reset
fwohci0: BUS reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
skc0: <Marvell Gigabit Ethernet> port 0x9400-0x94ff mem 
0xdb004000-0xdb007fff irq 17 at device 12.0 on pci5
skc0: Marvell Yukon Lite Gigabit Ethernet rev. (0x9)
sk0: <Marvell Semiconductor, Inc. Yukon> on skc0
sk0: Ethernet address: 00:13:d4:b8:48:56
miibus0: <MII bus> on sk0
e1000phy0: <Marvell 88E1011 Gigabit PHY> PHY 0 on miibus0
e1000phy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
skc0: [ITHREAD]
nfe0: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0xb000-0xb007 
mem 0xdc000000-0xdc000fff irq 23 at device 10.0 on pci0
miibus1: <MII bus> on nfe0
e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 1 on miibus1
e1000phy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
nfe0: Ethernet address: 00:13:d4:b8:3c:b8
nfe0: [FILTER]
pcib2: <ACPI PCI-PCI bridge> at device 11.0 on pci0
pci4: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 12.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 13.0 on pci0
pci2: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 14.0 on pci0
pci1: <ACPI PCI bus> on pcib5
vgapci0: <VGA-compatible display> port 0xa000-0xa0ff mem 
0xd0000000-0xd7ffffff,0xd9000000-0xd900ffff irq 18 at device 0.0 on pci1
vgapci1: <VGA-compatible display> mem 0xd9010000-0xd901ffff at device 
0.1 on pci1
acpi_tz0: <Thermal Zone> on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on 
acpi0
sio0: type 16550A
sio0: [FILTER]
ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77b irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/16 bytes threshold
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
cpu0: <ACPI CPU> on acpi0
powernow0: <Cool`n'Quiet K8> on cpu0
device_attach: powernow0 attach returned 6
orm0: <ISA Option ROMs> at iomem 
0xc0000-0xcffff,0xd0000-0xd3fff,0xd4000-0xd8fff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 1809281102 Hz quality 800
Timecounters tick every 1.000 msec
IP Filter: v4.1.28 initialized.  Default = pass all, Logging = enabled
ipfw2 (+ipv6) initialized, divert enabled, nat loadable, rule-based 
forwarding enabled, default to accept, logging limited to 1000 
packets/entry byfirewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire0: bus manager 0 (me)
  default
ad4: 953869MB <Seagate ST31000340AS SD01> at ata2-master SATA150
ad6: 239372MB <WDC WD2500YD-01NVB1 10.02E01> at ata3-master SATA150
GEOM_MIRROR[2]: Tasting ad4.
      magic: GEOM::MIRROR
    version: 4
       name: overview
        mid: 1187277655
        did: 3503848280
        all: 2
      genid: 0
     syncid: 1
   priority: 0
      slice: 2048
    balance: round-robin
  mediasize: 1000204885504
sectorsize: 512
syncoffset: 0
     mflags: NONE
     dflags: NONE
hcprovider:   provsize: 1000204886016
   MD5 hash: cd509d68698df4e4ecf090074f95e1b1
GEOM_MIRROR[1]: Creating device overview (id=1187277655).
GEOM_MIRROR[1]: Device overview created (2 components, id=1187277655).
GEOM_MIRROR[1]: root_mount_hold 0xffffff0001715140
GEOM_MIRROR[1]: Adding disk ad4 to overview.
GEOM_MIRROR[2]: Adding disk ad4.
GEOM_MIRROR[2]: Disk ad4 connected.
GEOM_MIRROR[1]: Disk ad4 state changed from NONE to NEW (device overview).
GEOM_MIRROR[1]: Device overview: provider ad4 detected.
GEOM_MIRROR[2]: Tasting ad4s1.
ad8: 239372MB <WDC WD2500YD-01NVB1 10.02E01> at ata4-master SATA150
GEOM_MIRROR[2]: Tasting ad6.
      magic: GEOM::MIRROR
    version: 4
       name: boot
        mid: 1589248060
        did: 3950302506
        all: 2
      genid: 0
     syncid: 1
   priority: 0
      slice: 2048
    balance: prefer
  mediasize: 251000192512
sectorsize: 512
syncoffset: 0
     mflags: NONE
     dflags: NONE
hcprovider:   provsize: 251000193024
   MD5 hash: 0ff0b87201e3ff9332d004523c6a7d87
GEOM_MIRROR[1]: Creating device boot (id=1589248060).
GEOM_MIRROR[1]: Device boot created (2 components, id=1589248060).
GEOM_MIRROR[1]: root_mount_hold 0xffffff000169c840
GEOM_MIRROR[1]: Adding disk ad6 to boot.
GEOM_MIRROR[2]: Adding disk ad6.
GEOM_MIRROR[2]: Disk ad6 connected.
GEOM_MIRROR[1]: Disk ad6 state changed from NONE to NEW (device boot).
GEOM_MIRROR[1]: Device boot: provider ad6 detected.
GEOM_MIRROR[2]: Tasting ad6s1.
GEOM_MIRROR[2]: Tasting ad8.
      magic: GEOM::MIRROR
    version: 4
       name: boot
        mid: 1589248060
        did: 2432525573
        all: 2
      genid: 0
     syncid: 1
   priority: 0
      slice: 2048
    balance: prefer
  mediasize: 251000192512
sectorsize: 512
syncoffset: 0
     mflags: NONE
     dflags: NONE
hcprovider:   provsize: 251000193024
   MD5 hash: 9209d0183abf207e563c699edf7b2755
GEOM_MIRROR[1]: Adding disk ad8 to boot.
GEOM_MIRROR[2]: Adding disk ad8.
GEOM_MIRROR[2]: Disk ad8 connected.
GEOM_MIRROR[1]: Disk ad8 state changed from NONE to NEW (device boot).
GEOM_MIRROR[1]: Device boot: provider ad8 detected.
GEOM_MIRROR[1]: Device boot state changed from STARTING to RUNNING.
GEOM_MIRROR[1]: Disk ad8 state changed from NEW to ACTIVE (device boot).
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Device boot: provider ad8 activated.
GEOM_MIRROR[1]: Disk ad6 state changed from NEW to ACTIVE (device boot).
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Device boot: provider ad6 activated.
GEOM_MIRROR[0]: Device mirror/boot launched (2/2).
GEOM_MIRROR[1]: root_mount_rel[2379] 0xffffff000169c840
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Tasting mirror/boot.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Tasting ad8s1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Tasting mirror/boots1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
ad10: 953869MB <Seagate ST31000340AS SD04> at ata5-master SATA150
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/boots1a.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
ad12: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata6-master SATA150
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/boots1b.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/boots1c.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/boots1d.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-2.
GEOM_MIRROR[2]: Tasting ufsid/4aa483631b551094.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ufsid/4aa483acdab38651.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-3.
ad14: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata7-master SATA150
GEOM_MIRROR[2]: Tasting ad10.
      magic: GEOM::MIRROR
    version: 4
       name: overview
        mid: 1187277655
        did: 3458568220
        all: 2
      genid: 0
     syncid: 1
   priority: 1
      slice: 2048
    balance: round-robin
  mediasize: 1000204885504
sectorsize: 512
syncoffset: 0
     mflags: NONE
     dflags: NONE
hcprovider:   provsize: 1000204886016
   MD5 hash: 1cb0842fd09935edb9b881430bb0a8af
GEOM_MIRROR[1]: Adding disk ad10 to overview.
GEOM_MIRROR[2]: Adding disk ad10.
GEOM_MIRROR[2]: Disk ad10 connected.
GEOM_MIRROR[1]: Disk ad10 state changed from NONE to NEW (device overview).
GEOM_MIRROR[1]: Device overview: provider ad10 detected.
GEOM_MIRROR[1]: Device overview state changed from STARTING to RUNNING.
GEOM_MIRROR[1]: Disk ad10 state changed from NEW to ACTIVE (device 
overview).
GEOM_MIRROR[2]: Metadata on ad10 updated.
GEOM_MIRROR[1]: Device overview: provider ad10 activated.
GEOM_MIRROR[1]: Disk ad4 state changed from NEW to ACTIVE (device overview).
GEOM_MIRROR[2]: Metadata on ad4 updated.
GEOM_MIRROR[1]: Device overview: provider ad4 activated.
GEOM_MIRROR[0]: Device mirror/overview launched (2/2).
GEOM_MIRROR[1]: root_mount_rel[2379] 0xffffff0001715140
GEOM_MIRROR[2]: Tasting ad12.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Tasting mirror/overview.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Tasting ad10s1.
GEOM_MIRROR[2]: Tasting ad12s1.
GEOM_MIRROR[2]: Tasting ad14.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ec.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
ad16: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata8-master SATA150
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Tasting mirror/overviews1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Tasting ad12s1c.
GEOM_MIRROR[2]: Tasting ad12s1d.
GEOM_MIRROR[2]: Tasting ad14s1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ecs1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/overviews1c.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/overviews1d.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting ufsid/4a8df25801f4e1a4.
GEOM_MIRROR[2]: Tasting ad14s1c.
GEOM_MIRROR[2]: Tasting ad14s1d.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ecs1c.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ecs1d.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ad16.
GEOM_MIRROR[2]: Tasting ufsid/4aa14ee7e70e19a6.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
ad18: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata9-master SATA150
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ufsid/4ac0c89000c1a133.
GEOM_MIRROR[2]: Tasting ad16s1.
GEOM_MIRROR[2]: Tasting ad16s1c.
GEOM_MIRROR[2]: Tasting ad16s1d.
GEOM_MIRROR[2]: Tasting ad18.
GEOM_MIRROR[2]: Tasting ufsid/4a8df299752d8b2f.
GEOM_MIRROR[2]: Tasting ad18s1.
GEOM_MIRROR[2]: Tasting ad18s1c.
GEOM_MIRROR[2]: Tasting ad18s1d.
Trying to mount root from ufs:/dev/mirror/boots1a
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/boot: r0w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[1]: Kernel dump will go to ad8.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r0w1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r0w-1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Tasting mirror/boots1a.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Tasting ufsid/4aa483631b551094.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r0w1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r0w-1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r0w1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Tasting mirror/boots1d.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e0.
GEOM_MIRROR[2]: Tasting ufsid/4aa483acdab38651.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r0w-1e-2.
GEOM_MIRROR[2]: Tasting ad12.
GEOM_MIRROR[2]: Tasting ad12s1.
GEOM_MIRROR[2]: Tasting ad12s1d.
GEOM_MIRROR[2]: Tasting ad16.
GEOM_MIRROR[2]: Tasting ad16s1.
GEOM_MIRROR[2]: Tasting ad16s1d.
GEOM_MIRROR[2]: Tasting ad14.
GEOM_MIRROR[2]: Tasting ad14s1.
GEOM_MIRROR[2]: Tasting ad14s1d.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Tasting mirror/overview.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Tasting mirror/overviews1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e0.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting mirror/overviews1d.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting ufsid/4a8df25801f4e1a4.
GEOM_MIRROR[2]: Tasting ufsid/4a8df299752d8b2f.
GEOM_MIRROR[2]: Tasting ufsid/4ac0c89000c1a133.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ec.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-1.
GEOM_MIRROR[2]: Tasting ufsid/4aa14ee7e70e19a6.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ecs1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e2.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-2.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ecs1c.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Tasting ufsid/4aa14bd1691027ecs1d.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w0e3.
GEOM_MIRROR[2]: Access request for mirror/overview: r-1w0e-3.
GEOM_MIRROR[2]: Access request for mirror/boot: r0w1e1.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w1e1.
GEOM_MIRROR[2]: Access request for mirror/overview: r1w1e3.
GEOM_MIRROR[1]: Disk ad10 (device overview) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad10 updated.
GEOM_MIRROR[1]: Disk ad4 (device overview) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad4 updated.
GEOM_MIRROR[2]: Access request for mirror/boot: r1w1e0.
GEOM_MIRROR[2]: Access request for mirror/boot: r-1w-1e0.
sk0: link state changed to UP
GEOM_MIRROR[1]: Disk ad10 (device overview) marked as clean.
GEOM_MIRROR[2]: Metadata on ad10 updated.
GEOM_MIRROR[1]: Disk ad4 (device overview) marked as clean.
GEOM_MIRROR[2]: Metadata on ad4 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as clean.
GEOM_MIRROR[2]: Metadata on ad6 updated.
GEOM_MIRROR[1]: Disk ad8 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad8 updated.
GEOM_MIRROR[1]: Disk ad6 (device boot) marked as dirty.
GEOM_MIRROR[2]: Metadata on ad6 updated.
Comment 3 Alexander Motin freebsd_committer freebsd_triage 2013-01-15 09:15:49 UTC 
I am unable to reproduce the problem on fresh system with 3TB drives.
Either the problem is not in gmirror itself (SATA controller, driver,
some RAID BIOS, etc) or it is already fixed somehow.

-- 
Alexander Motin
Comment 4 hsu 2013-01-15 10:40:06 UTC 
On 1/15/13 11:15 AM, Alexander Motin wrote:
> I am unable to reproduce the problem on fresh system with 3TB drives.
> Either the problem is not in gmirror itself (SATA controller, driver,
> some RAID BIOS, etc) or it is already fixed somehow.

I think I managed to get rid of this by dd zeroes after boot block until 
freebsd partition, apparently there was something after the MBR  and 
before bsd label which confused FreeBSD.  It is likely that those disks 
had been used in dedicated mode before, and then partitioned without 
clearing beginning of the disk, so there probably was some UFS data or 
like after MBR.  It might be a good idea to figure this out as there 
should be no reason for freebsd to read anything from area which is not 
used at all.  Unfortunately I did not take a copy of the offending data, 
I just dd:t it over.

Heikki Suonsivu
Comment 5 Alexander Motin freebsd_committer freebsd_triage 2013-01-15 10:50:02 UTC 
On 15.01.2013 12:40, Heikki Suonsivu wrote:
> On 1/15/13 11:15 AM, Alexander Motin wrote:
>> I am unable to reproduce the problem on fresh system with 3TB drives.
>> Either the problem is not in gmirror itself (SATA controller, driver,
>> some RAID BIOS, etc) or it is already fixed somehow.
> 
> I think I managed to get rid of this by dd zeroes after boot block until
> freebsd partition, apparently there was something after the MBR  and
> before bsd label which confused FreeBSD.  It is likely that those disks
> had been used in dedicated mode before, and then partitioned without
> clearing beginning of the disk, so there probably was some UFS data or
> like after MBR.  It might be a good idea to figure this out as there
> should be no reason for freebsd to read anything from area which is not
> used at all.  Unfortunately I did not take a copy of the offending data,
> I just dd:t it over.

There are some known problems from metadata detection order in GEOM.
Some classes, such as ufs or ufsid LABEL, due to lack of strict
information in their metadata may grab disk areas not belonging to them,
preventing MIRROR to attach. That may be not a MIRROR problem.

-- 
Alexander Motin
Comment 6 hsu 2013-01-15 11:20:29 UTC 
On 1/15/13 12:50 PM, Alexander Motin wrote:
> On 15.01.2013 12:40, Heikki Suonsivu wrote:
>> On 1/15/13 11:15 AM, Alexander Motin wrote:
>>> I am unable to reproduce the problem on fresh system with 3TB drives.
>>> Either the problem is not in gmirror itself (SATA controller, driver,
>>> some RAID BIOS, etc) or it is already fixed somehow.
>>
>> I think I managed to get rid of this by dd zeroes after boot block until
>> freebsd partition, apparently there was something after the MBR  and
>> before bsd label which confused FreeBSD.  It is likely that those disks
>> had been used in dedicated mode before, and then partitioned without
>> clearing beginning of the disk, so there probably was some UFS data or
>> like after MBR.  It might be a good idea to figure this out as there
>> should be no reason for freebsd to read anything from area which is not
>> used at all.  Unfortunately I did not take a copy of the offending data,
>> I just dd:t it over.
>
> There are some known problems from metadata detection order in GEOM.
> Some classes, such as ufs or ufsid LABEL, due to lack of strict
> information in their metadata may grab disk areas not belonging to them,
> preventing MIRROR to attach. That may be not a MIRROR problem.

This could explain other problems I have been with gjournal+gmirror 
partitions disappearing.  I think I have made a separate PR of that. 
That was mystical, no errors, but partition just disappears on boot. 
Or, more accurately, the computer does not boot as root partition no 
more exists.  That one I worked around by not having the fs partition to 
extend to end of disk and not using gjournal.  These are worth fixing, 
as this kind of mystical filesystems going away or polymorphing into 
something else on reboot does not contribute to reputation of reliability..

Heikki
Comment 7 Pawel Jakub Dawidek freebsd_committer freebsd_triage 2014-06-01 07:09:41 UTC 
State Changed
From-To: open->feedback

Please add kern.geom.mirrror.debug=2 to your /boot/loader.conf and send 
the additional output from the boot process. 

I'd also need the following: 

# gmirror dump /dev/ad1[48] 
# diskinfo -v /dev/ad1[48]
Comment 8 Pawel Jakub Dawidek freebsd_committer freebsd_triage 2014-06-01 07:09:41 UTC 
Responsible Changed
From-To: freebsd-geom->pjd

I'll take this one.
Comment 9 Eitan Adler freebsd_committer freebsd_triage 2017-12-31 08:01:23 UTC 
For bugs matching the following criteria:

Status: In Progress Changed: (is less than) 2014-06-01

Reset to default assignee and clear in-progress tags.

Mail being skipped