Bug 183391 - [oce] 10GbE networking problems with Emulex OCE 11102 CNA
Summary: [oce] 10GbE networking problems with Emulex OCE 11102 CNA
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 9.3-BETA3
Hardware: Any Any
: Normal Affects Only Me
Assignee: freebsd-net (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-10-28 11:20 UTC by pataki.antal
Modified: 2018-09-10 14:34 UTC (History)
5 users (show)

See Also:


Attachments
10-STABLE patch for the oce driver by Stefano Garzarella (3.35 KB, patch)
2014-07-16 07:01 UTC, Borja Marcos
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description pataki.antal 2013-10-28 11:20:00 UTC
System setup:
IBM x3500 m4 machine, with 
IBM branded Emulex 11102 CNA (IBM 95Y3764 Emulex 10GbE VFA III for IBM
System x)
2xE5-2620 CPU
16GB RAM
IBM ServeRAID M1115 SAS HBA

The installation:

The system contains the 10GbE NIC described above.
The system is direct-connected to an other similar IBM x3500m4 via
10gbit ethernet.  (The other machine originally contains the same Emulex
card, but we have Intel X520 NICs too for test.)  FreeBSD 9.2 installed
on both machines.

Situations:
1.) Machine1 with Emulex card connected to Machine2 with the same Emulex card
iperf -s on Machine1 and iperf -c on Machine2
The Machine2 hangs up.

2.) Machine1 with Emulex card connected to Machine2 with the same Emulex card
iperf -c on Machine1 and iperf -s on Machine2
The Machine1 hangs up.

3.) Machine1 with Emulex card connected to Machine2 with Intel X520 card
iperf -c on Machine1 and iperf -s on Machine2
The Machine1 hangs up.

3.) Machine1 with Intel X520 card connected to Machine2 with Emulex card
iperf -c on Machine1 and iperf -s on Machine2
No any machine hangs up, the iperf runs perfectly.

It seems, if any machine contains the Emulex card, and runs iperf -c ,
it will hangs up.

With heavy traffic (about over 5Gbit/sec) hangs up the machine that
contains the Emulex card, too, no only the iperf -c.

How-To-Repeat: Install Emulex OCE 11102 CNA to a FeeeBSD 9.2 system.
Connect it to an other machine via 10gbit ethernet.
Start iperf -c on the machine with the Emulex card.
The machine will hangs up.
Comment 1 pataki.antal 2013-10-30 21:05:09 UTC
please set this to critical and high priority.
the system hangs up because of this and this is a serious problem for
example the system is a storage....
anyway, if the system could hang, i think there is some critical error.
thank you!
Comment 2 Mark Linimon freebsd_committer freebsd_triage 2013-10-31 02:45:10 UTC
Responsible Changed
From-To: freebsd-bugs->freebsd-net


Over to maintainer(s).
Comment 3 pataki.antal 2013-11-02 12:11:49 UTC
I would like to correct his line: 

Synopsis:	[ixgbe] 10gigabit networking problems with Emulex OCE 11102 CNA


This problem is not realted to the ixgbe, but related to the oce.


Thanks,

Antal Pataki
Comment 4 mlavkin 2014-04-15 20:06:32 UTC
FIX

 

Use latest driver version

http://www.emulex.com/downloads/emulex/drivers/freebsd/freebsd-91-amd64/driv
ers/

 

I put it to 10.0 Release src tree and rebuild system. Now it work without
hangs and panics.

On 9.2 I have compile error.

 

I think then new oce version can go to CURRENT.

 
Comment 5 Borja Marcos 2014-06-12 10:02:09 UTC
I wouldn't classify this bug as non serious. It's critical, as the oce card is currently unusable with the driver included in -STABLE and -CURRENT (10.0.664.0).

I am experiencing easy to reproduce panics linked to network traffic. I include summaries of two crash reports.

PANIC 1:
mierda dumped core - see /var/crash/vmcore.0

Thu Jun 12 12:01:47 CEST 2014

FreeBSD mierda 10.0-STABLE FreeBSD 10.0-STABLE #0 r265018: Sun Apr 27 19:01:41 UTC 2014     root@grind.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64

panic: sbdrop

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:
panic: sbdrop
cpuid = 12
KDB: stack backtrace:
#0 0xffffffff809102b0 at kdb_backtrace+0x60
#1 0xffffffff808d5815 at panic+0x155
#2 0xffffffff80948383 at sbcut_internal+0x273
#3 0xffffffff80a6d68c at tcp_do_segment+0x175c
#4 0xffffffff80a6b2e4 at tcp_input+0xd04
#5 0xffffffff80a01087 at ip_input+0x97
#6 0xffffffff809a0332 at netisr_dispatch_src+0x62
#7 0xffffffff80997916 at ether_demux+0x126
#8 0xffffffff809985be at ether_nh_input+0x35e
#9 0xffffffff809a0332 at netisr_dispatch_src+0x62
#10 0xffffffff80a6fd38 at tcp_lro_flush+0x198
#11 0xffffffff81855692 at oce_rq_handler+0x212
#12 0xffffffff81857a8c at oce_intr+0xdc
#13 0xffffffff8091e8f5 at taskqueue_run_locked+0xe5
#14 0xffffffff8091f388 at taskqueue_thread_loop+0xa8
#15 0xffffffff808a63aa at fork_exit+0x9a
#16 0xffffffff80cafd3e at fork_trampoline+0xe



PANIC 2:
mierda dumped core - see /var/crash/vmcore.1

Thu Jun 12 12:20:20 CEST 2014

FreeBSD mierda 10.0-STABLE FreeBSD 10.0-STABLE #0 r265018: Sun Apr 27 19:01:41 UTC 2014     root@grind.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64

panic: sbsndptr: sockbuf 0xfffff800280549b0 and mbuf 0xfffff80178df1d00 clashing

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:
panic: sbsndptr: sockbuf 0xfffff800280549b0 and mbuf 0xfffff80178df1d00 clashing
cpuid = 12
KDB: stack backtrace:
#0 0xffffffff809102b0 at kdb_backtrace+0x60
#1 0xffffffff808d5815 at panic+0x155
#2 0xffffffff80948500 at sbdroprecord_locked+0
#3 0xffffffff80a7123c at tcp_output+0xdbc
#4 0xffffffff80a6f02f at tcp_do_segment+0x30ff
#5 0xffffffff80a6b2e4 at tcp_input+0xd04
#6 0xffffffff80a01087 at ip_input+0x97
#7 0xffffffff809a0332 at netisr_dispatch_src+0x62
#8 0xffffffff80997916 at ether_demux+0x126
#9 0xffffffff809985be at ether_nh_input+0x35e
#10 0xffffffff809a0332 at netisr_dispatch_src+0x62
#11 0xffffffff81855ab9 at oce_rx+0x3c9
#12 0xffffffff81855536 at oce_rq_handler+0xb6
#13 0xffffffff81857a8c at oce_intr+0xdc
#14 0xffffffff8091e8f5 at taskqueue_run_locked+0xe5
#15 0xffffffff8091f388 at taskqueue_thread_loop+0xa8
#16 0xffffffff808a63aa at fork_exit+0x9a
#17 0xffffffff80cafd3e at fork_trampoline+0xe
Uptime: 4m11s
Dumping 947 out of 24540 MB:..2%..11%..21%..31%..41%..51%..61%..71%..82%..92%
Comment 6 Borja Marcos 2014-06-12 15:15:48 UTC
Indeed, just fetching the source from the Emulex website, compiling and loading the module, it seems to be solid now.

dev.oce.0.%pnpinfo: vendor=0x19a2 device=0x0700 subvendor=0x10df subdevice=0xe629 class=0x020000
dev.oce.0.%parent: pci3
dev.oce.0.component_revision: ///10.0.747.0///
dev.oce.0.firmware_version: 2.103.397.34


I'm close saturating the interface bandwidth using iperf and now I am unable to make it crash.

Please, replace the driver!! :)
Comment 7 Kubilay Kocak freebsd_committer freebsd_triage 2014-06-17 23:38:42 UTC
Please attach:

* /var/run/dmesg.boot output
* pciconf pciconf -lveV
Comment 8 Kubilay Kocak freebsd_committer freebsd_triage 2014-06-17 23:59:09 UTC
Pataki, Borjan, MLavkin,

We need a confirmation that this issue (panic) is still present on 9.3-BETA3 in order to get this into 9.3-RELEASE. 

We have a very short window until -RELEASE, if one of you could provide that confirmation, it will go a long way.
Comment 9 pataki.antal 2014-06-18 02:20:30 UTC
(In reply to Kubilay Kocak from comment #7)
> Please attach:
> 
> * /var/run/dmesg.boot output
> * pciconf pciconf -lveV

Hi!

I am so sorry, but we didn't kept the unusable system from 2013 october until today....
The system is upgraded to 9.2-STABLE and the Emulex cards fired out and replaced with Intel X520 cards.
Like this, the system is operating good - in a production environment, so it is not possible to change the hardware or the operating system.

So I can't send you the dmesg.boot from 2013 october with the emulex card on fbsd 9.2-RELEASE, I am sorry.
Comment 10 pataki.antal 2014-06-18 02:23:27 UTC
Like my previous reply, I can't confirm this, because we workarounded the bug in a way.
(upgraded to freebsd 9.2-stable and the emulex cards are changed to intel x520 cards)

I am so sorry, we couldn't wait for about 8 months for any solution, we needed to use the servers in production - we spent many thousands of dollars for that, not for keeping them in the corner. I hope you understood.

(In reply to Kubilay Kocak from comment #8)
> Pataki, Borjan, MLavkin,
> 
> We need a confirmation that this issue (panic) is still present on 9.3-BETA3
> in order to get this into 9.3-RELEASE. 
> 
> We have a very short window until -RELEASE, if one of you could provide that
> confirmation, it will go a long way.
Comment 11 Borja Marcos 2014-06-18 12:17:11 UTC
Alright.

I installed 9.3-BETA3 on a test machine. On 9.3 it DOES NOT PANIC but, anyway, the interface freezes and it doesn't work properly.



It's cross connected to another machine using an Intel 10 Gbps adapter (ix driver).

So I did:

kldload oce
ifconfig oce0 inet 10.0.0.2 netmask 255.255.255.0


I started iperf -s on both machines. (iperf -s) (/usr/ports/benchmarks/iperf3)

iperf3 -N -c 10.0.0.2 -P 4 -t 120
iperf3 -N -c 10.0.0.1 -P 4 -t 120

The test started and it froze, unable to move more packets. It managed to connect and it started sending traffic.

root@pruebas:~ # iperf3 -N -c 10.0.0.1 -P 4 -t 120
Connecting to host 10.0.0.1, port 5201
[  4] local 10.0.0.2 port 58691 connected to 10.0.0.1 port 5201
[  6] local 10.0.0.2 port 25671 connected to 10.0.0.1 port 5201
[  8] local 10.0.0.2 port 30969 connected to 10.0.0.1 port 5201
[ 10] local 10.0.0.2 port 36802 connected to 10.0.0.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   150 MBytes  1.26 Gbits/sec                  
[  6]   0.00-1.00   sec   150 MBytes  1.25 Gbits/sec                  
[  8]   0.00-1.00   sec   150 MBytes  1.26 Gbits/sec                  
[ 10]   0.00-1.00   sec   150 MBytes  1.26 Gbits/sec                  
[SUM]   0.00-1.00   sec   599 MBytes  5.02 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  0.00 Bytes  0.00 bits/sec                  
[  6]   1.00-2.00   sec  0.00 Bytes  0.00 bits/sec                  
[  8]   1.00-2.00   sec  0.00 Bytes  0.00 bits/sec                  
[ 10]   1.00-2.00   sec  0.00 Bytes  0.00 bits/sec                  
[SUM]   1.00-2.00   sec  0.00 Bytes  0.00 bits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec                  
[  6]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec                  
[  8]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec                  
[ 10]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec                  
[SUM]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -








Trying pings from 10.0.0.1 (Intel) to 10.0.0.2 (Emulex) and running tcpdump on the Emulex I saw the ARP requests coming *but* no replies.

I tried to ifconfig oce0 down and up.

The ifconfig oce0 down took several seconds, showing an abnormal usage of CPU time in "top".

The ifconfig oce0 up is stuck in an endless loop, taking 100% CPU. It has been for several minutes.


(top)
  913 root          1  20    0 18344K  1932K CPU18  18   0:00 100.00% ifconfig

The second test I've done was similar, just iperf3 -s (server) on the Emulex machine, client on the Intel. Traffic froze in seconds.

I am going to reboot, compile the new Emulex driver and try again.

Followup will come in a couple of hours or so.








root@pruebas:~ # uname -a
FreeBSD pruebas 9.3-BETA3 FreeBSD 9.3-BETA3 #0 r267433: Fri Jun 13 01:48:48 UTC 2014     root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64


(from /var/log/messages after loading the oce.ko module)

Jun 18 13:50:13 pruebas kernel: oce0: <Emulex CNA NIC function:///10.0.664.0///> mem 0xdf478000-0xdf47bfff,0xdf480000-0xdf49ffff,0xdf4a0000-0xdf4bffff irq 38 at device 0.0 on pci3
Jun 18 13:50:13 pruebas kernel: oce1: <Emulex CNA NIC function:///10.0.664.0///> mem 0xdf47c000-0xdf47ffff,0xdf4c0000-0xdf4dffff,0xdf4e0000-0xdf4fffff irq 45 at device 0.1 on pci3

(sysctl dev.oce)
root@pruebas:~ # sysctl dev.oce
dev.oce.0.%desc: Emulex CNA NIC function:///10.0.664.0///
dev.oce.0.%driver: oce
dev.oce.0.%location: slot=0 function=0
dev.oce.0.%pnpinfo: vendor=0x19a2 device=0x0700 subvendor=0x10df subdevice=0xe629 class=0x020000
dev.oce.0.%parent: pci3
dev.oce.0.component_revision: ///10.0.664.0///
dev.oce.0.firmware_version: 2.103.397.34
dev.oce.0.max_rsp_handled: 64
dev.oce.0.speed: 10000
dev.oce.0.loop_back: 0
dev.oce.0.fw_upgrade: 
dev.oce.0.sfp_vpd_dump: 0
dev.oce.0.stats.rx.total_pkts: 448304
dev.oce.0.stats.rx.total_bytes: 30414856
dev.oce.0.stats.rx.total_frags: 448304
dev.oce.0.stats.rx.total_mcast_pkts: 0
dev.oce.0.stats.rx.total_ucast_pkts: 448242
dev.oce.0.stats.rx.total_rxcp_errs: 0
dev.oce.0.stats.rx.pause_frames: 0
dev.oce.0.stats.rx.priority_pause_frames: 0
dev.oce.0.stats.rx.control_frames: 0
dev.oce.0.stats.rx.queue0.rx_pkts: 448304
dev.oce.0.stats.rx.queue0.rx_bytes: 30414856
dev.oce.0.stats.rx.queue0.rx_frags: 448304
dev.oce.0.stats.rx.queue0.rx_mcast_pkts: 0
dev.oce.0.stats.rx.queue0.rx_ucast_pkts: 448242
dev.oce.0.stats.rx.queue0.rxcp_err: 0
dev.oce.0.stats.rx.err.crc_errs: 0
dev.oce.0.stats.rx.err.pbuf_errors: 0
dev.oce.0.stats.rx.err.erx_errors: 0
dev.oce.0.stats.rx.err.alignment_errors: 0
dev.oce.0.stats.rx.err.in_range_errors: 0
dev.oce.0.stats.rx.err.out_range_errors: 0
dev.oce.0.stats.rx.err.frame_too_long: 0
dev.oce.0.stats.rx.err.address_match_errors: 0
dev.oce.0.stats.rx.err.dropped_too_small: 0
dev.oce.0.stats.rx.err.dropped_too_short: 0
dev.oce.0.stats.rx.err.dropped_header_too_small: 0
dev.oce.0.stats.rx.err.dropped_tcp_length: 0
dev.oce.0.stats.rx.err.dropped_runt: 0
dev.oce.0.stats.rx.err.ip_checksum_errs: 0
dev.oce.0.stats.rx.err.tcp_checksum_errs: 0
dev.oce.0.stats.rx.err.udp_checksum_errs: 0
dev.oce.0.stats.rx.err.fifo_overflow_drop: 0
dev.oce.0.stats.rx.err.input_fifo_overflow_drop: 0
dev.oce.0.stats.tx.total_tx_pkts: 38169
dev.oce.0.stats.tx.total_tx_bytes: 1269173326
dev.oce.0.stats.tx.total_tx_reqs: 38169
dev.oce.0.stats.tx.total_tx_stops: 3
dev.oce.0.stats.tx.total_tx_wrbs: 474180
dev.oce.0.stats.tx.total_tx_compl: 37745
dev.oce.0.stats.tx.total_ipv6_ext_hdr_tx_drop: 0
dev.oce.0.stats.tx.pauseframes: 0
dev.oce.0.stats.tx.priority_pauseframes: 0
dev.oce.0.stats.tx.controlframes: 0
dev.oce.0.stats.tx.queue0.tx_pkts: 38169
dev.oce.0.stats.tx.queue0.tx_bytes: 1269173326
dev.oce.0.stats.tx.queue0.tx_reqs: 38169
dev.oce.0.stats.tx.queue0.tx_stops: 3
dev.oce.0.stats.tx.queue0.tx_wrbs: 474180
dev.oce.0.stats.tx.queue0.tx_compl: 37745
dev.oce.0.stats.tx.queue0.ipv6_ext_hdr_tx_drop: 0
dev.oce.1.%desc: Emulex CNA NIC function:///10.0.664.0///
dev.oce.1.%driver: oce
dev.oce.1.%location: slot=0 function=1
dev.oce.1.%pnpinfo: vendor=0x19a2 device=0x0700 subvendor=0x10df subdevice=0xe629 class=0x020000
dev.oce.1.%parent: pci3
dev.oce.1.component_revision: ///10.0.664.0///
dev.oce.1.firmware_version: 2.103.397.34
dev.oce.1.max_rsp_handled: 64
dev.oce.1.speed: 10000
dev.oce.1.loop_back: 0
dev.oce.1.fw_upgrade: 
dev.oce.1.sfp_vpd_dump: 0
dev.oce.1.stats.rx.total_pkts: 0
dev.oce.1.stats.rx.total_bytes: 0
dev.oce.1.stats.rx.total_frags: 0
dev.oce.1.stats.rx.total_mcast_pkts: 0
dev.oce.1.stats.rx.total_ucast_pkts: 0
dev.oce.1.stats.rx.total_rxcp_errs: 0
dev.oce.1.stats.rx.pause_frames: 0
dev.oce.1.stats.rx.priority_pause_frames: 0
dev.oce.1.stats.rx.control_frames: 0
dev.oce.1.stats.rx.queue0.rx_pkts: 0
dev.oce.1.stats.rx.queue0.rx_bytes: 0
dev.oce.1.stats.rx.queue0.rx_frags: 0
dev.oce.1.stats.rx.queue0.rx_mcast_pkts: 0
dev.oce.1.stats.rx.queue0.rx_ucast_pkts: 0
dev.oce.1.stats.rx.queue0.rxcp_err: 0
dev.oce.1.stats.rx.err.crc_errs: 0
dev.oce.1.stats.rx.err.pbuf_errors: 0
dev.oce.1.stats.rx.err.erx_errors: 0
dev.oce.1.stats.rx.err.alignment_errors: 0
dev.oce.1.stats.rx.err.in_range_errors: 0
dev.oce.1.stats.rx.err.out_range_errors: 0
dev.oce.1.stats.rx.err.frame_too_long: 0
dev.oce.1.stats.rx.err.address_match_errors: 0
dev.oce.1.stats.rx.err.dropped_too_small: 0
dev.oce.1.stats.rx.err.dropped_too_short: 0
dev.oce.1.stats.rx.err.dropped_header_too_small: 0
dev.oce.1.stats.rx.err.dropped_tcp_length: 0
dev.oce.1.stats.rx.err.dropped_runt: 0
dev.oce.1.stats.rx.err.ip_checksum_errs: 0
dev.oce.1.stats.rx.err.tcp_checksum_errs: 0
dev.oce.1.stats.rx.err.udp_checksum_errs: 0
dev.oce.1.stats.rx.err.fifo_overflow_drop: 0
dev.oce.1.stats.rx.err.input_fifo_overflow_drop: 0
dev.oce.1.stats.tx.total_tx_pkts: 0
dev.oce.1.stats.tx.total_tx_bytes: 0
dev.oce.1.stats.tx.total_tx_reqs: 0
dev.oce.1.stats.tx.total_tx_stops: 0
dev.oce.1.stats.tx.total_tx_wrbs: 0
dev.oce.1.stats.tx.total_tx_compl: 0
dev.oce.1.stats.tx.total_ipv6_ext_hdr_tx_drop: 0
dev.oce.1.stats.tx.pauseframes: 0
dev.oce.1.stats.tx.priority_pauseframes: 0
dev.oce.1.stats.tx.controlframes: 0
dev.oce.1.stats.tx.queue0.tx_pkts: 0
dev.oce.1.stats.tx.queue0.tx_bytes: 0
dev.oce.1.stats.tx.queue0.tx_reqs: 0
dev.oce.1.stats.tx.queue0.tx_stops: 0
dev.oce.1.stats.tx.queue0.tx_wrbs: 0
dev.oce.1.stats.tx.queue0.tx_compl: 0
dev.oce.1.stats.tx.queue0.ipv6_ext_hdr_tx_drop: 0

Machine information:

root@pruebas:~ # pciconf -lveV
hostb0@pci0:0:0:0:	class=0x060000 card=0x02f11028 chip=0x34038086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5500 I/O Hub to ESI Port'
    class      = bridge
    subclass   = HOST-PCI
pcib1@pci0:0:1:0:	class=0x060400 card=0x02f11028 chip=0x34088086 rev=0x13 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub PCI Express Root Port 1'
    class      = bridge
    subclass   = PCI-PCI
pcib2@pci0:0:3:0:	class=0x060400 card=0x02f11028 chip=0x340a8086 rev=0x13 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub PCI Express Root Port 3'
    class      = bridge
    subclass   = PCI-PCI
pcib3@pci0:0:7:0:	class=0x060400 card=0x02f11028 chip=0x340e8086 rev=0x13 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub PCI Express Root Port 7'
    class      = bridge
    subclass   = PCI-PCI
pcib4@pci0:0:9:0:	class=0x060400 card=0x02f11028 chip=0x34108086 rev=0x13 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub PCI Express Root Port 9'
    class      = bridge
    subclass   = PCI-PCI
pcib5@pci0:0:10:0:	class=0x060400 card=0x02f11028 chip=0x34118086 rev=0x13 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub PCI Express Root Port 10'
    class      = bridge
    subclass   = PCI-PCI
none0@pci0:0:20:0:	class=0x080000 card=0x00000000 chip=0x342e8086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub System Management Registers'
    class      = base peripheral
    subclass   = interrupt controller
none1@pci0:0:20:1:	class=0x080000 card=0x00000000 chip=0x34228086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers'
    class      = base peripheral
    subclass   = interrupt controller
none2@pci0:0:20:2:	class=0x080000 card=0x00000000 chip=0x34238086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 I/O Hub Control Status and RAS Registers'
    class      = base peripheral
    subclass   = interrupt controller
none3@pci0:0:22:0:	class=0x088000 card=0x02f11028 chip=0x34308086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none4@pci0:0:22:1:	class=0x088000 card=0x02f11028 chip=0x34318086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none5@pci0:0:22:2:	class=0x088000 card=0x02f11028 chip=0x34328086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none6@pci0:0:22:3:	class=0x088000 card=0x02f11028 chip=0x34338086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none7@pci0:0:22:4:	class=0x088000 card=0x02f11028 chip=0x34298086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none8@pci0:0:22:5:	class=0x088000 card=0x02f11028 chip=0x342a8086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none9@pci0:0:22:6:	class=0x088000 card=0x02f11028 chip=0x342b8086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
none10@pci0:0:22:7:	class=0x088000 card=0x02f11028 chip=0x342c8086 rev=0x13 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5520/5500/X58 Chipset QuickData Technology Device'
    class      = base peripheral
uhci0@pci0:0:26:0:	class=0x0c0300 card=0x02f11028 chip=0x3a378086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
uhci1@pci0:0:26:1:	class=0x0c0300 card=0x02f11028 chip=0x3a388086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
ehci0@pci0:0:26:7:	class=0x0c0320 card=0x02f11028 chip=0x3a3c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB2 EHCI Controller'
    class      = serial bus
    subclass   = USB
uhci2@pci0:0:29:0:	class=0x0c0300 card=0x02f11028 chip=0x3a348086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
uhci3@pci0:0:29:1:	class=0x0c0300 card=0x02f11028 chip=0x3a358086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
uhci4@pci0:0:29:2:	class=0x0c0300 card=0x02f11028 chip=0x3a368086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
uhci5@pci0:0:29:3:	class=0x0c0300 card=0x02f11028 chip=0x3a398086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB UHCI Controller'
    class      = serial bus
    subclass   = USB
ehci1@pci0:0:29:7:	class=0x0c0320 card=0x02f11028 chip=0x3a3a8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JI (ICH10 Family) USB2 EHCI Controller'
    class      = serial bus
    subclass   = USB
pcib6@pci0:0:30:0:	class=0x060401 card=0x02f11028 chip=0x244e8086 rev=0x90 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '82801 PCI Bridge'
    class      = bridge
    subclass   = PCI-PCI
isab0@pci0:0:31:0:	class=0x060100 card=0x02f11028 chip=0x3a168086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82801JIR (ICH10R) LPC Interface Controller'
    class      = bridge
    subclass   = PCI-ISA
bce0@pci0:1:0:0:	class=0x020000 card=0x02f11028 chip=0x163b14e4 rev=0x20 hdr=0x00
    vendor     = 'Broadcom Corporation'
    device     = 'NetXtreme II BCM5716 Gigabit Ethernet'
    class      = network
    subclass   = ethernet
  PCI-e errors = Correctable Error Detected
                 Unsupported Request Detected
     Corrected = Advisory Non-Fatal Error
    VPD ident  = 'Broadcom NetXtreme II Ethernet Controller'
    VPD ro PN  = 'BCM95716C1'
    VPD ro EC  = '220197-3'
    VPD ro SN  = '0123456789'
    VPD ro MN  = '1028'
    VPD ro V0  = '6.2.12'
bce1@pci0:1:0:1:	class=0x020000 card=0x02f11028 chip=0x163b14e4 rev=0x20 hdr=0x00
    vendor     = 'Broadcom Corporation'
    device     = 'NetXtreme II BCM5716 Gigabit Ethernet'
    class      = network
    subclass   = ethernet
  PCI-e errors = Correctable Error Detected
                 Unsupported Request Detected
     Corrected = Advisory Non-Fatal Error
    VPD ident  = 'Broadcom NetXtreme II Ethernet Controller'
    VPD ro PN  = 'BCM95716C1'
    VPD ro EC  = '220197-3'
    VPD ro SN  = '0123456789'
    VPD ro MN  = '1028'
    VPD ro V0  = '6.2.12'
mps0@pci0:2:0:0:	class=0x010700 card=0x1f1e1028 chip=0x00721000 rev=0x02 hdr=0x00
    vendor     = 'LSI Logic / Symbios Logic'
    device     = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
    class      = mass storage
    subclass   = SAS
oce0@pci0:3:0:0:	class=0x020000 card=0xe62910df chip=0x070019a2 rev=0x02 hdr=0x00
    vendor     = 'Emulex Corporation'
    device     = 'OneConnect 10Gb NIC'
    class      = network
    subclass   = ethernet
  PCI-e errors = Correctable Error Detected
                 Unsupported Request Detected
     Corrected = Advisory Non-Fatal Error
oce1@pci0:3:0:1:	class=0x020000 card=0xe62910df chip=0x070019a2 rev=0x02 hdr=0x00
    vendor     = 'Emulex Corporation'
    device     = 'OneConnect 10Gb NIC'
    class      = network
    subclass   = ethernet
  PCI-e errors = Correctable Error Detected
                 Unsupported Request Detected
     Corrected = Advisory Non-Fatal Error
vgapci0@pci0:6:3:0:	class=0x030000 card=0x02f11028 chip=0x0532102b rev=0x0a hdr=0x00
    vendor     = 'Matrox Graphics, Inc.'
    device     = 'MGA G200eW WPCM450'
    class      = display
    subclass   = VGA
hostb1@pci0:255:0:0:	class=0x060000 card=0x80868086 chip=0x2c708086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QuickPath Architecture Generic Non-core Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb2@pci0:255:0:1:	class=0x060000 card=0x80868086 chip=0x2d818086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QuickPath Architecture System Address Decoder'
    class      = bridge
    subclass   = HOST-PCI
hostb3@pci0:255:2:0:	class=0x060000 card=0x80868086 chip=0x2d908086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Link 0'
    class      = bridge
    subclass   = HOST-PCI
hostb4@pci0:255:2:1:	class=0x060000 card=0x80868086 chip=0x2d918086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Physical 0'
    class      = bridge
    subclass   = HOST-PCI
hostb5@pci0:255:2:2:	class=0x060000 card=0x80868086 chip=0x2d928086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Mirror Port Link 0'
    class      = bridge
    subclass   = HOST-PCI
hostb6@pci0:255:2:3:	class=0x060000 card=0x80868086 chip=0x2d938086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Mirror Port Link 1'
    class      = bridge
    subclass   = HOST-PCI
hostb7@pci0:255:2:4:	class=0x060000 card=0x80868086 chip=0x2d948086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Link 1'
    class      = bridge
    subclass   = HOST-PCI
hostb8@pci0:255:2:5:	class=0x060000 card=0x80868086 chip=0x2d958086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Physical 1'
    class      = bridge
    subclass   = HOST-PCI
hostb9@pci0:255:3:0:	class=0x060000 card=0x80868086 chip=0x2d988086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb10@pci0:255:3:1:	class=0x060000 card=0x80868086 chip=0x2d998086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Target Address Decoder'
    class      = bridge
    subclass   = HOST-PCI
hostb11@pci0:255:3:2:	class=0x060000 card=0x80868086 chip=0x2d9a8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller RAS Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb12@pci0:255:3:4:	class=0x060000 card=0x80868086 chip=0x2d9c8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Test Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb13@pci0:255:4:0:	class=0x060000 card=0x80868086 chip=0x2da08086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Control'
    class      = bridge
    subclass   = HOST-PCI
hostb14@pci0:255:4:1:	class=0x060000 card=0x80868086 chip=0x2da18086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Address'
    class      = bridge
    subclass   = HOST-PCI
hostb15@pci0:255:4:2:	class=0x060000 card=0x80868086 chip=0x2da28086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Rank'
    class      = bridge
    subclass   = HOST-PCI
hostb16@pci0:255:4:3:	class=0x060000 card=0x80868086 chip=0x2da38086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Thermal Control'
    class      = bridge
    subclass   = HOST-PCI
hostb17@pci0:255:5:0:	class=0x060000 card=0x80868086 chip=0x2da88086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Control'
    class      = bridge
    subclass   = HOST-PCI
hostb18@pci0:255:5:1:	class=0x060000 card=0x80868086 chip=0x2da98086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Address'
    class      = bridge
    subclass   = HOST-PCI
hostb19@pci0:255:5:2:	class=0x060000 card=0x80868086 chip=0x2daa8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Rank'
    class      = bridge
    subclass   = HOST-PCI
hostb20@pci0:255:5:3:	class=0x060000 card=0x80868086 chip=0x2dab8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Thermal Control'
    class      = bridge
    subclass   = HOST-PCI
hostb21@pci0:255:6:0:	class=0x060000 card=0x80868086 chip=0x2db08086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Control'
    class      = bridge
    subclass   = HOST-PCI
hostb22@pci0:255:6:1:	class=0x060000 card=0x80868086 chip=0x2db18086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Address'
    class      = bridge
    subclass   = HOST-PCI
hostb23@pci0:255:6:2:	class=0x060000 card=0x80868086 chip=0x2db28086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Rank'
    class      = bridge
    subclass   = HOST-PCI
hostb24@pci0:255:6:3:	class=0x060000 card=0x80868086 chip=0x2db38086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Thermal Control'
    class      = bridge
    subclass   = HOST-PCI
hostb25@pci0:254:0:0:	class=0x060000 card=0x80868086 chip=0x2c708086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QuickPath Architecture Generic Non-core Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb26@pci0:254:0:1:	class=0x060000 card=0x80868086 chip=0x2d818086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QuickPath Architecture System Address Decoder'
    class      = bridge
    subclass   = HOST-PCI
hostb27@pci0:254:2:0:	class=0x060000 card=0x80868086 chip=0x2d908086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Link 0'
    class      = bridge
    subclass   = HOST-PCI
hostb28@pci0:254:2:1:	class=0x060000 card=0x80868086 chip=0x2d918086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Physical 0'
    class      = bridge
    subclass   = HOST-PCI
hostb29@pci0:254:2:2:	class=0x060000 card=0x80868086 chip=0x2d928086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Mirror Port Link 0'
    class      = bridge
    subclass   = HOST-PCI
hostb30@pci0:254:2:3:	class=0x060000 card=0x80868086 chip=0x2d938086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Mirror Port Link 1'
    class      = bridge
    subclass   = HOST-PCI
hostb31@pci0:254:2:4:	class=0x060000 card=0x80868086 chip=0x2d948086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Link 1'
    class      = bridge
    subclass   = HOST-PCI
hostb32@pci0:254:2:5:	class=0x060000 card=0x80868086 chip=0x2d958086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series QPI Physical 1'
    class      = bridge
    subclass   = HOST-PCI
hostb33@pci0:254:3:0:	class=0x060000 card=0x80868086 chip=0x2d988086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb34@pci0:254:3:1:	class=0x060000 card=0x80868086 chip=0x2d998086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Target Address Decoder'
    class      = bridge
    subclass   = HOST-PCI
hostb35@pci0:254:3:2:	class=0x060000 card=0x80868086 chip=0x2d9a8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller RAS Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb36@pci0:254:3:4:	class=0x060000 card=0x80868086 chip=0x2d9c8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Test Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb37@pci0:254:4:0:	class=0x060000 card=0x80868086 chip=0x2da08086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Control'
    class      = bridge
    subclass   = HOST-PCI
hostb38@pci0:254:4:1:	class=0x060000 card=0x80868086 chip=0x2da18086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Address'
    class      = bridge
    subclass   = HOST-PCI
hostb39@pci0:254:4:2:	class=0x060000 card=0x80868086 chip=0x2da28086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Rank'
    class      = bridge
    subclass   = HOST-PCI
hostb40@pci0:254:4:3:	class=0x060000 card=0x80868086 chip=0x2da38086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 0 Thermal Control'
    class      = bridge
    subclass   = HOST-PCI
hostb41@pci0:254:5:0:	class=0x060000 card=0x80868086 chip=0x2da88086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Control'
    class      = bridge
    subclass   = HOST-PCI
hostb42@pci0:254:5:1:	class=0x060000 card=0x80868086 chip=0x2da98086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Address'
    class      = bridge
    subclass   = HOST-PCI
hostb43@pci0:254:5:2:	class=0x060000 card=0x80868086 chip=0x2daa8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Rank'
    class      = bridge
    subclass   = HOST-PCI
hostb44@pci0:254:5:3:	class=0x060000 card=0x80868086 chip=0x2dab8086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 1 Thermal Control'
    class      = bridge
    subclass   = HOST-PCI
hostb45@pci0:254:6:0:	class=0x060000 card=0x80868086 chip=0x2db08086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Control'
    class      = bridge
    subclass   = HOST-PCI
hostb46@pci0:254:6:1:	class=0x060000 card=0x80868086 chip=0x2db18086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Address'
    class      = bridge
    subclass   = HOST-PCI
hostb47@pci0:254:6:2:	class=0x060000 card=0x80868086 chip=0x2db28086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Rank'
    class      = bridge
    subclass   = HOST-PCI
hostb48@pci0:254:6:3:	class=0x060000 card=0x80868086 chip=0x2db38086 rev=0x02 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Xeon 5600 Series Integrated Memory Controller Channel 2 Thermal Control'
    class      = bridge
    subclass   = HOST-PCI
root@pruebas:~ # 


(/var/run/dmesg.boot)
root@pruebas:~ # cat /var/run/dmesg.boot 
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.3-BETA3 #0 r267433: Fri Jun 13 01:48:48 UTC 2014
    root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Xeon(R) CPU           L5640  @ 2.27GHz (2266.79-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x206c2  Family = 0x6  Model = 0x2c  Stepping = 2
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x29ee3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AESNI>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 25769803776 (24576 MB)
avail memory = 24828514304 (23678 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <DELL   PE_SC3  >
FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID: 32
 cpu1 (AP): APIC ID: 33
 cpu2 (AP): APIC ID: 34
 cpu3 (AP): APIC ID: 35
 cpu4 (AP): APIC ID: 36
 cpu5 (AP): APIC ID: 37
 cpu6 (AP): APIC ID: 48
 cpu7 (AP): APIC ID: 49
 cpu8 (AP): APIC ID: 50
 cpu9 (AP): APIC ID: 51
 cpu10 (AP): APIC ID: 52
 cpu11 (AP): APIC ID: 53
 cpu12 (AP): APIC ID:  0
 cpu13 (AP): APIC ID:  1
 cpu14 (AP): APIC ID:  2
 cpu15 (AP): APIC ID:  3
 cpu16 (AP): APIC ID:  4
 cpu17 (AP): APIC ID:  5
 cpu18 (AP): APIC ID: 16
 cpu19 (AP): APIC ID: 17
 cpu20 (AP): APIC ID: 18
 cpu21 (AP): APIC ID: 19
 cpu22 (AP): APIC ID: 20
 cpu23 (AP): APIC ID: 21
ioapic1: Changing APIC ID to 1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 32-55 on motherboard
kbd1 at kbdmux0
acpi0: <DELL PE_SC3> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
cpu8: <ACPI CPU> on acpi0
cpu9: <ACPI CPU> on acpi0
cpu10: <ACPI CPU> on acpi0
cpu11: <ACPI CPU> on acpi0
cpu12: <ACPI CPU> on acpi0
cpu13: <ACPI CPU> on acpi0
cpu14: <ACPI CPU> on acpi0
cpu15: <ACPI CPU> on acpi0
cpu16: <ACPI CPU> on acpi0
cpu17: <ACPI CPU> on acpi0
cpu18: <ACPI CPU> on acpi0
cpu19: <ACPI CPU> on acpi0
cpu20: <ACPI CPU> on acpi0
cpu21: <ACPI CPU> on acpi0
cpu22: <ACPI CPU> on acpi0
cpu23: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x5f irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Event timer "HPET3" frequency 14318180 Hz quality 440
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
bce0: <QLogic NetXtreme II BCM5716 1000Base-T (C0)> mem 0xda000000-0xdbffffff irq 36 at device 0.0 on pci1
miibus0: <MII bus> on bce0
brgphy0: <BCM5709 10/100/1000baseT PHY> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bce0: Ethernet address: 78:2b:cb:1b:4a:61
bce0: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (5.2.3); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI|MFW); MFW (NCSI 2.0.11)
Coal (RX:6,6,18,18; TX:20,20,80,80)
bce1: <QLogic NetXtreme II BCM5716 1000Base-T (C0)> mem 0xdc000000-0xddffffff irq 48 at device 0.1 on pci1
miibus1: <MII bus> on bce1
brgphy1: <BCM5709 10/100/1000baseT PHY> PHY 1 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bce1: Ethernet address: 78:2b:cb:1b:4a:62
bce1: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (5.2.3); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI|MFW); MFW (NCSI 2.0.11)
Coal (RX:6,6,18,18; TX:20,20,80,80)
pcib2: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci2: <ACPI PCI bus> on pcib2
mps0: <LSI SAS2008> port 0xfc00-0xfcff mem 0xdf2b0000-0xdf2bffff,0xdf2c0000-0xdf2fffff irq 32 at device 0.0 on pci2
mps0: Firmware: 14.00.00.00, Driver: 16.00.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib3: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pci3: <network, ethernet> at device 0.0 (no driver attached)
pci3: <network, ethernet> at device 0.1 (no driver attached)
pcib4: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 10.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pci0: <base peripheral, interrupt controller> at device 20.0 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.1 (no driver attached)
pci0: <base peripheral, interrupt controller> at device 20.2 (no driver attached)
uhci0: <Intel 82801JI (ICH10) USB controller USB-D> port 0xec40-0xec5f irq 17 at device 26.0 on pci0
usbus0 on uhci0
uhci1: <Intel 82801JI (ICH10) USB controller USB-E> port 0xec60-0xec7f irq 18 at device 26.1 on pci0
usbus1 on uhci1
ehci0: <Intel 82801JI (ICH10) USB 2.0 controller USB-B> mem 0xdf0de000-0xdf0de3ff irq 19 at device 26.7 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci0
uhci2: <Intel 82801JI (ICH10) USB controller USB-A> port 0xec80-0xec9f irq 21 at device 29.0 on pci0
usbus3 on uhci2
uhci3: <Intel 82801JI (ICH10) USB controller USB-B> port 0xeca0-0xecbf irq 20 at device 29.1 on pci0
usbus4 on uhci3
uhci4: <Intel 82801JI (ICH10) USB controller USB-C> port 0xecc0-0xecdf irq 21 at device 29.2 on pci0
usbus5 on uhci4
uhci5: <Intel 82801JI (ICH10) USB controller USB-F> port 0xece0-0xecff irq 20 at device 29.3 on pci0
usbus6 on uhci5
ehci1: <Intel 82801JI (ICH10) USB 2.0 controller USB-A> mem 0xdf0df000-0xdf0df3ff irq 21 at device 29.7 on pci0
usbus7: EHCI version 1.0
usbus7 on ehci1
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci6: <ACPI PCI bus> on pcib6
vgapci0: <VGA-compatible display> mem 0xd9800000-0xd9ffffff,0xde7fc000-0xde7fffff,0xde800000-0xdeffffff irq 19 at device 3.0 on pci6
vgapci0: Boot video device
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
qpi0: <QPI system bus> on motherboard
pcib7: <QPI Host-PCI bridge> pcibus 255 on qpi0
pci255: <PCI bus> on pcib7
pcib8: <QPI Host-PCI bridge> pcibus 254 on qpi0
pci254: <PCI bus> on pcib8
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcdfff,0xce000-0xcf7ff,0xcf800-0xd07ff,0xec000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est0 attach returned 6
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est2 attach returned 6
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est3 attach returned 6
p4tcc3: <CPU Frequency Thermal Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est4 attach returned 6
p4tcc4: <CPU Frequency Thermal Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est5 attach returned 6
p4tcc5: <CPU Frequency Thermal Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est6 attach returned 6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est7 attach returned 6
p4tcc7: <CPU Frequency Thermal Control> on cpu7
est8: <Enhanced SpeedStep Frequency Control> on cpu8
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est8 attach returned 6
p4tcc8: <CPU Frequency Thermal Control> on cpu8
est9: <Enhanced SpeedStep Frequency Control> on cpu9
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est9 attach returned 6
p4tcc9: <CPU Frequency Thermal Control> on cpu9
est10: <Enhanced SpeedStep Frequency Control> on cpu10
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est10 attach returned 6
p4tcc10: <CPU Frequency Thermal Control> on cpu10
est11: <Enhanced SpeedStep Frequency Control> on cpu11
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est11 attach returned 6
p4tcc11: <CPU Frequency Thermal Control> on cpu11
est12: <Enhanced SpeedStep Frequency Control> on cpu12
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est12 attach returned 6
p4tcc12: <CPU Frequency Thermal Control> on cpu12
est13: <Enhanced SpeedStep Frequency Control> on cpu13
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est13 attach returned 6
p4tcc13: <CPU Frequency Thermal Control> on cpu13
est14: <Enhanced SpeedStep Frequency Control> on cpu14
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est14 attach returned 6
p4tcc14: <CPU Frequency Thermal Control> on cpu14
est15: <Enhanced SpeedStep Frequency Control> on cpu15
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est15 attach returned 6
p4tcc15: <CPU Frequency Thermal Control> on cpu15
est16: <Enhanced SpeedStep Frequency Control> on cpu16
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est16 attach returned 6
p4tcc16: <CPU Frequency Thermal Control> on cpu16
est17: <Enhanced SpeedStep Frequency Control> on cpu17
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est17 attach returned 6
p4tcc17: <CPU Frequency Thermal Control> on cpu17
est18: <Enhanced SpeedStep Frequency Control> on cpu18
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est18 attach returned 6
p4tcc18: <CPU Frequency Thermal Control> on cpu18
est19: <Enhanced SpeedStep Frequency Control> on cpu19
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est19 attach returned 6
p4tcc19: <CPU Frequency Thermal Control> on cpu19
est20: <Enhanced SpeedStep Frequency Control> on cpu20
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est20 attach returned 6
p4tcc20: <CPU Frequency Thermal Control> on cpu20
est21: <Enhanced SpeedStep Frequency Control> on cpu21
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est21 attach returned 6
p4tcc21: <CPU Frequency Thermal Control> on cpu21
est22: <Enhanced SpeedStep Frequency Control> on cpu22
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est22 attach returned 6
p4tcc22: <CPU Frequency Thermal Control> on cpu22
est23: <Enhanced SpeedStep Frequency Control> on cpu23
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est23 attach returned 6
p4tcc23: <CPU Frequency Thermal Control> on cpu23
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 480Mbps High Speed USB v2.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 12Mbps Full Speed USB v1.0
usbus6: 12Mbps Full Speed USB v1.0
usbus7: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <Intel> at usbus4
uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen5.1: <Intel> at usbus5
uhub5: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
ugen6.1: <Intel> at usbus6
uhub6: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen7.1: <Intel> at usbus7
uhub7: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus7
da0 at mps0 bus 0 scbus0 target 8 lun 0
da0: <SEAGATE ST9146803SS FS64> Fixed Direct Access SCSI-5 device 
da0: Serial Number 6SD2R026
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 140014MB (286749480 512 byte sectors: 255H 63S/T 17849C)
da1 at mps0 bus 0 scbus0 target 9 lun 0
da1: <SEAGATE ST9146803SS FS64> Fixed Direct Access SCSI-5 device 
da1: Serial Number 6SD2QE3N
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 140014MB (286749480 512 byte sectors: 255H 63S/T 17849C)
da2 at mps0 bus 0 scbus0 target 11 lun 0
da2: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da2: Serial Number OCZ-806BA2P5056GW75I
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da2: quirks=0x8<4K>
da3 at mps0 bus 0 scbus0 target 12 lun 0
da3: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da3: Serial Number OCZ-XF296AZZ71QSP1ZW
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da3: quirks=0x8<4K>
da4 at mps0 bus 0 scbus0 target 13 lun 0
da4: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da4: Serial Number OCZ-XLEQGOUM0W4X8YEK
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da4: quirks=0x8<4K>
da5 at mps0 bus 0 scbus0 target 14 lun 0
da5: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da5: Serial Number OCZ-Y95766VPB527422Z
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da5: quirks=0x8<4K>
da6 at mps0 bus 0 scbus0 target 15 lun 0
da6: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da6: Serial Number OCZ-P41W6HED0801IAL3
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da6: quirks=0x8<4K>
da7 at mps0 bus 0 scbus0 target 16 lun 0
da7: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da7: Serial Number OCZ-YB60WW78PP6BK4TM
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da7: quirks=0x8<4K>
da8 at mps0 bus 0 scbus0 target 17 lun 0
da8: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da8: Serial Number OCZ-G8477U602103SBQ3
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da8: quirks=0x8<4K>
da9 at mps0 bus 0 scbus0 target 18 lun 0
da9: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da9: Serial Number OCZ-5Z928G69IA2N6WN7
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da9: quirks=0x8<4K>
da10 at mps0 bus 0 scbus0 target 19 lun 0
da10: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da10: Serial Number OCZ-K008HT13IQ31VK3F
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da10: quirks=0x8<4K>
da11 at mps0 bus 0 scbus0 target 20 lun 0
da11: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da11: Serial Number OCZ-I276ZFJW8I19B288
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da11: quirks=0x8<4K>
da12 at mps0 bus 0 scbus0 target 21 lun 0
da12: <ATA OCZ-VERTEX4 1.5> Fixed Direct Access SCSI-6 device 
da12: Serial Number OCZ-JHK0L1B3K0UJC91U
da12: 600.000MB/s transfers
da12: Command Queueing enabled
da12: 488386MB (1000215216 512 byte sectors: 255H 63S/T 62260C)
da12: quirks=0x8<4K>
SMP: AP CPU #1 Launched!
SMP: AP CPU #23 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #22 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #18 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #19 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #20 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #21 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #15 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #17 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #16 Launched!
Timecounter "TSC-low" frequency 1133396472 Hz quality 1000
uhub6: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub0: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
Root mount waiting for: usbus7 usbus2
Root mount waiting for: usbus7 usbus2
uhub2: 4 ports with 4 removable, self powered
uhub7: 4 ports with 4 removable, self powered
Root mount waiting for: usbus7 usbus2
ugen2.2: <vendor 0x0424> at usbus2
uhub8: <vendor 0x0424 product 0x2514, class 9/0, rev 2.00/0.00, addr 2> on usbus2
uhub8: MTT enabled
uhub8: 4 ports with 4 removable, self powered
Root mount waiting for: usbus7 usbus2
ugen2.3: <Mitsumi Electric> at usbus2
uhub9: <Mitsumi Electric Hub in Apple Extended USB Keyboard, class 9/0, rev 1.10/4.00, addr 3> on usbus2
ugen7.2: <LaCie> at usbus7
umass0: <LaCie LaCie CooKey, class 0/0, rev 2.00/11.00, addr 2> on usbus7
umass0:  SCSI over Bulk-Only; quirks = 0x0100
umass0:1:0:-1: Attached to scbus1
da13 at umass-sim0 bus 0 scbus1 target 0 lun 0
da13: <LaCie CooKey 1100> Removable Direct Access SCSI-4 device 
da13: Serial Number 3ENXRQO0QDYMK5QO
da13: 40.000MB/s transfers
da13: 15480MB (31703040 512 byte sectors: 255H 63S/T 1973C)
da13: quirks=0x2<NO_6_BYTE>
uhub9: 3 ports with 2 removable, bus powered
Root mount waiting for: usbus2
ugen2.4: <Mitsumi Electric> at usbus2
ukbd0: <Mitsumi Electric Apple Extended USB Keyboard, class 0/0, rev 1.10/4.00, addr 4> on usbus2
kbd2 at ukbd0
uhid0: <Mitsumi Electric Apple Extended USB Keyboard, class 0/0, rev 1.10/4.00, addr 4> on usbus2
Trying to mount root from ufs:/dev/da13p2 [rw]...
WARNING: / was not properly dismounted
ugen3.2: <Avocent> at usbus3
ukbd1: <Keyboard> on usbus3
kbd3 at ukbd1
ums0: <Mouse> on usbus3
ums0: 3 buttons and [Z] coordinates ID=0
root@pruebas:~ #
Comment 12 Borja Marcos 2014-06-18 14:07:45 UTC
I've compiled the latest driver supplied by Emulex.

Jun 18 17:47:22 pruebas kernel: oce0: <Emulex CNA NIC function:///10.0.747.0///> mem 0xdf478000-0xdf47bfff,0xdf480000-0xdf49ffff,0xdf4a0000-0xdf4bffff irq 38 at device 0.0 on pci3

Jun 18 17:47:22 pruebas kernel: oce1: <Emulex CNA NIC function:///10.0.747.0///> mem 0xdf47c000-0xdf47ffff,0xdf4c0000-0xdf4dffff,0xdf4e0000-0xdf4fffff irq 45 at device 0.1 on pci3


Running with this latest driver on 9.3-BETA3 it doesn't crash or freeze. At least I managed to keep a lot of traffic running for a couple of minutes.

The driver doesn't compile cleanly, I just commented out a couple of ifdefs and probably I broke something. Some adult please check this ;)

--- oce_if.c	2014-06-18 17:33:34.000000000 +0200
+++ oce_if.c.orig	2013-12-05 14:26:55.000000000 +0100
@@ -1232,7 +1232,7 @@
 }
 
 
-// #if __FreeBSD_version >= 1000000
+#if __FreeBSD_version >= 1000000
 static __inline void
 drbr_stats_update(struct ifnet *ifp, int len, int mflags)
 {
@@ -1242,7 +1242,7 @@
 		ifp->if_omcasts++;
 #endif
 }
-// #endif
+#endif
 
 static int 
 oce_multiq_transmit(struct ifnet *ifp, struct mbuf *m, struct oce_wq *wq)
Comment 13 Borja Marcos 2014-06-18 14:09:02 UTC
I downloaded the source code from here.

http://www.emulex.com/downloads/emulex/drivers/freebsd/freebsd-91-amd64/drivers/

To summarize:

Compiles cleanly and works on 10-STABLE

Can be compiled and works on 9.3-BETA3.
Comment 14 Kubilay Kocak freebsd_committer freebsd_triage 2014-06-18 14:35:39 UTC
Thank you Borjam, extremely helpful :)
Comment 15 Kubilay Kocak freebsd_committer freebsd_triage 2014-06-18 14:36:14 UTC
Updating Version to 9.3-BETA3 to reflect latest reproduction test.
Comment 16 Borja Marcos 2014-06-18 15:26:50 UTC
Remember, remember, the 10-STABLE of November, nonetheless :)
Comment 17 Borja Marcos 2014-07-16 07:01:12 UTC
Created attachment 144718 [details]
10-STABLE patch for the oce driver by Stefano Garzarella
Comment 18 Borja Marcos 2014-07-16 07:03:37 UTC
Luigi Rizzo and Stefano Garzarella pointed out several bugs. Notably, no locking operations in critical sections.

Stefano Garzarella sent a test patch against -STABLE. With the patch I haven't been able to reproduce the panics. 

Stefano noted that the latest version I was trying, 747, has some missing locking statements. 

Relevant thread on freebsd-net:

http://lists.freebsd.org/pipermail/freebsd-net/2014-July/039148.html
Comment 19 Eitan Adler freebsd_committer freebsd_triage 2018-05-28 19:46:06 UTC
batch change:

For bugs that match the following
-  Status Is In progress 
AND
- Untouched since 2018-01-01.
AND
- Affects Base System OR Documentation

DO:

Reset to open status.


Note:
I did a quick pass but if you are getting this email it might be worthwhile to double check to see if this bug ought to be closed.
Comment 20 Borja Marcos 2018-06-18 13:55:31 UTC
The bug is certainly open. My fault in part, I have been compiling the driver myself with Stefano's patch and I forgot that it hasn't been included on the base source. Which means I stopped pestering about it ;)

In summary:

Unless I am wrong, the driver was never updated, and this issue is still present
in 10, 11 and I assume CURRENT.

Can anyone have a look at it, please? It seems that the driver didn't have acquire some necessary locks. Or maybe a newer version that doesn't need those locks is included now? (But I doubt it!)
Comment 21 Borja Marcos 2018-06-18 14:01:48 UTC
Besides, this driver is a bit rusty :/ 

It doesn't report information about the attached SFP+ to ifconfig and the
media detection is broken at least with DA twinax cables, although at least it
does set the full-duplex flag properly.
Comment 22 kaleb.stolee+freebsd 2018-09-10 14:34:17 UTC
I can confirm the driver is still not updated in the livecd based on the base image (downloaded and tested last night).

I have an HPE branded emulex card (NC552SFP) that will not pass traffic with the 10.0.664.0 drivers. I'm in the process of building a Freenas kernel to include the updated oce 11.0.50.0 to see if that resolves my issues.

I did find the udpated driver source on the Freebsd github page (https://github.com/freebsd/freebsd/tree/master/sys/dev/oce), but it definitely was not updated when I pulled down the livecd and tested with that. 

Not sure why or where to go from here.