Attachment 203370 Details for Bug 235856 – dmesg with crash on t3.xlarge

dmesg with crash on t3.xlarge

t3.xlarge.txt (text/plain), 20.91 KB, created by Alex Dupre on 2019-04-04 07:46:02 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Alex Dupre

Created: 2019-04-04 07:46:02 UTC

Size: 20.91 KB

patch

obsolete

>Copyright (c) 1992-2018 The FreeBSD Project.
>Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>        The Regents of the University of California. All rights reserved.
>FreeBSD is a registered trademark of The FreeBSD Foundation.
>FreeBSD 12.0-RELEASE-p3 GENERIC amd64
>FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1)
>VT(vga): text 80x25
>CPU: HammerEM64T (2500.05-MHz K8-class CPU)
>  Origin="GenuineIntel"  Id=0x50654  Family=0x6  Model=0x55  Stepping=4
>  Features=0x1f83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS,HTT>
>  Features2=0xfffa3203<SSE3,PCLMULQDQ,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
>  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
>  AMD Features2=0x121<LAHF,ABM,Prefetch>
>  Structured Extended Features=0xd19f4fbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,AVX512CD,AVX512BW,AVX512VL>
>  Structured Extended Features2=0x8<PKU>
>  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
>  TSC: P-state invariant
>Hypervisor: Origin = "KVMKVMKVM"
>real memory  = 18056478720 (17220 MB)
>avail memory = 16427577344 (15666 MB)
>Event timer "LAPIC" quality 600
>ACPI APIC Table: <AMAZON AMZNAPIC>
>FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
>FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 hardware threads
>random: unblocking device.
>ioapic0 <Version 1.1> irqs 0-23 on motherboard
>Launching APs: 1 2 3
>random: entropy device external interface
>kbd0 at kbdmux0
>netmap: loaded module
>[ath_hal] loaded
>module_register_init: MOD_LOAD (vesa, 0xffffffff810f9770, 0) error 19
>random: registering fast source Intel Secure Key RNG
>random: fast provider: "Intel Secure Key RNG"
>nexus0
>vtvga0: <VT VGA driver> on motherboard
>cryptosoft0: <software crypto> on motherboard
>acpi0: <AMAZON AMZNRSDT> on motherboard
>acpi0: Power Button (fixed)
>acpi0: Sleep Button (fixed)
>cpu0: <ACPI CPU> on acpi0
>atrtc0: <AT realtime clock> port 0x70-0x71,0x72-0x77 irq 8 on acpi0
>atrtc0: registered as a time-of-day clock, resolution 1.000000s
>Event timer "RTC" frequency 32768 Hz quality 0
>Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
>acpi_timer0: <24-bit timer at 3.579545MHz> port 0xb008-0xb00b on acpi0
>pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>pci0: <ACPI PCI bus> on pcib0
>isab0: <PCI-ISA bridge> at device 1.0 on pci0
>isa0: <ISA bus> on isab0
>pci0: <old, non-VGA display device> at device 1.3 (no driver attached)
>vgapci0: <VGA-compatible display> mem 0xfe400000-0xfe7fffff at device 3.0 on pci0
>vgapci0: Boot video device
>nvme0: <Generic NVMe Device> mem 0xfebf0000-0xfebf3fff irq 11 at device 4.0 on pci0
>ena0: <ENA adapter> mem 0xfebf4000-0xfebf7fff at device 5.0 on pci0
>ena0: Elastic Network Adapter (ENA)ena v0.8.1
>ena0: initalize 4 io queues
>ena0: Ethernet address: 0a:50:3c:b9:97:66
>nvme1: <Generic NVMe Device> mem 0xfebf8000-0xfebfbfff irq 11 at device 31.0 on pci0
>uart0: <Non-standard ns8250 class UART with FIFOs> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
>uart0: console (115200,n,8,1)
>orm0: <ISA Option ROM> at iomem 0xef000-0xeffff pnpid ORM0000 on isa0
>vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
>attimer0: <AT timer> at port 0x40 on isa0
>Timecounter "i8254" frequency 1193182 Hz quality 0
>attimer0: Can't map interrupt.
>attimer0: non-PNP ISA device will be removed from GENERIC in FreeBSD 12.
>ena0: link is UP
>ena0: link state changed to UP
>Timecounters tick every 10.000 msec
>usb_needs_explore_all: no devclass
>nvme0: temperature threshold not supported
>nvd0: <Amazon Elastic Block Store> NVMe namespace
>nvd0: 10240MB (20971520 512 byte sectors)
>nvme1: temperature threshold not supported
>nvd1: <Amazon Elastic Block Store> NVMe namespace
>nvd1: 204800MB (419430400 512 byte sectors)
>Trying to mount root from ufs:/dev/gpt/rootfs [rw]...
>WARNING: / was not properly dismounted
>WARNING: /data was not properly dismounted
>lo0: link state changed to UP
>ena0: device is going UP
>ena0: device is going DOWN
>ena0: device is going UP
>intsmb0: <Intel PIIX4 SMBUS Interface> port 0xb100-0xb10f at device 1.3 on pci0
>intsmb0: intr IRQ 9 enabled revision 255
>smbus0: <System Management Bus> on intsmb0
>Security policy loaded: MAC/ntpd (mac_ntpd)
>Limiting closed port RST response from 210 to 200 packets/sec
>Limiting closed port RST response from 205 to 200 packets/sec
>Limiting closed port RST response from 212 to 200 packets/sec
>Limiting closed port RST response from 238 to 200 packets/sec
>Limiting closed port RST response from 262 to 200 packets/sec
>Limiting closed port RST response from 254 to 200 packets/sec
>Limiting closed port RST response from 215 to 200 packets/sec
>Limiting closed port RST response from 214 to 200 packets/sec
>Limiting closed port RST response from 239 to 200 packets/sec
>Limiting closed port RST response from 324 to 200 packets/sec
>Limiting closed port RST response from 211 to 200 packets/sec
>Limiting closed port RST response from 221 to 200 packets/sec
>Limiting closed port RST response from 203 to 200 packets/sec
>Limiting closed port RST response from 358 to 200 packets/sec
>Limiting closed port RST response from 202 to 200 packets/sec
>Limiting closed port RST response from 282 to 200 packets/sec
>nvme1: cpl does not map to outstanding cmd
>cdw0:00000000 sqhd:001b sqid:0001 cid:001a p:1 sc:00 sct:0 m:0 dnr:0
>nvme1: Missing interrupt
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 0 idx 0x177ena0: free uncompleted tx mbuf qid 3 idx 0x2d1ena0: device is going UP
>ena0: link is UP
>nvme1: Resetting controller due to a timeout.
>nvme1: resetting controller
>nvme1: temperature threshold not supported
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:1 nsid:1 lba:10570048 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:1 cdw0:0
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 0 idx 0xbena0: free uncompleted tx mbuf qid 2 idx 0x2d6ena0: free uncompleted tx mbuf qid 3 idx 0x0ena0: ena0: device is going UP
>link is UP
>ena0: Keep alive watchdog timeout.
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 1 idx 0x24cena0: device is going UP
>ena0: link is UP
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme0: Missing interrupt
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 0 idx 0x368ena0: free uncompleted tx mbuf qid 2 idx 0x12ena0: free uncompleted tx mbuf qid 3 idx 0x294ena0: device is going UP
>ena0: link is UP
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>nvme1: cpl does not map to outstanding cmd
>cdw0:00000000 sqhd:000c sqid:0001 cid:0016 p:1 sc:00 sct:0 m:0 dnr:0
>nvme1: Missing interrupt
>ena0: free uncompleted tx mbuf qid 1 idx 0x22eena0: ena0: device is going UP
>link is UP
>nvme1: Resetting controller due to a timeout.
>nvme1: resetting controller
>nvme1: temperature threshold not supported
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:26 nsid:1 lba:180679168 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:26 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:2 cid:22 nsid:1 lba:210327808 len:16
>nvme1: ABORTED - BY REQUEST (00/07) sqid:2 cid:22 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:2 cid:3 nsid:1 lba:128 len:8
>nvme1: ABORTED - BY REQUEST (00/07) sqid:2 cid:3 cdw0:0
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>ena0: free uncompleted tx mbuf qid 1 idx 0x235
>stray irq261
>ena0: device is going UP
>ena0: link is UP
>nvme0: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme1: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme1: Missing interrupt
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>nvme1: cpl does not map to outstanding cmd
>cdw0:00000000 sqhd:0003 sqid:0001 cid:0003 p:0 sc:00 sct:0 m:0 dnr:0
>nvme1: Missing interrupt
>ena0: free uncompleted tx mbuf qid 0 idx 0xe6ena0: free uncompleted tx mbuf qid 1 idx 0x26eena0: ena0: device is going UP
>link is UP
>nvme1: Resetting controller due to a timeout.
>nvme1: nvme1: Resetting controller due to a timeout.
>resetting controller
>nvme1: temperature threshold not supported
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:3 nsid:1 lba:210327808 len:16
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:3 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:128 len:8
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:0 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:1 nsid:1 lba:107806400 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:1 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:23 nsid:1 lba:60071296 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:23 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:21 nsid:1 lba:180679168 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:21 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:8 nsid:1 lba:107787840 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:8 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:16 nsid:1 lba:180680768 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:16 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:27 nsid:1 lba:247015616 len:128
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:27 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:17 nsid:1 lba:109724672 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:17 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:11 nsid:1 lba:113391552 len:128
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:11 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:5 nsid:1 lba:5220928 len:192
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:5 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:22 nsid:1 lba:5169416 len:48
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:22 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: READ sqid:1 cid:30 nsid:1 lba:158941376 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:30 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:2 nsid:1 lba:5129216 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:2 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:20 nsid:1 lba:5129280 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:20 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:14 nsid:1 lba:56418880 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:14 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:4 nsid:1 lba:103861760 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:4 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:26 nsid:1 lba:107708416 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:26 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:24 nsid:1 lba:107708480 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:24 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:28 nsid:1 lba:107708544 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:28 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:15 nsid:1 lba:107708608 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:15 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:29 nsid:1 lba:107708672 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:29 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:6 nsid:1 lba:107708736 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:6 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:13 nsid:1 lba:107708928 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:13 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:12 nsid:1 lba:107708992 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:12 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:9 nsid:1 lba:107709056 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:9 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:18 nsid:1 lba:107709120 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:18 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:25 nsid:1 lba:107709184 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:25 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:19 nsid:1 lba:107709248 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:19 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:10 nsid:1 lba:107709312 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:10 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:1 cid:7 nsid:1 lba:107709376 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:1 cid:7 cdw0:0
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709440 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709504 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709568 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709632 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709696 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709760 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709824 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709888 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107709952 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:107710016 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:108990656 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:110272896 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:111555136 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:112837376 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:114119616 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:115401856 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:116684096 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:60012992 len:64
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 2 idx 0x239ena0: free uncompleted tx mbuf qid 3 idx 0x1f4ena0: device is going UP
>ena0: link is UP
>Limiting closed port RST response from 217 to 200 packets/sec
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 2 idx 0x1d9ena0: device is going UP
>ena0: link is UP
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 1 idx 0x17bena0: ena0: device is going UP
>link is UP
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 0 idx 0x2cfena0: free uncompleted tx mbuf qid 2 idx 0x1a9ena0: device is going UP
>ena0: link is UP
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 1 idx 0x21aena0: device is going UP
>ena0: link is UP
>ena0: Keep alive watchdog timeout.
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: device is going UP
>ena0: link is UP
>Limiting closed port RST response from 204 to 200 packets/sec
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 3 idx 0x283ena0: ena0: device is going UP
>link is UP
>ena0: Keep alive watchdog timeout.
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: ena0: device is going UP
>link is UP
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>ena0: Keep alive watchdog timeout.
>ena0: Trigger reset is on
>ena0: device is going DOWN
>nvme0: cpl does not map to outstanding cmd
>cdw0:00000000 sqhd:0014 sqid:0002 cid:0010 p:1 sc:00 sct:0 m:0 dnr:0
>nvme0: Missing interrupt
>nvme0: Resetting controller due to a timeout.
>nvme0: resetting controller
>nvme0: temperature threshold not supported
>nvme0: aborting outstanding i/o
>nvme0: WRITE sqid:1 cid:8 nsid:1 lba:2765049 len:64
>nvme0: ABORTED - BY REQUEST (00/07) sqid:1 cid:8 cdw0:0
>ena0: free uncompleted tx mbuf qid 0 idx 0x3b4ena0: free uncompleted tx mbuf qid 3 idx 0x296ena0: ena0: device is going UP
>link is UP
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>ena0: Keep alive watchdog timeout.
>ena0: Trigger reset is on
>ena0: device is going DOWN
>ena0: free uncompleted tx mbuf qid 0 idx 0x0ena0: free uncompleted tx mbuf qid 1 idx 0x12bena0: free uncompleted tx mbuf qid 3 idx 0x2b3ena0: device is going UP
>ena0: link is UP
>ena0: The number of lost tx completion is above the threshold (129 > 128). Reset the device
>ena0: Trigger reset is on
>ena0: device is going DOWN
>nvme1: Missing interrupt
>nvme1: cpl does not map to outstanding cmd
>cdw0:00000000 sqhd:000f sqid:0002 cid:0001 p:1 sc:00 sct:0 m:0 dnr:0
>nvme1: Missing interrupt
>nvme1: Resetting controller due to a timeout.
>nvme1: resetting controller
>nvme1: temperature threshold not supported
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:111187200 len:256
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:180697216 len:64
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:247016768 len:128
>nvme1: resubmitting queued i/o
>nvme1: WRITE sqid:1 cid:0 nsid:1 lba:109724672 len:64
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:2 cid:1 nsid:1 lba:111173184 len:256
>nvme1: ABORTED - BY REQUEST (00/07) sqid:2 cid:1 cdw0:0
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:2 cid:9 nsid:1 lba:107708544 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:2 cid:9 cdw0:0
>nvme0: Missing interrupt
>nvme1: Missing interrupt
>ena0: free uncompleted tx mbuf qid 0 idx 0x15ena0: ena0: device is going UP
>link is UP
>nvme1: Resetting controller due to a timeout.
>nvme1: resetting controller
>nvme1: temperature threshold not supported
>nvme1: aborting outstanding i/o
>nvme1: WRITE sqid:2 cid:9 nsid:1 lba:109585408 len:64
>nvme1: ABORTED - BY REQUEST (00/07) sqid:2 cid:9 cdw0:0
>
>
>Fatal trap 12: page fault while in kernel mode
>cpuid = 2; apic id = 02
>fault virtual address   = 0xf610
>fault code              = supervisor read data, page not present
>instruction pointer     = 0x20:0xffffffff80b7ad1d
>stack pointer           = 0x28:0xfffffe00741bc140
>frame pointer           = 0x28:0xfffffe00741bc1b0
>code segment            = base 0x0, limit 0xfffff, type 0x1b
>                        = DPL 0, pres 1, long 1, def32 0, gran 1
>processor eflags        = interrupt enabled, resume, IOPL = 0
>current process         = 12 (irq258: nvme0)
>trap number             = 12
>panic: page fault
>cpuid = 2
>time = 1553756416
>KDB: stack backtrace:
>#0 0xffffffff80be7977 at kdb_backtrace+0x67
>#1 0xffffffff80b9b563 at vpanic+0x1a3
>#2 0xffffffff80b9b3b3 at panic+0x43
>#3 0xffffffff8107496f at trap_fatal+0x35f
>#4 0xffffffff810749c9 at trap_pfault+0x49
>#5 0xffffffff81073fee at trap+0x29e
>#6 0xffffffff8104f435 at calltrap+0x8
>#7 0xffffffff80ae3751 at g_disk_done+0x161
>#8 0xffffffff80767516 at nvme_qpair_complete_tracker+0x166
>#9 0xffffffff807672d4 at nvme_qpair_process_completions+0x94
>#10 0xffffffff80b5ee17 at ithread_loop+0x1a7
>#11 0xffffffff80b5bf33 at fork_exit+0x83
>#12 0xffffffff8105042e at fork_trampoline+0xe
>Uptime: 6d22h50m44s
>Rebooting...
>cpu_reset: Restarting BSP
>cpu_reset_proxy: Stopped CPU 2

Actions: View

Attachments on bug 235856: 202156 | 202157 | 202224 | 203370 | 209401 | 212278 | 212295