File system operations hangs with suspfs state, system still responsible, other functions like console, networking work fine. May be SUJ deadlock, but not sure. Kernel core dump available by request (100MB compressed) vk@dss$ ls load: 0.12 cmd: ls 99574 [suspfs] 1.25r 0.00u 0.00s 0% 1128k load: 0.12 cmd: ls 99574 [suspfs] 2.26r 0.00u 0.00s 0% 1128k load: 0.12 cmd: ls 99574 [suspfs] 2.53r 0.00u 0.00s 0% 1128k load: 0.12 cmd: ls 99574 [suspfs] 2.77r 0.00u 0.00s 0% 1128k load: 0.11 cmd: ls 99574 [suspfs] 2.99r 0.00u 0.00s 0% 1128k load: 0.11 cmd: ls 99574 [suspfs] 3.23r 0.00u 0.00s 0% 1128k KDB: enter: manual escape to debugger [ thread pid 12 tid 100016 ] Stopped at breakpoint+0x4: popl %ebp db> ps pid ppid pgrp uid state wmesg wchan cmd 99614 1859 99614 95 Ds suspfs 0xc4659a68 bforce 99578 99576 99578 0 Ds suspfs 0xc4659a68 atrun 99577 99575 99577 2 DEs suspfs 0xc4659a68 sh 99576 1737 1737 0 S piperd 0xc4514c40 cron 99575 1737 1737 0 S wait 0xc543cd48 cron 99574 6034 99574 1000 D+ suspfs 0xc4659a68 ls 99573 22088 22059 1000 D+ suspfs 0xc4659a68 xterm 99570 1859 99570 95 Ds suspfs 0xc4659a68 bforce 99569 1 25426 0 D suspfs 0xc4659a68 sendmail 99566 99565 99566 0 Ds suspfs 0xc4659a68 atrun 99565 1737 1737 0 S piperd 0xcfa92ab8 cron 99122 25426 25426 0 S select 0xce469764 sendmail 99060 1899 99060 1000 S+ ttyin 0xc3b43670 bash 92088 89311 92088 1000 S+ select 0xc646dca4 ssh 89311 8335 89311 1000 Ss+ wait 0xc4744550 bash 37731 35682 37731 1000 S+ select 0xc5ca79a4 ssh 35682 8335 35682 1000 Ss+ wait 0xc4a2ad48 bash 22161 1 22075 1000 S select 0xc4e3b924 initial thread 22159 22155 22059 1000 S+ (threaded) firefox-bin 100212 S ucond 0xc5d5ae00 firefox-bin 100211 S ucond 0xc4930780 firefox-bin 100174 S ucond 0xc4d40080 firefox-bin 100144 S ucond 0xc45f3680 firefox-bin 100210 S ucond 0xc6114880 firefox-bin 100139 S ucond 0xc4d40e80 firefox-bin 100138 S ucond 0xc5364580 firefox-bin 100137 S ucond 0xc4d40280 firefox-bin 100136 S select 0xc49cdd64 firefox-bin 100245 S suspfs 0xc4659a68 initial thread 22155 22151 22059 1000 S+ wait 0xc4513000 sh 22151 1 22059 1000 S+ wait 0xcfa8b000 sh 22099 1 22059 1000 S+ select 0xc4961564 initial thread 22092 1 22059 1000 S+ select 0xc610ba64 xfce4-settings-help 22091 22077 22059 1000 D+ (threaded) pidgin 100130 D suspfs 0xc4659a68 initial thread 22089 22077 22059 1000 S+ (threaded) xfdesktop 100236 S select 0xcb03dca4 initial thread 22088 22077 22059 1000 D+ (threaded) xfce4-panel 100135 S piperd 0xcfa92188 xfce4-panel 100133 D suspfs 0xc4659a68 initial thread 22087 1 22086 1000 S select 0xc5cb0c24 initial thread 22085 22077 22059 1000 S+ select 0xc55fb424 initial thread 22084 22077 22059 1000 S+ select 0xc610a9a4 initial thread 22083 1 22059 1000 S+ select 0xc57087e4 xfsettingsd 22079 1 22075 1000 S select 0xc49d0be4 initial thread 22077 22059 22059 1000 S+ (threaded) xfce4-session 100134 S piperd 0xc4654000 xfce4-session 100125 S select 0xcb03f1e4 initial thread 22075 1 22075 1000 Ss select 0xc5c567a4 dbus-daemon 22074 1 22059 1000 S+ select 0xc5054724 dbus-launch 22069 1 22069 1000 Ss select 0xc5cad2e4 ssh-agent 22059 22055 22059 1000 S+ wait 0xc4a2a000 sh 22056 22055 22056 1000 S+ select 0xc49c2ce4 initial thread 22055 22022 22022 1000 S+ wait 0xc4511d48 xinit 22022 7646 22022 1000 S+ wait 0xc5383d48 sh 18772 29861 29861 80 SJ lockf 0xc4abf880 httpd 18771 29861 29861 80 SJ lockf 0xc481a3c0 httpd 6034 5989 6034 1000 S+ wait 0xc6097d48 bash 5989 1 5989 0 SWs+ wait 0xc456a000 login 5911 30208 5911 1000 S+ select 0xc7938be4 ssh 53815 25405 53815 1000 S+ select 0xc60249a4 ssh 53814 29861 29861 80 SJ lockf 0xc5252800 httpd 30208 1898 30208 1000 SW+ wait 0xc6097aa0 bash 30078 29861 29861 80 SJ lockf 0xc47c99c0 httpd 29885 29861 29861 80 SJ select 0xc6109ce4 httpd 29868 29861 29861 80 SJ lockf 0xc5144dc0 httpd 29867 29861 29861 80 SJ lockf 0xc4ec7c80 httpd 29866 29861 29861 80 SJ lockf 0xc68c8200 httpd 29865 29861 29861 80 SJ lockf 0xc4ef95c0 httpd 29864 29861 29861 80 SJ lockf 0xc6944780 httpd 29861 1 29861 0 SsJ select 0xc6109c24 httpd 29850 1 29850 0 SsJ nanslp 0xc0b5ff84 cron 29844 1 29844 25 SsJ pause 0xc4538af8 sendmail 29838 1 29838 0 SsJ select 0xc76e9e24 sendmail 29833 1 29833 0 SsJ select 0xc44dada4 sshd 29779 1 29779 0 SsJ select 0xce3be124 syslogd 25429 1 25429 25 Ss pause 0xc6097300 sendmail 25426 1 25426 0 Ss select 0xc5c597e4 sendmail 25405 25404 25405 1000 SWs+ wait 0xc4744d48 bash 25404 1954 25404 1000 S+ select 0xc464dd24 mc 91143 1 91143 26 Ss (threaded) milter-greylist 100141 S select 0xc5e9ac64 milter-greylist 100214 S sigwait 0xdfb9aba0 milter-greylist 100195 S ucond 0xc471b280 milter-greylist 100148 S ucond 0xc4957800 milter-greylist 100126 S select 0xc4e3a124 milter-greylist 55568 55567 55567 26 S (threaded) dkim-filter 100194 S select 0xc4eca024 dkim-filter 100196 S sigwait 0xdfb64ba0 dkim-filter 100143 S sigwait 0xdfa9aba0 dkim-filter 100140 S select 0xce3bd664 dkim-filter 100116 S select 0xc60f23e4 dkim-filter 55567 1 55567 26 SWs wait 0xc4513d48 dkim-filter 11647 11646 11647 0 S+ ttyin 0xc860d470 bash 11646 8337 11646 1000 SW+ wait 0xc543b000 su 10912 10911 10912 0 Ss+ ttyin 0xc860d270 bash 10911 8345 10911 0 D+ suspfs 0xc4659a68 mc 10891 10890 10891 0 Ss+ ttyin 0xc860e870 bash 10890 10093 10890 0 D+ suspfs 0xc4659a68 mc 10093 1901 10093 0 SW+ wait 0xc4503550 bash 8345 1893 8345 0 SW+ wait 0xc4503d48 bash 8337 8335 8337 1000 SWs+ wait 0xc5d132a8 bash 8335 8334 8335 1000 Ss select 0xc44e80a4 screen 8334 8326 8334 1000 S+ pause 0xc450a058 screen 8326 1896 8326 1000 SW+ wait 0xc4511000 bash 7646 1903 7646 1000 S+ wait 0xc5d13550 bash 1954 1894 1954 1000 SW+ wait 0xc5d142a8 bash 1912 1904 1912 1000 S+ select 0xc52c7164 ssh 1904 1897 1904 1000 SW+ wait 0xc537f2a8 bash 1903 1 1903 0 SWs+ wait 0xc537f550 login 1902 1 1902 0 Ss+ ttyin 0xc3b43c70 getty 1901 1 1901 0 SWs+ wait 0xc537faa0 login 1900 1 1900 0 Ss+ ttyin 0xc3b43870 getty 1899 1 1899 0 Ss+ wait 0xc5383000 login 1898 1 1898 0 SWs+ wait 0xc53832a8 login 1897 1 1897 0 SWs+ wait 0xc5383550 login 1896 1 1896 0 SWs+ wait 0xc46b7550 login 1894 1 1894 0 SWs+ wait 0xc39e2aa0 login 1893 1 1893 0 SWs+ wait 0xc46ba7f8 login 1859 1 1859 0 Ss select 0xc44e71e4 inetd 1835 1 1835 95 Ds suspfs 0xc4659a68 bforce 1737 1 1737 0 Ss nanslp 0xc0b5ff84 cron 1718 1 1718 0 Ss select 0xc52c76e4 sshd 1647 1 1647 0 Ss select 0xc4e3be64 ntpd 1615 1 1615 0 Ss select 0xc4e39c24 lpd 1435 1 1435 0 Ss select 0xc4e399a4 moused 1402 1400 1400 0 S (threaded) nfsd 100083 S rpcsvc 0xc4e39d90 nfsd: service 100082 S rpcsvc 0xc4e3a610 nfsd: service 100081 S rpcsvc 0xc4e3a4d0 nfsd: service 100070 S rpcsvc 0xc3b2a6d0 nfsd: master 1400 1 1400 0 Ss select 0xc4e3a6e4 nfsd 1398 1 1398 0 Ss select 0xc44e8ba4 mountd 1377 1 1377 0 Ss select 0xc44da9e4 rpcbind 1234 1 1234 0 Ss select 0xc4e3b0e4 syslogd 982 1 982 0 Ss select 0xc464db24 devd 121 1 121 0 SWs pause 0xc46ba300 adjkerntz 22 0 0 0 DL flowclea 0xc0b73bcc [flowcleaner] 21 0 0 0 DL getblk 0xd2ac7bc0 [softdepflush] 20 0 0 0 DL syncer 0xc0b739d4 [syncer] 19 0 0 0 DL vlruwt 0xc4635550 [vnlru] 18 0 0 0 DL psleep 0xc0b7370c [bufdaemon] 17 0 0 0 DL pgzero 0xc0b81514 [pagezero] 16 0 0 0 DL psleep 0xc0b81154 [vmdaemon] 15 0 0 0 DL psleep 0xc0b81118 [pagedaemon] 9 0 0 0 DL m:w1 0xc44dfc00 [g_mirror root] 8 0 0 0 DL ccb_scan 0xc0b461d4 [xpt_thrd] 7 0 0 0 DL pftm 0xc04c2b2e [pfpurge] 6 0 0 0 DL waiting_ 0xc0b75718 [sctp_iterator] 5 0 0 0 DL - 0xc39be03c [fdc0] 14 0 0 0 DL (threaded) [usb] 100045 D - 0xc3a9ad0c [usbus4] 100044 D - 0xc3a9acdc [usbus4] 100043 D - 0xc3a9acac [usbus4] 100042 D - 0xc3a9ac7c [usbus4] 100040 D - 0xc3a88dac [usbus3] 100039 D - 0xc3a88d7c [usbus3] 100038 D - 0xc3a88d4c [usbus3] 100037 D - 0xc3a88d1c [usbus3] 100036 D - 0xc3a76dac [usbus2] 100035 D - 0xc3a76d7c [usbus2] 100034 D - 0xc3a76d4c [usbus2] 100033 D - 0xc3a76d1c [usbus2] 100031 D - 0xc3a5cdac [usbus1] 100030 D - 0xc3a5cd7c [usbus1] 100029 D - 0xc3a5cd4c [usbus1] 100028 D - 0xc3a5cd1c [usbus1] 100026 D - 0xc3a46dac [usbus0] 100025 D - 0xc3a46d7c [usbus0] 100024 D - 0xc3a46d4c [usbus0] 100023 D - 0xc3a46d1c [usbus0] 13 0 0 0 DL - 0xc0b5fde4 [yarrow] 4 0 0 0 DL - 0xc0b5daa4 [g_down] 3 0 0 0 DL - 0xc0b5daa0 [g_up] 2 0 0 0 DL - 0xc0b5da98 [g_event] 12 0 0 0 RL (threaded) [intr] 100053 I [swi0: uart uart] 100052 I [irq12: psm0] 100051 I [irq1: atkbd0] 100050 I [irq17: pcm0] 100049 I [irq15: ata1] 100048 I [irq14: ata0] 100047 I [irq22: fxp1] 100046 I [irq20: fxp0] 100041 I [irq23: ehci0] 100032 I [irq18: uhci2] 100027 I [irq19: uhci1] 100022 I [irq16: uhci0 uhci3] 100021 I [irq9: acpi0] 100019 I [swi2: cambio] 100018 I [swi5: +] 100016 Run CPU 0 [swi6: Giant taskq] 100015 I [swi6: task queue] 100006 I [swi4: clock] 100005 I [swi3: vm] 100004 I [swi1: netisr 0] 11 0 0 0 RL [idle: cpu0] 1 0 1 0 SLs wait 0xc3954d48 [init] 10 0 0 0 DL audit_wo 0xc0b7ef40 [audit] 0 0 0 0 DLs (threaded) [kernel] 100058 D - 0xc3b2a8c0 [dummynet] 100055 D deadlkre 0xc0b5fde4 [deadlkres] 100020 D - 0xc39f2280 [kqueue taskq] 100017 D - 0xc39f2440 [thread taskq] 100014 D - 0xc39f2800 [acpi_task_2] 100013 D - 0xc39f2800 [acpi_task_1] 100012 D - 0xc39f2800 [acpi_task_0] 100010 D - 0xc3932380 [firmware taskq] 100000 D sched 0xc0b5db80 [swapper] KDB: enter: manual escape to debugger [ thread pid 12 tid 100016 ] Stopped at breakpoint+0x4: popl %ebp db> show pcpu cpuid = 0 dynamic pcpu = 0x4dfc00 curthread = 0xc3a16840: pid 12 "swi6: Giant taskq" curpcb = 0xc365dd80 fpcurthread = none idlethread = 0xc3956840: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 db> cont KDB: enter: manual escape to debugger [ thread pid 12 tid 100016 ] Stopped at breakpoint+0x4: popl %ebp db> show pcpu cpuid = 0 dynamic pcpu = 0x4dfc00 curthread = 0xc3a16840: pid 12 "swi6: Giant taskq" curpcb = 0xc365dd80 fpcurthread = none idlethread = 0xc3956840: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 db> cont KDB: enter: manual escape to debugger [ thread pid 12 tid 100016 ] Stopped at breakpoint+0x4: popl %ebp db> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x4dfc00 curthread = 0xc3a16840: pid 12 "swi6: Giant taskq" curpcb = 0xc365dd80 fpcurthread = none idlethread = 0xc3956840: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 dss.kbb.ru dumped core - see /var/crash/vmcore.0 Wed Jul 28 11:06:12 NOVST 2010 FreeBSD dss.kbb.ru 9.0-CURRENT FreeBSD 9.0-CURRENT #2: Mon Jul 26 09:14:09 NOVST 2010 root@dss.kbb.ru:/usr/obj/usr/src/sys/DSS i386 panic: from debugger GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd"... Unread portion of the kernel message buffer: KDB: enter: manual escape to debugger panic: from debugger cpuid = 0 Uptime: 1d18h4m47s Physical memory: 738 MB Dumping 240 MB: 225 209 193 177 161 145 129 113 97 81 65 49 33 17 1 Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done. done. Loaded symbols for /boot/kernel/geom_mirror.ko Reading symbols from /boot/kernel/geom_stripe.ko...Reading symbols from /boot/kernel/geom_stripe.ko.symbols...done. done. Loaded symbols for /boot/kernel/geom_stripe.ko Reading symbols from /boot/kernel/snd_ich.ko...Reading symbols from /boot/kernel/snd_ich.ko.symbols...done. done. Loaded symbols for /boot/kernel/snd_ich.ko Reading symbols from /boot/kernel/sound.ko...Reading symbols from /boot/kernel/sound.ko.symbols...done. done. Loaded symbols for /boot/kernel/sound.ko Reading symbols from /boot/kernel/geom_cache.ko...Reading symbols from /boot/kernel/geom_cache.ko.symbols...done. done. Loaded symbols for /boot/kernel/geom_cache.ko Reading symbols from /boot/kernel/linux.ko...Reading symbols from /boot/kernel/linux.ko.symbols...done. done. Loaded symbols for /boot/kernel/linux.ko Reading symbols from /boot/kernel/logo_saver.ko...Reading symbols from /boot/kernel/logo_saver.ko.symbols...done. done. Loaded symbols for /boot/kernel/logo_saver.ko Reading symbols from /boot/kernel/i915.ko...Reading symbols from /boot/kernel/i915.ko.symbols...done. done. Loaded symbols for /boot/kernel/i915.ko Reading symbols from /boot/kernel/drm.ko...Reading symbols from /boot/kernel/drm.ko.symbols...done. done. Loaded symbols for /boot/kernel/drm.ko Reading symbols from /boot/kernel/gsched_rr.ko...Reading symbols from /boot/kernel/gsched_rr.ko.symbols...done. done. Loaded symbols for /boot/kernel/gsched_rr.ko Reading symbols from /boot/kernel/geom_sched.ko...Reading symbols from /boot/kernel/geom_sched.ko.symbols...done. done. Loaded symbols for /boot/kernel/geom_sched.ko #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:245 245 dumptid = curthread->td_tid; (kgdb) #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:245 #1 0xc06a341d in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:416 #2 0xc06a38af in panic (fmt=Could not find the frame base for "panic". ) at /usr/src/sys/kern/kern_shutdown.c:590 #3 0xc04fe79e in db_panic (addr=Could not find the frame base for "db_panic". ) at /usr/src/sys/ddb/db_command.c:478 #4 0xc04fe6ee in db_command (last_cmdp=0xc0b4877c, cmd_table=0x0, dopager=1) at /usr/src/sys/ddb/db_command.c:445 #5 0xc04fe806 in db_command_loop () at /usr/src/sys/ddb/db_command.c:498 #6 0xc0501049 in db_trap (type=3, code=0) at /usr/src/sys/ddb/db_main.c:229 #7 0xc06dc4e7 in kdb_trap (type=3, code=0, tf=0xc365db1c) at /usr/src/sys/kern/subr_kdb.c:535 #8 0xc0a33b22 in trap (frame=0xc365db1c) at /usr/src/sys/i386/i386/trap.c:697 #9 0xc0a14cfc in calltrap () at /usr/src/sys/i386/i386/exception.s:166 #10 0xc06dc0c5 in breakpoint () at cpufunc.h:71 #11 0xc06dc0b5 in kdb_enter (why=0xc0a8e4d5 "break", msg=0xc0a8e4bb "manual escape to debugger") at /usr/src/sys/kern/subr_kdb.c:340 #12 0xc05aabb6 in scgetc (sc=0xc0b985a0, flags=2) at /usr/src/sys/dev/syscons/syscons.c:3432 #13 0xc05a3cfd in sckbdevent (thiskbd=0xc3943600, event=0, arg=0xc0b985a0) at /usr/src/sys/dev/syscons/syscons.c:693 #14 0xc0571929 in kbdmux_intr (kbd=0xc3943600, arg=0x0) at /usr/src/sys/dev/kbdmux/kbdmux.c:549 #15 0xc0570fcb in kbdmux_kbd_intr (xkbd=0xc3943600, pending=1) at /usr/src/sys/dev/kbdmux/kbdmux.c:208 #16 0xc06eaae9 in taskqueue_run (queue=0xc39f24c0, tpp=0xc39f24d4) at /usr/src/sys/kern/subr_taskqueue.c:240 #17 0xc06eadbf in taskqueue_swi_giant_run (dummy=0x0) at /usr/src/sys/kern/subr_taskqueue.c:294 #18 0xc06716d0 in intr_event_execute_handlers (p=0xc39547f8, ie=0xc39a3100) at /usr/src/sys/kern/kern_intr.c:1220 #19 0xc0671787 in ithread_execute_handlers (p=0xc39547f8, ie=0xc39a3100) at /usr/src/sys/kern/kern_intr.c:1233 #20 0xc06718c1 in ithread_loop (arg=0xc3953320) at /usr/src/sys/kern/kern_intr.c:1315 #21 0xc066f45a in fork_exit (callout=0xc0671845 <ithread_loop>, arg=0xc3953320, frame=0xc365dd28) at /usr/src/sys/kern/kern_fork.c:843 #22 0xc0a14d74 in fork_trampoline () at /usr/src/sys/i386/i386/exception.s:273 (kgdb) ------------------------------------------------------------------------ ps -axl UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -68 0 0 0 - DLs ?? -28576326:-34.55 [kernel] 0 1 0 0 44 0 8032 76 wait DLs ?? -25356019:-18.55 [init] 0 2 0 0 -8 0 0 0 - DL ?? -19504965:-10.55 [g_event] 0 3 0 0 -8 0 0 0 - DL ?? -3327766:-38.55 [g_up] 0 4 0 0 -8 0 0 0 - DL ?? 6513292:05.00 [g_down] 0 5 0 0 -16 0 0 0 - DL ?? 27808067:26.00 [fdc0] 0 6 0 0 -16 0 0 0 waitin DL ?? 1146:57.00 [sctp_ite 0 7 0 0 44 0 0 0 pftm DL ?? -3680890:-5.55 [pfpurge] 0 8 0 0 44 0 0 0 ccb_sc DL ?? 22184:34.00 [xpt_thrd 0 9 0 0 -8 0 0 0 m:w1 DL ?? -27874408:-36.55 [g_mirror 0 10 0 0 -16 0 0 0 audit_ DL ?? 0:00.00 [audit] 0 11 0 0 171 0 0 0 - RL ?? 33486906:36.00 [idle] 0 12 0 0 -48 0 0 0 - WL ?? 526512:43.00 [intr] 0 13 0 0 -16 0 0 0 - DL ?? 6216227:26.00 [yarrow] 0 14 0 0 -64 0 0 0 - DL ?? -4059862:-59.55 [usb] 0 15 0 0 44 0 0 0 psleep DL ?? 34371000:36.00 [pagedaem 0 16 0 0 44 0 0 0 psleep DL ?? 27615062:28.00 [vmdaemon 0 17 0 0 76 0 0 0 pgzero DL ?? 122010:10.00 [pagezero 0 18 0 0 45 0 0 0 psleep DL ?? 10183027:06.00 [bufdaemo 0 19 0 0 44 0 0 0 vlruwt DL ?? -2385566:-14.55 [vnlru] 0 20 0 0 44 0 0 0 syncer DL ?? 34502453:27.55 [syncer] 0 21 0 0 44 0 0 0 getblk DL ?? -7529719:00.55 [softdepf 0 22 0 0 -16 0 0 0 flowcl DL ?? 21283936:13.00 [flowclea 0 121 1 0 76 0 1624 0 pause DWs ?? 0:00.00 [adjkernt 0 982 1 0 44 0 8032 212 select Ds ?? 1308468:46.00 [devd] 0 1234 1 0 44 0 9596 712 select Ds ?? -7814185:-11.55 [syslogd] 0 1377 1 0 44 0 9620 736 select Ds ?? 8141005:56.00 [rpcbind] 0 1398 1 0 44 0 9596 788 select Ds ?? 1167578:47.00 [mountd] 0 1400 1 0 76 0 9516 512 select Ds ?? 1735031:55.00 [nfsd] 0 1402 1400 0 44 0 9516 452 rpcsvc D ?? -33317594:-30.55 [nfsd] 0 1435 1 0 44 0 9696 520 select Ds ?? 19441541:22.00 [moused] 0 1615 1 0 76 0 9516 512 select Ds ?? 223122:44.00 [lpd] 0 1647 1 0 44 0 11140 1048 select Ds ?? 11955544:16.00 [ntpd] 0 1718 1 0 76 0 12840 600 select Ds ?? 85016:26.00 [sshd] 0 1737 1 0 44 0 9620 468 nanslp Ds ?? 22431821:20.00 [cron] 95 1835 1 0 44 0 1876 508 suspfs Ds ?? 29308693:30.00 [bforce] 0 1859 1 0 44 0 9652 652 select Ds ?? 3056727:59.00 [inetd] 0 1893 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 0 1894 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 0 1896 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 0 1897 1 0 45 0 10016 0 wait DWs ?? 0:00.00 [login] 0 1898 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 0 1899 1 0 44 0 10016 1620 wait Ds ?? 1680311:20.00 [login] 0 1900 1 0 76 0 9596 432 ttyin Ds+ ?? 168286:57.00 [getty] 0 1901 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 0 1902 1 0 76 0 9596 432 ttyin Ds+ ?? 161782:37.00 [getty] 0 1903 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 1000 1904 1897 0 44 0 10796 1212 suspfs D+ ?? 1074191:15.00 [bash] 1000 1954 1894 0 44 0 10808 0 wait DW ?? 0:00.00 [bash] 1000 5911 30208 0 44 0 12580 1088 select D+ ?? -28549660:-41.55 [ssh] 0 5989 1 0 44 0 10016 0 wait DWs ?? 0:00.00 [login] 1000 6034 5989 0 44 0 10808 1456 wait D ?? 2130616:48.00 [bash] 1000 7646 1903 0 44 0 10808 868 wait D ?? 1086033:37.00 [bash] 1000 8326 1896 0 48 0 10796 0 wait DW ?? 0:00.00 [bash] 1000 8334 8326 0 44 0 10152 184 pause D+ ?? 12001851:24.00 [screen] 0 8335 8334 0 44 0 10152 1436 select Ds ?? -28242263:-4.55 [screen] 1000 8337 8335 0 44 0 10796 0 wait DWs ?? 0:00.00 [bash] 0 8345 1893 0 44 0 10796 0 wait DW ?? 0:00.00 [bash] 0 10093 1901 0 45 0 10796 0 wait DW ?? 0:00.00 [bash] 0 10890 10093 0 44 0 17116 2612 suspfs D+ ?? -33825126:-54.55 [mc] 0 10891 10890 0 44 0 10796 1144 ttyin Ds+ ?? 5332361:07.00 [bash] 0 10911 8345 0 44 0 17116 3356 suspfs D+ ?? -12733091:-43.55 [mc] 0 10912 10911 0 44 0 10796 1208 ttyin Ds+ ?? 18654528:13.00 [bash] 0 11646 8337 0 44 0 10012 0 wait DW ?? 0:00.00 [su] 0 11647 11646 0 44 0 10808 1336 ttyin D+ ?? 3372491:00.00 [bash] 80 18771 29861 0 46 0 5604 1716 lockf D ?? 27309825:56.00 [httpd] 80 18772 29861 0 46 0 5644 1744 lockf D ?? 28897571:54.00 [httpd] 1000 22022 7646 0 76 0 9860 912 wait D+ ?? 497418:09.00 [sh] 1000 22055 22022 0 50 0 10788 972 wait D+ ?? 286491:55.00 [xinit] 0 22056 22055 0 44 0 196680 166740 select D ?? -13506071:-50.55 [Xorg] 1000 22059 22055 0 76 0 9860 892 wait D ?? 944279:32.00 [sh] 1000 22069 1 0 76 0 12512 1296 select Ds ?? 30709:05.00 [ssh-agen 1000 22074 1 0 68 0 10884 1044 select D ?? 75801:53.00 [dbus-lau 1000 22075 1 0 44 0 9736 1132 select Ds ?? -24171640:-9.55 [dbus-dae 1000 22077 22059 0 44 0 32380 9396 piperd D ?? 16376018:20.00 [xfce4-se 1000 22079 1 0 45 0 12288 1888 select D ?? 4416457:26.00 [xfconfd] 1000 22083 1 0 44 0 21888 6332 select D ?? 1469203:12.00 [xfsettin 1000 22084 22077 0 44 0 24120 9436 select D ?? 24054978:57.00 [xfwm4] 1000 22085 22077 0 44 0 22864 6736 select D ?? 16727163:22.00 [Thunar] 1000 22087 1 0 45 0 11664 1292 select D ?? 822791:36.00 [gam_serv 1000 22088 22077 0 44 0 37364 11736 piperd D ?? -13530150:-29.55 [xfce4-pa 1000 22089 22077 0 44 0 38856 11368 select D ?? -7563624:-50.55 [xfdeskto 1000 22091 22077 0 44 0 58984 24180 suspfs D ?? 26635636:21.00 [pidgin] 1000 22092 1 0 44 0 22720 7524 l D ?? -16310290:-52.55 [xfce4-se 1000 22099 1 0 45 0 14796 3272 select D ?? 19139482:44.00 [gkrellm] 1000 22151 1 0 76 0 9860 900 wait D ?? 814583:03.00 [sh] 1000 22155 22151 0 76 0 9860 936 wait D ?? 344077:27.00 [sh] 1000 22159 22155 0 76 0 199104 119248 ucond D ?? 6875064:41.00 [firefox- 1000 22161 1 0 44 0 12900 2564 select D ?? 2613022:32.00 [gconfd-2 1000 25404 1954 0 44 0 13020 832 select D+ ?? -28670328:-29.55 [mc] 1000 25405 25404 0 44 0 10808 0 wait DWs ?? 0:00.00 [bash] 0 25426 1 0 44 0 11256 1272 select Ds ?? 21547106:37.00 [sendmail 25 25429 1 0 44 0 11256 664 pause Ds ?? 1494141:19.00 [sendmail 0 29779 1 0 44 0 1516 348 select Ds ?? -27076192:-11.55 [syslogd] 0 29833 1 0 44 0 3808 340 select Ds ?? 175153:48.00 [sshd] 0 29838 1 0 44 0 3776 844 select Ds ?? 4284093:13.00 [sendmail 25 29844 1 0 44 0 3652 528 pause Ds ?? 1364358:51.00 [sendmail 0 29850 1 0 44 0 1536 272 nanslp Ds ?? 15369210:59.00 [cron] 0 29861 1 0 44 0 5400 344 select Ds ?? 33868907:54.00 [httpd] 80 29864 29861 0 46 0 5600 1592 lockf D ?? 32483642:19.00 [httpd] 80 29865 29861 0 46 0 5592 1616 lockf D ?? 31707095:32.00 [httpd] 80 29866 29861 0 44 0 5620 1592 select D ?? 29191840:12.00 [httpd] 80 29867 29861 0 46 0 5644 1616 lockf D ?? 34113028:31.00 [httpd] 80 29868 29861 0 44 0 5656 1616 lockf D ?? 32255286:27.00 [httpd] 80 29885 29861 0 47 0 5628 1592 lockf D ?? 34172955:23.55 [httpd] 80 30078 29861 0 46 0 5652 1604 lockf D ?? 30472484:18.00 [httpd] 1000 30208 1898 0 44 0 10808 0 wait DW ?? 0:00.00 [bash] 1000 35682 8335 0 46 0 10796 1784 wait Ds ?? 1205947:24.00 [bash] 1000 37731 35682 0 44 0 12580 2324 select D+ ?? 1922456:52.00 [ssh] 80 53814 29861 0 44 0 5664 1752 lockf D ?? 30435249:33.00 [httpd] 1000 53815 25405 0 44 0 12580 864 select D+ ?? 13876756:23.00 [ssh] 26 55567 1 0 76 0 11356 0 wait DWs ?? 0:00.00 [dkim-fil 26 55568 55567 0 44 0 25180 2188 select D ?? -27570932:-17.55 [dkim-fil 1000 89311 8335 0 44 0 10796 2112 wait Ds ?? 1429245:14.00 [bash] 26 91143 1 0 44 0 16468 2132 select Ds ?? 29366026:26.00 [milter-g 1000 92088 89311 0 44 0 12580 3112 select D+ ?? -28948054:-40.55 [ssh] 1000 99060 1899 0 44 0 10796 2140 ttyin D+ ?? 917953:33.00 [bash] 0 99122 25426 0 44 0 11256 2124 select D ?? 292046:56.00 [sendmail 0 99565 1737 0 44 0 9620 1008 piperd D ?? 36720:42.00 [cron] 0 99566 99565 0 44 0 476 240 suspfs Ds ?? 266093:12.00 [atrun] 0 99569 1 0 47 0 11384 2488 suspfs D ?? 283426:23.00 [sendmail 95 99570 1859 0 44 0 1624 500 suspfs Ds ?? 203812:17.00 [bforce] 0 99573 22088 0 45 0 792 472 suspfs D ?? 570046:23.00 [xterm] 1000 99574 6034 0 44 0 9844 1128 suspfs D+ ?? 152472:09.00 [ls] 0 99575 1737 0 44 0 9620 1016 wait D ?? 40283:30.00 [cron] 0 99576 1737 0 44 0 9620 1008 piperd D ?? 34039:14.00 [cron] 2 99577 99575 0 76 0 9860 1352 suspfs DEs ?? 750763:18.00 [sh] 0 99578 99576 0 45 0 476 240 suspfs Ds ?? 262781:36.00 [atrun] 95 99614 1859 0 44 0 1624 500 suspfs Ds ?? 209953:49.00 [bforce] 0 99652 1737 0 44 0 9620 1008 piperd D ?? 34895:28.00 [cron] 0 99653 1737 0 44 0 9620 1016 wait D ?? 41759:13.00 [cron] 0 99654 1737 0 44 0 9620 1008 piperd D ?? 36068:29.00 [cron] 0 99655 99652 0 44 0 9520 792 suspfs Ds ?? 323024:06.00 [newsyslo 0 99656 99654 0 44 0 476 240 suspfs Ds ?? 264477:06.00 [atrun] 2 99657 99653 0 76 0 9860 1352 suspfs DEs ?? 781064:06.00 [sh] 95 99788 1859 0 44 0 1624 500 suspfs Ds ?? 209561:49.00 [bforce] 95 99790 1859 0 44 0 1624 500 suspfs Ds ?? 204439:10.00 [bforce] ------------------------------------------------------------------------ vmstat -s 672824728 cpu context switches 31790520 device interrupts 151415057 software interrupts 217675304 traps 343637623 system calls 22 kernel threads created 561292 fork() calls 137454 vfork() calls 0 rfork() calls 41772 swap pager pageins 102763 swap pager pages paged in 93192 swap pager pageouts 312501 swap pager pages paged out 31566 vnode pager pageins 164360 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 2518 page daemon wakeups 37761297 pages examined by the page daemon 161002 pages reactivated 14395053 copy-on-write faults 4025 copy-on-write optimized faults 146883587 zero fill pages zeroed 3042544 zero fill pages prezeroed 43952 intransit blocking page faults 180277201 total VM faults taken 0 pages affected by kernel thread creation 511932122 pages affected by fork() 124888738 pages affected by vfork() 0 pages affected by rfork() 0 pages cached 177605259 pages freed 444764 pages freed by daemon 0 pages freed by exiting processes 49010 pages active 66464 pages inactive 4968 pages in VM cache 48581 pages wired down 16335 pages free 4096 bytes per page 341928331 total name lookups cache hits (83% pos + 11% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m Type InUse MemUse HighUse Requests Size(s) prison 3 3K - 3 16,256,2048 KTRACE 100 13K - 100 128 linker 159 411K - 286 16,32,512,1024,2048,4096 ddb_capture 1 48K - 1 lockf 179 8K - 545150 32,64,128 devbuf 3729 5861K - 376697 16,32,64,128,256,512,1024,2048,4096 temp 28 233K - 2055900 16,32,64,128,256,512,1024,2048,4096 ip6ndp 7 1K - 8 64,128 agp 7 1K - 13 16,64 USB 35 6K - 46 16,32,64,128,1024,4096 module 265 17K - 265 64,128 mtx_pool 2 8K - 2 4096 USBdev 20 6K - 25 32,128,1024 osd 3 1K - 3 16,32 ata_generic 3 3K - 3 1024 acpica 1634 84K - 51670 16,32,64,128,256,512,1024 pgrp 78 5K - 4717 64 session 55 4K - 3455 64 proc 2 8K - 2 4096 subproc 331 597K - 698963 256,4096 cred 188 18K - 5395394 64,128 plimit 41 11K - 44111 256 uidinfo 8 2K - 1950 64,1024 CAM dev queue 3 1K - 4 128 sysctl 0 0K - 1096195 16,32,64 sysctloid 3151 96K - 3266 16,32,64,128 sysctltmp 0 0K - 118960 16,32,64,128,4096 umtx 570 54K - 570 64,128 p1003.1b 1 1K - 1 16 SWAP 4 281K - 4 64 bus 709 34K - 3650 16,32,64,128,256,512,1024 bus-sc 59 128K - 1067 16,32,64,128,256,512,1024,2048,4096 scsi_cd 0 0K - 6 16 devstat 14 29K - 14 16,4096 eventhandler 88 5K - 88 32,64,128 acpitask 1 1K - 1 1024 kobj 179 358K - 102610 2048 Per-cpu 1 1K - 1 16 acpisem 14 2K - 14 64,128 rman 162 10K - 579 16,32,64 sbuf 0 0K - 3650 16,32,64,128,256,512,1024,2048,4096 ad_driver 2 1K - 2 32 ar_driver 0 0K - 12 512,2048 acd_driver 1 2K - 1 2048 stack 0 0K - 2 128 taskqueue 13 1K - 13 16,64 Unitno 18 1K - 7540 16,64 ioctlops 0 0K - 12594786 16,32,64,128,256,512,1024,2048,4096 select 192 12K - 192 64 iov 0 0K - 5111598 16,64,128,256 msg 4 25K - 4 1024,4096 sem 4 101K - 4 1024,4096 shm 9 20K - 311 1024 tty 25 13K - 89 512,1024 pts 6 1K - 68 128 mbuf_tag 0 0K - 9050271 32,64,256 ksem 1 4K - 1 4096 shmfd 1 4K - 1 4096 soname 51 6K - 277442 16,32,64,128 pcb 46 79K - 88530 16,64,512,1024,2048,4096 acl 0 0K - 23106 4096 biobuf 0 0K - 29111 2048 vfscache 1 256K - 1 cl_savebuf 0 0K - 96620 32,64 export_host 4 1K - 20 128 vfs_hash 1 128K - 1 vnodes 3 1K - 22 32,128 DEVFS2 116 2K - 138 16 mount 116 5K - 1435 16,32,64,128,256,1024 vnodemarker 0 0K - 83796 512 BPF 5 1K - 149 16,64,256 DEVFS3 289 37K - 433 128 ifnet 6 6K - 6 64,1024 ifaddr 72 15K - 72 16,32,64,128,256,512,2048 ether_multi 40 2K - 46 16,32,64 clone 5 20K - 5 4096 arpcom 3 1K - 3 16 lltable 22 5K - 113 128,256 DEVFS1 116 29K - 237 256 DEVFS_RULE 53 13K - 103 32,256 DEVFS 29 1K - 31 16,64 DEVFSP 1 1K - 36 32 pfs_nodes 21 3K - 21 128 routetbl 233 8245K - 914825 16,32,64,128,256,512 igmp 5 1K - 5 128 in_multi 2 1K - 2 128 pfs_vncache 1 1K - 975 32 GEOM 176 98K - 2450 16,32,64,128,256,512,1024,2048 dummynet 3 2K - 3 512 dummynet 3 1K - 1644 256,512 ata_cam 2 2K - 23 64,256,1024 IpFw/IpAcct 76 10K - 341 16,32,64,128,256,512,1024 sctp_a_it 0 0K - 3 16 sctp_vrf 1 1K - 1 64 sctp_ifa 6 1K - 6 128 sctp_ifn 2 1K - 2 128 sctp_iter 0 0K - 3 256 hostcache 1 16K - 1 syncache 1 72K - 1 in6_mfilter 1 1K - 1 512 in6_multi 22 3K - 22 16,256 ip6_moptions 2 1K - 2 32,128 kbdmux 6 18K - 6 16,256,1024,2048 mld 5 1K - 5 128 NFS FHA 1 1K - 42367 32,1024 rpc 1036 262K - 126474 16,32,64,128,256,512,2048,4096 audit_evclass 172 3K - 211 16 pagedep 1 32K - 90466 128 inodedep 12598 3278K - 972352 256 bmsafemap 31 8K - 27449 128,4096 newblk 108 46K - 2854746 128 indirdep 11 1K - 41929 64 freefrag 7350 460K - 562164 64 freeblks 668 42K - 405701 64 freefile 2880 90K - 461844 32 diradd 0 0K - 691462 64 mkdir 0 0K - 57112 64 dirrem 13263 829K - 589958 64 newdirblk 0 0K - 32331 32 freework 475 30K - 674165 64 freedep 0 0K - 12312 32 jaddref 84 6K - 748574 64 jremref 0 0K - 638280 64 jmvref 0 0K - 13141 64 jnewblk 5044 316K - 2854745 64 jfreeblk 0 0K - 634878 64 jfreefrag 0 0K - 562164 64 jseg 57098 3569K - 275595 64 jsegdep 27405 857K - 5451103 32 sbdep 0 0K - 8301 32 jtrunc 0 0K - 12462 64 savedino 0 0K - 2980901 256 jblocks 6 1K - 6 128 ufs_dirhash 216 98K - 86446 16,32,64,128,256,512,1024,2048,4096 ufs_mount 12 37K - 12 256,2048,4096 UMAHash 3 13K - 12 256,512,1024,2048,4096 acpidev 51 2K - 51 32 vm_pgdata 3 65K - 3 64 CAM SIM 3 1K - 4 128 atkbddev 2 1K - 2 32 isadev 5 1K - 5 64 CAM XPT 32 11K - 93 16,32,64,256,1024,2048 apmdev 1 1K - 1 64 CAM periph 4 1K - 18 16,32,64,128 memdesc 1 4K - 12 32,4096 nexusdev 4 1K - 4 16 entropy 1024 64K - 1024 64 UART 6 3K - 6 16,256,1024 CAM queue 11 1K - 56 16 cdev 11 2K - 11 128 scsi_da 0 0K - 15 16 filedesc 219 98K - 712201 16,32,64,128,256,512,1024,2048,4096 sigio 2 1K - 94 32 kenv 82 8K - 86 16,32,64,128,4096 kqueue 4 3K - 132801 128,1024,2048,4096 proc-args 103 6K - 542467 16,32,64,128,256 pci_link 16 2K - 16 64,128 io_apic 1 1K - 1 1024 ithread 78 6K - 169 16,64,128 mixer 1 4K - 1 4096 mirror_data 3 1K - 14933 32,128,512 stripe_data 2 1K - 2 16,32 feeder 19 1K - 366265 16,64 ac97 2 1K - 2 16,512 gcache_data 45 3K - 45409 64 linux 14 1K - 14 32,64 drm_ctxbitmap 1 4K - 1 4096 drm_agplists 1 1K - 1 64 drm_buflists 2 1K - 4 32 drm_files 1 1K - 4 64 drm_maps 9 9K - 21 64 drm_driver 5 5K - 6 16,32,64,256,4096 drm_sarea 1 1K - 1 16 drm_dma 1 1K - 1 16 GEOM_SCHED 6 1K - 41897 64,128 ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 128, 0, 108, 12, 108, 0, 0 UMA Zones: 896, 0, 108, 0, 108, 0, 0 UMA Slabs: 284, 0, 1072, 664, 163061, 0, 0 UMA RCntSlabs: 544, 0, 472, 298, 7932, 0, 0 UMA Hash: 128, 0, 3, 27, 6, 0, 0 16 Bucket: 76, 0, 6, 44, 71, 0, 0 32 Bucket: 140, 0, 25, 31, 112, 0, 0 64 Bucket: 268, 0, 15, 27, 193, 13, 0 128 Bucket: 524, 0, 126, 21, 48748,69538, 0 VM OBJECT: 136, 0, 10810, 27760,10016214, 0, 0 MAP: 140, 0, 7, 21, 7, 0, 0 KMAP ENTRY: 72, 46905, 2033, 1094, 640573, 0, 0 MAP ENTRY: 72, 0, 4700, 600,19864195, 0, 0 DP fakepg: 72, 0, 32797, 63, 65714, 0, 0 SG fakepg: 72, 0, 0, 0, 0, 0, 0 mt_zone: 2056, 0, 286, 104, 286, 0, 0 16: 16, 0, 2879, 369,10987127, 0, 0 32: 32, 0, 32802, 2454, 9830478, 0, 0 64: 64, 0, 88902, 2312,27124409, 0, 0 128: 128, 0, 3107, 3943, 6120483, 0, 0 256: 256, 0, 14685, 2895, 5766259, 0, 0 512: 512, 0, 289, 495, 748890, 0, 0 1024: 1024, 0, 60, 88, 899649, 0, 0 2048: 2048, 0, 227, 193, 217182, 0, 0 4096: 4096, 0, 253, 40, 752278, 0, 0 Files: 56, 0, 541, 799,46472284, 0, 0 TURNSTILE: 72, 0, 286, 14, 286, 0, 0 umtx pi: 52, 0, 0, 0, 0, 0, 0 MAC labels: 20, 0, 0, 0, 0, 0, 0 PROC: 680, 0, 136, 56, 698768, 0, 0 THREAD: 704, 0, 259, 26, 3831, 0, 0 SLEEPQUEUE: 44, 0, 286, 68, 286, 0, 0 VMSPACE: 240, 0, 115, 45, 698748, 0, 0 cpuset: 40, 0, 3, 181, 4, 0, 0 audit_record: 816, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 0, 243, 1211, 6498653, 0, 0 mbuf: 256, 0, 1176, 1470,10280119, 0, 0 mbuf_cluster: 2048, 24640, 748, 196, 1271319, 0, 0 mbuf_jumbo_page: 4096, 12320, 0, 0, 0, 0, 0 mbuf_jumbo_9k: 9216, 18480, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 12320, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 203, 598094, 0, 0 g_bio: 140, 0, 0, 756,29917606, 0, 0 ttyinq: 152, 0, 270, 224, 6480, 0, 0 ttyoutq: 256, 0, 144, 111, 2659, 0, 0 ata_request: 208, 0, 1, 511, 4282961, 0, 0 ata_composite: 180, 0, 0, 0, 0, 0, 0 VNODE: 272, 0, 16239, 18481, 2283603, 0, 0 VNODEPOLL: 60, 0, 73, 809, 889, 0, 0 NAMEI: 1024, 0, 0, 20,85865089, 0, 0 S VFS Cache: 72, 0, 15611, 27637,16134816, 0, 0 L VFS Cache: 292, 0, 278, 554, 437507, 0, 0 DIRHASH: 1024, 0, 43, 93, 185461, 0, 0 NFSMOUNT: 524, 0, 0, 0, 0, 0, 0 NFSNODE: 456, 0, 0, 0, 0, 0, 0 pipe: 392, 0, 46, 34, 252355, 0, 0 ksiginfo: 80, 0, 181, 107, 388273, 0, 0 itimer: 220, 0, 1, 35, 1, 0, 0 KNOTE: 72, 0, 72, 723, 135515, 0, 0 socket: 412, 24642, 176, 58, 106117, 0, 0 ipq: 32, 791, 0, 0, 0, 0, 0 udp_inpcb: 220, 24642, 22, 32, 77026, 0, 0 udpcb: 8, 24766, 22, 181, 77026, 0, 0 tcp_inpcb: 220, 24642, 40, 68, 17973, 0, 0 tcpcb: 632, 24642, 40, 38, 17973, 0, 0 tcptw: 52, 4968, 0, 144, 3813, 0, 0 syncache: 112, 15365, 0, 70, 2135, 0, 0 hostcache: 76, 15400, 41, 109, 483, 0, 0 tcpreass: 20, 1690, 0, 338, 112785, 0, 0 sackhole: 20, 0, 0, 169, 623, 0, 0 sctp_ep: 860, 24640, 0, 0, 0, 0, 0 sctp_asoc: 1484, 40000, 0, 0, 0, 0, 0 sctp_laddr: 24, 80040, 0, 145, 5, 0, 0 sctp_raddr: 432, 80001, 0, 0, 0, 0, 0 sctp_chunk: 92, 400008, 0, 0, 0, 0, 0 sctp_readq: 76, 400000, 0, 0, 0, 0, 0 sctp_stream_msg_out: 64, 400020, 0, 0, 0, 0, 0 sctp_asconf: 24, 400055, 0, 0, 0, 0, 0 sctp_asconf_ack: 24, 400055, 0, 0, 0, 0, 0 ripcb: 220, 24642, 0, 36, 246, 0, 0 unpcb: 172, 24656, 113, 48, 10864, 0, 0 rtentry: 108, 0, 19, 53, 19, 0, 0 pfsrctrpl: 124, 10013, 0, 0, 0, 0, 0 pfrulepl: 828, 0, 7, 5, 7, 0, 0 pfstatepl: 284, 10010, 49, 455, 162190, 0, 0 pfaltqpl: 224, 0, 0, 0, 0, 0, 0 pfpooladdrpl: 68, 0, 4, 108, 4, 0, 0 pfrktable: 1240, 1002, 0, 0, 0, 0, 0 pfrkentry: 156, 200000, 0, 0, 0, 0, 0 pfrkentry2: 156, 0, 0, 0, 0, 0, 0 pffrent: 16, 5075, 0, 203, 38619, 0, 0 pffrag: 48, 0, 0, 156, 6453, 0, 0 pffrcache: 48, 10062, 0, 0, 0, 0, 0 pffrcent: 12, 50141, 0, 0, 0, 0, 0 pfstatescrub: 28, 0, 0, 0, 0, 0, 0 pfiaddrpl: 100, 0, 0, 0, 0, 0, 0 pfospfen: 108, 0, 696, 24, 696, 0, 0 pfosfp: 28, 0, 407, 228, 407, 0, 0 IPFW dynamic rule: 108, 0, 99, 189, 21681, 0, 0 divcb: 220, 24642, 0, 0, 0, 0, 0 g_stripe_zone: 131072, 3200, 0, 0, 0, 0, 0 gcache: 131072, 0, 45, 159, 45409, 0, 0 selfd: 28, 0, 367, 268,100989132, 0, 0 ip4flow: 40, 24656, 4, 180, 10317, 0, 0 ip6flow: 64, 24650, 0, 174, 1, 0, 0 SWAPMETA: 276, 92834, 2875, 5525, 36364, 0, 0 Mountpoints: 648, 0, 7, 5, 7, 0, 0 FFS inode: 116, 0, 16182, 26916, 2282199, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 16182, 19713, 2282199, 0, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq1: atkbd0 126246 847 irq0: attimer0 19230043 129060 irq6: fdc0 11 0 irq12: psm0 1325857 8898 irq14: ata0 2124151 14256 irq15: ata1 2155003 14463 irq16: uhci0 uhci3 493891 3314 irq17: pcm0 40938 274 irq20: fxp0 6293916 42241 irq23: ehci0 464 3 cpu0:timer 151286734 1015347 Total 183077254 1228706 ------------------------------------------------------------------------ pstat -T 541/11848 files 52M/1559M swap space ------------------------------------------------------------------------ pstat -s Device 512-blocks Used Avail Capacity /dev/ad0s1b 1597184 53312 1543872 3% /dev/ad2s1b 1597184 53408 1543776 3% Total 3194368 106720 3087648 3% ------------------------------------------------------------------------ iostat iostat: kvm_read(_tk_nin): invalid address (0x0) iostat: disabling TTY statistics iostat: kvm_getcptime: invalid address (0x0) iostat: disabling CPU time statistics ad0 ad2 cd0 KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s 19.00 14186 263.19 18.85 14391 264.90 0.00 0 0.00 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 196608 0 --rw------- vk vk vk vk 2 393216 22084 22056 8:32:00 no-entry 8:32:00 m 131073 0 --rw------- vk vk vk vk 2 393216 22084 22056 8:32:00 no-entry 8:32:00 m 131074 0 --rw------- vk vk vk vk 2 393216 22089 22056 8:32:03 no-entry 8:32:03 m 131075 0 --rw------- vk vk vk vk 2 393216 22089 22056 8:32:06 no-entry 8:32:06 m 131076 0 --rw------- vk vk vk vk 2 393216 22088 22056 8:32:06 10:53:57 8:32:06 m 3997701 0 --rw------- vk vk vk vk 2 393216 22099 22056 8:32:11 10:34:04 8:32:11 m 3801094 0 --rw------- vk vk vk vk 2 393216 22091 22056 8:32:12 8:32:35 8:32:12 m 3014663 0 --rw------- vk vk vk vk 2 393216 22091 22056 8:32:12 8:32:17 8:32:12 m 3014664 0 --rw------- vk vk vk vk 2 393216 22159 22056 8:33:51 8:33:58 8:33:51 m 196617 0 --rw------- vk vk vk vk 2 393216 22077 22056 8:31:58 8:32:10 8:31:58 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 192 (max number of shared memory identifiers) shmseg: 128 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmap: 30 (# of entries in semaphore map) semmni: 50 (# of semaphore identifiers) semmns: 340 (# of semaphores in system) semmnu: 150 (# of undo structures in system) semmsl: 340 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 50 (max # of undo entries per process) semusz: 616 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ nfsstat Client Info: Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 0 Cache Info: Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses 0 0 0 0 0 0 0 0 BioRLHits Misses BioD Hits Misses DirE Hits Misses 0 0 0 0 0 0 Server Info: Getattr Setattr Lookup Readlink Read Write Create Remove 0 8 7016 0 12695 6427 14 13 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 4 2 104 0 15376 Mknod Fsstat Fsinfo PathConf Commit 0 1635 2 0 130 Server Ret-Failed 4249 Server Faults 0 Server Cache Stats: Inprog Idem Non-idem Misses 0 0 0 0 Server Write Gathering: WriteOps WriteRPC Opsaved 6427 6427 0 ------------------------------------------------------------------------ netstat -s tcp: 3359163 packets sent 255866 data packets (135979014 bytes) 1446 data packets (1572174 bytes) retransmitted 59 data packets unnecessarily retransmitted 0 resends initiated by MTU discovery 2113826 ack-only packets (55064 delayed) 0 URG only packets 12 window probe packets 957257 window update packets 30772 control packets 4875834 packets received 249997 acks (for 135481687 bytes) 12246 duplicate acks 0 acks for unsent data 4606398 packets (1865795108 bytes) received in-sequence 1559 completely duplicate packets (371580 bytes) 0 old duplicate packets 2 packets with some dup. data (706 bytes duped) 112725 out-of-order packets (159609409 bytes) 50 packets (50 bytes) of data after window 50 window probes 905 window update packets 82 packets received after close 0 discarded for bad checksums 0 discarded for bad header offset fields 0 discarded because packet too short 31760 discarded due to memory problems 15588 connection requests 2128 connection accepts 0 bad connection attempts 0 listen queue overflows 344 ignored RSTs in the windows 15966 connections established (including accepts) 17937 connections closed (including 267 drops) 5290 connections updated cached RTT on close 5313 connections updated cached RTT variance on close 385 connections updated cached ssthresh on close 1497 embryonic connections dropped 242773 segments updated rtt (of 229413 attempts) 1903 retransmit timeouts 28 connections dropped by rexmit timeout 15 persist timeouts 0 connections dropped by persist timeout 0 Connections (fin_wait_2) dropped because of timeout 18 keepalive timeouts 14 keepalive probes sent 4 connections dropped by keepalive 9000 correct ACK header predictions 4338311 correct data packet header predictions 2135 syncache entries added 21 retransmitted 19 dupsyn 0 dropped 2128 completed 0 bucket overflow 0 cache overflow 6 reset 1 stale 0 aborted 0 badack 0 unreach 0 zone failures 2135 cookies sent 0 cookies received 323 SACK recovery episodes 686 segment rexmits in SACK recovery episodes 910352 byte rexmits in SACK recovery episodes 3484 SACK options (SACK blocks) received 155471 SACK options (SACK blocks) sent 0 SACK scoreboard overflow 0 packets with ECN CE bit set 0 packets with ECN ECT(0) bit set 0 packets with ECN ECT(1) bit set 0 successful ECN handshakes 0 times ECN reduced the congestion window udp: 460481 datagrams received 0 with incomplete header 0 with bad data length field 0 with bad checksum 786 with no checksum 9327 dropped due to no socket 329789 broadcast/multicast datagrams undelivered 0 dropped due to full socket buffers 0 not for hashed pcb 121365 delivered 113810 datagrams output 0 times multicast source filter matched ip: 5561487 total packets received 0 bad header checksums 0 with size smaller than minimum 0 with data size < data length 0 with ip length > max ip packet size 0 with header length < data size 0 with data length < header length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 packets reassembled ok 5338383 packets for this host 1358 packets for unknown/unsupported protocol 0 packets forwarded (0 packets fast forwarded) 27504 packets not forwardable 0 packets received for unknown multicast group 0 redirects sent 3491991 packets sent from this host 288 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 12033 output datagrams fragmented 71708 fragments created 0 datagrams that can't be fragmented 0 tunneling packets that can't find gif 0 datagrams with bad address in header icmp: 1332 calls to icmp_error 0 errors not generated in response to an icmp message Output histogram: echo reply: 168 destination unreachable: 1332 0 messages with bad code fields 0 messages less than the minimum length 0 messages with bad checksum 0 messages with bad length 0 multicast echo requests ignored 0 multicast timestamp requests ignored Input histogram: echo reply: 1853 destination unreachable: 1153 echo: 168 time exceeded: 252 168 message responses generated 0 invalid return addresses 0 no return routes igmp: 0 messages received 0 messages received with too few bytes 0 messages received with wrong TTL 0 messages received with bad checksum 0 V1/V2 membership queries received 0 V3 membership queries received 0 membership queries received with invalid field(s) 0 general queries received 0 group queries received 0 group-source queries received 0 group-source queries dropped 0 membership reports received 0 membership reports received with invalid field(s) 0 membership reports received for groups to which we belong 0 V3 reports received without Router Alert 0 membership reports sent arp: 142 ARP requests sent 360 ARP replies sent 511616 ARP requests received 2498 ARP replies received 514114 ARP packets received 8 total packets dropped due to no ARP entry 91 ARP entrys timed out 0 Duplicate IPs seen ip6: 0 total packets received 0 with size smaller than minimum 0 with data size < data length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 fragments that exceeded limit 0 packets reassembled ok 0 packets for this host 0 packets forwarded 0 packets not forwardable 0 redirects sent 5 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 64 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 packets that violated scope rules 0 multicast packets which we don't join Mbuf statistics: 0 one mbuf 0 one ext mbuf 0 two or more ext mbuf 0 packets whose headers are not continuous 0 tunneling packets that can't find gif 0 packets discarded because of too many headers 0 failures of source address selection Source addresses selection rule applied: icmp6: 0 calls to icmp6_error 0 errors not generated in response to an icmp6 message 0 errors not generated because of rate limitation Output histogram: neighbor solicitation: 1 0 messages with bad code fields 0 messages < minimum length 0 bad checksums 0 messages with bad length Histogram of error messages to be generated: 0 no route 0 administratively prohibited 0 beyond scope 0 address unreachable 0 port unreachable 0 packet too big 0 time exceed transit 0 time exceed reassembly 0 erroneous header field 0 unrecognized next header 0 unrecognized option 0 redirect 0 unknown 0 message responses generated 0 messages with too many ND options 0 messages with bad ND options 0 bad neighbor solicitation messages 0 bad neighbor advertisement messages 0 bad router solicitation messages 0 bad router advertisement messages 0 bad redirect messages 0 path MTU changes rip6: 0 messages received 0 checksum calculations on inbound 0 messages with bad checksum 0 messages dropped due to no socket 0 multicast messages dropped due to no socket 0 messages dropped due to full socket buffers 0 delivered 0 datagrams output ------------------------------------------------------------------------ netstat -m 1419/2681/4100 mbufs in use (current/cache/total) 18446744073709551153/1407/944/24640 mbuf clusters in use (current/cache/total/max) 243/1211 mbuf+clusters out of packet secondary zone in use (current/cache) 0/0/0/12320 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/18480 9k jumbo clusters in use (current/cache/total/max) 0/0/0/12320 16k jumbo clusters in use (current/cache/total/max) 18014398509481412K/3484K/2913K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines ------------------------------------------------------------------------ netstat -id Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop fxp0 1500 <Link#1>
Responsible Changed From-To: freebsd-bugs->freebsd-fs Over to maintainer(s).
State Changed From-To: open->feedback Lots of people were seeing this issue and Jeff committed a potential fix in May. Could you confirm whether you're still having the problem?
State Changed From-To: feedback->closed Feedback timeout.