Attachment 167688 Details for Bug 173541 – broken loadavgs, a fix, then fixed loadavs

broken loadavgs, a fix, then fixed loadavs

before_and_after_cpuset.loadavg.HPET_one-shot (text/plain), 57.58 KB, created by Ian Smith on 2016-03-03 14:45:47 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Ian Smith

Created: 2016-03-03 14:45:47 UTC

Size: 57.58 KB

patch

obsolete

>[
>  originally Jan 31 04:57; (commentary only) updated 23 Feb & 4 Mar 2016 
>
>  Lenovo X200, 2.4GHz Core2 Duo, 2G RAM, HZ=1000, 9.3-STABLE r289106, HPET
>  used for Timecounter and Eventtimer, hpet0 sharing irq20 with uhci0; the
>  latter is unused during these tests.
>
>  Using default HPET one-shot mode event timer after boot, unloaded excess
>  daemons: hald & dbus for X/KDE (not started), rwho and moused, leaving
>  only ntpd, sshd (for this session) and powerd services running.
>
>  After some 2 minute stress tests, first waiting for loadavg to stabilise
>  at its 'normal' +0.4 to +0.7 at idle, with nothing else happening.
>
>  The below shows 1 min loadavg highly volatile between ~+0.4 to ~+0.7
>  with longer-term 5 & 15-minute (rolling) averages perhaps damping
>  towards 0.5 after over an hour, added to the 'real' (or or at least
>  'traditional') loadavg, here tracking long periods running real loads
>  on top of (accounted) system tasks registering around 0.2% of one CPU
>  at idle, then plus 1, 2 and 4 (and later, 11) 100% CPU-bound threads.
>
>  Using sysutils/stress which does a fine job of 100% CPU threads, well
>  reproducing earlier results with 2 other programs, one of them mine.
>
>  As we see later - from about 40% into this report - 'true' (or nearly
>  enough so) one-minute idle loadavg tends to 0.00, ie less than 0.005,
>  plus 1, 2, 4 and later 11 100% CPU tasks show 0.99, 1.99, 3.99 & 10.99,
>  leaving about 0.01 load for administration, illustrated by systat -v.
>
>  A complete and permanent fix of loadavg stats using HPET eventcounter
>  is accomplished - on this hardware, on 9.x at least - by just running,
>  any time after boot (/etc/rc.local works for me):
>
>  # cpuset -l 0 -s 1	# followed immediately or anytime later by:
>  # cpuset -l 0-1 -s 1	# ie: -l "0-`sysctl -n kern.smp.maxid`"
>
>  Please note carefully loadavg reports immediately after this 'trick'.
>
>  So, why, and how, could this be so?  Can anyone reproduce this on any
>  similar machine: Core2, Core2Duo and some Atoms were so affected?
>
>  Could any of the contributors to this bug try booting a 9.2 or 9.3-R
>  menstick in Live CD mode, observe over a reasonable period, perhaps
>    % sh -c 'date; while true; do uptime; sleep 60; done'
>  then, as root, apply the cpuset dance above, and repeat observations?
>
>  As far as I can observe, no other changes occur in the behaviour
>  of the system regarding interrupts, context switches, traps etc
>  (per systat -v) nor displayed CPU stats (ps, top, vmstat -w), either
>  at idle or under these specific test loads up to (here) 11.
>
>  The next day I ran the same tests with the HPET in periodic mode, where
>  previously completely idle loadavg after a few minutes tended to 1.00,
>  but that now produces the same entirely good results as in one-shot mode,
>  albeit with 2000 interrupts/s rather than one-shot's idle of 60 to 80
>  and maximum hpet0 under even high loads of ~1126, likely HZ + StatHz -1?
>
>  Subsequent tests show LAPIC event counter, both one-shot and periodic,
>  still provides as-good loadavgs, so there's no observable change there.
>
>  verbose dmesg.boot is also attached.
>]
>
>Fri Jan 29 23:22:48 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.60% 99.39% last 1691us  { 2.07 1.59 1.03 }
>0.00% 0.44% 99.55% last 1965us  { HPET one-shot }
>dev.acpi_ibm.0.thermal: 53 44 -1 51 35 -1 33 -1
>hw.acpi.thermal.tz0.temperature: 53.0C  tz1: 57.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3372
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12449 mV
>11:22PM  up  8:35, 1 user, load averages: 2.07, 1.59, 1.03  53.0C 57.0C
>11:23PM  up  8:36, 1 user, load averages: 3.58, 2.10, 1.25  69.0C 67.0C
>stress: info: [2538] successful run completed in 120s
>11:24PM  up  8:37, 1 user, load averages: 3.97, 2.50, 1.46  67.0C 58.0C
>^C
>[1]  + Done                          stress -c 4 -t 2m
>239.670u 0.000s 2:00.00 199.7%  25+2745k 0+0io 0pf+0w
>
>smithi@x200:~ % sh -c 'x200stat; while true; do \
>  echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` \
> `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Fri Jan 29 23:25:24 AEDT 2016  dev.cpu.0.freq: 800
>0.00% 0.60% 99.39% last 214us   { 2.40 2.27 1.42 }
>0.00% 0.44% 99.55% last 235us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 54 44 -1 56 35 -1 33 -1
>hw.acpi.thermal.tz0.temperature: 54.0C  tz1: 50.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3208
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12449 mV
>11:25PM  up  8:37, 1 user, load averages: 2.40, 2.27, 1.42  54.0C 50.0C
>11:26PM  up  8:38, 1 user, load averages: 1.34, 1.98, 1.36  49.0C 46.0C
>11:27PM  up  8:39, 1 user, load averages: 0.94, 1.75, 1.32  47.0C 44.0C
>11:28PM  up  8:40, 1 user, load averages: 0.77, 1.55, 1.27  46.0C 43.0C
>11:29PM  up  8:41, 1 user, load averages: 0.65, 1.37, 1.22  45.0C 42.0C
>11:30PM  up  8:42, 1 user, load averages: 0.68, 1.25, 1.19  45.0C 43.0C
>11:31PM  up  8:43, 1 user, load averages: 0.63, 1.14, 1.14  44.0C 42.0C
>11:32PM  up  8:44, 1 user, load averages: 0.57, 1.02, 1.10  44.0C 42.0C
>11:33PM  up  8:45, 1 user, load averages: 0.52, 0.91, 1.05  44.0C 42.0C
>11:34PM  up  8:46, 1 user, load averages: 0.42, 0.81, 1.00  44.0C 41.0C
>11:35PM  up  8:47, 1 user, load averages: 0.51, 0.77, 0.97  43.0C 40.0C
>11:36PM  up  8:48, 1 user, load averages: 0.69, 0.78, 0.96  43.0C 41.0C
>11:37PM  up  8:49, 1 user, load averages: 0.51, 0.71, 0.92  43.0C 40.0C
>11:38PM  up  8:50, 1 user, load averages: 0.66, 0.71, 0.91  43.0C 41.0C
>11:39PM  up  8:51, 1 user, load averages: 0.44, 0.64, 0.86  43.0C 40.0C
>11:40PM  up  8:52, 1 user, load averages: 0.51, 0.61, 0.84  43.0C 40.0C
>11:41PM  up  8:53, 1 user, load averages: 0.52, 0.59, 0.81  43.0C 40.0C
>11:42PM  up  8:54, 1 user, load averages: 0.69, 0.62, 0.81  43.0C 40.0C
>11:43PM  up  8:55, 1 user, load averages: 0.51, 0.59, 0.78  43.0C 41.0C
>11:44PM  up  8:56, 1 user, load averages: 0.45, 0.56, 0.76  43.0C 40.0C
>11:45PM  up  8:57, 1 user, load averages: 0.41, 0.53, 0.73  43.0C 40.0C
>11:46PM  up  8:58, 1 user, load averages: 0.60, 0.55, 0.73  43.0C 40.0C
>11:47PM  up  8:59, 1 user, load averages: 0.54, 0.55, 0.71  43.0C 40.0C
>11:48PM  up 9 hrs, 1 user, load averages: 0.55, 0.54, 0.70  43.0C 40.0C
>11:49PM  up  9:01, 1 user, load averages: 0.53, 0.54, 0.68  43.0C 40.0C
>11:50PM  up  9:02, 1 user, load averages: 0.49, 0.52, 0.66  43.0C 40.0C
>11:51PM  up  9:03, 1 user, load averages: 0.69, 0.57, 0.67  43.0C 40.0C
>11:52PM  up  9:04, 1 user, load averages: 0.66, 0.59, 0.67  43.0C 40.0C
>11:53PM  up  9:05, 1 user, load averages: 0.63, 0.59, 0.66  42.0C 40.0C
>11:54PM  up  9:06, 1 user, load averages: 0.63, 0.60, 0.66  42.0C 40.0C
>11:55PM  up  9:07, 1 user, load averages: 0.47, 0.56, 0.64  42.0C 40.0C
>11:56PM  up  9:08, 1 user, load averages: 0.34, 0.50, 0.61  42.0C 40.0C
>11:57PM  up  9:09, 1 user, load averages: 0.50, 0.52, 0.61  42.0C 40.0C
>11:58PM  up  9:10, 1 user, load averages: 0.60, 0.54, 0.61  42.0C 40.0C
>11:59PM  up  9:11, 1 user, load averages: 0.57, 0.54, 0.60  42.0C 40.0C
>12:00AM  up  9:12, 1 user, load averages: 0.60, 0.55, 0.60  42.0C 40.0C
>12:01AM  up  9:13, 1 user, load averages: 0.60, 0.56, 0.59  42.0C 40.0C
>12:02AM  up  9:14, 1 user, load averages: 0.62, 0.57, 0.59  42.0C 40.0C
>12:03AM  up  9:15, 1 user, load averages: 0.56, 0.57, 0.58  42.0C 40.0C
>12:04AM  up  9:16, 1 user, load averages: 0.56, 0.57, 0.58  42.0C 39.0C
>12:05AM  up  9:17, 1 user, load averages: 0.36, 0.51, 0.56  42.0C 40.0C
>12:06AM  up  9:18, 1 user, load averages: 0.62, 0.55, 0.57  42.0C 40.0C
>12:07AM  up  9:19, 1 user, load averages: 0.49, 0.52, 0.56  42.0C 40.0C
>12:08AM  up  9:20, 1 user, load averages: 0.55, 0.52, 0.55  42.0C 40.0C
>12:09AM  up  9:21, 1 user, load averages: 0.75, 0.58, 0.57  42.0C 40.0C
>12:10AM  up  9:22, 1 user, load averages: 0.48, 0.53, 0.55  42.0C 40.0C
>12:11AM  up  9:23, 1 user, load averages: 0.60, 0.56, 0.56  42.0C 38.0C
>12:12AM  up  9:24, 1 user, load averages: 0.40, 0.51, 0.54  42.0C 40.0C
>12:13AM  up  9:25, 1 user, load averages: 0.34, 0.47, 0.52  42.0C 40.0C
>12:14AM  up  9:26, 1 user, load averages: 0.41, 0.46, 0.51  42.0C 40.0C
>12:15AM  up  9:27, 1 user, load averages: 0.53, 0.48, 0.51  42.0C 38.0C
>12:16AM  up  9:28, 1 user, load averages: 0.47, 0.48, 0.51  42.0C 40.0C
>12:17AM  up  9:29, 1 user, load averages: 0.64, 0.52, 0.51  42.0C 40.0C
>12:18AM  up  9:30, 1 user, load averages: 0.57, 0.53, 0.51  42.0C 40.0C
>12:19AM  up  9:31, 1 user, load averages: 0.62, 0.55, 0.52  42.0C 40.0C
>12:20AM  up  9:32, 1 user, load averages: 0.70, 0.58, 0.53  42.0C 40.0C
>12:21AM  up  9:33, 1 user, load averages: 0.64, 0.58, 0.53  42.0C 39.0C
>12:22AM  up  9:34, 1 user, load averages: 0.54, 0.56, 0.52  42.0C 40.0C
>12:23AM  up  9:35, 1 user, load averages: 0.70, 0.59, 0.53  42.0C 40.0C
>12:24AM  up  9:36, 1 user, load averages: 0.55, 0.57, 0.53  42.0C 40.0C
>12:25AM  up  9:37, 1 user, load averages: 0.56, 0.57, 0.53  42.0C 40.0C
>12:26AM  up  9:38, 1 user, load averages: 0.51, 0.55, 0.52  42.0C 40.0C
>12:27AM  up  9:39, 1 user, load averages: 0.50, 0.54, 0.51  42.0C 38.0C
>12:28AM  up  9:40, 1 user, load averages: 0.69, 0.59, 0.53  42.0C 40.0C
>12:29AM  up  9:41, 1 user, load averages: 0.37, 0.52, 0.51  42.0C 40.0C
>12:30AM  up  9:42, 1 user, load averages: 0.40, 0.51, 0.50  42.0C 40.0C
>12:31AM  up  9:43, 1 user, load averages: 0.64, 0.56, 0.52  42.0C 40.0C
>12:32AM  up  9:44, 1 user, load averages: 0.62, 0.56, 0.52  42.0C 40.0C
>12:33AM  up  9:45, 1 user, load averages: 0.56, 0.56, 0.52  42.0C 40.0C
>12:34AM  up  9:46, 1 user, load averages: 0.57, 0.56, 0.52  42.0C 40.0C
>12:35AM  up  9:47, 1 user, load averages: 0.57, 0.56, 0.52  42.0C 40.0C
>12:36AM  up  9:48, 1 user, load averages: 0.68, 0.58, 0.52  42.0C 38.0C
>12:37AM  up  9:49, 1 user, load averages: 0.46, 0.54, 0.51  42.0C 38.0C
>12:38AM  up  9:50, 1 user, load averages: 0.70, 0.59, 0.53  42.0C 40.0C
>12:39AM  up  9:51, 1 user, load averages: 0.52, 0.56, 0.52  42.0C 40.0C
>12:40AM  up  9:52, 1 user, load averages: 0.61, 0.57, 0.52  42.0C 40.0C
>12:41AM  up  9:53, 1 user, load averages: 0.55, 0.57, 0.52  42.0C 40.0C
>12:42AM  up  9:54, 1 user, load averages: 0.64, 0.58, 0.52  42.0C 40.0C
>12:43AM  up  9:55, 1 user, load averages: 0.42, 0.52, 0.50  42.0C 38.0C
>12:44AM  up  9:56, 1 user, load averages: 0.55, 0.53, 0.51  42.0C 40.0C
>12:45AM  up  9:57, 1 user, load averages: 0.55, 0.54, 0.51  42.0C 40.0C
>12:46AM  up  9:58, 1 user, load averages: 0.36, 0.49, 0.49  42.0C 40.0C
>12:47AM  up  9:59, 1 user, load averages: 0.46, 0.48, 0.49  42.0C 39.0C
>12:48AM  up 10 hrs, 1 user, load averages: 0.38, 0.45, 0.47  42.0C 40.0C
>12:49AM  up 10:01, 1 user, load averages: 0.57, 0.48, 0.48  42.0C 40.0C
>12:50AM  up 10:02, 1 user, load averages: 0.75, 0.55, 0.51  42.0C 38.0C
>12:51AM  up 10:03, 1 user, load averages: 0.55, 0.53, 0.50  42.0C 40.0C
>12:52AM  up 10:04, 1 user, load averages: 0.56, 0.52, 0.50  42.0C 40.0C
>12:53AM  up 10:05, 1 user, load averages: 0.70, 0.55, 0.51  42.0C 40.0C
>12:54AM  up 10:06, 1 user, load averages: 0.60, 0.54, 0.51  42.0C 38.0C
>12:55AM  up 10:07, 1 user, load averages: 0.67, 0.56, 0.51  42.0C 38.0C
>12:56AM  up 10:08, 1 user, load averages: 0.56, 0.54, 0.50  42.0C 38.0C
>^C
>
>smithi@x200:~ % time stress -c 2 -t 16m &
>[1] 3154
>smithi@x200:~ % stress: info: [3154] dispatching hogs: 2 cpu, 0 io, 0 vm, 0 hdd
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 00:57:48 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.51% 99.48% last 1953us  { 0.45 0.50 0.49 }
>0.00% 0.37% 99.62% last 1731us  { HPET one-shot }
>dev.acpi_ibm.0.thermal: 46 44 -1 42 35 -1 33 -1
>hw.acpi.thermal.tz0.temperature: 42.0C  tz1: 42.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3369
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12449 mV
>12:57AM  up 10:10, 1 user, load averages: 0.45, 0.50, 0.49  42.0C 42.0C
>12:58AM  up 10:11, 1 user, load averages: 1.43, 0.77, 0.59  62.0C 61.0C
>^C
>
>smithi@x200:~ % systat -vm 10
>    1 users    Load  2.29  1.26  0.80                  Jan 30 01:00
>
>Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
>Act   24904    6168   459064     7416 1757352  count
>All   29416    7296   485688    24984          pages
>Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow    1129 total
>  2          23      2404   14   20 1129   68             zfod        atkbd0 1
>                                                          ozfod     1 acpi0 9
> 0.0%Sys   0.0%Intr  100%User  0.0%Nice  0.0%Idle        %ozfod  1126 hpet0 uhci
>|    |    |    |    |    |    |    |    |    |    |       daefr       ehci0 23
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        prcfr     1 em0 256
>                                         4 dtbuf        1 totfr       hdac0 257
>Namei     Name-cache   Dir-cache    110822 desvn          react     1 ahci0 258
>   Calls    hits   %    hits   %      5405 numvn          pdwak
>       3       3 100                   724 frevn          pdpgs
>                                                          intrn
>Disks  ada0 pass0                                  112556 wire
>KB/t  24.00  0.00                                   17560 act
>tps       1     0                                   18780 inact
>MB/s   0.01  0.00                                         cache
>%busy     0     0                                 1757352 free
>                                                   154240 buf
>
>
>smithi@x200:~ % nice top -SCHP -s10
>last pid:  3204;  load averages:  2.30,  1.37,  0.86	up 0+10:13:07  01:01:12
>108 processes: 6 running, 82 sleeping, 20 waiting
>CPU 0: 99.9% user,  0.0% nice,  0.0% system,  0.1% interrupt,  0.0% idle
>CPU 1:  100% user,  0.0% nice,  0.0% system,  0.0% interrupt,  0.0% idle
>Mem: 17M Active, 18M Inact, 110M Wired, 151M Buf, 1717M Free
>Swap: 2048M Total, 2048M Free
>
>  PID USERNAME   PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
> 3155 smithi     103    0 12160K  1700K CPU1    1   3:30 100.00% stress
> 3156 smithi     103    0 12160K  1700K RUN     0   3:30 100.00% stress
>   11 root       155 ki31     0K    32K RUN     1   5:10   0.00% idle{idle: cpu1}
>   11 root       155 ki31     0K    32K RUN     0   4:58   0.00% idle{idle: cpu0}
>    0 root       -16    0     0K   176K swapin  1   0:57   0.00% kernel{swapper}
>   12 root       -60    -     0K   320K WAIT    0   0:13   0.00% intr{swi4: clock}
>   12 root       -100    -     0K   320K WAIT    0   0:10   0.00% intr{irq20: hpet0 uhc}
>   16 root       -16    -     0K    16K tzpoll  0   0:05   0.00% acpi_thermal
>    8 root        16    -     0K    16K syncer  1   0:02   0.00% syncer
>   14 root       -16    -     0K    16K -       0   0:01   0.00% yarrow
>  678 root        20    0 22276K  3360K select  1   0:01   0.00% ntpd
>   12 root       -60    -     0K   320K WAIT    1   0:01   0.00% intr{swi4: clock}
>  940 smithi      20    0 74544K  6132K select  1   0:01   0.00% sshd
>  681 root        20    0 12104K  1648K select  0   0:01   0.00% powerd
>  810 root        20    0 20356K  4588K select  1   0:00   0.00% sendmail
>    0 root       -92    0     0K   176K -       1   0:00   0.00% kernel{em0 que}
>[..]
>
>smithi@x200:~ % ps ax | grep "[s]tress"
>3154  0  I     0:00.00 stress -c 2 -t 16m
>3155  0  R     4:01.07 stress -c 2 -t 16m
>3156  0  R     4:00.58 stress -c 2 -t 16m
>smithi@x200:~ % ps aux | grep "[s]tress"
>smithi 3155 100.0  0.1 12160 1700  0  R    12:57AM  4:09.13 stress -c 2 -t 16m
>smithi 3156 100.0  0.1 12160 1700  0  R    12:57AM  4:08.63 stress -c 2 -t 16m
>smithi 3154   0.0  0.1 12160 1704  0  I    12:57AM  0:00.00 stress -c 2 -t 16m
>smithi@x200:~ % top | grep "[s]tress"
> 3155 smithi        1 103    0 12160K  1700K CPU1    1   4:34  99.66% stress
> 3156 smithi        1 103    0 12160K  1700K RUN     0   4:33  99.66% stress
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 01:02:32 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.51% 99.48% last 1953us  { 2.52 1.67 1.02 }
>0.00% 0.37% 99.62% last 1731us  { HPET one-shot }
>dev.acpi_ibm.0.thermal: 74 44 -1 64 35 -1 33 -1
>hw.acpi.thermal.tz0.temperature: 74.0C  tz1: 71.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3762
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12449 mV
> 1:02AM  up 10:14, 1 user, load averages: 2.52, 1.67, 1.02  74.0C 71.0C
> 1:03AM  up 10:15, 1 user, load averages: 2.61, 1.85, 1.13  75.0C 73.0C
> 1:04AM  up 10:16, 1 user, load averages: 2.61, 1.98, 1.22  76.0C 73.0C
> 1:05AM  up 10:17, 1 user, load averages: 2.64, 2.10, 1.32  77.0C 74.0C
> 1:06AM  up 10:18, 1 user, load averages: 2.34, 2.11, 1.38  78.0C 74.0C
> 1:07AM  up 10:19, 1 user, load averages: 2.52, 2.20, 1.45  78.0C 75.0C
> 1:08AM  up 10:20, 1 user, load averages: 2.64, 2.29, 1.54  79.0C 75.0C  <<<<<<<
> 1:09AM  up 10:21, 1 user, load averages: 2.56, 2.33, 1.60  79.0C 75.0C
> 1:10AM  up 10:22, 1 user, load averages: 2.62, 2.38, 1.67  79.0C 75.0C  <<<<<<<
> 1:11AM  up 10:23, 1 user, load averages: 2.56, 2.40, 1.72  80.0C 75.0C
> 1:12AM  up 10:24, 1 user, load averages: 2.46, 2.40, 1.77  80.0C 76.0C
> 1:13AM  up 10:25, 1 user, load averages: 2.50, 2.43, 1.82  80.0C 76.0C
>stress: info: [3154] successful run completed in 960s
> 1:14AM  up 10:26, 1 user, load averages: 1.42, 2.14, 1.76  57.0C 55.0C
> 1:15AM  up 10:27, 1 user, load averages: 0.75, 1.81, 1.66  52.0C 48.0C
> 1:16AM  up 10:28, 1 user, load averages: 0.78, 1.64, 1.60  50.0C 46.0C
> 1:17AM  up 10:29, 1 user, load averages: 0.75, 1.46, 1.54  48.0C 45.0C
> 1:18AM  up 10:30, 1 user, load averages: 0.59, 1.28, 1.46  47.0C 44.0C
> 1:19AM  up 10:31, 1 user, load averages: 0.41, 1.10, 1.38  47.0C 44.0C
> 1:20AM  up 10:32, 1 user, load averages: 0.49, 1.01, 1.33  46.0C 43.0C
> 1:21AM  up 10:33, 1 user, load averages: 0.48, 0.90, 1.26  45.0C 43.0C
> 1:22AM  up 10:34, 1 user, load averages: 0.44, 0.81, 1.20  45.0C 43.0C
> 1:23AM  up 10:35, 1 user, load averages: 0.65, 0.80, 1.17  45.0C 42.0C
> 1:24AM  up 10:36, 1 user, load averages: 0.62, 0.76, 1.12  44.0C 42.0C
> 1:25AM  up 10:37, 1 user, load averages: 0.59, 0.72, 1.08  44.0C 42.0C
>^C
>[1]  + Done                          stress -c 2 -t 16m
>1917.523u 0.003s 16:00.00 199.7%        25+2745k 0+0io 0pf+0w
>
>smithi@x200:~ % x200stat
>Sat Jan 30 01:26:27 AEDT 2016  dev.cpu.0.freq: 800
>0.00% 0.49% 99.50% last 298us   { 0.56 0.70 1.05 }
>0.00% 0.36% 99.63% last 254us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 44 45 -1 44 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 44.0C  tz1: 42.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3366
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
>
>smithi@x200:~ % time stress -c 4 -t 16m &
>[1] 3390
>smithi@x200:~ % stress: info: [3390] dispatching hogs: 4 cpu, 0 io, 0 vm, 0 hdd
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 01:26:55 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.50% 99.49% last 2631us  { 1.13 0.81 1.08 }
>0.00% 0.36% 99.63% last 1178us  { HPET one-shot }
>dev.acpi_ibm.0.thermal: 51 44 -1 45 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 46.0C  tz1: 50.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3369
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
> 1:26AM  up 10:39, 1 user, load averages: 1.13, 0.81, 1.08  46.0C 50.0C
> 1:27AM  up 10:40, 1 user, load averages: 2.85, 1.34, 1.26  65.0C 63.0C
> 1:28AM  up 10:41, 1 user, load averages: 3.54, 1.79, 1.43  70.0C 68.0C
> 1:29AM  up 10:42, 1 user, load averages: 4.07, 2.26, 1.63  72.0C 71.0C
> 1:30AM  up 10:43, 1 user, load averages: 4.27, 2.64, 1.81  74.0C 72.0C
> 1:31AM  up 10:44, 1 user, load averages: 4.26, 2.93, 1.98  76.0C 74.0C
> 1:32AM  up 10:45, 1 user, load averages: 4.46, 3.23, 2.15  77.0C 74.0C
> 1:33AM  up 10:46, 1 user, load averages: 4.36, 3.44, 2.30  78.0C 74.0C
> 1:34AM  up 10:47, 1 user, load averages: 4.35, 3.60, 2.44  78.0C 75.0C
> 1:35AM  up 10:48, 1 user, load averages: 4.42, 3.76, 2.57  79.0C 75.0C
> 1:36AM  up 10:49, 1 user, load averages: 4.40, 3.86, 2.68  79.0C 75.0C
> 1:37AM  up 10:50, 1 user, load averages: 4.31, 3.93, 2.79  80.0C 76.0C
> 1:38AM  up 10:51, 1 user, load averages: 4.39, 4.03, 2.90  80.0C 76.0C
> 1:39AM  up 10:52, 1 user, load averages: 4.61, 4.15, 3.02  81.0C 76.0C
> 1:40AM  up 10:53, 1 user, load averages: 4.63, 4.23, 3.12  81.0C 76.0C
> 1:41AM  up 10:54, 1 user, load averages: 4.75, 4.33, 3.24  81.0C 76.0C  <<<<<<<
>stress: info: [3390] successful run completed in 960s
> 1:42AM  up 10:55, 1 user, load averages: 4.01, 4.24, 3.29  78.0C 65.0C
> 1:43AM  up 10:56, 1 user, load averages: 1.96, 3.63, 3.12  56.0C 55.0C
> 1:44AM  up 10:57, 1 user, load averages: 1.05, 3.03, 2.93  52.0C 49.0C
> 1:45AM  up 10:58, 1 user, load averages: 0.87, 2.62, 2.78  50.0C 46.0C
> 1:46AM  up 10:59, 1 user, load averages: 0.88, 2.29, 2.64  49.0C 46.0C
> 1:47AM  up 11 hrs, 1 user, load averages: 0.65, 1.98, 2.50  47.0C 44.0C
> 1:48AM  up 11:01, 1 user, load averages: 0.61, 1.72, 2.37  47.0C 44.0C
> 1:49AM  up 11:02, 1 user, load averages: 0.60, 1.51, 2.24  46.0C 42.0C
> 1:50AM  up 11:03, 1 user, load averages: 0.66, 1.35, 2.13  46.0C 43.0C
> 1:51AM  up 11:04, 1 user, load averages: 0.63, 1.21, 2.02  45.0C 43.0C
> 1:52AM  up 11:05, 1 user, load averages: 0.74, 1.12, 1.93  45.0C 42.0C
> 1:53AM  up 11:06, 1 user, load averages: 0.73, 1.05, 1.85  44.0C 42.0C
> 1:54AM  up 11:07, 1 user, load averages: 0.72, 0.99, 1.77  44.0C 42.0C
> 1:55AM  up 11:08, 1 user, load averages: 0.60, 0.91, 1.69  44.0C 41.0C
>^C
>[1]  + Done                          stress -c 4 -t 16m
>1917.590u 0.007s 16:00.00 199.7%        25+2745k 0+0io 0pf+0w
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>smithi@x200:~ % systat -vm 10
>    1 users    Load  0.65  0.67  1.25                  Jan 30 02:02
>
>Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
>Act   27696    6168   439700     7416 1754692  count
>All   32036    7124   463840    22500          pages
>Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow      75 total
>             22       304    2   22   74   73             zfod        atkbd0 1
>                                                          ozfod     1 acpi0 9
> 0.0%Sys   0.0%Intr  0.0%User  0.0%Nice 99.9%Idle        %ozfod    73 hpet0 uhci
>|    |    |    |    |    |    |    |    |    |    |       daefr       ehci0 23
>                                                          prcfr     1 em0 256
>                                           dtbuf          totfr       hdac0 257
>Namei     Name-cache   Dir-cache    110822 desvn          react       ahci0 258
>   Calls    hits   %    hits   %      5405 numvn          pdwak
>       3       3 100                   723 frevn          pdpgs
>                                                          intrn
>Disks  ada0 pass0                                  112572 wire
>KB/t   0.00  0.00                                   17408 act
>tps       0     0                                   21576 inact
>MB/s   0.00  0.00                                         cache
>%busy     0     0                                 1754692 free
>                                                   154560 buf
>
>
>smithi@x200:~ % nice top -SCHP -s10
>last pid:  3615;  load averages:  0.64,  0.65,  1.21	up 0+11:15:41  02:03:46
>105 processes: 3 running, 82 sleeping, 20 waiting
>CPU 0:  0.0% user,  0.0% nice,  0.0% system,  0.0% interrupt,  100% idle
>CPU 1:  0.0% user,  0.0% nice,  0.1% system,  0.0% interrupt, 99.9% idle
>Mem: 17M Active, 21M Inact, 110M Wired, 151M Buf, 1714M Free
>Swap: 2048M Total, 2048M Free
>
>  PID USERNAME   PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
>   11 root       155 ki31     0K    32K CPU1    1   5:27 100.00% idle{idle: cpu1}
>   11 root       155 ki31     0K    32K RUN     0   5:14 100.00% idle{idle: cpu0}
>    0 root       -16    0     0K   176K swapin  1   0:57   0.00% kernel{swapper}
>   12 root       -100    -     0K   320K WAIT    0   0:14   0.00% intr{irq20: hpet0 uhc}
>   12 root       -60    -     0K   320K WAIT    0   0:14   0.00% intr{swi4: clock}
>   16 root       -16    -     0K    16K tzpoll  1   0:05   0.00% acpi_thermal
>    8 root        16    -     0K    16K syncer  0   0:02   0.00% syncer
>  940 smithi      20    0 74544K  9056K select  0   0:02   0.00% sshd
>   14 root       -16    -     0K    16K -       0   0:01   0.00% yarrow
>  678 root        20    0 22276K  3360K select  1   0:01   0.00% ntpd
>   12 root       -60    -     0K   320K WAIT    1   0:01   0.00% intr{swi4: clock}
>  681 root        20    0 12104K  1648K select  0   0:01   0.00% powerd
>  810 root        20    0 20356K  4588K select  1   0:00   0.00% sendmail
>    0 root       -92    0     0K   176K -       1   0:00   0.00% kernel{em0 que}
>[..]
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>smithi@x200:~ % su -l
>Password:
>root@x200:~ # cpuset -g
>pid -1 mask: 0, 1
>root@x200:~ # cpuset -l 0 -s 1
>root@x200:~ # cpuset -g
>pid -1 mask: 0
>root@x200:~ # cpuset -l 0-1 -s 1
>root@x200:~ # cpuset -g
>pid -1 mask: 0, 1
>root@x200:~ # exit
>logout
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 02:05:24 AEDT 2016  dev.cpu.0.freq: 800
>0.00% 0.49% 99.50% last 220us   { 0.44 0.60 1.12 }
>0.00% 0.36% 99.63% last 210us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 43 45 -1 43 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 43.0C  tz1: 40.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3363
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
> 2:05AM  up 11:17, 1 user, load averages: 0.44, 0.60, 1.12  43.0C 40.0C
> 2:06AM  up 11:18, 1 user, load averages: 0.16, 0.49, 1.04  43.0C 40.0C
> 2:07AM  up 11:19, 1 user, load averages: 0.07, 0.41, 0.98  43.0C 41.0C
> 2:08AM  up 11:20, 1 user, load averages: 0.02, 0.33, 0.91  43.0C 41.0C
> 2:09AM  up 11:21, 1 user, load averages: 0.01, 0.27, 0.84  43.0C 41.0C
> 2:10AM  up 11:22, 1 user, load averages: 0.00, 0.21, 0.78  43.0C 41.0C
> 2:11AM  up 11:23, 1 user, load averages: 0.04, 0.19, 0.73  43.0C 41.0C
> 2:12AM  up 11:24, 1 user, load averages: 0.01, 0.15, 0.68  43.0C 41.0C
> 2:13AM  up 11:25, 1 user, load averages: 0.00, 0.12, 0.63  43.0C 41.0C
> 2:14AM  up 11:26, 1 user, load averages: 0.00, 0.10, 0.59  43.0C 40.0C
> 2:15AM  up 11:27, 1 user, load averages: 0.00, 0.08, 0.54  42.0C 41.0C
> 2:16AM  up 11:28, 1 user, load averages: 0.00, 0.06, 0.50  43.0C 40.0C
> 2:17AM  up 11:29, 1 user, load averages: 0.00, 0.05, 0.47  43.0C 41.0C
> 2:18AM  up 11:30, 1 user, load averages: 0.00, 0.04, 0.44  42.0C 41.0C
> 2:19AM  up 11:31, 1 user, load averages: 0.00, 0.03, 0.40  42.0C 41.0C
> 2:20AM  up 11:32, 1 user, load averages: 0.00, 0.02, 0.37  42.0C 41.0C
> 2:21AM  up 11:33, 1 user, load averages: 0.00, 0.02, 0.34  42.0C 40.0C
> 2:22AM  up 11:34, 1 user, load averages: 0.00, 0.01, 0.32  42.0C 40.0C
> 2:23AM  up 11:35, 1 user, load averages: 0.00, 0.00, 0.30  42.0C 38.0C
> 2:24AM  up 11:36, 1 user, load averages: 0.00, 0.00, 0.27  42.0C 41.0C
>^C
>
>smithi@x200:~ % time stress -c 1 -t 16m &
>[1] 3769
>smithi@x200:~ % stress: info: [3769] dispatching hogs: 1 cpu, 0 io, 0 vm, 0 hdd
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 02:25:34 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.48% 99.51% last 826us   { 0.15 0.03 0.26 }
>0.00% 0.35% 99.64% last 126051us        { HPET one-shot }
>dev.acpi_ibm.0.thermal: 43 44 -1 43 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 43.0C  tz1: 44.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3382
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
> 2:25AM  up 11:37, 1 user, load averages: 0.15, 0.03, 0.26  43.0C 44.0C
> 2:26AM  up 11:38, 1 user, load averages: 0.69, 0.21, 0.30  55.0C 55.0C
> 2:27AM  up 11:39, 1 user, load averages: 0.88, 0.35, 0.35  58.0C 56.0C
> 2:28AM  up 11:40, 1 user, load averages: 0.95, 0.46, 0.39  60.0C 58.0C
> 2:29AM  up 11:41, 1 user, load averages: 0.98, 0.55, 0.43  61.0C 60.0C
> 2:30AM  up 11:42, 1 user, load averages: 0.99, 0.63, 0.46  62.0C 60.0C
> 2:31AM  up 11:43, 1 user, load averages: 0.99, 0.69, 0.50  63.0C 60.0C
>^C
>
>smithi@x200:~ % systat -vm 10
>    1 users    Load  0.99  0.75  0.53                  Jan 30 02:32
>
>Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
>Act   27840    6168   456708     7416 1754252  count
>All   32348    7292   483204    24856          pages
>Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow    1128 total
>  1          23      2349    3   20 1128   65             zfod        atkbd0 1
>                                                          ozfod     1 acpi0 9
> 0.0%Sys   0.0%Intr 50.0%User  0.0%Nice 50.0%Idle        %ozfod  1126 hpet0 uhci
>|    |    |    |    |    |    |    |    |    |    |       daefr       ehci0 23
>>>>>>>>>>>>>>>>>>>>>>>>>>                                 prcfr     1 em0 256
>                                           dtbuf          totfr       hdac0 257
>Namei     Name-cache   Dir-cache    110822 desvn          react       ahci0 258
>   Calls    hits   %    hits   %      5406 numvn          pdwak
>       3       3 100                   723 frevn          pdpgs
>                                                          intrn
>Disks  ada0 pass0                                  112712 wire
>KB/t   0.00  0.00                                   17672 act
>tps       0     0                                   21608 inact
>MB/s   0.00  0.00                                         cache
>%busy     0     0                                 1754252 free
>                                                   154688 buf
>
>smithi@x200:~ % nice top -SCHP -s10
>last pid:  3836;  load averages:  0.99,  0.81,  0.57	up 0+11:45:55  02:34:00
>107 processes: 4 running, 83 sleeping, 20 waiting
>CPU 0: 97.3% user,  0.0% nice,  0.0% system,  0.0% interrupt,  2.7% idle
>CPU 1:  2.7% user,  0.0% nice,  0.0% system,  0.0% interrupt, 97.3% idle
>Mem: 17M Active, 21M Inact, 110M Wired, 151M Buf, 1714M Free
>Swap: 2048M Total, 2048M Free
>
>  PID USERNAME   PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
> 3770 smithi     103    0 12160K  1700K CPU0    0   8:31 100.00% stress
>   11 root       155 ki31     0K    32K RUN     1  13:33  98.10% idle{idle: cpu1}
>   11 root       155 ki31     0K    32K RUN     0   6:00   1.95% idle{idle: cpu0}
>    0 root       -16    0     0K   176K swapin  1   0:57   0.00% kernel{swapper}
>   12 root       -100    -     0K   320K WAIT    0   0:16   0.00% intr{irq20: hpet0 uhc}
>   12 root       -60    -     0K   320K WAIT    0   0:15   0.00% intr{swi4: clock}
>   16 root       -16    -     0K    16K tzpoll  0   0:06   0.00% acpi_thermal
>    8 root        16    -     0K    16K syncer  0   0:02   0.00% syncer
>  940 smithi      20    0 74544K  9056K select  1   0:02   0.00% sshd
>   14 root       -16    -     0K    16K -       0   0:01   0.00% yarrow
>  678 root        20    0 22276K  3360K select  1   0:01   0.00% ntpd
>   12 root       -60    -     0K   320K WAIT    0   0:01   0.00% intr{swi4: clock}
>  681 root        20    0 12104K  1648K select  1   0:01   0.00% powerd
>[..]
>
>smithi@x200:~ % ps aux | grep "[s]tress"
>smithi 3770 100.0  0.1 12160 1700  0  R     2:25AM  8:46.10 stress -c 1 -t 16m
>smithi 3769   0.0  0.1 12160 1704  0  I     2:25AM  0:00.00 stress -c 1 -t 16m
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 02:34:33 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.47% 99.52% last 750us   { 0.99 0.82 0.58 }
>0.00% 0.35% 99.64% last 127745us        { HPET one-shot }
>dev.acpi_ibm.0.thermal: 65 44 -1 59 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 65.0C  tz1: 62.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3377
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
> 2:34AM  up 11:46, 1 user, load averages: 0.99, 0.82, 0.58  65.0C 62.0C
> 2:35AM  up 11:47, 1 user, load averages: 0.99, 0.85, 0.60  65.0C 62.0C
> 2:36AM  up 11:48, 1 user, load averages: 0.99, 0.88, 0.63  66.0C 62.0C
> 2:37AM  up 11:49, 1 user, load averages: 0.99, 0.90, 0.65  66.0C 63.0C
> 2:38AM  up 11:50, 1 user, load averages: 0.99, 0.91, 0.67  66.0C 63.0C
> 2:39AM  up 11:51, 1 user, load averages: 0.99, 0.92, 0.69  66.0C 63.0C
> 2:40AM  up 11:52, 1 user, load averages: 0.99, 0.93, 0.71  66.0C 64.0C
>stress: info: [3769] successful run completed in 960s
> 2:41AM  up 11:53, 1 user, load averages: 0.91, 0.93, 0.72  67.0C 63.0C
> 2:42AM  up 11:54, 1 user, load averages: 0.33, 0.76, 0.67  52.0C 48.0C
> 2:43AM  up 11:55, 1 user, load averages: 0.11, 0.60, 0.61  49.0C 46.0C
>^C
>[1]  + Done                          stress -c 1 -t 16m
>957.882u 0.015s 16:00.00 99.7%  25+2747k 0+0io 0pf+0w
>
>smithi@x200:~ % systat -vm 10
>    1 users    Load  0.01  0.32  0.49                  Jan 30 02:46
>
>Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
>Act   27696    6168   439700     7416 1754668  count
>All   32036    7124   463840    22500          pages
>Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow      67 total
>             22       225    2   19   67   65             zfod        atkbd0 1
>                                                          ozfod     1 acpi0 9
> 0.0%Sys   0.0%Intr  0.0%User  0.0%Nice  100%Idle        %ozfod    65 hpet0 uhci
>|    |    |    |    |    |    |    |    |    |    |       daefr       ehci0 23
>                                                          prcfr     1 em0 256
>                                           dtbuf          totfr       hdac0 257
>Namei     Name-cache   Dir-cache    110822 desvn          react       ahci0 258
>   Calls    hits   %    hits   %      5406 numvn          pdwak
>       3       3 100                   723 frevn          pdpgs
>                                                          intrn
>Disks  ada0 pass0                                  112584 wire
>KB/t   0.00  0.00                                   17420 act
>tps       0     0                                   21572 inact
>MB/s   0.00  0.00                                         cache
>%busy     0     0                                 1754668 free
>                                                   154752 buf
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 02:46:59 AEDT 2016  dev.cpu.0.freq: 800
>0.00% 0.46% 99.53% last 237us   { 0.00 0.31 0.48 }
>0.00% 0.35% 99.64% last 161us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 45 45 -1 45 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 45.0C  tz1: 42.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3364
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
> 2:46AM  up 11:59, 1 user, load averages: 0.00, 0.31, 0.48  45.0C 42.0C
> 2:47AM  up 12 hrs, 1 user, load averages: 0.00, 0.25, 0.44  45.0C 42.0C
> 2:48AM  up 12:01, 1 user, load averages: 0.00, 0.20, 0.41  44.0C 42.0C
> 2:49AM  up 12:02, 1 user, load averages: 0.00, 0.16, 0.38  44.0C 41.0C
>^C
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 02:52:57 AEDT 2016  dev.cpu.0.freq: 800
>0.00% 0.46% 99.53% last 345us   { 0.00 0.08 0.30 }
>0.00% 0.36% 99.63% last 249us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 43 44 -1 44 36 -1 35 -1
>hw.acpi.thermal.tz0.temperature: 43.0C  tz1: 41.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3396
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12450 mV
> 2:52AM  up 12:05, 1 user, load averages: 0.00, 0.08, 0.30  43.0C 41.0C
> 2:53AM  up 12:06, 1 user, load averages: 0.00, 0.06, 0.28  43.0C 41.0C
>^C
>
>smithi@x200:~ % time stress -c 2 -t 16m &
>[1] 3996
>smithi@x200:~ % stress: info: [3996] dispatching hogs: 2 cpu, 0 io, 0 vm, 0 hdd
>
>smithi@x200:~ % ps aux | grep "[s]tress"
>smithi 3997 56.1  0.1 12160 1700  0  R     2:54AM  0:07.74 stress -c 2 -t 16m
>smithi 3998 56.1  0.1 12160 1700  0  R     2:54AM  0:07.77 stress -c 2 -t 16m
>smithi 3996  0.0  0.1 12160 1704  0  S     2:54AM  0:00.00 stress -c 2 -t 16m
>
>smithi@x200:~ % systat -vm 10
>    1 users    Load  1.32  0.44  0.40                  Jan 30 02:55
>
>Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
>Act   27872    6168   459064     7416 1754120  count
>All   32384    7296   485688    24984          pages
>Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow    1128 total
>  2          23      2362   13   22 1128   67             zfod        atkbd0 1
>                                                          ozfod     1 acpi0 9
> 0.0%Sys   0.0%Intr  100%User  0.0%Nice  0.0%Idle        %ozfod  1126 hpet0 uhci
>|    |    |    |    |    |    |    |    |    |    |       daefr       ehci0 23
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>        prcfr     1 em0 256
>                                         6 dtbuf          totfr       hdac0 257
>Namei     Name-cache   Dir-cache    110822 desvn          react       ahci0 258
>   Calls    hits   %    hits   %      5407 numvn          pdwak
>       3       3 100                   724 frevn          pdpgs
>                                                          intrn
>Disks  ada0 pass0                                  112808 wire
>KB/t   0.00  0.00                                   17728 act
>tps       0     0                                   21588 inact
>MB/s   0.00  0.00                                         cache
>%busy     0     0                                 1754120 free
>                                                   154976 buf
>
>
>smithi@x200:~ % nice top -SCHP -s10
>last pid:  4016;  load averages:  1.59,  0.58,  0.45	up 0+12:07:42  02:55:47
>108 processes: 5 running, 83 sleeping, 20 waiting
>CPU 0:  100% user,  0.0% nice,  0.0% system,  0.0% interrupt,  0.0% idle
>CPU 1:  100% user,  0.0% nice,  0.0% system,  0.0% interrupt,  0.0% idle
>Mem: 17M Active, 21M Inact, 110M Wired, 151M Buf, 1713M Free
>Swap: 2048M Total, 2048M Free
>
>  PID USERNAME   PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
> 3998 smithi     103    0 12160K  1700K RUN     1   1:36 100.00% stress
> 3997 smithi     103    0 12160K  1700K CPU0    0   1:36 100.00% stress
>   11 root       155 ki31     0K    32K RUN     1  20:38   0.00% idle{idle: cpu1}
>   11 root       155 ki31     0K    32K RUN     0   6:35   0.00% idle{idle: cpu0}
>    0 root       -16    0     0K   176K swapin  1   0:57   0.00% kernel{swapper}
>   12 root       -100    -     0K   320K WAIT    0   0:17   0.00% intr{irq20: hpet0 uhc}
>   12 root       -60    -     0K   320K WAIT    0   0:15   0.00% intr{swi4: clock}
>   16 root       -16    -     0K    16K tzpoll  0   0:06   0.00% acpi_thermal
>  940 smithi      20    0 74544K  9056K select  1   0:03   0.00% sshd
>    8 root        16    -     0K    16K syncer  0   0:02   0.00% syncer
>   14 root       -16    -     0K    16K -       0   0:01   0.00% yarrow
>  678 root        20    0 22276K  3360K select  1   0:01   0.00% ntpd
>   12 root       -60    -     0K   320K WAIT    0   0:01   0.00% intr{swi4: clock}
>  681 root        20    0 12104K  1648K select  1   0:01   0.00% powerd
>[..]
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 02:55:57 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.46% 99.53% last 1055us  { 1.65 0.63 0.47 }
>0.00% 0.36% 99.63% last 1670us  { HPET one-shot }
>dev.acpi_ibm.0.thermal: 69 44 -1 59 35 -1 34 -1
>hw.acpi.thermal.tz0.temperature: 69.0C  tz1: 66.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3372
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12447 mV
> 2:55AM  up 12:08, 1 user, load averages: 1.65, 0.63, 0.47  69.0C 66.0C
> 2:56AM  up 12:09, 1 user, load averages: 1.86, 0.86, 0.56  72.0C 69.0C
> 2:57AM  up 12:10, 1 user, load averages: 1.95, 1.08, 0.66  73.0C 71.0C
> 2:58AM  up 12:11, 1 user, load averages: 1.98, 1.23, 0.74  75.0C 71.0C
> 2:59AM  up 12:12, 1 user, load averages: 1.99, 1.37, 0.83  76.0C 73.0C
> 3:00AM  up 12:13, 1 user, load averages: 1.99, 1.47, 0.90  77.0C 74.0C
>
>[ and then plus periodic daily, which of course ran maybe 3 times longer than usual ]
>
> 3:01AM  up 12:14, 1 user, load averages: 2.56, 1.72, 1.03  78.0C 74.0C
> 3:02AM  up 12:15, 1 user, load averages: 2.84, 1.95, 1.16  78.0C 75.0C
> 3:03AM  up 12:16, 1 user, load averages: 2.94, 2.15, 1.29  79.0C 75.0C
> 3:04AM  up 12:17, 1 user, load averages: 2.98, 2.29, 1.39  79.0C 75.0C
> 3:05AM  up 12:18, 1 user, load averages: 2.99, 2.42, 1.50  79.0C 75.0C
> 3:06AM  up 12:19, 1 user, load averages: 2.99, 2.53, 1.61  80.0C 75.0C
> 3:07AM  up 12:20, 1 user, load averages: 2.92, 2.58, 1.69  80.0C 75.0C
> 3:08AM  up 12:21, 1 user, load averages: 2.97, 2.66, 1.78  80.0C 76.0C
> 3:09AM  up 12:22, 1 user, load averages: 2.93, 2.70, 1.85  80.0C 75.0C
>stress: info: [3996] successful run completed in 960s
> 3:10AM  up 12:23, 1 user, load averages: 1.81, 2.44, 1.81  71.0C 69.0C
> 3:11AM  up 12:24, 1 user, load averages: 0.73, 2.02, 1.70  55.0C 54.0C
> 3:12AM  up 12:25, 1 user, load averages: 0.29, 1.68, 1.59  52.0C 48.0C
> 3:13AM  up 12:26, 1 user, load averages: 0.10, 1.35, 1.47  49.0C 46.0C
> 3:14AM  up 12:27, 1 user, load averages: 0.03, 1.10, 1.37  48.0C 44.0C
> 3:15AM  up 12:28, 1 user, load averages: 0.06, 0.91, 1.28  47.0C 44.0C
> 3:16AM  up 12:29, 1 user, load averages: 0.02, 0.74, 1.19  46.0C 43.0C
> 3:17AM  up 12:30, 1 user, load averages: 0.01, 0.60, 1.10  46.0C 42.0C
> 3:18AM  up 12:31, 1 user, load averages: 0.00, 0.49, 1.02  45.0C 42.0C
> 3:19AM  up 12:32, 1 user, load averages: 0.00, 0.40, 0.95  45.0C 42.0C
>^C
>[1]  + Done                          stress -c 2 -t 16m
>1898.011u 0.000s 16:00.00 197.7%        25+2746k 0+0io 0pf+0w
>
>
>root@x200:~ # tail -48 /var/log/cron
>[..]
>Jan 30 03:00:00 x200 /usr/sbin/cron[4060]: (root) CMD (newsyslog)
>Jan 30 03:00:00 x200 /usr/sbin/cron[4061]: (operator) CMD (/usr/libexec/save-entropy)
>Jan 30 03:00:00 x200 /usr/sbin/cron[4062]: (root) CMD (/usr/libexec/atrun)
>Jan 30 03:01:00 x200 /usr/sbin/cron[4079]: (root) CMD (adjkerntz -a)
>Jan 30 03:01:00 x200 /usr/sbin/cron[4080]: (root) CMD (periodic daily)
>Jan 30 03:05:00 x200 /usr/sbin/cron[4156]: (root) CMD (/usr/libexec/atrun)
>Jan 30 03:10:00 x200 /usr/sbin/cron[4249]: (root) CMD (/usr/libexec/atrun)
>Jan 30 03:11:00 x200 /usr/sbin/cron[4459]: (operator) CMD (/usr/libexec/save-entropy)
>[..]
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sat Jan 30 03:43:58 AEDT 2016  dev.cpu.0.freq: 800
>0.00% 0.51% 99.48% last 2us     { 0.00 0.00 0.14 }
>0.00% 0.63% 99.35% last 156us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 42 44 -1 42 35 -1 34 -1
>hw.acpi.thermal.tz0.temperature: 42.0C  tz1: 40.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3360
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12447 mV
> 3:43AM  up 12:56, 1 user, load averages: 0.00, 0.00, 0.14  42.0C 40.0C
> 3:44AM  up 12:57, 1 user, load averages: 0.00, 0.00, 0.13  42.0C 40.0C
>^C
>smithi@x200:~ % time stress -c 4 -t 16m &
>[1] 4621
>smithi@x200:~ % stress: info: [4621] dispatching hogs: 4 cpu, 0 io, 0 vm, 0 hdd
>w.acpi.thermal.tz1.temperature`";  sleep 60; done'ysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n h
>Sat Jan 30 03:45:33 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.50% 99.48% last 764us   { 0.61 0.13 0.17 }
>0.00% 0.63% 99.35% last 902us   { HPET one-shot }
>dev.acpi_ibm.0.thermal: 54 44 -1 46 35 -1 34 -1
>hw.acpi.thermal.tz0.temperature: 54.0C  tz1: 54.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3359
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12447 mV
> 3:45AM  up 12:58, 1 user, load averages: 1.29, 0.29, 0.23  54.0C 54.0C
> 3:46AM  up 12:59, 1 user, load averages: 3.00, 0.96, 0.48  65.0C 63.0C
> 3:47AM  up 13 hrs, 1 user, load averages: 3.66, 1.55, 0.74  70.0C 67.0C
> 3:48AM  up 13:01, 1 user, load averages: 3.86, 1.96, 0.94  72.0C 69.0C
> 3:49AM  up 13:02, 1 user, load averages: 3.95, 2.36, 1.16  73.0C 71.0C
> 3:50AM  up 13:03, 1 user, load averages: 3.98, 2.65, 1.35  75.0C 72.0C
> 3:51AM  up 13:04, 1 user, load averages: 3.99, 2.90, 1.53  76.0C 73.0C
> 3:52AM  up 13:05, 1 user, load averages: 3.99, 3.09, 1.69  76.0C 74.0C
> 3:53AM  up 13:06, 1 user, load averages: 3.99, 3.26, 1.85  77.0C 74.0C
> 3:54AM  up 13:07, 1 user, load averages: 3.99, 3.39, 1.99  78.0C 74.0C
> 3:55AM  up 13:08, 1 user, load averages: 3.99, 3.50, 2.13  78.0C 74.0C
> 3:56AM  up 13:09, 1 user, load averages: 3.99, 3.59, 2.25  79.0C 75.0C
> 3:57AM  up 13:10, 1 user, load averages: 3.99, 3.66, 2.37  79.0C 75.0C
> 3:58AM  up 13:11, 1 user, load averages: 3.99, 3.72, 2.47  79.0C 75.0C
> 3:59AM  up 13:12, 1 user, load averages: 3.99, 3.77, 2.58  80.0C 75.0C
> 4:00AM  up 13:13, 1 user, load averages: 3.99, 3.81, 2.68  80.0C 75.0C
>stress: info: [4621] successful run completed in 960s
> 4:01AM  up 13:14, 1 user, load averages: 3.11, 3.64, 2.69  64.0C 60.0C
> 4:02AM  up 13:15, 1 user, load averages: 1.24, 3.03, 2.52  55.0C 51.0C
> 4:03AM  up 13:16, 1 user, load averages: 0.45, 2.48, 2.35  51.0C 48.0C
> 4:04AM  up 13:17, 1 user, load averages: 0.17, 2.02, 2.19  49.0C 46.0C
> 4:05AM  up 13:18, 1 user, load averages: 0.06, 1.65, 2.03  47.0C 44.0C
> 4:06AM  up 13:19, 1 user, load averages: 0.02, 1.35, 1.89  46.0C 44.0C
> 4:07AM  up 13:20, 1 user, load averages: 0.01, 1.10, 1.76  45.0C 43.0C
> 4:08AM  up 13:21, 1 user, load averages: 0.00, 0.91, 1.65  45.0C 42.0C
> 4:09AM  up 13:22, 1 user, load averages: 0.00, 0.74, 1.53  45.0C 42.0C
> 4:10AM  up 13:23, 1 user, load averages: 0.00, 0.60, 1.43  44.0C 41.0C
> 4:11AM  up 13:24, 1 user, load averages: 0.00, 0.49, 1.33  44.0C 41.0C
> 4:12AM  up 13:25, 1 user, load averages: 0.00, 0.40, 1.23  44.0C 41.0C
> 4:13AM  up 13:26, 1 user, load averages: 0.00, 0.32, 1.15  43.0C 41.0C
> 4:14AM  up 13:27, 1 user, load averages: 0.00, 0.26, 1.06  43.0C 41.0C
> 4:15AM  up 13:28, 1 user, load averages: 0.13, 0.26, 1.01  44.0C 42.0C
> 4:16AM  up 13:29, 1 user, load averages: 0.04, 0.20, 0.93  43.0C 41.0C
> 4:17AM  up 13:30, 1 user, load averages: 0.02, 0.17, 0.87  43.0C 41.0C
> 4:18AM  up 13:31, 1 user, load averages: 0.00, 0.13, 0.81  43.0C 40.0C
> 4:19AM  up 13:32, 1 user, load averages: 0.00, 0.11, 0.74  43.0C 41.0C
> 4:20AM  up 13:33, 1 user, load averages: 0.00, 0.08, 0.69  43.0C 41.0C
> 4:21AM  up 13:34, 1 user, load averages: 0.00, 0.07, 0.64  43.0C 40.0C
> 4:22AM  up 13:35, 1 user, load averages: 0.00, 0.05, 0.59  42.0C 40.0C
> 4:23AM  up 13:36, 1 user, load averages: 0.00, 0.04, 0.55  42.0C 38.0C
> 4:24AM  up 13:37, 1 user, load averages: 0.00, 0.03, 0.51  42.0C 40.0C
> 4:25AM  up 13:38, 1 user, load averages: 0.00, 0.02, 0.47  42.0C 40.0C
> 4:26AM  up 13:39, 1 user, load averages: 0.00, 0.02, 0.44  42.0C 38.0C
> 4:27AM  up 13:40, 1 user, load averages: 0.00, 0.01, 0.40  42.0C 40.0C
> 4:28AM  up 13:41, 1 user, load averages: 0.00, 0.00, 0.37  42.0C 38.0C
> 4:29AM  up 13:42, 1 user, load averages: 0.00, 0.00, 0.34  42.0C 40.0C
> 4:30AM  up 13:43, 1 user, load averages: 0.00, 0.00, 0.32  42.0C 38.0C
> 4:31AM  up 13:44, 1 user, load averages: 0.00, 0.00, 0.29  41.0C 38.0C
> 4:32AM  up 13:45, 1 user, load averages: 0.06, 0.01, 0.27  41.0C 38.0C
> 4:33AM  up 13:46, 1 user, load averages: 0.02, 0.01, 0.25  41.0C 38.0C
> 4:34AM  up 13:47, 1 user, load averages: 0.00, 0.00, 0.23  41.0C 38.0C
> 4:35AM  up 13:48, 1 user, load averages: 0.00, 0.00, 0.21  41.0C 38.0C
> 4:36AM  up 13:49, 1 user, load averages: 0.00, 0.00, 0.20  41.0C 38.0C
> 4:37AM  up 13:50, 1 user, load averages: 0.00, 0.00, 0.18  41.0C 38.0C
> 4:38AM  up 13:51, 1 user, load averages: 0.00, 0.00, 0.16  41.0C 37.0C
> 4:39AM  up 13:52, 1 user, load averages: 0.00, 0.00, 0.15  41.0C 38.0C
> 4:40AM  up 13:53, 1 user, load averages: 0.04, 0.01, 0.15  41.0C 38.0C
> 4:41AM  up 13:54, 1 user, load averages: 0.01, 0.01, 0.14  41.0C 38.0C
> 4:42AM  up 13:55, 1 user, load averages: 0.00, 0.00, 0.12  41.0C 38.0C
> 4:43AM  up 13:56, 1 user, load averages: 0.00, 0.00, 0.11  41.0C 38.0C
> 4:44AM  up 13:57, 1 user, load averages: 0.00, 0.00, 0.10  41.0C 38.0C
> 4:45AM  up 13:58, 1 user, load averages: 0.00, 0.00, 0.09  41.0C 38.0C
> 4:46AM  up 13:59, 1 user, load averages: 0.00, 0.00, 0.08  41.0C 38.0C
> 4:47AM  up 14 hrs, 1 user, load averages: 0.00, 0.00, 0.07  41.0C 37.0C
> 4:48AM  up 14:01, 1 user, load averages: 0.00, 0.00, 0.07  41.0C 38.0C
> 4:49AM  up 14:02, 1 user, load averages: 0.00, 0.00, 0.06  41.0C 37.0C
> 4:50AM  up 14:03, 1 user, load averages: 0.00, 0.00, 0.06  41.0C 37.0C
> 4:51AM  up 14:04, 1 user, load averages: 0.00, 0.00, 0.05  41.0C 36.0C
> 4:52AM  up 14:05, 1 user, load averages: 0.00, 0.00, 0.04  41.0C 37.0C
> 4:53AM  up 14:06, 1 user, load averages: 0.00, 0.00, 0.04  41.0C 38.0C
> 4:54AM  up 14:07, 1 user, load averages: 0.00, 0.00, 0.03  41.0C 37.0C
> 4:55AM  up 14:08, 1 user, load averages: 0.00, 0.00, 0.03  41.0C 37.0C
> 4:56AM  up 14:09, 1 user, load averages: 0.00, 0.00, 0.02  41.0C 36.0C
> 4:57AM  up 14:10, 1 user, load averages: 0.00, 0.00, 0.02  41.0C 38.0C
> 4:58AM  up 14:11, 1 user, load averages: 0.00, 0.00, 0.01  41.0C 38.0C
> 4:59AM  up 14:12, 1 user, load averages: 0.00, 0.00, 0.00  41.0C 38.0C
> 5:00AM  up 14:13, 1 user, load averages: 0.00, 0.00, 0.00  41.0C 38.0C
> 5:01AM  up 14:14, 1 user, load averages: 0.00, 0.00, 0.00  41.0C 38.0C
> 5:02AM  up 14:15, 1 user, load averages: 0.00, 0.00, 0.00  41.0C 37.0C
>^C
>[1]  + Done                          stress -c 4 -t 16m
>1916.779u 0.015s 16:00.00 199.6%        25+2744k 0+0io 0pf+0w
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>[ next night .. one more to clarify the point: HPET loadavgs are FIXED
>  after the mystery magic of the cpuset dance .. and stay fixed ..
>]
>
>smithi@x200:~ % systat -vm 10
>    1 users    Load  0.00  0.01  0.01                  Jan 31 03:12
>
>Mem:KB    REAL            VIRTUAL                       VN PAGER   SWAP PAGER
>        Tot   Share      Tot    Share    Free           in   out     in   out
>Act   28004    6316   439700     7416 1113436  count
>All   32344    7272   463840    22500          pages
>Proc:                                                            Interrupts
>  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow      74 total
>             22       242    2   19   74   65             zfod        atkbd0 1
>                                                          ozfod     1 acpi0 9
> 0.2%Sys   0.0%Intr  0.0%User  0.0%Nice 99.8%Idle        %ozfod    72 hpet0 uhci
>|    |    |    |    |    |    |    |    |    |    |       daefr       ehci0 23
>                                                          prcfr     1 em0 256
>                                         1 dtbuf          totfr       hdac0 257
>Namei     Name-cache   Dir-cache    110822 desvn          react       ahci0 258
>   Calls    hits   %    hits   %     92044 numvn          pdwak
>       3       3 100                 27702 frevn          pdpgs
>                                                          intrn
>Disks  ada0 pass0                                  316880 wire
>KB/t   4.00  0.00                                   17936 act
>tps       0     0                                  458108 inact
>MB/s   0.00  0.00                                         cache
>%busy     0     0                                 1113436 free
>                                                   206816 buf
>
>
>smithi@x200:~ % cptimes.sh "`sysctl kern.cp_times`" "`sleep 78.74; sysctl kern.cp_times`"
>              cp_user    cp_nice     cp_sys    cp_intr    cp_idle
>cpu: 0 @t0     636160         71      31747       2937   15977855
>cpu: 0 @t1     636161         71      31765       2942   15987832
>                    1          0         18          5       9977  (10001)
>cpu: 1 @t0     531450        170       6444         20   16110652
>cpu: 1 @t1     531450        170       6444         20   16120653
>                    0          0          0          0      10001  (10001)
>
>smithi@x200:~ % time stress -c 11 -t 20m &
>[1] 8484
>smithi@x200:~ % stress: info: [8484] dispatching hogs: 11 cpu, 0 io, 0 vm, 0 hdd
>
>smithi@x200:~ % top | grep "[s]tress"
> 8485 smithi        1  20    0 12160K  1700K CPU0    0   0:08  53.76% stress
> 8488 smithi        1  77    0 12160K  1700K RUN     1   0:03  11.47% stress
> 8486 smithi        1  75    0 12160K  1700K RUN     1   0:02  11.47% stress
> 8487 smithi        1  75    0 12160K  1700K RUN     1   0:02  10.25% stress
> 8495 smithi        1  74    0 12160K  1700K RUN     1   0:01   9.18% stress
> 8492 smithi        1  74    0 12160K  1700K RUN     1   0:01   8.06% stress
> 8491 smithi        1  74    0 12160K  1700K RUN     1   0:01   6.69% stress
> 8494 smithi        1  73    0 12160K  1700K RUN     1   0:01   5.76% stress
> 8489 smithi        1  73    0 12160K  1700K RUN     1   0:01   2.78% stress
> 8490 smithi        1  73    0 12160K  1700K RUN     1   0:00   1.17% stress
> 8493 smithi        1  72    0 12160K  1700K RUN     1   0:00   0.49% stress
>
>smithi@x200:~ % sh -c 'x200stat; while true; do echo "`uptime`  `sysctl -n hw.acpi.thermal.tz0.temperature` `sysctl -n hw.acpi.thermal.tz1.temperature`";  sleep 60; done'
>Sun Jan 31 03:15:34 AEDT 2016  dev.cpu.0.freq: 2400
>0.00% 0.24% 99.75% last 428us   { 4.87 1.21 0.44 }
>0.00% 0.30% 99.68% last 1151us  { HPET one-shot }
>dev.acpi_ibm.0.thermal: 58 43 -1 49 34 -1 32 -1
>hw.acpi.thermal.tz0.temperature: 57.0C  tz1: 56.0C
>dev.acpi_ibm.0.fan_level: 0     _speed: 3365
>high            capacity: 99%   time: unknown
>rate: 0 mW      voltage: 12438 mV
> 3:15AM  up 1 day, 12:28, 1 user, load averages: 5.44, 1.39, 0.51  57.0C 56.0C
> 3:16AM  up 1 day, 12:29, 1 user, load averages: 8.78, 3.01, 1.16  65.0C 63.0C
> 3:17AM  up 1 day, 12:30, 1 user, load averages: 10.18, 4.46, 1.83  69.0C 67.0C
> 3:18AM  up 1 day, 12:31, 1 user, load averages: 10.70, 5.65, 2.45  71.0C 68.0C
> 3:19AM  up 1 day, 12:32, 1 user, load averages: 10.89, 6.62, 3.03  73.0C 69.0C
> 3:20AM  up 1 day, 12:33, 1 user, load averages: 10.96, 7.41, 3.57  74.0C 71.0C
> 3:21AM  up 1 day, 12:34, 1 user, load averages: 10.98, 8.06, 4.07  75.0C 72.0C
> 3:22AM  up 1 day, 12:35, 1 user, load averages: 10.99, 8.55, 4.51  75.0C 73.0C
> 3:23AM  up 1 day, 12:36, 1 user, load averages: 10.99, 9.03, 4.98  76.0C 74.0C
> 3:24AM  up 1 day, 12:37, 1 user, load averages: 10.99, 9.38, 5.39  77.0C 74.0C
> 3:25AM  up 1 day, 12:38, 1 user, load averages: 10.99, 9.65, 5.74  77.0C 74.0C
> 3:26AM  up 1 day, 12:39, 1 user, load averages: 10.99, 9.90, 6.09  77.0C 74.0C
> 3:27AM  up 1 day, 12:40, 1 user, load averages: 10.99, 10.09, 6.42  78.0C 74.0C
> 3:28AM  up 1 day, 12:41, 1 user, load averages: 10.99, 10.26, 6.73  78.0C 74.0C
> 3:29AM  up 1 day, 12:42, 1 user, load averages: 10.99, 10.40, 7.04  78.0C 75.0C
> 3:30AM  up 1 day, 12:43, 1 user, load averages: 10.99, 10.51, 7.31  78.0C 75.0C
> 3:31AM  up 1 day, 12:44, 1 user, load averages: 10.99, 10.59, 7.56  79.0C 75.0C
> 3:32AM  up 1 day, 12:45, 1 user, load averages: 10.99, 10.66, 7.77  79.0C 75.0C
> 3:33AM  up 1 day, 12:46, 1 user, load averages: 10.99, 10.72, 7.99  79.0C 75.0C
> 3:34AM  up 1 day, 12:47, 1 user, load averages: 10.99, 10.77, 8.21  79.0C 75.0C
>stress: info: [8484] successful run completed in 1200s
> 3:35AM  up 1 day, 12:48, 1 user, load averages: 5.64, 9.43, 7.89  60.0C 57.0C
> 3:36AM  up 1 day, 12:49, 1 user, load averages: 2.07, 7.71, 7.35  53.0C 49.0C
> 3:37AM  up 1 day, 12:50, 1 user, load averages: 0.76, 6.31, 6.84  50.0C 46.0C
> 3:38AM  up 1 day, 12:51, 1 user, load averages: 0.28, 5.15, 6.38  48.0C 45.0C
> 3:39AM  up 1 day, 12:52, 1 user, load averages: 0.10, 4.21, 5.94  47.0C 44.0C
> 3:40AM  up 1 day, 12:53, 1 user, load averages: 0.03, 3.44, 5.53  46.0C 43.0C
> 3:41AM  up 1 day, 12:54, 1 user, load averages: 0.01, 2.81, 5.15  45.0C 42.0C
> 3:42AM  up 1 day, 12:55, 1 user, load averages: 0.00, 2.30, 4.80  44.0C 42.0C
> 3:43AM  up 1 day, 12:56, 1 user, load averages: 0.00, 1.85, 4.44  44.0C 42.0C
> 3:44AM  up 1 day, 12:57, 1 user, load averages: 0.06, 1.52, 4.14  44.0C 42.0C
> 3:45AM  up 1 day, 12:58, 1 user, load averages: 0.02, 1.24, 3.86  43.0C 41.0C
> 3:46AM  up 1 day, 12:59, 1 user, load averages: 0.01, 1.02, 3.59  43.0C 41.0C
> 3:47AM  up 1 day, 13 hrs, 1 user, load averages: 0.00, 0.81, 3.33  43.0C 40.0C
> 3:48AM  up 1 day, 13:01, 1 user, load averages: 0.00, 0.66, 3.10  43.0C 40.0C
> 3:49AM  up 1 day, 13:02, 1 user, load averages: 0.00, 0.54, 2.88  42.0C 41.0C
> 3:50AM  up 1 day, 13:03, 1 user, load averages: 0.00, 0.45, 2.70  42.0C 40.0C
> 3:51AM  up 1 day, 13:04, 1 user, load averages: 0.00, 0.36, 2.51  42.0C 40.0C
> 3:52AM  up 1 day, 13:05, 1 user, load averages: 0.08, 0.31, 2.34  42.0C 40.0C
> 3:53AM  up 1 day, 13:06, 1 user, load averages: 0.03, 0.25, 2.18  42.0C 40.0C
> 3:54AM  up 1 day, 13:07, 1 user, load averages: 0.01, 0.20, 2.03  42.0C 38.0C
> 3:55AM  up 1 day, 13:08, 1 user, load averages: 0.00, 0.17, 1.90  42.0C 38.0C
> 3:56AM  up 1 day, 13:09, 1 user, load averages: 0.00, 0.13, 1.77  42.0C 38.0C
> 3:57AM  up 1 day, 13:10, 1 user, load averages: 0.00, 0.11, 1.65  41.0C 40.0C
> 3:58AM  up 1 day, 13:11, 1 user, load averages: 0.00, 0.08, 1.53  41.0C 40.0C
> 3:59AM  up 1 day, 13:12, 1 user, load averages: 0.00, 0.07, 1.42  41.0C 38.0C
> 4:00AM  up 1 day, 13:13, 1 user, load averages: 0.00, 0.05, 1.32  41.0C 38.0C
> 4:01AM  up 1 day, 13:14, 1 user, load averages: 0.00, 0.04, 1.22  41.0C 38.0C
> 4:02AM  up 1 day, 13:15, 1 user, load averages: 0.00, 0.03, 1.14  41.0C 38.0C
>^C
>[1]  + Done                          stress -c 11 -t 20m
>2396.034u 0.004s 20:00.00 199.6%        25+2745k 0+0io 0pf+0w
>
>

Actions: View

Attachments on bug 173541: 129541 | 129542 | 167688 | 167689 | 233113 | 233114