Created attachment 188225 [details]
release multiple blocks at a time
This allows to release multiple swap blocks via swp_pager_freeswapspace().
For each call, swp_pager_freeswapspace() locks. Releasing multiple
blocks helps to reduce number of locks. If a swblk contains
continuous blocks, it reduces up to SWAP_META_PAGES-1 locks.
This patch covers 2 case: 1. when a process exits and all of its
swap blocks are released and 2. when a process is paged in from
Created attachment 188460 [details]
swapoff to release multiple blocks at a time
https://svnweb.freebsd.org/base?view=revision&revision=326329 change works better for the first patchset and already committed to the head.
This one is to release multiple blocks from "swapoff" command.
The patch allows to take SWB_NPAGES blocks at once from backing store.
On i386, it is 32 blocks maximum compare to 1 block at a time.
The patch is not applicable to HEAD, please update it.
For the swap_pager_swapoff() chunk, it seems that the new variable offset can be used before initialized.
That said, why optimize swapoff at all ?
(In reply to Konstantin Belousov from comment #2)
Indeed, 1st patch chunk failed and I overlooked it.
Also, I missed offset initialization.
To answer your question, I started with 2 reasons.
#1 - I started looking at optimizing page-in cases and process exit cases where they had released 1 block at a time although swp_pager_freeswapspace() takes npages to free. This was the 3rd one.
#2 - swp_pager_force_pagein() comment says "it doesn't work" and I wondered why. The reason I found is we need to call vm_page_grab for the number of pages we want to page in.
Summing up, after I figured vm_page part, the code started working okay and based on my observation of "top", multi-block page-in was considerably faster - reading 1 block 32 times compare to 32 blocks a time. It looksvm_object_t is locked during swapoff operation (while paging-in), too.
During research, I found swap_pager_getpages() calls swap_pager_haspage() anyway and swap_pager_haspage() checks how many continuous blocks are behind. So, I started researching from swap_pager_haspage() side instead of swblk side.
I had few questions like when to lock and how and when to increment vm_object_pip. I posted here for some feed backs.
While checking patch failure against HEAD, I realized swp_pager_force_pagein() in HEAD had a change for (m->valid == VM_PAGE_BITS_ALL) case. This change cleared some of my questions. I will update my changes and post a new one for 11-STABLE and HEAD.
Created attachment 188607 [details]
swapoff to release multiple blocks at a time for 11-stable
Split vm operations into functions.
It looks I need to call vm_page_grab and cannot use rbehind to call
vm_page_alloc() is called by swap_pager_getpages() but I got a crash.
Created attachment 188608 [details]
swapoff to release multiple blocks at a time for 12-head
(In reply to ota from comment #5)
1. Generate the patch for HEAD using svn diff -x -U 999999
2. Publish the patch on https://reviews.freebsd.org, assigning me as the reviewer.
(In reply to Konstantin Belousov from comment #6)
I created https://reviews.freebsd.org/D13484 for this case.
I have another change-set for a improvement and also created https://reviews.freebsd.org/D13485
Triaged during 2019 Waterloo Hackathon, Doug would you be interested in shepherding this change in?
Yes, he addressed this, https://reviews.freebsd.org/D20635.