Bug 248342 - Bad performance Zvols+CTLD with windows clients
Summary: Bad performance Zvols+CTLD with windows clients
Status: Closed Unable to Reproduce
Alias: None
Product: Base System
Classification: Unclassified
Component: kern (show other bugs)
Version: 11.2-RELEASE
Hardware: amd64 Any
: --- Affects Some People
Assignee: freebsd-fs (Nobody)
URL:
Keywords: needs-qa, performance
: 248366 (view as bug list)
Depends on:
Blocks:
 
Reported: 2020-07-29 08:58 UTC by Евгений
Modified: 2021-04-19 09:56 UTC (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Евгений 2020-07-29 08:58:19 UTC
Добрый день. Есть проблема с работой zvol-ов, клоны которых раздаются по средством ctld (100 клиентов). Происходит зависание клиента Windows на 5-10 секунд, который соответственно внутри клона zvol. Проблема проявляется если удалять старые клоны, и создавать новые.
uname -a
FreeBSD bsd 11.2-RELEASE FreeBSD 11.2-RELEASE #0 r335510: Fri Jun 22 04:32:14 UTC 2018     root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64

Конфигурация zpool: 
atime=off dedup=off sync=disabled compression=lz4
Конфигурация CTLD:
portal-group test {
 discovery-auth-group no-authentication
 listen 192.168.173.206:3260
}
target iqn.orig1 {
auth-group no-authentication
portal-group test
lun 0 {
path /dev/zvol/ssd/orig/original1
ctl-lun 194
}}
target iqn.orig2 {
auth-group no-authentication
portal-group test
lun 0 {
path /dev/zvol/ssd/orig/original2
ctl-lun 195
}}
target iqn.orig3 {
auth-group no-authentication
portal-group test
lun 0 { 
path /dev/zvol/ssd/orig/original3
ctl-lun 196 }}
target iqn.orig4 {
auth-group no-authentication
portal-group test
lun 0 { 
path /dev/zvol/ssd/orig/original4
ctl-lun 198 }}
target iqn.games {
auth-group no-authentication
portal-group test
lun 0 { 
path /dev/zvol/hdd/orig/games
ctl-lun 197 }}


target iqn.pc1 { 
auth-group no-authentication 
portal-group test
lun 0 { 
path /dev/zvol/ssd/snap/win1 
ctl-lun 1}
lun 1 { 
path /dev/zvol/hdd/snap/win1 
ctl-lun 101}}
target iqn.pc2 { 
auth-group no-authentication 
portal-group test 
lun 0 { 
path /dev/zvol/ssd/snap/win2 
ctl-lun 2}
lun 1 { 
path /dev/zvol/hdd/snap/win2 
ctl-lun 102}}
И так до iqn.pc100.
Пробовал на разном оборудовании и с разными дисками, проблема остается неизменной. Так же клиент Windows вылизан до блеска, по минимуму нагружается диск.
Кусок скрипта удаления/создания клона:
ctladm remove -b block -l $name 
cat /dev/null > /var/log/xferlog
zfs destroy -R ssd/orig/original$c@win$name
zfs snap ssd/orig/original$c@win$name
zfs clone ssd/orig/original$c@win$name ssd/snap/win$name
ctladm create -b block -l $name -o file=/dev/zvol/ssd/snap/win$name 

Сервер:
Intel Xeon E5-2620
128Gb DDR3 ECC REG
SSD NVMe Samsung EVO 970 512Gb
SSD Intel DC4502 3.84Tb
NIC Mellanox ConnectX-2 10G SFP+
Надеюсь на Вашу помощь, так как обессилел в поиске решения.
Comment 1 Jochen Neumeister freebsd_committer freebsd_triage 2020-07-30 10:24:02 UTC
Please open a PR in English.
Comment 2 Евгений 2020-07-30 11:19:01 UTC
English version:
Good day. We have a problem with zvols. Zvol's clones giving through ctld (100 clients). There is freeze in Windows client on 5-10 seconds, respectively clients NTFS Windows are under zfs zvols. Problem begining when we destroyd old clones and snapshots and maked new snapshots and clones.

uname -a
FreeBSD bsd 11.2-RELEASE FreeBSD 11.2-RELEASE #0 r335510: Fri Jun 22 04:32:14 UTC 2018     root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64

Configuration zpool: 
atime=off dedup=off sync=disabled compression=lz4
Конфигурация CTLD:
portal-group test {
 discovery-auth-group no-authentication
 listen 192.168.173.206:3260
}
target iqn.orig1 {
auth-group no-authentication
portal-group test
lun 0 {
path /dev/zvol/ssd/orig/original1
ctl-lun 194
}}
target iqn.orig2 {
auth-group no-authentication
portal-group test
lun 0 {
path /dev/zvol/ssd/orig/original2
ctl-lun 195
}}
target iqn.orig3 {
auth-group no-authentication
portal-group test
lun 0 { 
path /dev/zvol/ssd/orig/original3
ctl-lun 196 }}
target iqn.orig4 {
auth-group no-authentication
portal-group test
lun 0 { 
path /dev/zvol/ssd/orig/original4
ctl-lun 198 }}
target iqn.games {
auth-group no-authentication
portal-group test
lun 0 { 
path /dev/zvol/hdd/orig/games
ctl-lun 197 }}


target iqn.pc1 { 
auth-group no-authentication 
portal-group test
lun 0 { 
path /dev/zvol/ssd/snap/win1 
ctl-lun 1}
lun 1 { 
path /dev/zvol/hdd/snap/win1 
ctl-lun 101}}
target iqn.pc2 { 
auth-group no-authentication 
portal-group test 
lun 0 { 
path /dev/zvol/ssd/snap/win2 
ctl-lun 2}
lun 1 { 
path /dev/zvol/hdd/snap/win2 
ctl-lun 102}}

So until iqn.pc100.
We tried on the difference hardware and Windows clients, but problem didnt solve. Windows clients always configured for performance.
Piece of script destroy/make snap and clones:

ctladm remove -b block -l $name 
cat /dev/null > /var/log/xferlog
zfs destroy -R ssd/orig/original$c@win$name
zfs snap ssd/orig/original$c@win$name
zfs clone ssd/orig/original$c@win$name ssd/snap/win$name
ctladm create -b block -l $name -o file=/dev/zvol/ssd/snap/win$name 

Hardware:
Intel Xeon E5-2620
128Gb DDR3 ECC REG
SSD NVMe Samsung EVO 970 512Gb
SSD Intel DC4502 3.84Tb
NIC Mellanox ConnectX-2 10G SFP+

We believe on your help, becouse any ideas doesn't work.
Comment 3 Kubilay Kocak freebsd_committer freebsd_triage 2020-07-30 12:14:11 UTC
*** Bug 248366 has been marked as a duplicate of this bug. ***
Comment 4 Kubilay Kocak freebsd_committer freebsd_triage 2020-07-30 12:16:33 UTC
^Triage: Re-open post comment 2
Comment 5 Kubilay Kocak freebsd_committer freebsd_triage 2020-07-30 12:19:03 UTC
@Reporter Support for 11.2-RELEASE ended October 31, 2019

Can you update to a supported release/branch (ideally at least stable/12 or current) and reproduce please
Comment 6 Евгений 2020-07-30 14:12:31 UTC
(In reply to Kubilay Kocak from comment #5)
Ok, we can try stable version 12.1 for two days and write here. Thank you.
Comment 7 Edward Tomasz Napierala freebsd_committer freebsd_triage 2021-04-04 21:46:55 UTC
Ping?  Does the problem still happen with eg 13.0-RC?
Comment 8 Евгений 2021-04-04 22:29:54 UTC
(In reply to Edward Tomasz Napierala from comment #7)
We doesnt have problem with 12.1-RELEASE r354233, and 13.0 we unused.
Comment 9 Edward Tomasz Napierala freebsd_committer freebsd_triage 2021-04-19 09:56:44 UTC
This does not happen anymore with 12.1, I guess we can close it then.