Bug 225062

Summary:	pkg.fo performance
Product:	Services	Reporter:	heas
Component:	FTP/WWW Sites & Mirrors	Assignee:	FreeBSD Mirror Admin <mirror-admin>
Status:	Closed FIXED
Severity:	Affects Only Me	CC:	georg-bsd, lwhsu, tok
Priority:	---
Version:	unspecified
Hardware:	Any
OS:	Any

Description heas 2018-01-11 01:39:58 UTC

Hi,
I know that this probably has something to do with my network and pkg.fo (149.20.1.201), but I need a little help to find the cause.

I receive horribly performance downloading binary ports from the aforementioned pkg host, roughly 8k/s.  If I force pkg.fo to resolve to 96.47.72.71, the performance is a little better, roughly 16 - 48k/s.  If turn off my low MTU link (1340b) with offers ~15Mb/s, the performance is what i expect for the secondary link, 3xT1.

The ends of the low-MTU link are forcing and doing fragmentation.  I do not normally see any problem with other hosts.

I see 3 fragments for some of the packets coming from 149.20.1.201.  Is that expected? Does it have a >1500 MTU?  Can you tell me what the path to 198.58.5.4 is from one of these hosts?

Any ideas welcome.

Thanks in advance!

Comment 1 georg-bsd 2019-01-26 09:15:27 UTC

In the german bsdforen.de we noticed that basicly all people experience bad download rates. We all get redirectoed to New York Mirror.

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=225062

At least from france it is the same like from germany. We got a lot dropped tcp packages. 

It doesnt matter if we use IPv4 or IPv6.

Comment 2 georg-bsd 2019-01-26 09:19:26 UTC

Yamagi (who is the bsdforen.de admin and the most experienced freebsd user there) has the same issues. 

HOST: nobu.home.yamagi.org                Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- router.home.yamagi.org               0.0%    10    0.7   0.7   0.6   0.7   0.0
  2.|-- 62.155.240.193                       0.0%    10    9.1   9.0   8.3  10.7   0.9
  3.|-- d-ed5-i.D.DE.NET.DTAG.DE             0.0%    10   15.1  15.0  14.5  15.2   0.2
  4.|-- 80.157.129.202                      80.0%    10   24.7  24.7  24.7  24.7   0.0
  5.|-- 4.69.214.26                         90.0%    10  112.0 112.0 112.0 112.0   0.0
  6.|-- THE-NEW-YOR.ear1.Newark1.Level3.net  0.0%    10  133.2 132.6 113.8 144.6  10.1
  7.|-- cs90.cs89new.v.ewr.nyinternet.net   10.0%    10  106.8 107.0 106.1 109.3   0.9
  8.|-- 96.47.66.42.static.nyinternet.net   10.0%    10   99.4  99.2  99.0  99.5   0.2
  9.|-- pkg0.nyi.freebsd.org                10.0%    10  100.1 100.0  99.7 100.2   0.2

We got the same drops from Telekom, Hetzner.de (a server hoster in germany with a big back bone).

Comment 3 georg-bsd 2019-01-26 09:28:13 UTC

This is frommy Hetzner FreeBSD Server mtr output

Server (xx.yy.zz.aa)                                      2019-01-26T10:27:00+0100
Keys:  Help   Display mode   Restart statistics   Order of fields   quit
                                        Packets               Pings
 Host                                 Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. static.129.96.9.5.clients.your-se  0.0%    29    1.9   0.8   0.2   4.8   1.0
 2. core23.fsn1.hetzner.com            0.0%    29    2.9   0.9   0.2   3.3   0.9
 3. core1.fra.hetzner.com              0.0%    29    5.1   9.6   4.8  65.8  15.1
 4. zayo.fra.ecix.net                  0.0%    29    5.0   6.3   4.9  27.6   4.2
 5. ae1.cs1.fra9.de.eth.zayo.com       0.0%    29   82.7  84.2  82.2 101.9   3.8
 6. ae0.cs1.fra6.de.eth.zayo.com       0.0%    29   82.3  82.8  82.3  84.2   0.7
 7. ae2.cs1.ams17.nl.eth.zayo.com      3.6%    28   83.3  82.7  82.2  84.1   0.5
 8. ae0.cs1.ams10.nl.eth.zayo.com      3.6%    28   82.7  82.8  82.3  84.6   0.7
 9. ae2.cs1.lhr15.uk.eth.zayo.com      0.0%    28   82.3  83.1  82.3  88.4   1.4
10. ae0.cs1.lhr11.uk.eth.zayo.com      0.0%    28   82.2  84.3  82.2  92.2   2.7
11. ae5.cs1.lga5.us.eth.zayo.com      96.3%    28   82.2  82.2  82.2  82.2   0.0
12. ae1.mcs1.lga5.us.eth.zayo.com      0.0%    28   82.1  82.4  81.5  87.4   1.5
13. ae7.mpr1.ewr1.us.zip.zayo.com      0.0%    28   81.9  82.7  81.8  90.4   1.6
14. ae5.mpr1.ewr4.us.zip.zayo.com      0.0%    28   82.3  82.5  82.2  83.8   0.5
15. 208.184.34.238.IPYX-076763-900-ZY  0.0%    28  121.6 108.4  82.5 210.3  24.2
16. cs90.cs89new.v.ewr.nyinternet.net  0.0%    28   82.5  84.0  82.5  96.8   3.1
17. 96.47.66.42.static.nyinternet.net  0.0%    28   84.1  83.0  82.3  84.3   0.6
18. pkg0.nyi.freebsd.org               0.0%    28   82.7  83.1  82.5  87.2   0.9

Comment 4 tok 2019-01-27 11:17:24 UTC

Same here, bad performance on European systems because of US mirror.

Geo DNS for pkg mirrors appears to be non-functional: DNS lookups for both pkg.freebsd.org (A/AAAA) and _http._tcp.pkg.freebsd.org (SRV) point to pkg0.nyi.freebsd.org instead of pkg0.bme.

Lookups performed from
- Vodafone Germany
- Telefonica Germany
- Deutsche Telekom
- Hetzner Hosting
- Digital Ocean (DC Amsterdam 3)

All of the above result @ pkg0.nyi


Regards

Comment 5 Mathieu Arnold freebsd_committer

2019-01-28 09:30:08 UTC

The Geo DNS is functionnal, as the bme mirror is currently not working.

Comment 6 Li-Wen Hsu freebsd_committer

2020-06-16 07:17:05 UTC

Does this issue still exists? We have a new European mirror now.

Comment 7 Li-Wen Hsu freebsd_committer

2020-09-04 15:41:41 UTC

Feedback timeout, please let us know if there is any issue still exists.