We can see that only a fairly small percentage of the files are now cached on the ports mirror. There are a large number of third-party links directly to sites provided by the software developers, such as GitHub or their own sites. The number of these files is so large that the ports mirror is essentially useless. If you don't use a VPN or proxy server, it is basically impossible to use ports to install the software. The Gentoo mirrors basically cache all the files you need. I don't know why this is a problem. What exactly are the criteria for caching and not caching? I know there is some software that has distribution restrictions or other copyright restrictions, but they are in the minority in ports. The reality is that almost all software is not cached on mirrors, and ports mirrors are almost impossible to use without using a proxy or VPN. This is not conducive to future maintenance, and if a user needs to download a fairly old version, it may be difficult to download the software that was available at the time. It is also not conducive to the advocacy and promotion of FreeBSD. Although pkg can solve the problem to some extent, ports are still an important software installation method and one of the strengths of FreeBSD, supporting both binary package installation and installation via source code. This is hampered by the current caching mechanism.
The package building infrastructure caches every distfile we are legally allowed to distribute. By default, the ports framework will fetch from the upstream sites. In many cases, they're better connected than our mirrors. If you struggle to connect to the upstream sites, you could configure your /etc/make.conf to try our cache first. MASTER_SITE_OVERRIDE?= ${MASTER_SITE_BACKUP} If you hit missing files, please let us know which mirror you're connecting to (traceroute) and which files you're missing.
(In reply to Philip Paeps from comment #1) I understand your point of view, but there are still some problems here. Caching files for download is something that should be done by mirrors, not by users, and FreeBSD users are not just limited to the US or Europe but are widely distributed around the world. This is why mirror sites are so important. According to the Gentoo Linux mirror, it is only 544.87 GB in size, while the FreeBSD ports mirror is currently 171.74 GB. Even if the FreeBSD ports mirror were to cache all the files for download, it would not be much larger than that. In contrast, one version of the FreeBSD pkg image has an architecture of about 150 GB, and caching all the files needed for ports is not likely to put much strain on the FreeBSD servers. I would ask the FreeBSD community to actively consider this issue. thanks a lot.
A full FreeBSD pkg mirror, including the distfile cache, is currently well over 7TB. We currently have mirrors in Australia, Brazil, Germany, Japan (two sites in Tokyo), Malaysia, South Africa, Taiwan, the UK and the US (California, New Jersey, and Washington). I am not sure I understand what you are complaining about or what problem you are trying to solve.
(In reply to Philip Paeps from comment #3) Ok, In short it's to solve the problem that the current ports mirror site doesn't mirror all the ports files that need to be downloaded. Most of these ports point to addresses that are difficult for us to reach, even when using a VPN as a proxy for us. By pkg mirrors I mean pkg binary packages and nothing else.
(In reply to ykla from comment #4) >By pkg mirrors I mean pkg binary packages and nothing else. No you don't. What you mean are the source packages for building ports. Those are not always cached, and if the download location is not online/changed etc you cant build the package from ports.
(In reply to Gian-Simon Purkert from comment #5) What I mean is that each freebsd version has about 150 GB of pkg binary packages built for each architecture. The distfile cache now occupies roughly 171.74 GB of the freebsd mirror, and even with all the distfile cache cached it should not exceed the 544.87 G size of the gentoo mirror.
Each of the pkg mirrors also serves distcache.freebsd.org, an archive of every ports distfile ever referenced by a port, that we are legally allowed to distribute. In other words, every distfile that is not RESTRICTED or similar is available on every pkg mirror. Which files are you missing? From which mirror?
(In reply to ykla from comment #6) I don't know where you get your numbers. They are wrong. On my two nearest mirrors: root@fbs-pkg0-ctl.bbt:/home/pkgsync # du -ksh pkg-mirror ports-distfiles 5.0T pkg-mirror 2.2T ports-distfiles root@fbs-pkg0-ctl.twn:/home/pkgsync # du -ksh pkg-mirror ports-distfiles 5.1T pkg-mirror 2.2T ports-distfiles On the master site all mirrors pull from: root@fbs-pkgm-ctl.nyi:/home/pkgsync # du -ksh pkg-master ports-distfiles 6.9T pkg-master 2.2T ports-distfiles (pkg-master is often larger than pkg-mirror while new builds are being distributed.)
Just test for gnome(too long) vim. Just about every port is like this. You will see many not found in http://distcache.freebsd.org/ports-distfiles. ---------------------------------------------------------- root@ykla:/usr/ports/x11/gnome # setenv http_proxy http://192.168.245.1:7890 root@ykla:/usr/ports/x11/gnome # make BATCH=yes fetch-recursive ===> Fetching all distfiles for gnome-42_2 and dependencies ===> License NA accepted by the user ===> gnome-42_2 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by gnome-42_2 for building ===> License BSD2CLAUSE accepted by the user => freebsd-pkg-1.19.0_GH0.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/freebsd-pkg-1.19.0_GH0.tar.gz freebsd-pkg-1.19.0_GH0.tar.gz 3995 kB 1312 kBps 03s ===> Fetching all distfiles required by pkg-1.19.0 for building ===> License GPLv3 accepted by the user ===> dconf-editor-3.38.3 depends on file: /usr/local/sbin/pkg - found => dconf-editor-3.38.3.tar.xz doesn't seem to exist in /usr/ports/distfiles/gnome. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/gnomedconf-editor-3.38.3.tar.xz fetch: http://distcache.freebsd.org/ports-distfiles/gnomedconf-editor-3.38.3.tar.xz: Not Found => Attempting to fetch https://download.gnome.org/sources/dconf-editor/3.38/dconf-editor-3.38.3.tar.xz dconf-editor-3.38.3.tar.xz 580 kB 826 kBps 01s => 56474378568e.patch doesn't seem to exist in /usr/ports/distfiles/gnome. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/gnome56474378568e.patch fetch: http://distcache.freebsd.org/ports-distfiles/gnome56474378568e.patch: Not Found => Attempting to fetch https://gitlab.gnome.org/GNOME/dconf-editor/-/commit/56474378568e.patch 56474378568e.patch 825 B 5876 kBps 00s ===> Fetching all distfiles required by dconf-editor-3.38.3 for building ===> License LGPL21 accepted by the user ===> dconf-0.40.0_3 depends on file: /usr/local/sbin/pkg - found => dconf-0.40.0.tar.xz doesn't seem to exist in /usr/ports/distfiles/gnome. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/gnomedconf-0.40.0.tar.xz fetch: http://distcache.freebsd.org/ports-distfiles/gnomedconf-0.40.0.tar.xz: Not Found => Attempting to fetch https://download.gnome.org/sources/dconf/0.40/dconf-0.40.0.tar.xz dconf-0.40.0.tar.xz 115 kB 329 kBps 00s ===> Fetching all distfiles required by dconf-0.40.0_3 for building ===> License MIT accepted by the user ===> docbook-xsl-1.79.1_1,1 depends on file: /usr/local/sbin/pkg - found => docbook-xsl-1.79.1.tar.bz2 doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-xsl-1.79.1.tar.bz2 docbook-xsl-1.79.1.tar.bz2 20 MB 7562 kBps 03s => docbook-xsl-doc-1.79.1.tar.bz2 doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-xsl-doc-1.79.1.tar.bz2 docbook-xsl-doc-1.79.1.tar.bz2 1004 kB 920 kBps 01s ===> Fetching all distfiles required by docbook-xsl-1.79.1_1,1 for building ===> License BSD3CLAUSE accepted by the user ===> xmlcatmgr-2.2_3 depends on file: /usr/local/sbin/pkg - found => xmlcatmgr-2.2.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/xmlcatmgr-2.2.tar.gz xmlcatmgr-2.2.tar.gz 94 kB 199 kBps 01s ===> Fetching all distfiles required by xmlcatmgr-2.2_3 for building ===> License NA accepted by the user ===> docbook-1.5 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by docbook-1.5 for building ===> License MIT accepted by the user ===> docbook-sgml-4.5_1 depends on file: /usr/local/sbin/pkg - found => docbk241.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbk241.zip docbk241.zip 54 kB 151 kBps 00s => docbk30.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbk30.zip docbk30.zip 42 kB 133 kBps 00s => docbk31.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbk31.zip docbk31.zip 54 kB 143 kBps 01s => docbk40.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbk40.zip docbk40.zip 54 kB 153 kBps 01s => docbk41.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbk41.zip docbk41.zip 55 kB 152 kBps 00s => docbook-4.2.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-4.2.zip docbook-4.2.zip 60 kB 161 kBps 01s => docbook-4.3.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-4.3.zip docbook-4.3.zip 64 kB 163 kBps 01s => docbook-4.4.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-4.4.zip docbook-4.4.zip 65 kB 174 kBps 01s => docbook-4.5.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-4.5.zip docbook-4.5.zip 69 kB 175 kBps 01s ===> Fetching all distfiles required by docbook-sgml-4.5_1 for building ===> NOTICE: The iso8879 port currently does not have a maintainer. As a result, it is more likely to have unresolved issues, not be up-to-date, or even be removed in the future. To volunteer to maintain this port, please create an issue at: https://bugs.freebsd.org/bugzilla More information about port maintainership is available at: https://docs.freebsd.org/en/articles/contributing/#ports-contributing ===> License IOS accepted by the user ===> iso8879-1986_3 depends on file: /usr/local/sbin/pkg - found => isoENTS.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/isoENTS.zip isoENTS.zip 20 kB 114 kBps 00s ===> Fetching all distfiles required by iso8879-1986_3 for building ===> docbook-xml-5.0_3 depends on file: /usr/local/sbin/pkg - found => docbkx412.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbkx412.zip docbkx412.zip 73 kB 174 kBps 00s => docbook-xml-4.2.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-xml-4.2.zip docbook-xml-4.2.zip 76 kB 182 kBps 00s => docbook-xml-4.3.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-xml-4.3.zip docbook-xml-4.3.zip 81 kB 166 kBps 01s => docbook-xml-4.4.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-xml-4.4.zip docbook-xml-4.4.zip 93 kB 198 kBps 01s => docbook-xml-4.5.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-xml-4.5.zip docbook-xml-4.5.zip 96 kB 194 kBps 01s => docbook-5.0.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-5.0.zip docbook-5.0.zip 816 kB 741 kBps 01s ===> Fetching all distfiles required by docbook-xml-5.0_3 for building ===> License OASIS accepted by the user ===> xmlcharent-0.3_2 depends on file: /usr/local/sbin/pkg - found => xmlcharent-0.3.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/xmlcharent-0.3.zip xmlcharent-0.3.zip 29 kB 138 kBps 00s ===> Fetching all distfiles required by xmlcharent-0.3_2 for building ===> License OASIS accepted by the user ===> sdocbook-xml-1.1_2,2 depends on file: /usr/local/sbin/pkg - found => docbook-simple-1.1.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/docbook-simple-1.1.zip docbook-simple-1.1.zip 33 kB 149 kBps 00s ===> Fetching all distfiles required by sdocbook-xml-1.1_2,2 for building ===> License BSD2CLAUSE GPLv2+ accepted by the user ===> bash-completion-2.11_2,2 depends on file: /usr/local/sbin/pkg - found => scop-bash-completion-2.11_GH0.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/scop-bash-completion-2.11_GH0.tar.gz scop-bash-completion-2.11_GH0.tar.gz 349 kB 443 kBps 01s => 0mp-bash-completion-freebsd-1.2.0_GH0.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/0mp-bash-completion-freebsd-1.2.0_GH0.tar.gz 0mp-bash-completion-freebsd-1.2.0_GH0.tar.gz 7109 B 31 MBps 00s ===> Fetching all distfiles required by bash-completion-2.11_2,2 for building ===> License GPLv3 accepted by the user ===> gmake-4.3_2 depends on file: /usr/local/sbin/pkg - found => make-4.3.tar.lz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/make-4.3.tar.lz make-4.3.tar.lz 1236 kB 922 kBps 02s ===> Fetching all distfiles required by gmake-4.3_2 for building ===> License LGPL21+ GPLv3+ accepted by the user ===> gettext-runtime-0.21.1 depends on file: /usr/local/sbin/pkg - found => gettext-0.21.1.tar.xz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/gettext-0.21.1.tar.xz gettext-0.21.1.tar.xz 9818 kB 4531 kBps 03s ===> Fetching all distfiles required by gettext-runtime-0.21.1 for building ===> License GPLv3 accepted by the user ===> libiconv-1.17 depends on file: /usr/local/sbin/pkg - found => libiconv-1.17.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/libiconv-1.17.tar.gz libiconv-1.17.tar.gz 5286 kB 3162 kBps 02s ===> Fetching all distfiles required by libiconv-1.17 for building ===> License BSD2CLAUSE accepted by the user ===> indexinfo-0.3.1 depends on file: /usr/local/sbin/pkg - found => bapt-indexinfo-0.3.1_GH0.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bapt-indexinfo-0.3.1_GH0.tar.gz bapt-indexinfo-0.3.1_GH0.tar.gz 3860 B 28 MBps 00s ===> Fetching all distfiles required by indexinfo-0.3.1 for building ===> License EXCEPTION GFDL GPLv2+ GPLv3+ accepted by the user ===> autoconf-2.71 depends on file: /usr/local/sbin/pkg - found => autoconf-2.71.tar.xz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/autoconf-2.71.tar.xz autoconf-2.71.tar.xz 1262 kB 974 kBps 02s ===> Fetching all distfiles required by autoconf-2.71 for building ===> License GPLv3 accepted by the user ===> m4-1.4.19,1 depends on file: /usr/local/sbin/pkg - found => m4-1.4.19.tar.xz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/m4-1.4.19.tar.xz m4-1.4.19.tar.xz 1616 kB 1108 kBps 02s ===> Fetching all distfiles required by m4-1.4.19,1 for building ===> License GPLv3+ accepted by the user ===> texinfo-6.8_3,1 depends on file: /usr/local/sbin/pkg - found => texinfo-6.8.tar.xz doesn't seem to exist in /usr/ports/distfiles/texinfo. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/texinfotexinfo-6.8.tar.xz fetch: http://distcache.freebsd.org/ports-distfiles/texinfotexinfo-6.8.tar.xz: Not Found => Attempting to fetch https://ftpmirror.gnu.org/texinfo/texinfo-6.8.tar.xz texinfo-6.8.tar.xz 4845 kB 2097 kBps 02s => htmlxref.cnf-20220110 doesn't seem to exist in /usr/ports/distfiles/texinfo. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/texinfohtmlxref.cnf-20220110 fetch: http://distcache.freebsd.org/ports-distfiles/texinfohtmlxref.cnf-20220110: Not Found => Attempting to fetch http://distcache.FreeBSD.org/local-distfiles/sunpoet/texinfo/htmlxref.cnf-20220110 htmlxref.cnf-20220110 22 kB 120 kBps 00s => texi2dvi-20220408 doesn't seem to exist in /usr/ports/distfiles/texinfo. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/texinfotexi2dvi-20220408 fetch: http://distcache.freebsd.org/ports-distfiles/texinfotexi2dvi-20220408: Not Found => Attempting to fetch http://distcache.FreeBSD.org/local-distfiles/sunpoet/texinfo/texi2dvi-20220408 texi2dvi-20220408 57 kB 159 kBps 01s => texinfo.tex-20220409 doesn't seem to exist in /usr/ports/distfiles/texinfo. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/texinfotexinfo.tex-20220409 fetch: http://distcache.freebsd.org/ports-distfiles/texinfotexinfo.tex-20220409: Not Found => Attempting to fetch http://distcache.FreeBSD.org/local-distfiles/sunpoet/texinfo/texinfo.tex-20220409 texinfo.tex-20220409 365 kB 418 kBps 01s ===> Fetching all distfiles required by texinfo-6.8_3,1 for building ===> License GPLv3 accepted by the user ===> help2man-1.49.2 depends on file: /usr/local/sbin/pkg - found => help2man-1.49.2.tar.xz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/help2man-1.49.2.tar.xz help2man-1.49.2.tar.xz 220 kB 157 kBps 02s ===> Fetching all distfiles required by help2man-1.49.2 for building ===> License ARTPERL10 GPLv2 accepted by the user ===> p5-Locale-gettext-1.07 depends on file: /usr/local/sbin/pkg - found => gettext-1.07.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/gettext-1.07.tar.gz gettext-1.07.tar.gz 8651 B 36 MBps 00s ===> Fetching all distfiles required by p5-Locale-gettext-1.07 for building ===> License GPLv3+ accepted by the user ===> gettext-tools-0.21.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by gettext-tools-0.21.1 for building ===> License GPLv3+ accepted by the user ===> libtextstyle-0.21.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by libtextstyle-0.21.1 for building ===> License ART10 GPLv1+ accepted by the user ===> perl5-5.32.1_3 depends on file: /usr/local/sbin/pkg - found => perl-5.32.1.tar.xz doesn't seem to exist in /usr/ports/distfiles/perl. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/perlperl-5.32.1.tar.xz fetch: http://distcache.freebsd.org/ports-distfiles/perlperl-5.32.1.tar.xz: Not Found => Attempting to fetch https://cpan.metacpan.org/modules/by-module/../../src/5.0/perl-5.32.1.tar.xz perl-5.32.1.tar.xz 12 MB 4996 kBps 02s ===> Fetching all distfiles required by perl5-5.32.1_3 for building ===> License GPLv3+ accepted by the user ===> p5-Locale-libintl-1.32 depends on file: /usr/local/sbin/pkg - found => libintl-perl-1.32.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/libintl-perl-1.32.tar.gz libintl-perl-1.32.tar.gz 584 kB 376 kBps 02s ===> Fetching all distfiles required by p5-Locale-libintl-1.32 for building ===> License ART10 GPLv1+ accepted by the user ===> p5-Text-Unidecode-1.30 depends on file: /usr/local/sbin/pkg - found => Text-Unidecode-1.30.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/Text-Unidecode-1.30.tar.gz Text-Unidecode-1.30.tar.gz 134 kB 235 kBps 01s ===> Fetching all distfiles required by p5-Text-Unidecode-1.30 for building ===> License CC0-1.0 accepted by the user ===> p5-Unicode-EastAsianWidth-12.0 depends on file: /usr/local/sbin/pkg - found => Unicode-EastAsianWidth-12.0.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/Unicode-EastAsianWidth-12.0.tar.gz Unicode-EastAsianWidth-12.0.tar.gz 51 kB 144 kBps 00s ===> Fetching all distfiles required by p5-Unicode-EastAsianWidth-12.0 for building ===> License BSD2CLAUSE accepted by the user ===> autoconf-switch-20220527 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by autoconf-switch-20220527 for building ===> License GPLv2+ GFDL accepted by the user ===> automake-1.16.5 depends on file: /usr/local/sbin/pkg - found => automake-1.16.5.tar.xz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/automake-1.16.5.tar.xz automake-1.16.5.tar.xz 1564 kB 1206 kBps 01s ===> Fetching all distfiles required by automake-1.16.5 for building ===> License GPLv3+ accepted by the user ===> bash-5.2.15 depends on file: /usr/local/sbin/pkg - found => bash-5.2.tar.gz doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash-5.2.tar.gz fetch: http://distcache.freebsd.org/ports-distfiles/bashbash-5.2.tar.gz: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2.tar.gz bash-5.2.tar.gz 10 MB 4611 kBps 02s => bash52-001 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-001 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-001: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-001 bash52-001 1381 B 9636 kBps 00s => bash52-002 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-002 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-002: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-002 bash52-002 1328 B 9 MBps 00s => bash52-003 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-003 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-003: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-003 bash52-003 2157 B 9698 kBps 00s => bash52-004 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-004 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-004: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-004 bash52-004 2016 B 10 MBps 00s => bash52-005 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-005 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-005: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-005 bash52-005 1515 B 11 MBps 00s => bash52-006 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-006 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-006: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-006 bash52-006 8790 B 45 MBps 00s => bash52-007 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-007 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-007: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-007 bash52-007 9072 B 36 MBps 00s => bash52-008 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-008 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-008: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-008 bash52-008 1771 B 12 MBps 00s => bash52-009 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-009 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-009: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-009 bash52-009 1316 B 9 MBps 00s => bash52-010 doesn't seem to exist in /usr/ports/distfiles/bash. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/bashbash52-010 fetch: http://distcache.freebsd.org/ports-distfiles/bashbash52-010: Not Found => Attempting to fetch https://ftpmirror.gnu.org/bash/bash-5.2-patches/bash52-010 ^C ----------------------------------------------------------------------------- root@ykla:/usr/ports/x11/gnome # cd /usr/ports/editors/vim root@ykla:/usr/ports/editors/vim # make BATCH=yes fetch-recursive ===> Fetching all distfiles for vim-9.0.0981 and dependencies ===> License VIM accepted by the user ===> vim-9.0.0981 depends on file: /usr/local/sbin/pkg - found => vim-vim-v9.0.0981_GH0.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/vim-vim-v9.0.0981_GH0.tar.gz vim-vim-v9.0.0981_GH0.tar.gz 16 MB 4086 kBps 04s ===> Fetching all distfiles required by vim-9.0.0981 for building ===> License BSD2CLAUSE accepted by the user ===> Fetching all distfiles required by pkg-1.19.0 for building ===> License GPLv3 accepted by the user ===> libiconv-1.17 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by libiconv-1.17 for building ===> License ISCL accepted by the user ===> pkgconf-1.8.0_1,1 depends on file: /usr/local/sbin/pkg - found => pkgconf-1.8.0.tar.xz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/pkgconf-1.8.0.tar.xz pkgconf-1.8.0.tar.xz 289 kB 302 kBps 01s ===> Fetching all distfiles required by pkgconf-1.8.0_1,1 for building ===> License BSD3CLAUSE accepted by the user ===> kyua-0.13_5,3 depends on file: /usr/local/sbin/pkg - found => kyua-0.13.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/kyua-0.13.tar.gz kyua-0.13.tar.gz 648 kB 570 kBps 01s ===> Fetching all distfiles required by kyua-0.13_5,3 for building ===> License BSD3CLAUSE accepted by the user ===> atf-0.21 depends on file: /usr/local/sbin/pkg - found => atf-0.21.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/atf-0.21.tar.gz atf-0.21.tar.gz 554 kB 540 kBps 01s ===> Fetching all distfiles required by atf-0.21 for building ===> License BSD3CLAUSE accepted by the user ===> lutok-0.4_7 depends on file: /usr/local/sbin/pkg - found => lutok-0.4.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/lutok-0.4.tar.gz lutok-0.4.tar.gz 478 kB 466 kBps 01s ===> Fetching all distfiles required by lutok-0.4_7 for building ===> License MIT accepted by the user ===> lua54-5.4.4 depends on file: /usr/local/sbin/pkg - found => lua-5.4.4.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/lua-5.4.4.tar.gz lua-5.4.4.tar.gz 352 kB 309 kBps 01s ===> Fetching all distfiles required by lua54-5.4.4 for building ===> License BSD2CLAUSE accepted by the user ===> libedit-3.1.20221030,1 depends on file: /usr/local/sbin/pkg - found => libedit-20221030-3.1.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/libedit-20221030-3.1.tar.gz libedit-20221030-3.1.tar.gz 520 kB 519 kBps 01s ===> Fetching all distfiles required by libedit-3.1.20221030,1 for building ===> License PD accepted by the user ===> sqlite3-3.40.0,1 depends on file: /usr/local/sbin/pkg - found => sqlite-src-3400000.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/sqlite-src-3400000.zip sqlite-src-3400000.zip 13 MB 4101 kBps 03s ===> Fetching all distfiles required by sqlite3-3.40.0,1 for building ===> License TclTk accepted by the user ===> tcl86-8.6.13 depends on file: /usr/local/sbin/pkg - found => tcl8.6.13-src.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/tcl8.6.13-src.tar.gz tcl8.6.13-src.tar.gz 10 MB 4654 kBps 02s ===> Fetching all distfiles required by tcl86-8.6.13 for building ===> License GPLv3+ accepted by the user ===> gettext-tools-0.21.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by gettext-tools-0.21.1 for building ===> License GPLv3+ accepted by the user ===> libtextstyle-0.21.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by libtextstyle-0.21.1 for building ===> License BSD2CLAUSE accepted by the user ===> indexinfo-0.3.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by indexinfo-0.3.1 for building ===> License LGPL21+ GPLv3+ accepted by the user ===> gettext-runtime-0.21.1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by gettext-runtime-0.21.1 for building ===> License PSFL accepted by the user ===> python39-3.9.16 depends on file: /usr/local/sbin/pkg - found => Python-3.9.16.tar.xz doesn't seem to exist in /usr/ports/distfiles/python. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/pythonPython-3.9.16.tar.xz fetch: http://distcache.freebsd.org/ports-distfiles/pythonPython-3.9.16.tar.xz: Not Found => Attempting to fetch https://www.python.org/ftp/python/3.9.16/Python-3.9.16.tar.xz Python-3.9.16.tar.xz 18 MB 5049 kBps 04s ===> Fetching all distfiles required by python39-3.9.16 for building ===> License MIT accepted by the user ===> libffi-3.4.4 depends on file: /usr/local/sbin/pkg - found => libffi-3.4.4.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/libffi-3.4.4.tar.gz libffi-3.4.4.tar.gz 1330 kB 712 kBps 02s ===> Fetching all distfiles required by libffi-3.4.4 for building ===> License GPLv3 accepted by the user ===> dejagnu-1.6.3 depends on file: /usr/local/sbin/pkg - found => dejagnu-1.6.3.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/dejagnu-1.6.3.tar.gz dejagnu-1.6.3.tar.gz 607 kB 652 kBps 01s ===> Fetching all distfiles required by dejagnu-1.6.3 for building ===> License GPLv3 accepted by the user ===> gmake-4.3_2 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by gmake-4.3_2 for building ===> License PD accepted by the user ===> expect-5.45.4_4,1 depends on file: /usr/local/sbin/pkg - found => expect5.45.4.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/expect5.45.4.tar.gz expect5.45.4.tar.gz 617 kB 407 kBps 01s ===> Fetching all distfiles required by expect-5.45.4_4,1 for building ===> License EXCEPTION GFDL GPLv2+ GPLv3+ accepted by the user ===> autoconf-2.71 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by autoconf-2.71 for building ===> License GPLv3 accepted by the user ===> m4-1.4.19,1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by m4-1.4.19,1 for building ===> License GPLv3+ accepted by the user ===> texinfo-6.8_3,1 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by texinfo-6.8_3,1 for building ===> License GPLv3 accepted by the user ===> help2man-1.49.2 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by help2man-1.49.2 for building ===> License ARTPERL10 GPLv2 accepted by the user ===> p5-Locale-gettext-1.07 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by p5-Locale-gettext-1.07 for building ===> License ART10 GPLv1+ accepted by the user ===> perl5-5.32.1_3 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by perl5-5.32.1_3 for building ===> License GPLv3+ accepted by the user ===> p5-Locale-libintl-1.32 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by p5-Locale-libintl-1.32 for building ===> License ART10 GPLv1+ accepted by the user ===> p5-Text-Unidecode-1.30 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by p5-Text-Unidecode-1.30 for building ===> License CC0-1.0 accepted by the user ===> p5-Unicode-EastAsianWidth-12.0 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by p5-Unicode-EastAsianWidth-12.0 for building ===> License BSD2CLAUSE accepted by the user ===> autoconf-switch-20220527 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by autoconf-switch-20220527 for building ===> License GPLv2+ GFDL accepted by the user ===> automake-1.16.5 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by automake-1.16.5 for building ===> License BSD2CLAUSE accepted by the user ===> mpdecimal-2.5.1 depends on file: /usr/local/sbin/pkg - found => mpdecimal-2.5.1.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/mpdecimal-2.5.1.tar.gz mpdecimal-2.5.1.tar.gz 2523 kB 874 kBps 03s ===> Fetching all distfiles required by mpdecimal-2.5.1 for building ===> License GPLv3 accepted by the user ===> readline-8.2.0 depends on file: /usr/local/sbin/pkg - found => readline-8.2.tar.gz doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/readline-8.2.tar.gz readline-8.2.tar.gz 2972 kB 2099 kBps 02s ===> Fetching all distfiles required by readline-8.2.0 for building ------------------------------------------------------------------
root@ykla:/usr/ports/www/firefox # cat /etc/make.conf MASTER_SITE_OVERRIDE?=http://distcache.freebsd.org/ports-distfiles/${DIST_SUBDIR}
Or test for texlive-full ------------------------------------------------------------------- root@ykla:/usr/ports/www/firefox # cd /usr/ports/print/texlive-full root@ykla:/usr/ports/print/texlive-full # make BATCH=yes fetch-recursive ===> Fetching all distfiles for texlive-full-20210325 and dependencies ===> License NA accepted by the user ===> texlive-full-20210325 depends on file: /usr/local/sbin/pkg - found ===> Fetching all distfiles required by texlive-full-20210325 for building ===> License BSD2CLAUSE accepted by the user ===> Fetching all distfiles required by pkg-1.19.0 for building ===> texlive-docs-20210325 depends on file: /usr/local/sbin/pkg - found => texlive-20210325-texmf.tar.xz doesn't seem to exist in /usr/ports/distfiles/TeX. => Attempting to fetch http://distcache.freebsd.org/ports-distfiles/TeXtexlive-20210325-texmf.tar.xz fetch: http://distcache.freebsd.org/ports-distfiles/TeXtexlive-20210325-texmf.tar.xz: Not Found => Attempting to fetch https://ftp.tu-chemnitz.de/pub/tug/historic/systems/texlive/2021/texlive-20210325-texmf.tar.xz texlive-20210325-texmf.tar.xz 2% of 3313 MB 5452 kBps 09m55s^C fetch: transfer interrupted *** Signal 2 *** Signal 2 root@ykla:/usr/ports/print/texlive-full #
Now we're starting to get useful information ... Your MASTER_SITE_OVERRIDE is set wrong. fetch: http://distcache.freebsd.org/ports-distfiles/bashbash-5.2.tar.gz: Not Found fetch: http://distcache.freebsd.org/ports-distfiles/TeXtexlive-20210325-texmf.tar.xz: Not Found These work fine: http://distcache.freebsd.org/ports-distfiles/bash/bash-5.2.tar.gz http://distcache.freebsd.org/ports-distfiles/TeX/texlive-20210325-texmf.tar.xz Note the additional '/'es. This is wrong: MASTER_SITE_OVERRIDE?=http://distcache.freebsd.org/ports-distfiles/${DIST_SUBDIR} It should be: MASTER_SITE_OVERRIDE?=http://distcache.freebsd.org/ports-distfiles/${DIST_SUBDIR}/ You could also simply set it to this as I recommended: MASTER_SITE_OVERRIDE?= ${MASTER_SITE_BACKUP} Reading through Mk/bsd.port.mk, setting this would achieve the same effect: MASTER_SITE_FREEBSD=
OK. Thanks.