Created attachment 231547 [details] switch default version of python from 3.8 to 3.9 Default python version was updated without errors form 3.8 to 3.9 on my host (12.3 amd64) with 258 ports dependent from python. Maybe it's time to switch to 3.9.
The exp-run can't start, there are issues with some ports that have 3.8 hardcoded: [00:07:34] Error: compute_deps_pkg failed to lookup pkgname for devel/py-jsonschema@py38 processing package py38-aws-sam-translator-1.42.0 from devel/py-aws-sam-translator -- Is SUBDIR+=py-jsonschema@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:34] Error: compute_deps_pkg failed to lookup pkgname for devel/py-six@py38 processing package py38-aws-sam-translator-1.42.0 from devel/py-aws-sam-translator -- Is SUBDIR+=py-six@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:34] Error: compute_deps_pkg failed to lookup pkgname for www/py-boto3@py38 processing package py38-aws-sam-translator-1.42.0 from devel/py-aws-sam-translator -- Is SUBDIR+=py-boto3@py38 missing in www/Makefile and does the port provide the 'py38' FLAVOR? [00:07:34] Error: compute_deps_pkg failed to lookup existing pkgname for www/py-boto3@py38 processing package py38-aws-sam-translator-1.42.0 [00:07:34] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-jsonschema@py38 processing package py38-aws-sam-translator-1.42.0 [00:07:34] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-six@py38 processing package py38-aws-sam-translator-1.42.0 [00:07:34] Error: compute_deps_pkg failed to lookup pkgname for devel/py-aws-sam-translator@py39 processing package py39-cfn-lint-0.54.2 from devel/py-cfn-lint -- Is SUBDIR+=py-aws-sam-translator@py39 missing in devel/Makefile and does the port provide the 'py39' FLAVOR? [00:07:34] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-aws-sam-translator@py39 processing package py39-cfn-lint-0.54.2 [00:07:34] Error: compute_deps_pkg failed to lookup pkgname for devel/py-six@py38 processing package py38-meliae-0.5.1 from devel/py-meliae -- Is SUBDIR+=py-six@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:35] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-six@py38 processing package py38-meliae-0.5.1 [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for devel/py-Jinja2@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-Jinja2@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for devel/py-msgpack@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-msgpack@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for devel/py-pyinotify@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-pyinotify@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for devel/py-yaml@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-yaml@py38 missing in devel/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for misc/py-progressbar@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-progressbar@py38 missing in misc/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for net/py-libcloud@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-libcloud@py38 missing in net/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for net/py-pyzmq@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-pyzmq@py38 missing in net/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for security/py-pycryptodomex@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-pycryptodomex@py38 missing in security/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for sysutils/py-distro@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-distro@py38 missing in sysutils/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for sysutils/py-psutil@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-psutil@py38 missing in sysutils/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for textproc/py-markupsafe@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-markupsafe@py38 missing in textproc/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for www/py-requests@py38 processing package py38-salt-3004_1 from sysutils/py-salt -- Is SUBDIR+=py-requests@py38 missing in www/Makefile and does the port provide the 'py38' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-Jinja2@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for textproc/py-markupsafe@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for sysutils/py-distro@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for net/py-libcloud@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-msgpack@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for misc/py-progressbar@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for sysutils/py-psutil@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for www/py-requests@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-yaml@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for devel/py-pyinotify@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for net/py-pyzmq@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for security/py-pycryptodomex@py38 processing package py38-salt-3004_1 [00:07:56] Error: compute_deps_pkg failed to lookup pkgname for sysutils/py-salt@py39 processing package rubygem-smart_proxy_salt-4.0.0 from sysutils/rubygem-smart_proxy_salt -- Is SUBDIR+=py-salt@py39 missing in sysutils/Makefile and does the port provide the 'py39' FLAVOR? [00:07:56] Error: compute_deps_pkg failed to lookup existing pkgname for sysutils/py-salt@py39 processing package rubygem-smart_proxy_salt-4.0.0 [00:08:05] Error: Fatal errors encountered calculating dependencies
The ports that have some 3.8 limit hardcoded: devel/py-aws-sam-translator/Makefile:USES= python:3.6-3.8 devel/py-meliae/Makefile:USES= python:3.6-3.8 math/py-cdecimal/Makefile:USES= python:3.6-3.8 sysutils/linux-miniconda-installer/Makefile:USES= linux python:3.8 sysutils/py-salt/Makefile:USES= cpe python:3.6-3.8 www/bluefish/Makefile: pkgconfig python:3.0-3.8 shared-mime-info shebangfix tar:bzip2
The default version not being compatible with a python ports python version spec shouldn't cause bulk to fail, the latest compatible Python port should be used. If this needs to be done in python.mk please let us know, otherwise, we can create a relevent bug report for the tooling in question that needs to handle this and other cases.
Setting BUILD_ALL_PYTHON_FLAVORS=yes should fix the issue, but this is overkill. Maybe we should introduce a new variable, something like BUILD_ALSO_PREV_PYTHON_FLAVOR, to build the default flavor and the previous one?
(In reply to Thierry Thomas from comment #4) I think that most ports mentionned in comment #1 could be fixed, for instance: - sysutils/py-salt version 3004 works fine with python 3.9, contrary to what the port Makefile claims - devel/py-aws-sam-translator does build fine with python 3.9 - devel/py-meliae was removed from a few linux distros (archlinux, debian..), maybe we should do the same We could also set USE_PYTHON=allflavors to a few ports if really needed but I would rather not do it
Is everything fixed?
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=f703d911d13c1f8142d12473a77a747a1c872407 commit f703d911d13c1f8142d12473a77a747a1c872407 Author: Antoine Brodin <antoine@FreeBSD.org> AuthorDate: 2022-02-27 08:31:16 +0000 Commit: Antoine Brodin <antoine@FreeBSD.org> CommitDate: 2022-02-27 08:31:16 +0000 devel/py-meliae: remove python flavor restriction - Remove python flavor restriciton - Set an expiration date - Fix brokenness condition PR: 261703 devel/py-meliae/Makefile | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
(In reply to VVD from comment #6) The exp-run is not started yet.
Some new failure logs: http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-bup-0.31.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-PySCeS-1.0.1.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/libsigrokdecode-0.5.3.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/pycharm-pro-2021.3.2.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/trellis-g20190422_3.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/intellij-ultimate-2021.3.2.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-levmar-0.2.3.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-pystan-2.19.0.0_1.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-symcxx-0.1.10.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-topologic-space-modeling-library-0.5.0.21.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-xonsh-0.7.9.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/uefi-edk2-qemu-i386-g20191122.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/uefi-edk2-qemu-x86_64-g20191122.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-02-27_08h38m12s/logs/errors/py39-word_cloud-1.5.0.log
(In reply to Antoine Brodin from comment #9) Can't resolve gohan05.nyi.freebsd.org - tried: local bind, 8.8.8.8, 1.1.1.1.
(In reply to VVD from comment #10) Try http://www.ipv6proxy.net/
(In reply to Antoine Brodin from comment #11) IPv6 only sites… $ drill -t AAAA gohan05.nyi.freebsd.org ;; ->>HEADER<<- opcode: QUERY, rcode: NOERROR, id: 13114 ;; flags: qr rd ra ; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;; gohan05.nyi.freebsd.org. IN AAAA ;; ANSWER SECTION: gohan05.nyi.freebsd.org. 3600 IN AAAA 2610:1c1:1:607e::16:15 ;; AUTHORITY SECTION: ;; ADDITIONAL SECTION: ;; Query time: 233 msec ;; SERVER: 127.0.0.1 ;; WHEN: Tue Mar 1 16:37:31 2022 ;; MSG SIZE rcvd: 69 $ drill -t A gohan05.nyi.freebsd.org ;; ->>HEADER<<- opcode: QUERY, rcode: NOERROR, id: 12992 ;; flags: qr rd ra ; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 0 ;; QUESTION SECTION: ;; gohan05.nyi.freebsd.org. IN A ;; ANSWER SECTION: ;; AUTHORITY SECTION: freebsd.org. 1390 IN SOA ns0.freebsd.org. hostmaster.freebsd.org. 2022030112 3600 900 1209600 3600 ;; ADDITIONAL SECTION: ;; Query time: 0 msec ;; SERVER: 127.0.0.1 ;; WHEN: Tue Mar 1 16:38:56 2022 ;; MSG SIZE rcvd: 103
I’ve just fixed textproc/py-wordcloud directly, without opening a PR.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=b6ac38cf27573d6d2037fcfffcdf7cffdd35f9a2 commit b6ac38cf27573d6d2037fcfffcdf7cffdd35f9a2 Author: Yuri Victorovich <yuri@FreeBSD.org> AuthorDate: 2022-03-28 17:51:50 +0000 Commit: Yuri Victorovich <yuri@FreeBSD.org> CommitDate: 2022-03-28 18:11:57 +0000 math/py-symcxx: Deprecate because the upstream repository was experimental and is now archived PR: 261703 Reported by: thierry@ MOVED | 1 + math/Makefile | 1 - math/py-symcxx/Makefile (gone) | 24 ------------------------ math/py-symcxx/distinfo (gone) | 3 --- math/py-symcxx/pkg-descr (gone) | 7 ------- 5 files changed, 1 insertion(+), 35 deletions(-)
Antoine, all the previously reported failures have been addressed. Could you please launch another exp-run?
Maybe skip 3.9 and update to 3.10? :-D
(In reply to Thierry Thomas from comment #15) Hello, Unfortunately, the ports tree regressed and exp-run does not start anymore. The problematic ports are: databases/py-carbon deskutils/py-taskw www/py-gandi.cli www/py-graphite-web I will switch those 4 ports to USES=python to be able to start the exp-run
Some new failure logs (after switching the 4 ports mentionned above to USES=python): http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-06-08_07h40m52s/logs/errors/surge-synthesizer-xt-lv2-1.0.1.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-06-08_07h40m52s/logs/errors/include-what-you-use-0.18.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-06-08_07h40m52s/logs/errors/py39-primme-3.2.1.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-06-08_07h40m52s/logs/errors/py39-MDAnalysis-0.19.2_2.log http://gohan05.nyi.freebsd.org/data/130amd64-default-foo/2022-06-08_07h40m52s/logs/errors/libpreludedb-5.2.0.log
(In reply to Antoine Brodin from comment #18) - audio/surge-synthesizer-xt-lv2 has been fixed in 7eb495bac17f - devel/include-what-you-use in ca7f5508eba0
(In reply to Thierry Thomas from comment #19) And math/py-primme has been fixed in 781943db1d6b.
Hello Antoine, All reported failures have been resolved.
(In reply to Thierry Thomas from comment #21) Those 4 ports still have to be fixed (either switched to USES=python or removed with the ports depending on them): databases/py-carbon deskutils/py-taskw www/py-gandi.cli www/py-graphite-web
$ grep ^USES databases/py-carbon deskutils/py-taskw www/py-gandi.cli www/py-graphite-web databases/py-carbon/Makefile:USES= python:3.5-3.8 deskutils/py-taskw/Makefile:USES= python:3.5-3.8 www/py-gandi.cli/Makefile:USES= python:3.6-3.8 www/py-graphite-web/Makefile:USES= cpe python:3.4-3.8 shebangfix Python-3.9 is not supported by these ports, what is the problem? Should we mark them explicitly BROKEN with Python-3.9? It would be redundant.
(In reply to Thierry Thomas from comment #23) The problem is that poudriere bulk -a doesn't start due to those ports. If you switch them to USES=python it starts (and they seem to build fine)
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=e7722d38757e4561a7a27d64001df978a03fca7b commit e7722d38757e4561a7a27d64001df978a03fca7b Author: Muhammad Moinur Rahman <bofh@FreeBSD.org> AuthorDate: 2022-06-25 21:10:28 +0000 Commit: Muhammad Moinur Rahman <bofh@FreeBSD.org> CommitDate: 2022-06-25 21:17:53 +0000 www/py-graphite-web: Mark BROKEN for python39 - Remove version-spec PR: 261703 Reported by: exp-run www/py-graphite-web/Makefile | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-)
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=45dc0ba0481317efb8a7b6e65d6942469b1746b2 commit 45dc0ba0481317efb8a7b6e65d6942469b1746b2 Author: Muhammad Moinur Rahman <bofh@FreeBSD.org> AuthorDate: 2022-06-25 21:16:43 +0000 Commit: Muhammad Moinur Rahman <bofh@FreeBSD.org> CommitDate: 2022-06-25 21:17:54 +0000 www/py-gandi.cli: Mark BROKEN for python39 - Remove version-spec PR: 261703 Reported by: exp-run www/py-gandi.cli/Makefile | 10 ++++++++-- 1 file changed, 8 insertions(+), 2 deletions(-)
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=82b534dccca2749a00192038fbaed1c53e761b2a commit 82b534dccca2749a00192038fbaed1c53e761b2a Author: Muhammad Moinur Rahman <bofh@FreeBSD.org> AuthorDate: 2022-06-25 21:12:34 +0000 Commit: Muhammad Moinur Rahman <bofh@FreeBSD.org> CommitDate: 2022-06-25 21:17:53 +0000 deskutils/py-taskw: Mark BROKEN for python39 - Remove version-spec PR: 261703 Reported by: exp-run deskutils/py-taskw/Makefile | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-)
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=06ae81597b621cb16e2529fa6cc189ed97350bf5 commit 06ae81597b621cb16e2529fa6cc189ed97350bf5 Author: Muhammad Moinur Rahman <bofh@FreeBSD.org> AuthorDate: 2022-06-25 20:43:41 +0000 Commit: Muhammad Moinur Rahman <bofh@FreeBSD.org> CommitDate: 2022-06-25 21:17:52 +0000 databases/py-carbon: Mark BROKEN for python39 - Remove version-spec PR: 261703 Reported by: exp-run databases/py-carbon/Makefile | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-)
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=c63392d91639c8db23dcf4c24c08179b582f50b0 commit c63392d91639c8db23dcf4c24c08179b582f50b0 Author: Muhammad Moinur Rahman <bofh@FreeBSD.org> AuthorDate: 2022-06-25 21:15:02 +0000 Commit: Muhammad Moinur Rahman <bofh@FreeBSD.org> CommitDate: 2022-06-25 21:17:54 +0000 deskutils/py-bugwarrior: Mark BROKEN for python39 - Remove version-spec PR: 261703 Reported by: exp-run deskutils/py-bugwarrior/Makefile | 4 ++++ 1 file changed, 4 insertions(+)
(In reply to Thierry Thomas from comment #21) This looks fine now.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=f117f2c48552792743a74a931a49e76fc4a9c0f7 commit f117f2c48552792743a74a931a49e76fc4a9c0f7 Author: VVD <vvd@unislabs.com> AuthorDate: 2022-06-26 20:31:43 +0000 Commit: Thierry Thomas <thierry@FreeBSD.org> CommitDate: 2022-06-26 20:31:43 +0000 Mk/bsd.default-versions.mk: Switch default Python version to 3.9 PR: 261703 Reported by: VVD Tested by: exp-run by antoin@ Approved by: maintainer’s time-out Mk/Uses/python.mk | 4 ++-- Mk/bsd.default-versions.mk | 4 ++-- UPDATING | 33 +++++++++++++++++++++++++++++++++ 3 files changed, 37 insertions(+), 4 deletions(-)
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/ports/commit/?id=ad2d6b8e488819a85ade85ecbf1fc16db82b49b9 commit ad2d6b8e488819a85ade85ecbf1fc16db82b49b9 Author: Thierry Thomas <thierry@FreeBSD.org> AuthorDate: 2022-06-26 20:36:53 +0000 Commit: Thierry Thomas <thierry@FreeBSD.org> CommitDate: 2022-06-26 20:36:53 +0000 Mk/bsd.default-versions.mk: chase the switch to Python 3.9 Following the rules of <https://wiki.freebsd.org/Python#Steps_to_switch_the_Python_default_version> PR: 261703 devel/py-setuptools/Makefile | 1 + lang/cython/Makefile | 1 + math/py-numpy/Makefile | 1 + 3 files changed, 3 insertions(+)
Just committed!