New builds of stable/13, stable/12, and current used to appear in Google Cloud about once per week. But the latest builds all date from 13-April-2023. The situation just became urgent because of the OpenSSL 3.0 upgrade on 14.0-CURRENT. The official packages now all require libssl-3, which isn't present in the gcloud images. As a result, the 14.0-CURRENT images in gcloud are basically useless. Does some script need to be kicked? To see the currently available images, do: pkg install google-cloud-sdk gcloud compute images list --project freebsd-org-cloud-dev --no-standard-images
Thank you for the report. It's actually a problem with python27 versus python28 that went unnoticed. I will have this resolved for the next snapshot builds for this week. Note: stable/12 snapshot builds are no longer produced.
Should be fixed now for the next snapshot builds. Was an easier fix than I originally anticipated.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3f21d3e0babacabb9a32e0e9a8ab290025d5577c commit 3f21d3e0babacabb9a32e0e9a8ab290025d5577c Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-03 19:28:33 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-03 19:28:33 +0000 release: update GCE configuration for python3 Reported by: asomers PR: 272354 MFC after: 3 days Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd release/tools/gce.conf | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(In reply to Glen Barber from comment #2) Pending the MFC to stable branches, that is.
Thanks for fixing it!
MFC complete.
A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=32beaf6d4dc5c380545cb05c8684f330bb4770d6 commit 32beaf6d4dc5c380545cb05c8684f330bb4770d6 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-03 19:28:33 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-05 21:00:05 +0000 release: update GCE configuration for python3 Reported by: asomers PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd (cherry picked from commit 3f21d3e0babacabb9a32e0e9a8ab290025d5577c) release/tools/gce.conf | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
A commit in branch stable/12 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=afbcdd6e080f817ed51af42ac3e645584441abdc commit afbcdd6e080f817ed51af42ac3e645584441abdc Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-03 19:28:33 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-05 21:00:31 +0000 release: update GCE configuration for python3 Reported by: asomers PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd (cherry picked from commit 3f21d3e0babacabb9a32e0e9a8ab290025d5577c) release/tools/gce.conf | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
Reopening, as there is still a problem. root@releng1.nyi:/releng/scripts-snapshot/scripts # ls /releng/14-amd64-GENERIC-snap/usr/local/bin/python ls: /releng/14-amd64-GENERIC-snap/usr/local/bin/python: No such file or directory I will continue investigating this.
Do you need any help, Glen? I could try debugging the image build, if you tell me the command.
Yes, any extra eyes on this would be helpful. The commands are from /usr/src/release: # make obj # make WITH_CLOUDWARE=1 CLOUDWARE=GCE gce-do-package I am pulling out my hair trying to understand why lang/python and lang/python3 (both ports create symlinks) do not seem to get installed.
mv: rename gce.raw to disk.raw: No such file or directory How do I get this gce.raw file?
Hmm. Maybe you also need the 'cw-gce' target.
Where does cw-gce come from? I don't see any such target.
(In reply to Alan Somers from comment #14) Nevermind, I figured it out. I need to define WITH_CLOUDWARE=1.
Doh. sorry about that. :(
It worked for me. I was able to build gce-do-package and in the gce.img file there are both /usr/local/bin/python and /usr/local/bin/python3 symlinks.
What about the build environment thought? The python symlinks do not exist there in the build chroot, which is the part I do not understand. Sorry for the confusion here. If you want to reproduce it in a pristine environment, you can create a chroot and mount the relevant trees within (where /usr/local/bin/python does not exist): # make -C /usr/src DESTDIR=/scratch installworld distribution # mkdir -p /scratch/usr/src /scratch/usr/ports # mount -t nullfs /usr/src /scratch/usr/src # mount -t nullfs /usr/ports /scratch/usr/ports # mount -t devfs devfs /scratch/dev # cp /etc/resolv.conf /scratch/etc/resolv.conf # chroot /scratch/usr/src/release obj # chroot /scratch/usr/src/release WITH_CLOUDWARE=1 CLOUDWARE=GCE gce-do-package This is supposed to pull in lang/python and lang/python3 as part of the process for post-img building, where the gce.img itself is uploaded from the chroot (but gce-do-package does not invoke that target). Meaning, when the gce.img file is done being created, the chroot should contain /usr/local/bin/python{,3} symlinks.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=0ed426276fd52e917506ab87c05a61c6641ae298 commit 0ed426276fd52e917506ab87c05a61c6641ae298 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:08:40 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-12 20:08:40 +0000 release: ensure gce-check-depends installs lang/python{,3} PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd release/Makefile.gce | 2 ++ 1 file changed, 2 insertions(+)
I think I have figured it out, and have pushed an update (0ed426276fd52e917506ab87c05a61c6641ae298). I will triple-check it is correct shortly.
Sorry, in comment 18, s/gce-do-package/cw-gce/.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=cd8cad0ef5cd534dc7ae1dd9a470cac2057ed957 commit cd8cad0ef5cd534dc7ae1dd9a470cac2057ed957 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:49:53 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-12 20:49:53 +0000 release: follow-up to previous commit to install lang/python{,3} PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd release/Makefile.gce | 2 ++ 1 file changed, 2 insertions(+)
I just followed-up with another update to this change, which both now appear to be correct. The following 2 package(s) will be affected (of 0 checked): New packages to be INSTALLED: python: 3.9_3,2 python3: 3_3 Number of packages to be installed: 2 However, there is this... pkg: Cannot open dev/null In any case, it appears the net/google-cloud-sdk port is missing dependencies.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=510fd83138001b0a6e45b3fa6a7249377f806171 commit 510fd83138001b0a6e45b3fa6a7249377f806171 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:57:57 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-12 20:57:57 +0000 release: remove a stray backslash PR: 272354 (related) MFC after: 3 days MFC with: 0ed426276fd52e917506ab87c05a61c6641ae298 MFC with: cd8cad0ef5cd534dc7ae1dd9a470cac2057ed957 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd release/tools/gce.conf | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
Quick update. After re-examining the logs from last week's build, I noticed that the lang/python3 port *did* in fact get installed, and failed to register as it was installed as a dependency (correctly) because FORCE_PKG_REGISTER was not set. So behaviorally something did change in the right direction. I am testing another patch now to reduce the changes previously made, but at least some of the previous changes were correct to some point. I should have this fixed this afternoon and ready for this week's snapshot builds.
Ok, I've got it for real this time. Update to release/Makefile.gce incoming.
A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=b24c35b326dbd355070335e63d02e7c29ee58bf0 commit b24c35b326dbd355070335e63d02e7c29ee58bf0 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-17 20:16:46 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-17 20:16:46 +0000 release: adjust lang/python* dependencies for GCE The lang/python3 port had failed to properly install because it did in fact already exist and FORCE_PKG_REGISTER was not set. So, behaviorally everything here was correct. However, installing lang/python3 is in fact not correct and not needed, so only install the lang/python port to provide symbolic links. PR: 272354 MFC after: 3 days MFC with: 510fd83138001b0a6e45b3fa6a7249377f806171 MFC with: cd8cad0ef5cd534dc7ae1dd9a470cac2057ed957 MFC with: 0ed426276fd52e917506ab87c05a61c6641ae298 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd release/Makefile.gce | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-)
A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=af8d597af0c12d46e80467964144d255bee7756a commit af8d597af0c12d46e80467964144d255bee7756a Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:08:40 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:30:20 +0000 release: ensure gce-check-depends installs lang/python{,3} PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit 0ed426276fd52e917506ab87c05a61c6641ae298) release/Makefile.gce | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=119b44c2b2f0ea9141777fe6774e5f9a3d47a2d6 commit 119b44c2b2f0ea9141777fe6774e5f9a3d47a2d6 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:49:53 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:30:53 +0000 release: follow-up to previous commit to install lang/python{,3} PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit cd8cad0ef5cd534dc7ae1dd9a470cac2057ed957) release/Makefile.gce | 2 ++ 1 file changed, 2 insertions(+)
A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=ca7d3085f1f407df504ea7216c74526bef4727b4 commit ca7d3085f1f407df504ea7216c74526bef4727b4 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:57:57 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:31:22 +0000 release: remove a stray backslash PR: 272354 (related) Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit 510fd83138001b0a6e45b3fa6a7249377f806171) release/tools/gce.conf | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
A commit in branch stable/13 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3e94b6a238081a1178f2e6448cb9d91028784bf2 commit 3e94b6a238081a1178f2e6448cb9d91028784bf2 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-17 20:16:46 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:31:52 +0000 release: adjust lang/python* dependencies for GCE The lang/python3 port had failed to properly install because it did in fact already exist and FORCE_PKG_REGISTER was not set. So, behaviorally everything here was correct. However, installing lang/python3 is in fact not correct and not needed, so only install the lang/python port to provide symbolic links. PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit b24c35b326dbd355070335e63d02e7c29ee58bf0) release/Makefile.gce | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-)
A commit in branch stable/12 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=58bc084de5a2155f34ffbd5fd3812fb432e1a72e commit 58bc084de5a2155f34ffbd5fd3812fb432e1a72e Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-17 20:16:46 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:36:06 +0000 release: adjust lang/python* dependencies for GCE The lang/python3 port had failed to properly install because it did in fact already exist and FORCE_PKG_REGISTER was not set. So, behaviorally everything here was correct. However, installing lang/python3 is in fact not correct and not needed, so only install the lang/python port to provide symbolic links. PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit b24c35b326dbd355070335e63d02e7c29ee58bf0) release/Makefile.gce | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-)
A commit in branch stable/12 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=7815d3738acfeb85f71c0ad714b5262dea5b1d53 commit 7815d3738acfeb85f71c0ad714b5262dea5b1d53 Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:49:53 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:35:14 +0000 release: follow-up to previous commit to install lang/python{,3} PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit cd8cad0ef5cd534dc7ae1dd9a470cac2057ed957) release/Makefile.gce | 2 ++ 1 file changed, 2 insertions(+)
A commit in branch stable/12 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=e7ee4c09f7890f2cd8ed4a0ce27d56583d6ac74f commit e7ee4c09f7890f2cd8ed4a0ce27d56583d6ac74f Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:08:40 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:34:49 +0000 release: ensure gce-check-depends installs lang/python{,3} PR: 272354 Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit 0ed426276fd52e917506ab87c05a61c6641ae298) release/Makefile.gce | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
A commit in branch stable/12 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=ad6773477b566bb901a4fca31bcb004dc11b319f commit ad6773477b566bb901a4fca31bcb004dc11b319f Author: Glen Barber <gjb@FreeBSD.org> AuthorDate: 2023-07-12 20:57:57 +0000 Commit: Glen Barber <gjb@FreeBSD.org> CommitDate: 2023-07-20 01:35:39 +0000 release: remove a stray backslash PR: 272354 (related) Sponsored by: GoFundMe https://www.gofundme.com/f/gjbbsd Sponsored by: PayPal https://paypal.me/gjbbsd (cherry picked from commit 510fd83138001b0a6e45b3fa6a7249377f806171) release/tools/gce.conf | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
This should be all straightened out now. I will keep the PR open until the weekly snapshots have completed.
The 14.0-CURRENT GCE builds completed successfully. The 13.2-STABLE GCE builds failed, but for a reason unrelated to any of the recent changes in this PR. (It appears I have missed an MFC.) I'll work on the latter, after which I will close the PR. In the meantime, GCE builds for main should be available again. Thank you again for the report and thank you for your patience while the proper fix was diagnosed.
I see freebsd-14-0-current-amd64-v20230720. Thanks!
And Cirrus-CI runs using `image: family/freebsd-14-0-snap` are working again
Commits 1feb6f1cbe06, 9265ff1fe357, 638dd626370e, and a1e58f1f630f to stable/13 resolve the failure encountered this week, which effectively was a mismerge from main. Closing this PR as this should now be resolved. I hope to not have to re-open it.