Bug 242303 - GCE 11.3-RELEASE image doesn't have right dependency of google-compute-engine installed
Summary: GCE 11.3-RELEASE image doesn't have right dependency of google-compute-engine...
Status: Open
Alias: None
Product: Base System
Classification: Unclassified
Component: misc (show other bugs)
Version: 11.3-RELEASE
Hardware: Any Any
: --- Affects Only Me
Assignee: freebsd-bugs mailing list
URL:
Keywords: regression
Depends on:
Blocks:
 
Reported: 2019-11-29 21:08 UTC by Li-Wen Hsu
Modified: 2019-12-07 07:59 UTC (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Li-Wen Hsu freebsd_committer 2019-11-29 21:08:57 UTC
It is reported that Cirrus-CI cannot provision 11.3-RELEASE instance on GCE.

From the boot log of 11.3-RELEASE on GCE provided by kibab@:
https://pastebin.com/G01MgN0y

The line:

```
pkg_resources.DistributionNotFound: The 'boto' distribution was not found and is required by google-compute-engine
```

Shows that Python module boto is not installed and cause GCE agent can not execute correctly.

From sbz@ (and edited by me):
After looking at the ports source, ports commit r501581 removed py-boto from RUN_DEPENDS and added back in r502800.

But tags/RELEASE_11_3_0 only contains r501581:

https://svnweb.freebsd.org/ports/tags/RELEASE_11_3_0/sysutils/py-google-compute-engine/Makefile?view=log

I suggest we build a new 11.3-RELEASE image with correct dependency and upload to GCE. It would be best to keep the same name of `freebsd-11-3-release-amd64` for not increasing the complexity of the configuration of the downstream users.

Thanks for kibab@ and sbz@ test and analyze the problem.
Comment 1 Glen Barber freebsd_committer 2019-12-03 17:02:09 UTC
Unfortunatley, we cannot just "go and re-roll a new 11.3-RELEASE for GCE", as there are third-party validations that need to be run, and changing the version of the port on the image changes reproducibility.

As the validation for the GCE marketplace did succeed (otherwise it would not be in the marketplace), it is adviced to either upgrade to 12.0 or use the 11.3-STABLE snapshots.
Comment 2 Ed Maste freebsd_committer 2019-12-05 18:19:47 UTC
Reopening, because the issue is not solved. The current image does not work so even if we can't re-spin it we need to address it in some way.
Comment 3 Ed Maste freebsd_committer 2019-12-05 18:47:56 UTC
The failure can be reproduced via the GCP web UI. Create a new FreeBSD 11.3 instance, then click the connect by SSH button.

Observe

> Connecting...
> Transferring SSH keys to the VM.

for quite some time, three retries, and eventually it times out.
Comment 4 Ed Maste freebsd_committer 2019-12-05 19:11:21 UTC
Downstream bug that's a result of the broken image: https://github.com/cirruslabs/cirrus-ci-docs/issues/359
Comment 5 commit-hook freebsd_committer 2019-12-06 21:20:44 UTC
A commit references this bug:

Author: gjb
Date: Fri Dec  6 21:20:32 UTC 2019
New revision: 355463
URL: https://svnweb.freebsd.org/changeset/base/355463

Log:
  Document the 11.3-RELEASE images in GCE do not work, and provide
  information regarding alternative solutions.

  PR:		242303 (related)
  Sponsored by:	Rubicon Communications, LLC (netgate.com)

Changes:
  stable/11/release/doc/en_US.ISO8859-1/errata/article.xml
Comment 6 Ilya Bakulin freebsd_committer 2019-12-07 07:59:22 UTC
Are there so many changes between 11.3-RELEASE and whatever the first 11-stable snapshot that works? Maybe we are solving the problem that can be workarounded by using 11-stable? To date, we know about Cirrus-CI problem, and that is it. Most users will be probably happier with 12-RELEASE anyway.
My suggestion will be:
1) Delete 11.3-RELEASE from GCP entirely;
2) Direct Cirrus to use 11-stable for their setup;
3) Acknowledge that 11.3-RELEASE is not available on GCP. An errata notice (already committed) should be enough.