Bug 275906 - FreeBSD/amd64 main@51e7276365ba does not run on AWS
Summary: FreeBSD/amd64 main@51e7276365ba does not run on AWS
Status: Closed FIXED
Alias: None
Product: Base System
Classification: Unclassified
Component: misc (show other bugs)
Version: 15.0-CURRENT
Hardware: amd64 Any
: --- Affects Only Me
Assignee: Roger Pau Monné
URL:
Keywords: regression
Depends on:
Blocks:
 
Reported: 2023-12-24 03:33 UTC by Benson Muite
Modified: 2024-02-28 07:48 UTC (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Benson Muite 2023-12-24 03:33:38 UTC
FreeBSD 15.0-CURRENT-amd64-20231130 UEFI-PREFERRED cloud-init ZFS ami-03df2931843b8541c  launches but then is immediately shutdown on AWS and so cannot be used. This is in US East 1. Older AMIs work fine.
Comment 1 Benson Muite 2023-12-24 03:39:50 UTC
FreeBSD 15.0-CURRENT-amd64-20230907 UEFI-PREFERRED UFS
ami-092f080286f6cfa09 works fine on a T2 medium instance with 20Gb storage.
Comment 2 Mark Johnston freebsd_committer freebsd_triage 2024-01-21 16:21:46 UTC
I can reproduce this with the "FreeBSD 15.0-CURRENT-amd64-20240118 UEFI-PREFERRED base ZFS" AMI in a t2.medium.  The instance just ends up terminated after I launch it.

No such problem with the otherwise identical arm64 image in a t4g.large instance.  I can't view the serial console of a t2.medium so it's hard to tell what's going wrong there. A t3.medium instance with the amd64 image, which does have a serial console, boots fine.
Comment 3 Colin Percival freebsd_committer freebsd_triage 2024-01-21 18:57:56 UTC
The biggest difference between T2 and T3 is that T2 instances run Xen/HVM, so I'm guessing something broke there.

Roger, are you aware of any recent changes in our Xen code which could cause problems?
Comment 4 Roger Pau Monné freebsd_committer freebsd_triage 2024-01-21 20:07:00 UTC
Hello,

The 20231130 images and later are broken due to c7368ccb6801, however my attempt to fix this in b0165dc4539f is not complete, and seems to cause issues on older hypervisor versions or different configurations (see also PR 276421). I will look into it first thing tomorrow morning.  Sorry for the mess.
Comment 5 Colin Percival freebsd_committer freebsd_triage 2024-01-21 22:42:40 UTC
Thanks!  I just added t2.medium to my weekly snapshot testing (I was only testing the newer Nitro instances until now) and I can confirm that HEAD is broken but stable/13 and stable/14 seem fine.  So as long as you get this fixed before any Xen changes get MFCed, I'm not worried. :-)
Comment 6 Roger Pau Monné freebsd_committer freebsd_triage 2024-02-06 10:21:02 UTC
I've pushed the changes to:

https://xenbits.xen.org/gitweb/?p=people/royger/freebsd.git;a=shortlog;h=refs/heads/pvh-hvm-unify

If anyone wants to give a try.
Comment 7 Benson Muite 2024-02-28 07:48:27 UTC
Thanks for fixing this.