Bug 241435 - cap_dns & cap_net test fails in CI
Summary: cap_dns & cap_net test fails in CI
Status: Closed FIXED
Alias: None
Product: Base System
Classification: Unclassified
Component: tests (show other bugs)
Version: CURRENT
Hardware: Any Any
: --- Affects Only Me
Assignee: freebsd-testing (Nobody)
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-10-23 13:10 UTC by Kyle Evans
Modified: 2024-11-02 16:43 UTC (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Kyle Evans freebsd_committer freebsd_triage 2019-10-23 13:10:58 UTC 
(Connected to the build as of r353911)

Presumably our CI setup doesn't have much in the way of functional network in the -test jobs, so 12/91 tests consistently fail[0].

[0] https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13009/testReport/lib.libcasper.services.cap_dns/dns_test/main/
Comment 1 Li-Wen Hsu freebsd_committer freebsd_triage 2019-10-24 10:56:47 UTC 
Temporarily disable cap_dns before having VM networking

https://github.com/freebsd/freebsd-ci/commit/95c829cd8175074f4f3779de1daeba66bc21aaf4
Comment 2 Mark Johnston freebsd_committer freebsd_triage 2020-07-11 17:22:51 UTC 
(In reply to Li-Wen Hsu from comment #1)
Do we still have the same limitation with respect to network configuration?
Comment 3 Li-Wen Hsu freebsd_committer freebsd_triage 2020-07-13 19:31:13 UTC 
(In reply to Mark Johnston from comment #2)
Currently yes, I'll work on enabling networking for the testing VM.

BTW, it would be worth to modify the test and mark them require public networking, and skip if unavailable.
Comment 4 Li-Wen Hsu freebsd_committer freebsd_triage 2020-08-20 21:51:31 UTC 
cap_net tests also need internet access.
Comment 5 Li-Wen Hsu freebsd_committer freebsd_triage 2020-08-20 22:20:29 UTC 
Temporarily disable cap_net tests before having VM networking

https://github.com/freebsd/freebsd-ci/commit/103a89c77ba3d4afd0a69b33c071826c898a31d8
Comment 6 Mark Johnston freebsd_committer freebsd_triage 2024-11-02 16:43:19 UTC 
I reworked these tests to skip when internet access is not available.  I think that's the best we can do without rewriting them.