Bug 241435

Summary: cap_dns & cap_net test fails in CI
Product: Base System Reporter: Kyle Evans <kevans>
Component: testsAssignee: freebsd-testing (Nobody) <testing>
Status: Closed FIXED    
Severity: Affects Only Me CC: emaste, lwhsu, markj, oshogbo
Priority: ---    
Version: CURRENT   
Hardware: Any   
OS: Any   

Description Kyle Evans freebsd_committer freebsd_triage 2019-10-23 13:10:58 UTC
(Connected to the build as of r353911)

Presumably our CI setup doesn't have much in the way of functional network in the -test jobs, so 12/91 tests consistently fail[0].

[0] https://ci.freebsd.org/job/FreeBSD-head-amd64-test/13009/testReport/lib.libcasper.services.cap_dns/dns_test/main/
Comment 1 Li-Wen Hsu freebsd_committer freebsd_triage 2019-10-24 10:56:47 UTC
Temporarily disable cap_dns before having VM networking

https://github.com/freebsd/freebsd-ci/commit/95c829cd8175074f4f3779de1daeba66bc21aaf4
Comment 2 Mark Johnston freebsd_committer freebsd_triage 2020-07-11 17:22:51 UTC
(In reply to Li-Wen Hsu from comment #1)
Do we still have the same limitation with respect to network configuration?
Comment 3 Li-Wen Hsu freebsd_committer freebsd_triage 2020-07-13 19:31:13 UTC
(In reply to Mark Johnston from comment #2)
Currently yes, I'll work on enabling networking for the testing VM.

BTW, it would be worth to modify the test and mark them require public networking, and skip if unavailable.
Comment 4 Li-Wen Hsu freebsd_committer freebsd_triage 2020-08-20 21:51:31 UTC
cap_net tests also need internet access.
Comment 5 Li-Wen Hsu freebsd_committer freebsd_triage 2020-08-20 22:20:29 UTC
Temporarily disable cap_net tests before having VM networking

https://github.com/freebsd/freebsd-ci/commit/103a89c77ba3d4afd0a69b33c071826c898a31d8
Comment 6 Mark Johnston freebsd_committer freebsd_triage 2024-11-02 16:43:19 UTC
I reworked these tests to skip when internet access is not available.  I think that's the best we can do without rewriting them.