Bug 239292 - Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger
Summary: Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unr...
Status: Closed FIXED
Alias: None
Product: Base System
Classification: Unclassified
Component: tests (show other bugs)
Version: CURRENT
Hardware: Any Any
: --- Affects Only Me
Assignee: Li-Wen Hsu
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-07-19 05:35 UTC by Li-Wen Hsu
Modified: 2024-11-25 13:48 UTC (History)
2 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Li-Wen Hsu freebsd_committer freebsd_triage 2019-07-19 05:35:34 UTC 
sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger starts unstable since Jun:

https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11408/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11539/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11567/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11632/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11736/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11819/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11896/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/
https://ci.freebsd.org/job/FreeBSD-head-amd64-test/11899/testReport/junit/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/

https://ci.freebsd.org/job/FreeBSD-head-i386-test/6033/testReport/sys.kern/ptrace_test/ptrace__follow_fork_child_detached_unrelated_debugger/

---

Error Message
/usr/src/tests/sys/kern/ptrace_test.c:567: WIFSTOPPED(status) not met
Standard Error
Test case metadata
------------------

allowed_architectures is empty
allowed_platforms is empty
description is empty
has_cleanup = false
is_exclusive = false
required_configs is empty
required_disk_space = 0
required_files is empty
required_memory = 0
required_programs is empty
required_user is empty
timeout = 300

Timing information
------------------

Start time: 2019-06-24T18:52:34.850499Z
End time:   2019-06-24T18:52:34.857713Z
Duration:   0.007s

Original stderr
---------------

/usr/src/tests/sys/kern/ptrace_test.c:787: read(cpipe[1], &fpid, sizeof(fpid)) == 0 not met
Comment 1 commit-hook freebsd_committer freebsd_triage 2019-07-22 10:38:41 UTC 
A commit references this bug:

Author: lwhsu
Date: Mon Jul 22 10:37:57 UTC 2019
New revision: 350211
URL: https://svnweb.freebsd.org/changeset/base/350211

Log:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger

  PR:		239292
  Sponsored by:	The FreeBSD Foundation

Changes:
  head/tests/sys/kern/ptrace_test.c
Comment 2 commit-hook freebsd_committer freebsd_triage 2019-10-25 21:52:08 UTC 
A commit references this bug:

Author: lwhsu
Date: Fri Oct 25 21:52:02 UTC 2019
New revision: 354105
URL: https://svnweb.freebsd.org/changeset/base/354105

Log:
  MFC r350211, r350220, r350235, r350238-r350239, r350295, r350512, r350700, r352219

  r350211:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger

  PR:		239292
  Sponsored by:	The FreeBSD Foundation

  r350220:
  Fix URL.

  Sponsored by:	The FreeBSD Foundation

  r350235:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop

  PR:		220841
  Sponsored by:	The FreeBSD Foundation

  r350238:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger

  PR:		239397
  Sponsored by:	The FreeBSD Foundation

  r350239:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger

  PR:		239399
  Sponsored by:	The FreeBSD Foundation

  r350295:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger

  PR:		239425
  Sponsored by:	The FreeBSD Foundation

  r350512:
  Only skip test cases sometimes failing in CI when they are running in CI

  Suggested by:	jhb
  Sponsored by:	The FreeBSD Foundation

  r350700:
  Get configuration variable with default value for not breaking default setting

  Reported by:	markj
  Sponsored by:	The FreeBSD Foundation

  r352219:
  Temporarily skip flakey test case sys.kern.ptrace_test.ptrace__getppid

  PR:		240510
  Sponsored by:	The FreeBSD Foundation

Changes:
_U  stable/12/
  stable/12/tests/sys/kern/ptrace_test.c
Comment 3 commit-hook freebsd_committer freebsd_triage 2019-10-28 13:07:02 UTC 
A commit references this bug:

Author: lwhsu
Date: Mon Oct 28 13:06:01 UTC 2019
New revision: 354134
URL: https://svnweb.freebsd.org/changeset/base/354134

Log:
  MFC r350211, r350220, r350235, r350238-r350239, r350295, r350512, r350700, r352219

  r350211:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger

  PR:		239292
  Sponsored by:	The FreeBSD Foundation

  r350220:
  Fix URL.

  Sponsored by:	The FreeBSD Foundation

  r350235:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop

  PR:		220841
  Sponsored by:	The FreeBSD Foundation

  r350238:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger

  PR:		239397
  Sponsored by:	The FreeBSD Foundation

  r350239:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger

  PR:		239399
  Sponsored by:	The FreeBSD Foundation

  r350295:
  Temporarily skip flakey test case
  sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger

  PR:		239425
  Sponsored by:	The FreeBSD Foundation

  r350512:
  Only skip test cases sometimes failing in CI when they are running in CI

  Suggested by:	jhb
  Sponsored by:	The FreeBSD Foundation

  r350700:
  Get configuration variable with default value for not breaking default setting

  Reported by:	markj
  Sponsored by:	The FreeBSD Foundation

  r352219:
  Temporarily skip flakey test case sys.kern.ptrace_test.ptrace__getppid

  PR:		240510
  Sponsored by:	The FreeBSD Foundation

Changes:
_U  stable/11/
  stable/11/tests/sys/kern/ptrace_test.c
Comment 4 Ed Maste freebsd_committer freebsd_triage 2024-11-25 13:48:10 UTC 
The referenced commit is not a fix - it is only skipping the flaky test. The skips were removed by the commit referenced below (it seems this PR was unintentionally omitted).

Author:     Alex Richardson <arichardson@FreeBSD.org>
AuthorDate: Mon Mar 1 18:51:02 2021 +0000
Commit:     Alex Richardson <arichardson@FreeBSD.org>
CommitDate: Mon Mar 1 19:56:05 2021 +0000

    Remove atf_tc_skip calls from ptrace_test

    I've run these tests many times in a loop on multiple architectures and
    it works reliably for me, maybe it's time to retire these skips?
    This also adds an additional waitpid to one of the tests to avoid
    a potential race condition (suggested by markj@).
        
    PR:             239397, 244056, 239425, 240510, 220841, 243605
    Reviewed By:    markj
    Differential Revision: https://reviews.freebsd.org/D28888