runtime: TestGdbBacktrace failures #58698

gopherbot · 2023-02-24T16:35:15Z

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace" && (`No child processes` || `No such process`)

Issue created automatically to collect these failures.

Example (log):

--- FAIL: TestGdbBacktrace (2323.65s)
    runtime-gdb_test.go:83: gdb version 10.1
    runtime-gdb_test.go:468: GDB command timed out after 38m43.017693938s: /usr/bin/gdb -nx -batch -iex add-auto-load-safe-path /workdir/go/src/runtime -ex set startup-with-shell off -ex break main.eee -ex run -ex backtrace -ex continue /workdir/tmp/TestGdbBacktrace2238907183/001/a.exe
    runtime-gdb_test.go:473: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x80a2830: file /workdir/tmp/TestGdbBacktrace2238907183/001/main.go, line 17.
        [New LWP 532860]
        [New LWP 532862]
        [New LWP 532864]
        [New LWP 532865]

        Thread 1 "a.exe" hit Breakpoint 1, main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:17
        17	func eee() bool { return true }
        #0  main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:17
        #1  0x080a280f in main.ddd (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:14
        #2  0x080a27da in main.ccc (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:11
        #3  0x080a27aa in main.bbb (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:8
        #4  0x080a277a in main.aaa (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:5
        #5  0x080a286a in main.main () at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:22
        waiting for new child: No child processes.
    runtime-gdb_test.go:488: gdb exited with error: signal: killed

— watchflakes

The text was updated successfully, but these errors were encountered:

gopherbot · 2023-02-24T16:37:48Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace"

2023-02-13 19:42 linux-386-longtest go@0b922bfa runtime.TestGdbBacktrace (log)

--- FAIL: TestGdbBacktrace (2323.65s)
    runtime-gdb_test.go:83: gdb version 10.1
    runtime-gdb_test.go:468: GDB command timed out after 38m43.017693938s: /usr/bin/gdb -nx -batch -iex add-auto-load-safe-path /workdir/go/src/runtime -ex set startup-with-shell off -ex break main.eee -ex run -ex backtrace -ex continue /workdir/tmp/TestGdbBacktrace2238907183/001/a.exe
    runtime-gdb_test.go:473: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x80a2830: file /workdir/tmp/TestGdbBacktrace2238907183/001/main.go, line 17.
        [New LWP 532860]
        [New LWP 532862]
        [New LWP 532864]
        [New LWP 532865]

        Thread 1 "a.exe" hit Breakpoint 1, main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:17
        17	func eee() bool { return true }
        #0  main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:17
        #1  0x080a280f in main.ddd (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:14
        #2  0x080a27da in main.ccc (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:11
        #3  0x080a27aa in main.bbb (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:8
        #4  0x080a277a in main.aaa (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:5
        #5  0x080a286a in main.main () at /workdir/tmp/TestGdbBacktrace2238907183/001/main.go:22
        waiting for new child: No child processes.
    runtime-gdb_test.go:488: gdb exited with error: signal: killed

— watchflakes

mknyszek · 2023-03-01T20:18:59Z

In triage, best guess is that this is just a "GDB tests are sometimes flaky" but we'll wait on more failures.

Than and Cherry note that the GDB version isn't very old.

gopherbot · 2023-03-16T20:11:06Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace"

2023-03-16 19:44 linux-arm64 go@19281498 runtime.TestGdbBacktrace (log)

--- FAIL: TestGdbBacktrace (0.33s)
    runtime-gdb_test.go:81: gdb version 10.1
    runtime-gdb_test.go:471: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x64e84: file /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go, line 17.
        [New LWP 180945]
        [New LWP 180946]
        [New LWP 180947]

        Thread 1 "a.exe" hit Breakpoint 1, 0x0000000000064e84 in main.eee (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:17
        17	func eee() bool { return true }
        #0  0x0000000000064e84 in main.eee (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:17
        #1  0x0000000000064e68 in main.ddd (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:14
        #2  0x0000000000064e1c in main.ccc (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:11
        #3  0x0000000000064ddc in main.bbb (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:8
        #4  0x0000000000064d9c in main.aaa (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:5
        #5  0x0000000000064eac in main.main () at /tmp/workdir/tmp/TestGdbBacktrace2506571992/001/main.go:22
        Unable to fetch general registers.: No such process.
        [LWP 180947 exited]
        [LWP 180945 exited]
        [LWP 180940 exited]
    runtime-gdb_test.go:486: gdb exited with error: exit status 1

— watchflakes

gopherbot · 2023-03-16T20:42:58Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace"

2023-03-16 19:51 linux-arm64-boringcrypto go@e91876f4 runtime.TestGdbBacktrace (log)

--- FAIL: TestGdbBacktrace (0.28s)
    runtime-gdb_test.go:81: gdb version 10.1
    runtime-gdb_test.go:471: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x64e84: file /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go, line 17.
        [New LWP 188825]
        [New LWP 188826]
        [New LWP 188827]

        Thread 1 "a.exe" hit Breakpoint 1, 0x0000000000064e84 in main.eee (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:17
        17	func eee() bool { return true }
        #0  0x0000000000064e84 in main.eee (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:17
        #1  0x0000000000064e68 in main.ddd (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:14
        #2  0x0000000000064e1c in main.ccc (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:11
        #3  0x0000000000064ddc in main.bbb (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:8
        #4  0x0000000000064d9c in main.aaa (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:5
        #5  0x0000000000064eac in main.main () at /tmp/workdir/tmp/TestGdbBacktrace4270477819/001/main.go:22
        Unable to fetch general registers.: No such process.
        [LWP 188827 exited]
        [LWP 188825 exited]
        [LWP 188822 exited]
    runtime-gdb_test.go:486: gdb exited with error: exit status 1

— watchflakes

gopherbot · 2023-03-30T19:30:01Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace"

2023-03-30 18:50 linux-amd64 go@8890c3a0 runtime.TestGdbBacktrace (log)

--- FAIL: TestGdbBacktrace (148.14s)
    runtime-gdb_test.go:81: gdb version 10.1
    runtime-gdb_test.go:466: GDB command timed out after 2m27.709563668s: /usr/bin/gdb -nx -batch -iex add-auto-load-safe-path /workdir/go/src/runtime -ex set startup-with-shell off -ex break main.eee -ex run -ex backtrace -ex continue /workdir/tmp/TestGdbBacktrace732529650/001/a.exe
    runtime-gdb_test.go:471: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x455180: file /workdir/tmp/TestGdbBacktrace732529650/001/main.go, line 17.
        [New LWP 69987]
        [New LWP 69988]
        [New LWP 69989]

        Thread 1 "a.exe" hit Breakpoint 1, main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:17
        17	func eee() bool { return true }
        #0  main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:17
        #1  0x0000000000455176 in main.ddd (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:14
        #2  0x000000000045514f in main.ccc (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:11
        #3  0x000000000045512f in main.bbb (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:8
        #4  0x000000000045510f in main.aaa (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:5
        #5  0x00000000004551af in main.main () at /workdir/tmp/TestGdbBacktrace732529650/001/main.go:22
        waiting for new child: No child processes.
    runtime-gdb_test.go:486: gdb exited with error: signal: killed

— watchflakes

bcmills · 2023-04-06T12:52:34Z

https://storage.googleapis.com/go-build-log/c6e62ba1/linux-arm64_2690be7d.log (a TryBot)

bcmills · 2023-04-06T12:58:10Z

In triage, best guess is that this is just a "GDB tests are sometimes flaky" but we'll wait on more failures.

Even if the problem is “GDB tests are sometimes flaky”, arguably they ought to skip in case of known failure modes.

(At the very least, there ought to be specific upstream issues we can refer to for the failures — if the problem is upstream and we don't report it, then it presumably won't ever get fixed.)

bcmills · 2023-04-06T16:14:41Z

https://storage.googleapis.com/go-build-log/644a8c08/linux-arm64_6b8f2dc0.log (another TryBot)

gopherbot · 2023-05-04T21:09:53Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace" && (`No child processes` || `No such process`)

2023-05-04 17:01 linux-arm64 go@8337ca09 runtime.TestGdbBacktrace (log)

--- FAIL: TestGdbBacktrace (0.27s)
    runtime-gdb_test.go:81: gdb version 10.1
    runtime-gdb_test.go:471: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x66464: file /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go, line 17.
        [New LWP 193720]
        [New LWP 193721]
        [New LWP 193722]

        Thread 1 "a.exe" hit Breakpoint 1, 0x0000000000066464 in main.eee (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:17
        17	func eee() bool { return true }
        #0  0x0000000000066464 in main.eee (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:17
        #1  0x0000000000066448 in main.ddd (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:14
        #2  0x00000000000663fc in main.ccc (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:11
        #3  0x00000000000663bc in main.bbb (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:8
        #4  0x000000000006637c in main.aaa (~r0=<optimized out>) at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:5
        #5  0x000000000006648c in main.main () at /tmp/workdir/tmp/TestGdbBacktrace3646086843/001/main.go:22
        Unable to fetch general registers.: No such process.
        [LWP 193722 exited]
        [LWP 193720 exited]
        [LWP 193717 exited]
    runtime-gdb_test.go:486: gdb exited with error: exit status 1

— watchflakes

bcmills · 2023-06-01T14:33:19Z

https://storage.googleapis.com/go-build-log/d8316abe/linux-amd64-longtest_5f06b423.log (a SlowBot on CL 499855)

bcmills · 2023-06-01T14:36:23Z

@golang/runtime, could someone please at least update the skips for this test?

If the problem is “GDB is flaky” we shouldn't be annoying Go developers (and Go users who run go test all as they should!) with ongoing test flakes that aren't actionable.

gopherbot · 2023-06-01T16:36:55Z

Change https://go.dev/cl/499975 mentions this issue: runtime: update skips for TestGdbBacktrace

gopherbot · 2023-06-05T17:25:29Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime" && test == "TestGdbBacktrace" && (`No child processes` || `No such process`)

2023-06-05 16:41 linux-ppc64le-power10osu go@587c1c19 runtime.TestGdbBacktrace (log)

--- FAIL: TestGdbBacktrace (0.66s)
    runtime-gdb_test.go:81: gdb version 12.1
    runtime-gdb_test.go:471: gdb output:
        Loading Go Runtime support.
        Breakpoint 1 at 0x6c964: file /workdir/tmp/TestGdbBacktrace3086457048/001/main.go, line 17.
        [New LWP 48184]
        [New LWP 48185]
        [New LWP 48188]
        [New LWP 48191]

        Thread 1 "a.exe" hit Breakpoint 1, 0x000000000006c964 in main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:17
        17	func eee() bool { return true }
        #0  0x000000000006c964 in main.eee (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:17
        #1  0x000000000006c944 in main.ddd (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:14
        #2  0x000000000006c8f4 in main.ccc (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:11
        #3  0x000000000006c8b4 in main.bbb (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:8
        #4  0x000000000006c874 in main.aaa (~r0=<optimized out>) at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:5
        #5  0x000000000006c994 in main.main () at /workdir/tmp/TestGdbBacktrace3086457048/001/main.go:22
        reading register pc (#64): No such process.
        [LWP 48191 exited]
        [LWP 48185 exited]
        [LWP 48184 exited]
        [LWP 48181 exited]
    runtime-gdb_test.go:488: gdb exited with error: exit status 1

— watchflakes

gopherbot · 2023-06-05T18:02:07Z

Change https://go.dev/cl/500959 mentions this issue: runtime: skip another GDB "no such process" case

gopherbot added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. compiler/runtime Issues related to the Go compiler and/or runtime. labels Feb 24, 2023

mknyszek added the WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. label Mar 1, 2023

mknyszek added this to the Backlog milestone Mar 1, 2023

bcmills mentioned this issue Apr 6, 2023

runtime: move tests for runtime-gdb.py to a separate package and do not run them during all.bash #39204

Open

bcmills removed the WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. label Apr 11, 2023

gopherbot closed this as completed in d045976 Jun 1, 2023

gopherbot reopened this Jun 5, 2023

gopherbot closed this as completed in 1b9c721 Jun 5, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

runtime: TestGdbBacktrace failures #58698

runtime: TestGdbBacktrace failures #58698

gopherbot commented Feb 24, 2023 •

edited by bcmills

gopherbot commented Feb 24, 2023

mknyszek commented Mar 1, 2023

gopherbot commented Mar 16, 2023

gopherbot commented Mar 16, 2023

gopherbot commented Mar 30, 2023

bcmills commented Apr 6, 2023

bcmills commented Apr 6, 2023

bcmills commented Apr 6, 2023

gopherbot commented May 4, 2023

bcmills commented Jun 1, 2023

bcmills commented Jun 1, 2023

gopherbot commented Jun 1, 2023

gopherbot commented Jun 5, 2023

gopherbot commented Jun 5, 2023

runtime: TestGdbBacktrace failures #58698

runtime: TestGdbBacktrace failures #58698

Comments

gopherbot commented Feb 24, 2023 • edited by bcmills

gopherbot commented Feb 24, 2023

mknyszek commented Mar 1, 2023

gopherbot commented Mar 16, 2023

gopherbot commented Mar 16, 2023

gopherbot commented Mar 30, 2023

bcmills commented Apr 6, 2023

bcmills commented Apr 6, 2023

bcmills commented Apr 6, 2023

gopherbot commented May 4, 2023

bcmills commented Jun 1, 2023

bcmills commented Jun 1, 2023

gopherbot commented Jun 1, 2023

gopherbot commented Jun 5, 2023

gopherbot commented Jun 5, 2023

gopherbot commented Feb 24, 2023 •

edited by bcmills