Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

all: test failures on netbsd blocked on waiting for subprocesses #57999

Open
bcmills opened this issue Jan 25, 2023 · 162 comments
Open

all: test failures on netbsd blocked on waiting for subprocesses #57999

bcmills opened this issue Jan 25, 2023 · 162 comments
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-NetBSD
Milestone

Comments

@bcmills
Copy link
Contributor

bcmills commented Jan 25, 2023

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
@bcmills bcmills added OS-NetBSD NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Jan 25, 2023
@bcmills bcmills changed the title all: test failures on netbsd-386-9_3 blocked in os.wait6 all: test failures on netbsd-.*-9_3 blocked in os.wait6 Jan 25, 2023
@bcmills bcmills added this to the Backlog milestone Jan 25, 2023
@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*-9_3` && (`^\s*os\.wait6` || `DETECTED A HANGING GO COMMAND`)
2022-12-09 02:07 netbsd-386-9_3 tools@88ceb240 go@e738a2f1 x/tools/gopls/internal/regtest/completion (log)
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 10026): see golang/go#54461 for more details

goroutine 7949 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x94ba3c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8c938b8, 0xb4a5710}, 0x95523c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xa12ce08, {0x8c938b8, 0xb4a5710}, {0x8c8edac, 0xb49d4e8}, {0x8c8edac, 0xb49d500})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xa12ce08, {0x8c938b8, 0xb4a5710}, {0x8c8edac, 0xb49d4e8}, {0x8c8edac, 0xb49d500})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).PackagesForFile(0x981ae40, {0x8c93918, 0xb49d350}, {0xa85e1c0, 0x61}, 0x0, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:640 +0x14a
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0xa0a20a0, {0x8c93918, 0xb49d290}, {0x8c9865c, 0x981ae40}, {0xb51bbf0, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:197 +0x2b7
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0xa0a20a0, {0x8c9865c, 0x981ae40}, {0xb51bbf0, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:156 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8c9865c, 0x981ae40}, {0xb51bbf0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:136 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:134 +0x5c
2022-12-09 21:38 netbsd-386-9_3 go@e8f78cb6 cmd/go.TestScript (log)
vcs-test.golang.org rerouted to http://127.0.0.1:53798
https://vcs-test.golang.org rerouted to https://127.0.0.1:53797
go test proxy running at GOPROXY=http://127.0.0.1:53796/mod
panic: test timed out after 9m0s
running tests:
	TestScript (9m0s)
	TestScript/mod_get_upgrade (8m39s)

syscall.Syscall6(0x1, 0x704, 0x9907b1c, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x9907af4 sp=0x9907af0 pc=0x80c53d5
...
	/tmp/workdir/go/src/cmd/go/internal/script/engine.go:590 +0x2cc fp=0x9907c48 sp=0x9907bd0 pc=0x863437c
cmd/go/internal/script.(*Engine).Execute(0x9365020, 0x910abd0, {0x93d1870, 0x13}, 0x9907e54, {0x885913c, 0x95d0170})
	/tmp/workdir/go/src/cmd/go/internal/script/engine.go:292 +0x9bb fp=0x9907db0 sp=0x9907c48 pc=0x8631d4b
cmd/go/internal/script/scripttest.Run.func1({0x885d76c, 0x9559b30}, 0x910abd0, 0x9365020, {0x93d1870, 0x13}, {0x88583cc, 0x955a120})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:89 +0x4fd fp=0x9907e88 sp=0x9907db0 pc=0x86473dd
cmd/go/internal/script/scripttest.Run({0x885d76c, 0x9559b30}, 0x9365020, 0x910abd0, {0x93d1870, 0x13}, {0x88583cc, 0x955a120})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:90 +0x67 fp=0x9907ecc sp=0x9907e88 pc=0x8646cf7
cmd/go_test.TestScript.func3(0x9559b30)
	/tmp/workdir/go/src/cmd/go/script_test.go:154 +0x66c fp=0x9907f9c sp=0x9907ecc pc=0x8664e5c
testing.tRunner(0x9559b30, 0x94fb7a0)
2023-01-03 18:53 netbsd-amd64-9_3 go@d03231d9 cmd/go.TestScript (log)
vcs-test.golang.org rerouted to http://127.0.0.1:54291
https://vcs-test.golang.org rerouted to https://127.0.0.1:54290
go test proxy running at GOPROXY=http://127.0.0.1:54289/mod
fatal error: runtime.SetFinalizer: finalizer already set

runtime stack:
runtime.throw({0xb84f6e?, 0xbd9d78?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x70ddcbfcfef8 sp=0x70ddcbfcfec8 pc=0x43821d
runtime.SetFinalizer.func2()
	/tmp/workdir/go/src/runtime/mfinal.go:478 +0x54 fp=0x70ddcbfcff30 sp=0x70ddcbfcfef8 pc=0x41ac14
...
	/tmp/workdir/go/src/testing/testing.go:1095 +0x4a fp=0xc0007dfd08 sp=0xc0007dfcb0 pc=0x52bcaa
testing.(*common).Skip(0xc0003dc000, {0xc000112270?, 0xa98cc0?, 0x125f001?})
	/tmp/workdir/go/src/testing/testing.go:1071 +0x58 fp=0xc0007dfd60 sp=0xc0007dfd08 pc=0x52ba58
testing.(*T).Skip(0xc84940?, {0xc000112270?, 0xaae120?, 0xc000112260?})
	<autogenerated>:1 +0x29 fp=0xc0007dfd90 sp=0xc0007dfd60 pc=0x533349
cmd/go/internal/script/scripttest.Run({0xc8e148, 0xc0003dc000}, 0xb60533?, 0xc0002b7ee8?, {0xc0005157d0, 0xf}, {0xc84480, 0xc000e4c1e0})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:94 +0x12e fp=0xc0007dfe10 sp=0xc0007dfd90 pc=0xa2a2ee
cmd/go_test.TestScript.func3(0xc0003dc000)
	/tmp/workdir/go/src/cmd/go/script_test.go:154 +0x60d fp=0xc0007dff70 sp=0xc0007dfe10 pc=0xa4734d
testing.tRunner(0xc0003dc000, 0xc00032d360)
2023-01-05 20:09 netbsd-386-9_3 tools@057ed3c5 go@119f679a x/tools/gopls/internal/regtest/codelens (log)
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
PPID   PID COMMAND
...
panic: detected hanging go command (pid 10692): see golang/go#54461 for more details

goroutine 1083 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x96b8060)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8ccb080, 0x97fc630}, 0x9a4a0c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:261 +0x1a5
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x9e6bca4, {0x8ccb080, 0x97fc630}, {0x8cc645c, 0x97fc720}, {0x8cc645c, 0x97fc738})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x9e6bca4, {0x8ccb080, 0x97fc630}, {0x8cc645c, 0x97fc720}, {0x8cc645c, 0x97fc738})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).ModTidy.func1({0x8ccb020, 0x9aca720}, {0x8a4ef40, 0x9402b40})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/mod_tidy.go:74 +0x86
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:187 +0x96
runtime/trace.WithRegion({0x8ccb020, 0x9aca720}, {0x94b0fc0, 0x13}, 0x97747cc)
	/tmp/workdir/go/src/runtime/trace/annotation.go:141 +0xe0
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:180 +0x121
created by golang.org/x/tools/internal/memoize.(*Promise).run
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:179 +0x1d6

watchflakes

@bcmills bcmills changed the title all: test failures on netbsd-.*-9_3 blocked in os.wait6 all: test failures on netbsd blocked in os.wait6 Jan 25, 2023
@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `DETECTED A HANGING GO COMMAND`)
2023-01-24 14:59 netbsd-386-9_3 tools@deeb64bd go@2bf0f54b x/tools/gopls/internal/regtest/workspace (log)
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 15336): see golang/go#54461 for more details

goroutine 10519 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xc39f6e0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d0f070, 0xabb3c20}, 0xb80e000)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xe8def38, {0x8d0f070, 0xabb3c20}, {0x8d0a3dc, 0xb1646d8}, {0x8d0a3dc, 0xb1646f0})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xcfe
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xe8def38, {0x8d0f070, 0xabb3c20}, {0x8d0a3dc, 0xb1646d8}, {0x8d0a3dc, 0xb1646f0})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xafe9d40, {0x8d0f0d0, 0xb1644f8}, {0x9c81f10, 0x68})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:681 +0x1fb
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0xae799e0, {0x8d0f0d0, 0xb1643d8}, {0x8d13e7c, 0xafe9d40}, {0xb0e6968, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0xae799e0, {0x8d13e7c, 0xafe9d40}, {0xb0e6968, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x157
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d13e7c, 0xafe9d40}, {0xb0e6968, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-01-25 23:57 netbsd-amd64-9_3 tools@82707575 go@581603cb x/tools/cmd/fiximports.TestFixImports (log)
panic: test timed out after 10m0s

syscall.Syscall6(0x1c1, 0x6fb, 0xc0000b8f34, 0x0, 0xc000164240, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_amd64.s:39 +0x5
syscall.wait4(0xc0000b8f38?, 0x40ccc7?, 0x90?, 0x5a5960?)
	/tmp/workdir/go/src/syscall/zsyscall_netbsd_amd64.go:34 +0x4e
syscall.Wait4(0x203000?, 0xc0000b8f6c, 0xc0000b8fe8?, 0x5622c6?)
	/tmp/workdir/go/src/syscall/syscall_bsd.go:144 +0x2b
os.(*Process).wait(0xc0001854d0)
	/tmp/workdir/go/src/os/exec_unix.go:43 +0x77
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0xc00048f4a0)
	/tmp/workdir/go/src/os/exec/exec.go:514 +0x54
os/exec.(*Cmd).Run(0x5ac4a7?)
	/tmp/workdir/go/src/os/exec/exec.go:341 +0x39
golang.org/x/tools/cmd/fiximports.list({0xc0000b9340?, 0x1?, 0xc0003e8fc0?})
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/fiximports/main.go:489 +0x1d9
golang.org/x/tools/cmd/fiximports.fiximports({0xc000058840?, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/fiximports/main.go:156 +0xe8
golang.org/x/tools/cmd/fiximports.TestFixImports(0xc0000a4680)
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/fiximports/main_test.go:222 +0x625
testing.tRunner(0xc0000a4680, 0x5ba450)

watchflakes

@bcmills bcmills changed the title all: test failures on netbsd blocked in os.wait6 all: test failures on netbsd blocked on waiting for subprocesses Jan 26, 2023
@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2022-12-21 03:49 netbsd-arm-bsiegert go@78fc8107 (log)
fatal error: index out of range

runtime stack:
runtime.throw({0x63d1b7, 0x12})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x4c fp=0x7fffd394 sp=0x7fffd380 pc=0x4b2ac
runtime.panicCheck1(0x3b088, {0x63d1b7, 0x12})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:57 +0xb0 fp=0x7fffd3a8 sp=0x7fffd394 pc=0x48938
runtime.goPanicIndex(0x21401a6, 0x1fc)
	/var/gobuilder/buildlet/go/src/runtime/panic.go:112 +0x2c fp=0x7fffd3c8 sp=0x7fffd3a8 pc=0x489d4
runtime.(*gcWork).put(0xc2c25c, 0xc98000)
	/var/gobuilder/buildlet/go/src/runtime/mgcwork.go:136 +0xf4 fp=0x7fffd3d8 sp=0x7fffd3c8 pc=0x3b088
runtime.greyobject(0xc98000, 0xa0d360, 0x8, 0x7bc52ff8, 0xc2c25c, 0x0)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:1506 +0x1d8 fp=0x7fffd3f8 sp=0x7fffd3d8 pc=0x33188
runtime.scanblock(0xa0d360, 0x12eac, 0x7bc544fd, 0xc2c25c, 0x0)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:1238 +0x120 fp=0x7fffd424 sp=0x7fffd3f8 pc=0x32a68
runtime.markrootBlock(0xa0d360, 0x12eac, 0x7bc544fd, 0xc2c25c, 0x0)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:284 +0x74 fp=0x7fffd440 sp=0x7fffd424 pc=0x2ffd0
runtime.markroot(0xc2c25c, 0x3, 0x1)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:176 +0x434 fp=0x7fffd49c sp=0x7fffd440 pc=0x2fc8c
runtime.gcDrain(0xc2c25c, 0x7)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:1069 +0x58c fp=0x7fffd4e4 sp=0x7fffd49c pc=0x32494
runtime.gcBgMarkWorker.func2()
	/var/gobuilder/buildlet/go/src/runtime/mgc.go:1367 +0x7c fp=0x7fffd510 sp=0x7fffd4e4 pc=0x2d11c
runtime.systemstack()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm.s:317 +0x60 fp=0x7fffd514 sp=0x7fffd510 pc=0x7ddd8

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2022-12-22 14:46 netbsd-386-9_3 tools@3be06475 go@41eb70ae x/tools/gopls/internal/regtest/misc (log)
serve.go:434: debug server listening at http://localhost:65433
serve.go:434: debug server listening at http://localhost:65432
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 22331): see golang/go#54461 for more details

goroutine 62705 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x1048c8d0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d68700, 0x94dff80}, 0xa988fd0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x11b82d10, {0x8d68700, 0x94dff80}, {0x8d6395c, 0x10fa5b78}, {0x8d6395c, 0x10fa5ba8})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x11b82d10, {0x8d68700, 0x94dff80}, {0x8d6395c, 0x10fa5b78}, {0x8d6395c, 0x10fa5ba8})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xd56b080, {0x8d68720, 0x10fa5878}, {0x11cb9680, 0x58})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:771 +0x1ee
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0x11cb3180, {0x8d68720, 0x10fa57b8}, {0x8d6de28, 0xd56b080}, {0xc449c70, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0x11cb3180, {0x8d6de28, 0xd56b080}, {0xc449c70, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d6de28, 0xd56b080}, {0xc449c70, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c
2022-12-29 16:33 netbsd-386-9_3 tools@3b16059a go@c1760296 x/tools/gopls/internal/regtest/misc (log)
serve.go:434: debug server listening at http://localhost:65426
serve.go:434: debug server listening at http://localhost:65425
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 20990): see golang/go#54461 for more details

goroutine 66880 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x12d40ab0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d674c0, 0x11ef1380}, 0x14705550)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x14adcd58, {0x8d674c0, 0x11ef1380}, {0x8d6275c, 0x15b27ae8}, {0x8d6275c, 0x15b27b00})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xfb7dd58, {0x8d674c0, 0x11ef1380}, {0x8d6275c, 0x15b27ae8}, {0x8d6275c, 0x15b27b00})
...
golang.org/x/tools/internal/gocommand.(*Runner).runConcurrent(0x156358a8, {0x8d674c0, 0x11ef1380}, {{0x8abfd1e, 0x4}, {0x9a8e400, 0x4, 0x4}, {0x92e9260, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:100 +0x17c
golang.org/x/tools/internal/gocommand.(*Runner).RunRaw(0x156358a8, {0x8d674c0, 0x11ef1380}, {{0x8abfd1e, 0x4}, {0x9a8e400, 0x4, 0x4}, {0x92e9260, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:75 +0x5e
golang.org/x/tools/go/internal/packagesdriver.GetSizesGolist({0x8d674c0, 0x11ef1380}, {{0x8abfd1e, 0x4}, {0x9a8e400, 0x4, 0x4}, {0x92e9260, 0x0, 0x0}, ...}, ...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/packagesdriver/sizes.go:22 +0xd8
golang.org/x/tools/go/packages.goListDriver.func1()
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:157 +0x124
created by golang.org/x/tools/go/packages.goListDriver
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:155 +0x325
2023-01-04 22:18 netbsd-386-9_3 tools@a4455feb go@eeaf508d x/tools/gopls/internal/regtest/misc (log)
serve.go:434: debug server listening at http://localhost:65435
serve.go:434: debug server listening at http://localhost:65434
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 18859): see golang/go#54461 for more details

goroutine 51067 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x154e7cb0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d3088c, 0x157166c0}, 0x1572e160)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x4f0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x137d4f3c, {0x8d3088c, 0x157166c0}, {0x8d2be88, 0x15730270}, {0x8d2be88, 0x15730288})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x137d4f3c, {0x8d3088c, 0x157166c0}, {0x8d2be88, 0x15730270}, {0x8d2be88, 0x15730288})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xc330540, {0x8d308ec, 0x15730108}, {0x142ca780, 0x60})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:692 +0x1ee
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0x147c1540, {0x8d308ec, 0x15730048}, {0x8d35b64, 0xc330540}, {0x155581f8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0x147c1540, {0x8d35b64, 0xc330540}, {0x155581f8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d35b64, 0xc330540}, {0x155581f8, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-01-17 19:56 netbsd-386-9_3 go@2f5718a8 runtime.TestCgoExecSignalMask (log)
--- FAIL: TestCgoExecSignalMask (145.59s)
    exec.go:146: test timed out while running command: /tmp/workdir/tmp/go-build4138185153/testprogcgo.exe CgoExecSignalMask
    crash_test.go:58: /tmp/workdir/tmp/go-build4138185153/testprogcgo.exe CgoExecSignalMask: exit status 2
    crash_cgo_test.go:140: expected "OK\n", got SIGQUIT: quit
        PC=0x80b2437 m=13 sigcode=0

        eax    0x4
        ebx    0x85824b0
        ecx    0x85824b0
        edx    0x8580240
        edi    0x8418110
        esi    0x2
        ebp    0x1
        esp    0xa9dffe18
        eip    0x80b2437
        eflags 0x247
        cs     0x17
        fs     0xab
        gs     0xb3
2023-02-01 19:46 netbsd-386-9_3 tools@41adf8d4 go@de4748c4 x/tools/gopls/internal/regtest/workspace (log)
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 19419): see golang/go#54461 for more details

goroutine 20140 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x97f00c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d054e0, 0xa353368}, 0xb14f800)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xbe7bca4, {0x8d054e0, 0xa353368}, {0x8d007bc, 0xa353590}, {0x8d007bc, 0xa3535a8})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xbe7bca4, {0x8d054e0, 0xa353368}, {0x8d007bc, 0xa353590}, {0x8d007bc, 0xa3535a8})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).ModTidy.func1({0x8d05480, 0xaa8a540}, {0x8a82400, 0xb14f380})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/mod_tidy.go:74 +0x86
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:187 +0x96
runtime/trace.WithRegion({0x8d05480, 0xaa8a540}, {0xa8ffe78, 0x13}, 0xb238fcc)
	/tmp/workdir/go/src/runtime/trace/annotation.go:141 +0xe0
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:180 +0x121
created by golang.org/x/tools/internal/memoize.(*Promise).run
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:179 +0x1d6

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-01 23:31 netbsd-arm-bsiegert tools@4e8ff892 go@de4748c4 x/tools/go/ssa.TestBuildPackage (log)
panic: test timed out after 1h40m0s
running tests:
	TestBuildPackage (1h40m0s)

syscall.Syscall6(0x1e1, 0x1, 0x2837, 0x94548c, 0x10020, 0x0, 0x0)
	/var/gobuilder/buildlet/go/src/syscall/asm_netbsd_arm.s:39 +0x8
os.wait6(0x1, 0x2837, 0x10020)
	/var/gobuilder/buildlet/go/src/os/wait6_netbsd.go:16 +0x54
os.(*Process).blockUntilWaitable(0x8212c0)
	/var/gobuilder/buildlet/go/src/os/wait_wait6.go:20 +0x30
...
	/var/gobuilder/buildlet/go/src/go/types/resolver.go:254 +0xba0
go/types.(*Checker).checkFiles(0xaa6ff0, {0xabe6b8, 0x1, 0x1})
	/var/gobuilder/buildlet/go/src/go/types/check.go:326 +0xd4
go/types.(*Checker).Files(...)
	/var/gobuilder/buildlet/go/src/go/types/check.go:304
golang.org/x/tools/go/ssa/ssautil.BuildPackage(0xac0390, 0xac0180, 0xac0360, {0xabe6b8, 0x1, 0x1}, 0x8)
	/var/gobuilder/buildlet/gopath/src/golang.org/x/tools/go/ssa/ssautil/load.go:150 +0x194
golang.org/x/tools/go/ssa_test.TestBuildPackage(0xaa6f00)
	/var/gobuilder/buildlet/gopath/src/golang.org/x/tools/go/ssa/builder_test.go:69 +0x218
testing.tRunner(0xaa6f00, 0x38c178)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-08 22:43 netbsd-386-9_3 tools@d0863f03 go@7302f83d x/tools/gopls/internal/regtest/misc (log)
serve.go:434: debug server listening at http://localhost:65383
serve.go:434: debug server listening at http://localhost:65382
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 18413): see golang/go#54461 for more details

goroutine 64636 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x1073a2a0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d766b4, 0xfe3ca80}, 0x11a65680)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x118dbd54, {0x8d766b4, 0xfe3ca80}, {0x8d7198c, 0xa6001f8}, {0x8d7198c, 0xa600210})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xa787554, {0x8d766b4, 0xfe3ca80}, {0x8d7198c, 0xa6001f8}, {0x8d7198c, 0xa600210})
...
golang.org/x/tools/internal/gocommand.(*Runner).runConcurrent(0xa2eebb8, {0x8d766b4, 0xfe3ca80}, {{0x8ae6d85, 0x4}, {0xd7a98a0, 0x4, 0x4}, {0x932a1f8, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:100 +0x17c
golang.org/x/tools/internal/gocommand.(*Runner).RunRaw(0xa2eebb8, {0x8d766b4, 0xfe3ca80}, {{0x8ae6d85, 0x4}, {0xd7a98a0, 0x4, 0x4}, {0x932a1f8, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:75 +0x5e
golang.org/x/tools/go/internal/packagesdriver.GetSizesGolist({0x8d766b4, 0xfe3ca80}, {{0x8ae6d85, 0x4}, {0xd7a98a0, 0x4, 0x4}, {0x932a1f8, 0x0, 0x0}, ...}, ...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/packagesdriver/sizes.go:22 +0xd8
golang.org/x/tools/go/packages.goListDriver.func1()
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:157 +0x130
created by golang.org/x/tools/go/packages.goListDriver
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:155 +0x33c

watchflakes

@bcmills
Copy link
Contributor Author

bcmills commented Feb 9, 2023

@golang/netbsd, is anyone looking into this? These failures are quite frequent.

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-10 19:39 netbsd-amd64-9_3 go@88ad4476 runtime.TestCgoExecSignalMask (log)
--- FAIL: TestCgoExecSignalMask (145.75s)
    exec.go:146: test timed out while running command: /tmp/workdir/tmp/go-build3507279962/testprogcgo.exe CgoExecSignalMask
    crash_cgo_test.go:137: /tmp/workdir/tmp/go-build3507279962/testprogcgo.exe CgoExecSignalMask: exit status 2
    crash_cgo_test.go:140: expected "OK\n", got SIGQUIT: quit
        PC=0x46c2a3 m=13 sigcode=0

        rax    0x4
        rbx    0x0
        rcx    0x46c2a3
        rdx    0x0
        rdi    0x3
        rsi    0x0
        rbp    0x740fb15ffd48
        rsp    0x740fb15ffcf0
        r8     0xc0002b4340
        r9     0xc0002b4340
        r10    0x0
        r11    0x202
        r12    0x21
        r13    0xc00001a110
        r14    0xc0002b61a0
        r15    0x740fb60ab000
        rip    0x46c2a3
        rflags 0x203
        cs     0x47
        fs     0x0
        gs     0x0

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-22 21:51 netbsd-386-9_3 tools@3ec30bd9 go@0fa9ba8a x/tools/gopls/internal/regtest/misc (log)
serve.go:434: debug server listening at http://localhost:65442
serve.go:434: debug server listening at http://localhost:65441
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 21113): see golang/go#54461 for more details

goroutine 51703 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xac47a40)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d9e5c0, 0xd11e600}, 0x9f57a20)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xab1ed58, {0x8d9e5c0, 0xd11e600}, {0x8d9973c, 0xa057788}, {0x8d9973c, 0xa0577a0})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xa84e558, {0x8d9e5c0, 0xd11e600}, {0x8d9973c, 0xa057788}, {0x8d9973c, 0xa0577a0})
...
golang.org/x/tools/internal/gocommand.(*Runner).runConcurrent(0xcf83c50, {0x8d9e5c0, 0xd11e600}, {{0x8af158a, 0x4}, {0xa3e3680, 0x4, 0x4}, {0x93356c0, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:100 +0x17c
golang.org/x/tools/internal/gocommand.(*Runner).RunRaw(0xcf83c50, {0x8d9e5c0, 0xd11e600}, {{0x8af158a, 0x4}, {0xa3e3680, 0x4, 0x4}, {0x93356c0, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:75 +0x5e
golang.org/x/tools/go/internal/packagesdriver.GetSizesGolist({0x8d9e5c0, 0xd11e600}, {{0x8af158a, 0x4}, {0xa3e3680, 0x4, 0x4}, {0x93356c0, 0x0, 0x0}, ...}, ...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/packagesdriver/sizes.go:22 +0xd8
golang.org/x/tools/go/packages.goListDriver.func1()
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:157 +0x124
created by golang.org/x/tools/go/packages.goListDriver
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:155 +0x325

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-14 17:25 netbsd-arm64-bsiegert go@8e02cffd os/exec.TestCancelErrors (log)
panic: test timed out after 30m0s
running tests:
	TestCancelErrors (30m0s)
	TestCancelErrors/killed_after_error (30m0s)

syscall.Syscall6(0x1e1, 0x1, 0x3bf8, 0x4000047d5c, 0x10020, 0x0, 0x0)
	/var/gobuilder/buildlet/go/src/syscall/asm_netbsd_arm64.s:56 +0x10 fp=0x4000047d00 sp=0x4000047cf0 pc=0x88390
os.wait6(0x3b7b78?, 0x40000ec140?, 0x400006c2a0?)
	/var/gobuilder/buildlet/go/src/os/wait6_netbsd.go:16 +0x48 fp=0x4000047d70 sp=0x4000047d00 pc=0xab888
os.(*Process).blockUntilWaitable(0x40000ce0c0)
	/var/gobuilder/buildlet/go/src/os/wait_wait6.go:20 +0x38 fp=0x4000047da0 sp=0x4000047d70 pc=0xab8f8
os.(*Process).wait(0x40000ce0c0)
	/var/gobuilder/buildlet/go/src/os/exec_unix.go:22 +0x2c fp=0x4000047e00 sp=0x4000047da0 pc=0xa631c
os.(*Process).Wait(...)
	/var/gobuilder/buildlet/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x40002a6c60)
	/var/gobuilder/buildlet/go/src/os/exec/exec.go:890 +0x38 fp=0x4000047e70 sp=0x4000047e00 pc=0x101388
os/exec_test.TestCancelErrors.func3(0x400014aea0)
	/var/gobuilder/buildlet/go/src/os/exec/exec_test.go:1613 +0x23c fp=0x4000047f60 sp=0x4000047e70 pc=0x29326c
testing.tRunner(0x400014aea0, 0x360dc0)
2023-02-24 20:25 netbsd-386-9_3 go@f8050362 runtime.TestLockOSThreadTemplateThreadRace (log)
panic: test timed out after 3m0s
running tests:
	TestLockOSThreadTemplateThreadRace (2m33s)

syscall.Syscall6(0x1, 0x3543, 0x8d1b5fc, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x8d1b5d4 sp=0x8d1b5d0 pc=0x80ca555
os.wait6(0x1, 0x3543, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x5b fp=0x8d1b608 sp=0x8d1b5d4 pc=0x80ee49b
os.(*Process).blockUntilWaitable(0x8825680)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0x8d1b624 sp=0x8d1b608 pc=0x80ee4f1
os.(*Process).wait(0x8825680)
	/tmp/workdir/go/src/os/exec_unix.go:22 +0x28 fp=0x8d1b660 sp=0x8d1b624 pc=0x80e8c48
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x88da3c0)
	/tmp/workdir/go/src/os/exec/exec.go:890 +0x36 fp=0x8d1b698 sp=0x8d1b660 pc=0x8172a06
os/exec.(*Cmd).Run(0x88da3c0)
	/tmp/workdir/go/src/os/exec/exec.go:590 +0x43 fp=0x8d1b6a8 sp=0x8d1b698 pc=0x8171793
os/exec.(*Cmd).CombinedOutput(0x88da3c0)
	/tmp/workdir/go/src/os/exec/exec.go:1005 +0x8f fp=0x8d1b6bc sp=0x8d1b6a8 pc=0x817321f
runtime_test.runBuiltTestProg(0x89cc780, {0x9534210, 0x2f}, {0x8422390, 0x1e}, {0x0, 0x0, 0x0})
	/tmp/workdir/go/src/runtime/crash_test.go:76 +0x28d fp=0x8d1b734 sp=0x8d1b6bc pc=0x82f1f5d
runtime_test.TestLockOSThreadTemplateThreadRace(0x89cc780)
	/tmp/workdir/go/src/runtime/proc_test.go:1022 +0x164 fp=0x8d1b798 sp=0x8d1b734 pc=0x83556c4
testing.tRunner(0x89cc780, 0x8439370)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-28 05:12 netbsd-386-9_3 go@41e86796 cmd/compile/internal/test.TestReproducibleBuilds (log)
panic: test timed out after 3m0s
running tests:
	TestReproducibleBuilds (2m51s)
	TestReproducibleBuilds/issue27013.go (2m51s)

syscall.Syscall6(0x1, 0x455a, 0x9092dd8, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x9092db0 sp=0x9092dac pc=0x80c2155
os.wait6(0x1, 0x455a, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x5b fp=0x9092de4 sp=0x9092db0 pc=0x80f0afb
os.(*Process).blockUntilWaitable(0x9886480)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0x9092e00 sp=0x9092de4 pc=0x80f0b51
os.(*Process).wait(0x9886480)
	/tmp/workdir/go/src/os/exec_unix.go:22 +0x28 fp=0x9092e3c sp=0x9092e00 pc=0x80eae28
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x984cc00)
	/tmp/workdir/go/src/os/exec/exec.go:890 +0x36 fp=0x9092e74 sp=0x9092e3c pc=0x81814f6
os/exec.(*Cmd).Run(0x984cc00)
	/tmp/workdir/go/src/os/exec/exec.go:590 +0x43 fp=0x9092e84 sp=0x9092e74 pc=0x8180273
os/exec.(*Cmd).CombinedOutput(0x984cc00)
	/tmp/workdir/go/src/os/exec/exec.go:1005 +0x8f fp=0x9092e98 sp=0x9092e84 pc=0x8181d0f
cmd/compile/internal/test.TestReproducibleBuilds.func1(0x8f880f0)
	/tmp/workdir/go/src/cmd/compile/internal/test/reproduciblebuilds_test.go:42 +0x360 fp=0x9092f98 sp=0x9092e98 pc=0x842f790
testing.tRunner(0x8f880f0, 0x8f82020)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-03-01 16:36 netbsd-386-9_3 tools@096bae8f go@600d372f x/tools/gopls/internal/regtest/completion (log)
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 13546): see golang/go#54461 for more details

goroutine 6974 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xb6c5ce0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d3b260, 0x9ac99e0}, 0xba586e0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xb658f40, {0x8d3b260, 0x9ac99e0}, {0x8d3642c, 0xa59ddb8}, {0x8d3642c, 0xa59de18})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xb658f40, {0x8d3b260, 0x9ac99e0}, {0x8d3642c, 0xa59ddb8}, {0x8d3642c, 0xa59de18})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xad53b80, {0x8d3b2c0, 0xa59d710}, {0xa8fb5c0, 0x5e})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:703 +0x1ee
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0xa938750, {0x8d3b2c0, 0xa59d650}, {0x8d40088, 0xad53b80}, {0xa7cfdf8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0xa938750, {0x8d40088, 0xad53b80}, {0xa7cfdf8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d40088, 0xad53b80}, {0xa7cfdf8, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-01-17 19:56 netbsd-386-9_3 go@354c8fb4 go/internal/srcimporter.TestCgo (log)
panic: test timed out after 3m0s
running tests:
	TestCgo (2m58s)

syscall.Syscall6(0x1, 0x23c6, 0xa787714, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0xa7876ec sp=0xa7876e8 pc=0x80b76c5
os.wait6(0x1, 0x23c6, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x57 fp=0xa787720 sp=0xa7876ec pc=0x80d2c87
os.(*Process).blockUntilWaitable(0x9f803c0)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0xa78773c sp=0xa787720 pc=0x80d2ce1
...
	/tmp/workdir/go/src/go/types/check.go:326 +0x120 fp=0xa787e60 sp=0xa787e30 pc=0x81b9ed0
go/types.(*Checker).Files(...)
	/tmp/workdir/go/src/go/types/check.go:304
go/types.(*Config).Check(0xa170780, {0x825b9cd, 0xa}, 0x9fee240, {0x8ad6700, 0x21, 0x40}, 0x0)
	/tmp/workdir/go/src/go/types/api.go:415 +0x83 fp=0xa787e80 sp=0xa787e60 pc=0x81a8ca3
go/internal/srcimporter.(*Importer).ImportFrom(0x8af1ad0, {0x825b9cd, 0xa}, {0x8a61218, 0x14}, 0x0)
	/tmp/workdir/go/src/go/internal/srcimporter/srcimporter.go:145 +0x815 fp=0xa787f48 sp=0xa787e80 pc=0x8210315
go/internal/srcimporter.TestCgo(0x93b34a0)
	/tmp/workdir/go/src/go/internal/srcimporter/srcimporter_test.go:249 +0x2b3 fp=0xa787f9c sp=0xa787f48 pc=0x8213613
testing.tRunner(0x93b34a0, 0x826bc44)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-03-06 21:22 netbsd-386-9_3 go@c6cdfdab runtime.TestEINTR (log)
panic: test timed out after 3m0s
running tests:
	TestEINTR (2m29s)

syscall.Syscall6(0x1, 0x3f99, 0x8cc3de0, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x8cc3db8 sp=0x8cc3db4 pc=0x80ca5d5
os.wait6(0x1, 0x3f99, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x5b fp=0x8cc3dec sp=0x8cc3db8 pc=0x80ee28b
os.(*Process).blockUntilWaitable(0x88c01b0)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0x8cc3e08 sp=0x8cc3dec pc=0x80ee2e1
os.(*Process).wait(0x88c01b0)
	/tmp/workdir/go/src/os/exec_unix.go:22 +0x28 fp=0x8cc3e44 sp=0x8cc3e08 pc=0x80e8ca8
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x8c26180)
	/tmp/workdir/go/src/os/exec/exec.go:890 +0x36 fp=0x8cc3e7c sp=0x8cc3e44 pc=0x81723c6
os/exec.(*Cmd).Run(0x8c26180)
	/tmp/workdir/go/src/os/exec/exec.go:590 +0x43 fp=0x8cc3e8c sp=0x8cc3e7c pc=0x8171143
os/exec.(*Cmd).CombinedOutput(0x8c26180)
	/tmp/workdir/go/src/os/exec/exec.go:1005 +0x8f fp=0x8cc3ea0 sp=0x8cc3e8c pc=0x8172bdf
runtime_test.runBuiltTestProg(0x89e80f0, {0x887dac0, 0x32}, {0x841008a, 0x5}, {0x0, 0x0, 0x0})
	/tmp/workdir/go/src/runtime/crash_test.go:76 +0x28d fp=0x8cc3f18 sp=0x8cc3ea0 pc=0x82f00ad
runtime_test.runTestProg(0x89e80f0, {0x84130b7, 0xb}, {0x841008a, 0x5}, {0x0, 0x0, 0x0})
	/tmp/workdir/go/src/runtime/crash_test.go:59 +0x169 fp=0x8cc3f54 sp=0x8cc3f18 pc=0x82efdf9
runtime_test.TestEINTR(0x89e80f0)
	/tmp/workdir/go/src/runtime/crash_cgo_test.go:700 +0x67 fp=0x8cc3f98 sp=0x8cc3f54 pc=0x82ef2f7
testing.tRunner(0x89e80f0, 0x8438570)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-01-19 14:44 netbsd-amd64-9_3 tools@c467be36 go@a95136a8 x/tools/gopls/internal/test/integration/misc.TestRenamePackage (log)
serve.go:441: debug server listening at http://localhost:65462
serve.go:441: debug server listening at http://localhost:65461
panic: test timed out after 10m0s
running tests:
	TestRenamePackage (9m1s)
	TestRenamePackage/default (9m1s)

testing.(*T).Run(0xc000bf0d00, {0x107cc87?, 0x109aa70?}, 0xc00140f3b0)
	/tmp/workdir/go/src/testing/testing.go:1630 +0x405
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0xc00014afa0, 0xc000bf0d00, {0x10f764f, 0x11a}, 0x120f3c0, {0x0, 0x0, 0x48ee97?})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x4e5
golang.org/x/tools/gopls/internal/test/integration.Run(...)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:56
golang.org/x/tools/gopls/internal/test/integration/misc.TestRenamePackage(0xc001f4c7d0?)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/misc/rename_test.go:302 +0x45
testing.tRunner(0xc000bf0d00, 0x120f488)

watchflakes

@bcmills
Copy link
Contributor Author

bcmills commented Jan 23, 2024

@golang/netbsd, is it possible that this is (somehow) a kqueue-related race condition?
#63937 on darwin is plausibly kqueue-related, and I wonder if they might share a similar root cause.

@bsiegert
Copy link
Contributor

bsiegert commented Jan 23, 2024 via email

@bcmills
Copy link
Contributor Author

bcmills commented Jan 24, 2024

I suspect a race in the way Go uses kqueue.

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-01-04 21:37 go1.21-netbsd-arm64 release-branch.go1.21@f6b203c8 cmd/go.TestScript [ABORT] (log)
=== RUN   TestScript/mod_list_sums
=== PAUSE TestScript/mod_list_sums
=== CONT  TestScript/mod_list_sums
panic: test timed out after 9m0s
running tests:
	TestScript (8m59s)
	TestScript/mod_list_sums (0s)
	TestScript/mod_list_test (0s)
	TestScript/mod_list_upgrade (0s)
	TestScript/mod_load_badchain (0s)
...
cmd/go_test.TestScript.func3(0x400074c340)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go/script_test.go:157 +0x498 fp=0x4000457f60 sp=0x4000457e10 pc=0x2006cdce8
testing.tRunner(0x400074c340, 0x4000552870)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1595 +0xe8 fp=0x4000457fb0 sp=0x4000457f60 pc=0x20022a0c8
testing.(*T).Run.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1648 +0x2c fp=0x4000457fd0 sp=0x4000457fb0 pc=0x20022aedc
runtime.goexit()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1197 +0x4 fp=0x4000457fd0 sp=0x4000457fd0 pc=0x200171e44
created by testing.(*T).Run in goroutine 95
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1648 +0x33c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-01-03 10:09 x_tools-go1.22-netbsd-arm64 tools@5e6f314f release-branch.go1.22@fa72f3e0 x/tools/go/packages.TestOverlay [ABORT] (log)
=== RUN   TestOverlay/Modules
=== PAUSE TestOverlay/Modules
=== CONT  TestOverlay/Modules
    invoke.go:268: 243.461578ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:268: 119.589945ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 1.161605313s for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- golang.org/fake/a
    invoke.go:268: 380.574165ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:268: 600.38958ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 340.6639ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- golang.org/fake/a
    invoke.go:268: 74.496408ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:268: 345.781858ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 797.850096ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -overlay=/home/swarming/.swarming/w/ir/x/t/gopackages-2055998350/overlay.json -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- golang.org/fake/a
    invoke.go:268: 328.214826ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 613.504017ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:268: 456.829533ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -overlay=/home/swarming/.swarming/w/ir/x/t/gopackages-57960478/overlay.json -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- golang.org/fake/a
    invoke.go:268: 461.793308ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:268: 547.31951ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 713.30403ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -overlay=/home/swarming/.swarming/w/ir/x/t/gopackages-3891496019/overlay.json -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- golang.org/fake/a
    invoke.go:268: 186.953955ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -e -f {{context.ReleaseTags}} -- unsafe
    invoke.go:268: 132.865952ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 3.863684348s for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestOverlay_Modules1772997305/fake go list -overlay=/home/swarming/.swarming/w/ir/x/t/gopackages-3656479102/overlay.json -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- golang.org/fake/a
2024-01-03 10:09 x_tools-go1.22-netbsd-arm64 tools@5e6f314f release-branch.go1.22@fa72f3e0 x/tools/internal/gcimporter.TestStdlib [ABORT] (log)
=== RUN   TestStdlib
panic: test timed out after 10m0s
running tests:
	TestStdlib (8m55s)

goroutine 6931 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
golang.org/x/tools/go/packages.Visit.func1(0x40009cf080)
	/home/swarming/.swarming/w/ir/x/w/targetrepo559260801/go/packages/visit.go:38 +0x134
golang.org/x/tools/go/packages.Visit({0x4011821008, 0x1f1, 0x2?}, 0x0, 0x40004f1f30)
	/home/swarming/.swarming/w/ir/x/w/targetrepo559260801/go/packages/visit.go:43 +0xcc
golang.org/x/tools/internal/gcimporter_test.TestStdlib(0x40002611e0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo559260801/internal/gcimporter/stdlib_test.go:61 +0x1e8
testing.tRunner(0x40002611e0, 0x33cdc0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1689 +0xec
created by testing.(*T).Run in goroutine 1
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1742 +0x318
2024-01-03 10:09 x_tools-go1.22-netbsd-arm64 tools@5e6f314f release-branch.go1.22@fa72f3e0 x/tools/internal/imports.TestReadFromFilesystem [ABORT] (log)
=== RUN   TestReadFromFilesystem/works/Modules
panic: test timed out after 10m0s
running tests:
	TestReadFromFilesystem (0s)
	TestReadFromFilesystem/works (0s)
	TestReadFromFilesystem/works/Modules (0s)

goroutine 628 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
...
os.(*file).close(0x400037c2a0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/file_unix.go:315 +0x98
os.(*File).Close(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/file_posix.go:23
os/exec.(*Cmd).writerDescriptor.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:578 +0x60
os/exec.(*Cmd).Start.func2(0x40004b4680?)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:724 +0x34
created by os/exec.(*Cmd).Start in goroutine 569
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:723 +0x7cc
2024-01-03 10:09 x_tools-gotip-netbsd-arm64 tools@5e6f314f go@c95fe91d x/tools/gopls/internal/test/integration/diagnostics.TestIssue44736/default [ABORT] (log)
=== RUN   TestIssue44736/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (pid 11719): see golang/go#54461 for more details

goroutine 43867 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x40024b9770)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/internal/gocommand/invoke.go:442 +0x378
golang.org/x/tools/internal/gocommand.runCmdContext({0xe1c340, 0x4006446930}, 0x400864c6e0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/internal/gocommand/invoke.go:375 +0x354
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x4001a05f78, {0xe1c340, 0x4006446930}, {0xe135e0, 0x4006446a50}, {0xe135e0, 0x4006446a80})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/internal/gocommand/invoke.go:270 +0xd4c
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x4001a05f40?, {0xe1c340, 0x4006446930}, {0xe135e0?, 0x4006446a50?}, {0xe135e0, 0x4006446a80})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).load(0x4007ccef00, {0xe1c378, 0x40022fd040}, 0x1, {0x4007dd1180, 0x2, 0x4007773d38?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/load.go:136 +0xaa4
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).loadWorkspace(0x4007ccef00, {0xe1c378, 0x40022fd040}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/view.go:727 +0x1dc
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).initialize(0x4007ccef00, {0xe1c378, 0x40022fd040}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/view.go:638 +0x1a0
golang.org/x/tools/gopls/internal/lsp/cache.(*Session).createView.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/session.go:227 +0x44
created by golang.org/x/tools/gopls/internal/lsp/cache.(*Session).createView in goroutine 44003
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/session.go:225 +0xa40
2024-01-03 10:09 x_tools-gotip-netbsd-arm64 tools@5e6f314f go@c95fe91d x/tools/gopls/internal/test/integration/misc.TestRenamePackage_InternalPackage/default [ABORT] (log)
=== RUN   TestRenamePackage_InternalPackage/default
    rename_test.go:895: context deadline exceeded
#### Start Gopls Test Logs for "TestRenamePackage_InternalPackage/default"
[Trace - 12:03:19.185 PM] Sending request 'initialize - (1)'.
Params: {"processId":0,"rootUri":"","capabilities":{"workspace":{"workspaceEdit":{"resourceOperations":["rename"]},"didChangeConfiguration":{},"didChangeWatchedFiles":{"dynamicRegistration":true},"configuration":true},"textDocument":{"completion":{"completionItem":{"snippetSupport":true,"tagSupport":{"valueSet":[1]}}},"documentSymbol":{"hierarchicalDocumentSymbolSupport":true},"codeAction":{"codeActionLiteralSupport":{"codeActionKind":{"valueSet":null}}},"publishDiagnostics":{},"semanticTokens":{"requests":{"full":true},"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"],"formats":null}},"window":{"workDoneProgress":true}},"initializationOptions":{"completionBudget":"0s","diagnosticsDelay":"10ms","env":{"GO111MODULE":"","GOMODCACHE":"","GOPACKAGESDRIVER":"off","GOPATH":"/home/swarming/.swarming/w/ir/x/t/gopls-test-755129211/TestRenamePackage_InternalPackage/default/gopath","GOPROXY":"file:///home/swarming/.swarming/w/ir/x/t/gopls-test-755129211/TestRenamePackage_InternalPackage/default/proxy","GOSUMDB":"off"},"verboseWorkDoneProgress":true},"trace":"messages","workspaceFolders":[{"uri":"file:///home/swarming/.swarming/w/ir/x/t/gopls-test-755129211/TestRenamePackage_InternalPackage/default/work","name":"work"}]}


[Trace - 12:03:19.350 PM] Received response 'initialize - (1)' in 164ms.
Result: {"capabilities":{"textDocumentSync":{"openClose":true,"change":2,"save":{}},"completionProvider":{"triggerCharacters":["."]},"hoverProvider":true,"signatureHelpProvider":{"triggerCharacters":["(",","]},"definitionProvider":true,"typeDefinitionProvider":true,"implementationProvider":true,"referencesProvider":true,"documentHighlightProvider":true,"documentSymbolProvider":true,"codeActionProvider":true,"codeLensProvider":{},"documentLinkProvider":{},"workspaceSymbolProvider":true,"documentFormattingProvider":true,"renameProvider":true,"foldingRangeProvider":true,"selectionRangeProvider":true,"executeCommandProvider":{"commands":["gopls.add_dependency","gopls.add_import","gopls.add_telemetry_counters","gopls.apply_fix","gopls.change_signature","gopls.check_upgrades","gopls.diagnose_files","gopls.edit_go_directive","gopls.fetch_vulncheck_result","gopls.gc_details","gopls.generate","gopls.go_get_package","gopls.list_imports","gopls.list_known_packages","gopls.maybe_prompt_for_telemetry","gopls.mem_stats","gopls.regenerate_cgo","gopls.remove_dependency","gopls.reset_go_mod_diagnostics","gopls.run_go_work_command","gopls.run_govulncheck","gopls.run_tests","gopls.start_debugging","gopls.start_profile","gopls.stop_profile","gopls.test","gopls.tidy","gopls.toggle_gc_details","gopls.update_go_sum","gopls.upgrade_dependency","gopls.vendor","gopls.views","gopls.workspace_stats"]},"callHierarchyProvider":true,"semanticTokensProvider":{"legend":{"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"]},"range":true,"full":true},"inlayHintProvider":{},"workspace":{"workspaceFolders":{"supported":true,"changeNotifications":"workspace/didChangeWorkspaceFolders"}}},"serverInfo":{"name":"gopls","version":"{\"GoVersion\":\"devel c95fe91d0715dc0a8d55ac80a80f383c3635548b\",\"Path\":\"\",\"Main\":{\"Path\":\"\",\"Version\":\"\",\"Sum\":\"\",\"Replace\":null},\"Deps\":null,\"Settings\":null,\"Version\":\"(unknown)\"}"}}

...
panic: test timed out after 10m0s
running tests:
	TestRenamePackage_InternalPackage (8s)
	TestRenamePackage_InternalPackage/default (8s)

goroutine 48474 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
golang.org/x/tools/internal/jsonrpc2.Serve({0xe98660, 0x400555f9b0}, {0xe975a0, 0x4005394e20}, {0xe8f9a0, 0x400555fa10}, 0x0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/internal/jsonrpc2/serve.go:112 +0x234
created by golang.org/x/tools/internal/jsonrpc2/servertest.NewTCPServer in goroutine 4588
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/internal/jsonrpc2/servertest/servertest.go:47 +0xe4

goroutine 47409 [select]:
golang.org/x/tools/gopls/internal/lsp/cache.(*parseCache).gc(0x400156fc70)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/parse_cache.go:262 +0xa8
created by golang.org/x/tools/gopls/internal/lsp/cache.newParseCache in goroutine 47372
	/home/swarming/.swarming/w/ir/x/w/targetrepo1646811552/gopls/internal/lsp/cache/parse_cache.go:119 +0xc4
2024-01-05 14:42 x_tools-go1.22-netbsd-arm64 tools@78257367 release-branch.go1.22@fa72f3e0 x/tools/gopls/internal/test/integration/misc.TestInconsistentVendoring/default [ABORT] (log)
=== RUN   TestInconsistentVendoring/default
panic: test timed out after 10m0s
running tests:
	TestInconsistentVendoring (9s)
	TestInconsistentVendoring/default (9s)

goroutine 55337 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...
golang.org/x/tools/gopls/internal/test/integration/fake.(*Sandbox).Close(0x4003bd4b40)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1390669620/gopls/internal/test/integration/fake/sandbox.go:292 +0x9c
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run.func1.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1390669620/gopls/internal/test/integration/runner.go:206 +0x34
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run.func1(0x4006111d40)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1390669620/gopls/internal/test/integration/runner.go:255 +0x9fc
testing.tRunner(0x4006111d40, 0x400ab9d950)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1689 +0xec
created by testing.(*T).Run in goroutine 55179
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1742 +0x318
2024-01-05 17:34 x_tools-gotip-netbsd-arm64 tools@ba8672b5 go@8088b6db x/tools/go/packages.TestIssue32814 [ABORT] (log)
=== RUN   TestIssue32814/Modules
=== PAUSE TestIssue32814/Modules
=== CONT  TestIssue32814/Modules
    invoke.go:268: 47.112562ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestIssue32814_Modules3995234186/modcache GO111MODULE=on GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestIssue32814_Modules3995234186/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestIssue32814_Modules3995234186/fake go list -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
    invoke.go:268: 374.87945ms for GOROOT= GOPATH=/home/swarming/.swarming/w/ir/x/t/TestIssue32814_Modules3995234186/modcache GO111MODULE=off GOPROXY=file:///home/swarming/.swarming/w/ir/x/t/TestIssue32814_Modules3995234186/modproxy PWD=/home/swarming/.swarming/w/ir/x/t/TestIssue32814_Modules3995234186/fake go list -e -f {{context.ReleaseTags}} -- unsafe
panic: test timed out after 10m0s
running tests:
	TestCgoNoCcompiler/Modules (6m46s)
	TestInvalidFilesBeforeOverlayContains/Modules (9m19s)
	TestInvalidFilesBeforeOverlayContains/Modules/main (6m29s)
...
sync.(*Once).doSlow(0x401ed16d60, 0x4006d03760)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/sync/once.go:70 +0x90
sync.(*Once).Do(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/sync/once.go:65
golang.org/x/tools/go/packages.(*loader).loadRecursive(0x401ca63c08?, 0x401ca63c20?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/go/packages/packages.go:856 +0x50
golang.org/x/tools/go/packages.(*loader).loadRecursive.func1.1(0x0?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/go/packages/packages.go:863 +0x30
created by golang.org/x/tools/go/packages.(*loader).loadRecursive.func1 in goroutine 18203
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/go/packages/packages.go:862 +0x84
2024-01-05 17:34 x_tools-gotip-netbsd-arm64 tools@ba8672b5 go@8088b6db x/tools/gopls/internal/test/integration/misc.TestRunGovulncheckError2 [ABORT] (log)
=== RUN   TestRunGovulncheckError2/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        
        #### diagnostics:
...
panic: test timed out after 10m0s
running tests:
	TestRunGovulncheckError2 (1m33s)
	TestRunGovulncheckError2/default (1m33s)

goroutine 55852 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
os.(*File).WriteTo(0x4000d43f58?, {0xe7f060?, 0x4003e56930?})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/file.go:247 +0x60
io.copyBuffer({0xe7f060, 0x4003e56930}, {0xe7ec60, 0x4009fc0bf0}, {0x0, 0x0, 0x0})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:411 +0x98
io.Copy(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:388
golang.org/x/tools/internal/gocommand.runCmdContext.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/internal/gocommand/invoke.go:307 +0x4c
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 55846
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/internal/gocommand/invoke.go:306 +0x134
2024-01-05 17:34 x_tools-gotip-netbsd-arm64 tools@ba8672b5 go@8088b6db x/tools/internal/imports.TestModMultipleScansWithSubdirs [ABORT] (log)
=== RUN   TestModMultipleScansWithSubdirs
panic: test timed out after 10m0s
running tests:
	TestModMultipleScansWithSubdirs (0s)

goroutine 1728 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
os.(*Process).wait(0x40000c25a0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec_unix.go:22 +0x2c
os.(*Process).Wait(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec.go:134
os/exec.(*Cmd).Wait(0x4000385340)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:897 +0x38
golang.org/x/tools/internal/gocommand.runCmdContext.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/internal/gocommand/invoke.go:362 +0x28
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 1724
	/home/swarming/.swarming/w/ir/x/w/targetrepo1886311479/internal/gocommand/invoke.go:361 +0x284

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-01-08 18:41 x_tools-go1.20-netbsd-arm64 tools@25a0e9d3 release-branch.go1.20@5c38c049 x/tools/gopls/internal/test/integration/diagnostics.TestIssue44736/default [ABORT] (log)
=== RUN   TestIssue44736/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (pid 10168): see golang/go#54461 for more details

goroutine 42043 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x4002b1b740)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/internal/gocommand/invoke.go:442 +0x378
golang.org/x/tools/internal/gocommand.runCmdContext({0xda7fa8, 0x400b6353e0}, 0x4001ddd4a0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/internal/gocommand/invoke.go:375 +0x370
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x4002c91e88, {0xda7fa8, 0x400b6353e0}, {0xd9f160?, 0x400b635530}, {0xd9f160?, 0x400b635560})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/internal/gocommand/invoke.go:270 +0xe08
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x4002c91e50?, {0xda7fa8, 0x400b6353e0}, {0xd9f160?, 0x400b635530?}, {0xd9f160?, 0x400b635560?})
...
golang.org/x/tools/go/packages.Load(0x4000166d00?, {0x4002d7e300, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/go/packages/packages.go:262 +0x48
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).load(0x4000166d00, {0xda7f00, 0x400717f270}, 0x1, {0x4002d7e2e0, 0x2, 0x4001f8ce78?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/gopls/internal/lsp/cache/load.go:136 +0xaf0
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).initialize(0x4000166d00, {0xda7f00, 0x400717f270}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/gopls/internal/lsp/cache/view.go:716 +0x36c
golang.org/x/tools/gopls/internal/lsp/cache.(*Session).createView.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/gopls/internal/lsp/cache/session.go:227 +0x44
created by golang.org/x/tools/gopls/internal/lsp/cache.(*Session).createView
	/home/swarming/.swarming/w/ir/x/w/targetrepo3929501465/gopls/internal/lsp/cache/session.go:225 +0xb00
2024-01-10 16:06 x_tools-gotip-netbsd-arm64 tools@706525de go@8c1349ba x/tools/gopls/internal/test/integration/diagnostics.TestIssue44736/default [ABORT] (log)
=== RUN   TestIssue44736/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (pid 25504): see golang/go#54461 for more details

goroutine 44244 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x4009d6acf0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/internal/gocommand/invoke.go:442 +0x378
golang.org/x/tools/internal/gocommand.runCmdContext({0xe1c980, 0x4008210120}, 0x400817f1e0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/internal/gocommand/invoke.go:375 +0x354
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x40027b6018, {0xe1c980, 0x4008210120}, {0xe13c20, 0x4008210240}, {0xe13c20, 0x4008210270})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/internal/gocommand/invoke.go:270 +0xd4c
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x40027b5fe0?, {0xe1c980, 0x4008210120}, {0xe13c20?, 0x4008210240?}, {0xe13c20, 0x4008210270})
...
golang.org/x/tools/go/packages.Load(0x4003708d00?, {0x4006b8e020, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/go/packages/packages.go:262 +0x48
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).load(0x4003708d00, {0xe1c9b8, 0x4005967cc0}, 0x1, {0x4006b8e000, 0x2, 0x40055a1e08?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/gopls/internal/lsp/cache/load.go:136 +0xa80
golang.org/x/tools/gopls/internal/lsp/cache.(*Snapshot).initialize(0x4003708d00, {0xe1c9b8, 0x4005967cc0}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/gopls/internal/lsp/cache/view.go:716 +0x340
golang.org/x/tools/gopls/internal/lsp/cache.(*Session).createView.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/gopls/internal/lsp/cache/session.go:227 +0x44
created by golang.org/x/tools/gopls/internal/lsp/cache.(*Session).createView in goroutine 44213
	/home/swarming/.swarming/w/ir/x/w/targetrepo3887546112/gopls/internal/lsp/cache/session.go:225 +0xa40
2024-01-29 16:50 x_tools-gotip-netbsd-arm64 tools@5e164372 go@f719d5cf x/tools/gopls/internal/test/integration/misc.TestRunGovulncheckStd/default [ABORT] (log)
=== RUN   TestRunGovulncheckStd/default
    vuln_test.go:212: waiting on:
        Unmet: once "completed work for token 2642144517071313623" is met, must have:
        received window/showMessage containing "Found GOSTDLIB"
        no diagnostics for file "go.mod"
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
...
panic: test timed out after 10m0s
running tests:
	TestRunGovulncheckStd (7s)
	TestRunGovulncheckStd/default (7s)

goroutine 55623 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
golang.org/x/tools/gopls/internal/vulncheck/scan.RunGovulncheck({0xe86fe8, 0x400fe73900}, {0x4010197370, 0x5}, 0x4000c4a480, {0x4004ae8157, 0x5a}, {0xe7ed80, 0x4001b234a0})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1506847421/gopls/internal/vulncheck/scan/command.go:93 +0x4a4
golang.org/x/tools/gopls/internal/server.(*commandHandler).RunGovulncheck.func1({0xe86fe8, 0x400fe73900}, {0x4000c4a480?, {0xe87e40?, 0x4000c5e180?}, 0x400fe73d10?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1506847421/gopls/internal/server/command.go:977 +0x124
golang.org/x/tools/gopls/internal/server.(*commandHandler).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1506847421/gopls/internal/server/command.go:177 +0x80
golang.org/x/tools/gopls/internal/server.(*commandHandler).run.func3()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1506847421/gopls/internal/server/command.go:193 +0x40
created by golang.org/x/tools/gopls/internal/server.(*commandHandler).run in goroutine 55470
	/home/swarming/.swarming/w/ir/x/w/targetrepo1506847421/gopls/internal/server/command.go:192 +0x360
2024-01-29 18:13 x_tools-go1.20-netbsd-arm64 tools@b048cf12 release-branch.go1.20@d7df7f4f x/tools/gopls/internal/test/integration/misc.TestRunVulncheckWarning/default [ABORT] (log)
=== RUN   TestRunVulncheckWarning/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/01/30 00:04:04 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckWarning (6s)
	TestRunVulncheckWarning/default (5s)

goroutine 54951 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2241 +0x31c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:176 +0x38
...
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x40003b0e60, 0x4003347380, {0xbcee91, 0x3a5}, 0xcd1a08, {0x400beb5b90, 0x3, 0x4b9?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo881657353/gopls/internal/test/integration/runner.go:167 +0x438
golang.org/x/tools/gopls/internal/test/integration.configuredRunner.Run({{0x400beb5b90?, 0xe7cb2a?, 0xbd0fab?}}, 0x4003347380, {0xbcee91, 0x3a5}, 0x20696?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo881657353/gopls/internal/test/integration/regtest.go:80 +0xf0
golang.org/x/tools/gopls/internal/test/integration/misc.TestRunVulncheckWarning(0x4003347380)
	/home/swarming/.swarming/w/ir/x/w/targetrepo881657353/gopls/internal/test/integration/misc/vuln_test.go:646 +0xe0
testing.tRunner(0x4003347380, 0xcd1a10)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1576 +0x104
created by testing.(*T).Run
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1629 +0x370

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-01 22:48 netbsd-386-9_3 tools@44aed241 go@a2f4a5a6 x/tools/gopls/internal/test/integration/misc.TestRenamePackage_TestVariant (log)
serve.go:441: debug server listening at http://localhost:65464
serve.go:441: debug server listening at http://localhost:65463
panic: test timed out after 10m0s
running tests:
	TestRenamePackage_TestVariant (9m7s)
	TestRenamePackage_TestVariant/default (9m7s)

testing.(*T).Run(0xa88d860, {0x8bbb483, 0x7}, 0xd3ad8f0)
	/tmp/workdir/go/src/testing/testing.go:1630 +0x440
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x9abe420, 0xa88d860, {0x8c3b2e4, 0x193}, 0x8d36e04, {0x0, 0x0, 0x0})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x41e
golang.org/x/tools/gopls/internal/test/integration.Run(...)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:56
golang.org/x/tools/gopls/internal/test/integration/misc.TestRenamePackage_TestVariant(0xa88d860)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/misc/rename_test.go:686 +0x59
testing.tRunner(0xa88d860, 0x8d36e08)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-01-04 23:16 go1.21-netbsd-arm64 release-branch.go1.21@368e2a94 cmd/go.TestBadCommandLines [ABORT] (log)
=== RUN   TestBadCommandLines
=== PAUSE TestBadCommandLines
=== CONT  TestBadCommandLines
    go_test.go:2763: running testgo [build x]
    go_test.go:2766: running testgo [build x]
    go_test.go:2766: standard error:
    go_test.go:2766: package x: invalid input file name "@y.go"
        
    go_test.go:2766: testgo failed as expected: exit status 1
    go_test.go:2771: running testgo [build x]
...
panic: test timed out after 9m0s
running tests:
	TestBadCommandLines (11s)

goroutine 11994 [running]:
panic({0x20071d0a0?, 0x4000780e70?})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1017 +0x3cc fp=0x40002a0f00 sp=0x40002a0e50 pc=0x20013b44c
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320 fp=0x40002a0fd0 sp=0x40002a0f00 pc=0x20022dd60
runtime.goexit()
...

goroutine 123 [GC worker (idle)]:
runtime.gopark(0x2b5e663c5a192?, 0x40002289c0?, 0x1a?, 0x14?, 0x0?)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/proc.go:398 +0xc8 fp=0x4000424730 sp=0x4000424710 pc=0x20013e5f8
runtime.gcBgMarkWorker()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1295 +0xd8 fp=0x40004247d0 sp=0x4000424730 pc=0x20011f978
runtime.goexit()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1197 +0x4 fp=0x40004247d0 sp=0x40004247d0 pc=0x200171ee4
created by runtime.gcBgMarkStartWorkers in goroutine 117
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mgc.go:1219 +0x28
2024-01-04 23:16 go1.21-netbsd-arm64 release-branch.go1.21@368e2a94 cmd/go.TestGoListExport (log)
=== RUN   TestGoListExport
=== PAUSE TestGoListExport
=== CONT  TestGoListExport
    go_test.go:1310: running testgo [list -f {{.Export}} strings]
    go_test.go:1314: running testgo [list -export -f {{.Export}} strings]
    exec.go:190: test timed out while running command: /home/swarming/.swarming/w/ir/x/t/cmd-go-test-4103796080/tmpdir2792630161/testbin/go list -export -f {{.Export}} strings
    go_test.go:1314: standard error:
    go_test.go:1314: SIGQUIT: quit
        PC=0x200172c0c m=10 sigcode=0
        
...
        r27     0x40
        r28     0x4000003d40
        r29     0xfa55a1fcfaa8
        lr      0x2001389cc
        sp      0xfa55a1fcfab0
        pc      0x200172c0c
        fault   0x3e900007373
        
    go_test.go:1314: go [list -export -f {{.Export}} strings] failed unexpectedly in /home/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go: exit status 2
--- FAIL: TestGoListExport (27.40s)
2024-01-04 23:16 go1.21-netbsd-arm64 release-branch.go1.21@368e2a94 cmd/go.TestScript (log)
=== RUN   TestScript/get_update_all
=== PAUSE TestScript/get_update_all
=== CONT  TestScript/get_update_all
    script_test.go:132: 2024-01-05T15:22:14Z
    script_test.go:134: $WORK=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-4103796080/tmpdir2792630161/get_update_all1180367014
    script_test.go:156: 
        PATH=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-4103796080/tmpdir2792630161/testbin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/cache/tools/bin:/home/swarming/.swarming/w/ir/bbagent_utility_packages:/home/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages:/home/swarming/.swarming/w/ir/cipd_bin_packages/bin:/home/swarming/.swarming/w/ir/cache/cipd_client:/home/swarming/.swarming/w/ir/cache/cipd_client/bin:/home/swarming/.swarming/cipd_cache/bin:/command:/usr/local/bin:/usr/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        r26     0x200878030
        r27     0x20
        r28     0x400008a820
        r29     0xffc5415ffc88
        lr      0x2001389cc
        sp      0xffc5415ffc90
        pc      0x200172c0c
        fault   0x3e900007373
    script_test.go:156: FAIL: testdata/script/get_update_all.txt:6: go get -u -n .../: exit status 2
--- FAIL: TestScript/get_update_all (9.76s)
2024-01-30 18:33 x_tools-go1.22-netbsd-arm64 tools@7ec8ac08 release-branch.go1.22@117d7b10 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckWarning/default [ABORT] (log)
=== RUN   TestRunVulncheckWarning/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/01/31 02:49:34 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckWarning (10s)
	TestRunVulncheckWarning/default (9s)

goroutine 57303 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 57261
	/home/swarming/.swarming/w/ir/x/w/targetrepo2291045777/internal/gocommand/invoke.go:306 +0x134

goroutine 57262 [select, 1 minutes]:
golang.org/x/tools/gopls/internal/cache.(*Snapshot).AwaitInitialized(0x400483f9e0, {0xe87ad0, 0x4008240420})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2291045777/gopls/internal/cache/snapshot.go:1361 +0x68
golang.org/x/tools/gopls/internal/server.(*server).addFolders.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2291045777/gopls/internal/server/general.go:320 +0x48
created by golang.org/x/tools/gopls/internal/server.(*server).addFolders in goroutine 57268
	/home/swarming/.swarming/w/ir/x/w/targetrepo2291045777/gopls/internal/server/general.go:319 +0x454
2024-01-30 23:08 gotip-netbsd-arm64 go@41d66870 cmd/go.TestScript/build_GOTMPDIR (log)
=== RUN   TestScript/build_GOTMPDIR
=== PAUSE TestScript/build_GOTMPDIR
=== CONT  TestScript/build_GOTMPDIR
    script_test.go:132: 2024-01-31T08:46:52Z
    script_test.go:134: $WORK=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-1533113900/tmpdir1345347344/build_GOTMPDIR2273321617
    script_test.go:156: 
        PATH=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-1533113900/tmpdir1345347344/testbin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/cache/tools/bin:/home/swarming/.swarming/w/ir/bbagent_utility_packages:/home/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages:/home/swarming/.swarming/w/ir/cipd_bin_packages/bin:/home/swarming/.swarming/w/ir/cache/cipd_client:/home/swarming/.swarming/w/ir/cache/cipd_client/bin:/home/swarming/.swarming/cipd_cache/bin:/command:/usr/local/bin:/usr/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        r26     0x2008a42f8
        r27     0xffffffffffffff80
        r28     0x40002e9180
        r29     0xf3e1095ffc08
        lr      0x20013b57c
        sp      0xf3e1095ffc10
        pc      0x20017a62c
        fault   0x3e900004a33
    script_test.go:156: FAIL: testdata/script/build_GOTMPDIR.txt:9: go build -x hello.go: exit status 2
--- FAIL: TestScript/build_GOTMPDIR (12.63s)
2024-01-30 23:37 gotip-netbsd-arm64 go@ae457e81 cmd/go.TestGoListExport [ABORT] (log)
=== RUN   TestGoListExport
=== PAUSE TestGoListExport
=== CONT  TestGoListExport
    go_test.go:1164: running testgo [list -f {{.Export}} strings]
    go_test.go:1168: running testgo [list -export -f {{.Export}} strings]
    exec.go:193: test timed out while running command: /home/swarming/.swarming/w/ir/x/t/cmd-go-test-2844365317/tmpdir3682440447/testbin/go list -export -f {{.Export}} strings
    go_test.go:1168: standard error:
    go_test.go:1168: SIGQUIT: quit
        PC=0x200177460 m=11 sigcode=0
        
...
        r26     0x2008a4040
        r27     0x10
        r28     0x40002cd340
        r29     0x4000266a18
        lr      0x200177458
        sp      0xf6f7dd5fff00
        pc      0x200177460
        fault   0x3e9000009ad
        
    go_test.go:1168: go [list -export -f {{.Export}} strings] failed unexpectedly in /home/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go: exit status 2
2024-01-30 23:37 gotip-netbsd-arm64 go@ae457e81 cmd/go.TestGoListTest [ABORT] (log)
=== RUN   TestGoListTest
=== PAUSE TestGoListTest
=== CONT  TestGoListTest
    go_test.go:1089: running testgo [list -test -deps sort]
    exec.go:193: test timed out while running command: /home/swarming/.swarming/w/ir/x/t/cmd-go-test-2844365317/tmpdir3682440447/testbin/go list -test -deps sort
    go_test.go:1089: standard error:
    go_test.go:1089: SIGQUIT: quit
        PC=0x20011a500 m=8 sigcode=0
        
        goroutine 64 gp=0x40001da540 m=8 mp=0x400009b808 [running]:
        runtime.spanOf(...)
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mheap.go:690
        runtime.bulkBarrierPreWriteSrcOnly(0x80?, 0x200807b20?, 0x40001da501?, 0x400011c120?)
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/mbitmap_allocheaders.go:514 +0x50 fp=0x4000314d90 sp=0x4000314d20 pc=0x20011a500
        runtime.growslice(0x40003464c0
    go_test.go:1089: go [list -test -deps sort] failed unexpectedly in /home/swarming/.swarming/w/ir/x/w/goroot/src/cmd/go: signal: killed
2024-01-30 23:37 gotip-netbsd-arm64 go@ae457e81 cmd/go.TestScript (log)
=== RUN   TestScript/list_symlink_vendor_issue14054
=== PAUSE TestScript/list_symlink_vendor_issue14054
=== CONT  TestScript/list_symlink_vendor_issue14054
    script_test.go:132: 2024-01-31T05:52:00Z
    script_test.go:134: $WORK=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-2844365317/tmpdir3682440447/list_symlink_vendor_issue140543787136851
    script_test.go:156: 
        PATH=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-2844365317/tmpdir3682440447/testbin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/cache/tools/bin:/home/swarming/.swarming/w/ir/bbagent_utility_packages:/home/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages:/home/swarming/.swarming/w/ir/cipd_bin_packages/bin:/home/swarming/.swarming/w/ir/cache/cipd_client:/home/swarming/.swarming/w/ir/cache/cipd_client/bin:/home/swarming/.swarming/cipd_cache/bin:/command:/usr/local/bin:/usr/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        r29     0xf85b2b7efe08
        lr      0x20013b57c
        sp      0xf85b2b7efe10
        pc      0x20017a62c
        fault   0x3e9000009ad
        [exit status 2]
    script_test.go:156: FAIL: testdata/script/list_symlink_vendor_issue14054.txt:19: wait: testdata/script/list_symlink_vendor_issue14054.txt:15: go run p.go: exit status 2
        testdata/script/list_symlink_vendor_issue14054.txt:16: go build: exit status 2
        testdata/script/list_symlink_vendor_issue14054.txt:17: go install: exit status 2
--- FAIL: TestScript/list_symlink_vendor_issue14054 (4.39s)
2024-01-31 16:59 x_tools-go1.22-netbsd-arm64 tools@da7ed649 release-branch.go1.22@9289b9c3 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckWarning/default [ABORT] (log)
=== RUN   TestRunVulncheckWarning/default
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckWarning (11s)
	TestRunVulncheckWarning/default (11s)

goroutine 58236 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...
golang.org/x/tools/gopls/internal/test/integration/fake.(*Sandbox).Close(0x4003652d80)
	/home/swarming/.swarming/w/ir/x/w/targetrepo4207189936/gopls/internal/test/integration/fake/sandbox.go:292 +0x9c
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run.func1.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo4207189936/gopls/internal/test/integration/runner.go:206 +0x34
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run.func1(0x4003294ea0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo4207189936/gopls/internal/test/integration/runner.go:255 +0x9f4
testing.tRunner(0x4003294ea0, 0x4003dca640)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1689 +0xec
created by testing.(*T).Run in goroutine 57438
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1742 +0x318

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-02 23:11 netbsd-386-9_3 tools@3403ce10 go@a2f4a5a6 x/tools/internal/imports.TestConcurrentProcess (log)
panic: test timed out after 10m0s
running tests:
	TestConcurrentProcess (9m46s)
	TestConcurrentProcess/GOPATH (9m46s)

testing.(*T).Run(0x8d00d20, {0x8294b86, 0x6}, 0x88ad420)
	/tmp/workdir/go/src/testing/testing.go:1630 +0x440
golang.org/x/tools/internal/imports.testConfig.test({0x0, {{0x829693a, 0x7}, 0x8d977e0, 0x0}, {0x0, 0x0, 0x0}}, 0x8d00d20, 0x82ca160)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/imports/fix_test.go:1690 +0x144
golang.org/x/tools/internal/imports.TestConcurrentProcess(0x8d00d20)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/imports/fix_test.go:2906 +0x104
testing.tRunner(0x8d00d20, 0x82ca164)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-07 19:42 netbsd-amd64-9_3 tools@76ef6b6a go@f2920803 x/tools/gopls/internal/test/integration/misc.TestRenamePackage (log)
serve.go:441: debug server listening at http://localhost:65467
serve.go:441: debug server listening at http://localhost:65466
panic: test timed out after 10m0s
running tests:
	TestRenamePackage (9m10s)
	TestRenamePackage/default (9m10s)

testing.(*T).Run(0xc001e2d1e0, {0x10751a5?, 0x1092adc?}, 0xc0024e9ea0)
	/tmp/workdir/go/src/testing/testing.go:1649 +0x3c8
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0xc00055f4a0, 0xc001e2d1e0, {0x10f2f15, 0x11a}, 0x1210e80, {0x0, 0x0, 0x49310f?})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x48b
golang.org/x/tools/gopls/internal/test/integration.Run(...)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:56
golang.org/x/tools/gopls/internal/test/integration/misc.TestRenamePackage(0xc001174b60?)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/misc/rename_test.go:302 +0x3d
testing.tRunner(0xc001e2d1e0, 0x12109a0)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-01 17:54 x_tools-go1.21-netbsd-arm64 tools@42507833 release-branch.go1.21@f2920803 x/tools/gopls/internal/test/integration/misc.TestStaticcheckGenerics/default [ABORT] (log)
=== RUN   TestStaticcheckGenerics/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/07 21:42:37 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestStaticcheckGenerics (2s)
	TestStaticcheckGenerics/default (1s)

goroutine 49712 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:176 +0x38
...
encoding/json.(*Decoder).Decode(0x40002f0a00, {0xa493c0, 0x40001c9470})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/encoding/json/stream.go:63 +0x5c
golang.org/x/tools/internal/jsonrpc2.(*rawStream).Read(0x400d424570, {0xe4bd48, 0x4001b9c000})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3910434633/internal/jsonrpc2/stream.go:61 +0x70
golang.org/x/tools/gopls/internal/protocol.(*loggingStream).Read(0x4005c444e0, {0xe4bd48?, 0x4001b9c000?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3910434633/gopls/internal/protocol/log.go:30 +0x38
golang.org/x/tools/internal/jsonrpc2.(*conn).run(0x400ab89cc0, {0xe4bd48, 0x4001b9c000}, 0x40032ad818)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3910434633/internal/jsonrpc2/conn.go:196 +0x84
created by golang.org/x/tools/internal/jsonrpc2.(*conn).Go in goroutine 49702
	/home/swarming/.swarming/w/ir/x/w/targetrepo3910434633/internal/jsonrpc2/conn.go:189 +0xa8
2024-02-07 02:22 x_tools-gotip-netbsd-arm64 tools@7f80389a go@39ec246e x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/default/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/default/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/07 16:28:10 go info for /home/swarming/.sw...
        	Info: "2024/02/07 16:28:21 go/packages.Load #304\n\tsnaps...
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (55s)
	TestRunVulncheckPackageDiagnostics/default (34s)
	TestRunVulncheckPackageDiagnostics/default/default (33s)

goroutine 56898 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...

goroutine 56538 [chan receive]:
testing.(*T).Run(0x400208a9c0, {0xbc9450?, 0xbfa212?}, 0x4004628f80)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1750 +0x32c
golang.org/x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics(0x400208a9c0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo350669198/gopls/internal/test/integration/misc/vuln_test.go:556 +0x214
testing.tRunner(0x400208a9c0, 0xd65018)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1689 +0xec
created by testing.(*T).Run in goroutine 1
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1742 +0x318

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-07 19:14 x_tools-go1.21-netbsd-arm64 tools@acf07b3c release-branch.go1.21@b214108e x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/imports/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/imports/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/09 19:18:26 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (9s)
	TestRunVulncheckPackageDiagnostics/imports (8s)
	TestRunVulncheckPackageDiagnostics/imports/default (8s)

goroutine 55548 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
...
os.(*Process).wait(0x400d9aa5d0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec_unix.go:22 +0x2c
os.(*Process).Wait(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec.go:134
os/exec.(*Cmd).Wait(0x40020b06e0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:890 +0x38
golang.org/x/tools/internal/gocommand.runCmdContext.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1563104732/internal/gocommand/invoke.go:362 +0x28
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 55544
	/home/swarming/.swarming/w/ir/x/w/targetrepo1563104732/internal/gocommand/invoke.go:361 +0x288
2024-02-08 13:20 x_tools-go1.22-netbsd-arm64 tools@f4fa7a75 release-branch.go1.22@20107e05 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/08 19:38:07 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (36s)
	TestRunVulncheckPackageDiagnostics/invalid (4s)
	TestRunVulncheckPackageDiagnostics/invalid/default (4s)

goroutine 57842 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...
net.(*TCPListener).Accept(0x4007d61240)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/net/tcpsock.go:327 +0x2c
net/http.(*Server).Serve(0x400cba3e00, {0xeac510, 0x4007d61240})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/net/http/server.go:3255 +0x2a8
net/http.Serve(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/net/http/server.go:2794
golang.org/x/tools/gopls/internal/debug.(*Instance).Serve.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo750608834/gopls/internal/debug/serve.go:483 +0x984
created by golang.org/x/tools/gopls/internal/debug.(*Instance).Serve in goroutine 4662
	/home/swarming/.swarming/w/ir/x/w/targetrepo750608834/gopls/internal/debug/serve.go:444 +0x388

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-07 19:14 x_tools-go1.22-netbsd-arm64 tools@acf07b3c release-branch.go1.22@20107e05 x/tools/gopls/internal/test/integration/misc.TestPrepareRenameFailWithUnknownModule/default [ABORT] (log)
=== RUN   TestPrepareRenameFailWithUnknownModule/default
    rename_test.go:138: missing cannot rename packages with unknown module from PrepareRename
#### Start Gopls Test Logs for "TestPrepareRenameFailWithUnknownModule/default"
[Trace - 04:59:08.110 AM] Sending request 'initialize - (1)'.
Params: {"processId":0,"rootUri":"","capabilities":{"workspace":{"workspaceEdit":{"resourceOperations":["rename"]},"didChangeConfiguration":{},"didChangeWatchedFiles":{"dynamicRegistration":true},"configuration":true},"textDocument":{"completion":{"completionItem":{"snippetSupport":true,"tagSupport":{"valueSet":[1]}}},"documentSymbol":{"hierarchicalDocumentSymbolSupport":true},"codeAction":{"codeActionLiteralSupport":{"codeActionKind":{"valueSet":null}}},"publishDiagnostics":{},"semanticTokens":{"requests":{"full":true},"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"],"formats":null}},"window":{"workDoneProgress":true}},"initializationOptions":{"completionBudget":"0s","diagnosticsDelay":"10ms","env":{"GO111MODULE":"","GOMODCACHE":"","GOPACKAGESDRIVER":"off","GOPATH":"/home/swarming/.swarming/w/ir/x/t/gopls-test-2835049393/TestPrepareRenameFailWithUnknownModule/default/gopath","GOPROXY":"file:///home/swarming/.swarming/w/ir/x/t/gopls-test-2835049393/TestPrepareRenameFailWithUnknownModule/default/proxy","GOSUMDB":"off"},"verboseWorkDoneProgress":true},"trace":"messages","workspaceFolders":[{"uri":"file:///home/swarming/.swarming/w/ir/x/t/gopls-test-2835049393/TestPrepareRenameFailWithUnknownModule/default/work","name":"work"}]}


[Trace - 04:59:08.255 AM] Received response 'initialize - (1)' in 145ms.
Result: {"capabilities":{"textDocumentSync":{"openClose":true,"change":2,"save":{}},"completionProvider":{"triggerCharacters":["."]},"hoverProvider":true,"signatureHelpProvider":{"triggerCharacters":["(",","]},"definitionProvider":true,"typeDefinitionProvider":true,"implementationProvider":true,"referencesProvider":true,"documentHighlightProvider":true,"documentSymbolProvider":true,"codeActionProvider":true,"codeLensProvider":{},"documentLinkProvider":{},"workspaceSymbolProvider":true,"documentFormattingProvider":true,"renameProvider":true,"foldingRangeProvider":true,"selectionRangeProvider":true,"executeCommandProvider":{"commands":["gopls.add_dependency","gopls.add_import","gopls.add_telemetry_counters","gopls.apply_fix","gopls.change_signature","gopls.check_upgrades","gopls.diagnose_files","gopls.edit_go_directive","gopls.fetch_vulncheck_result","gopls.gc_details","gopls.generate","gopls.go_get_package","gopls.list_imports","gopls.list_known_packages","gopls.maybe_prompt_for_telemetry","gopls.mem_stats","gopls.regenerate_cgo","gopls.remove_dependency","gopls.reset_go_mod_diagnostics","gopls.run_go_work_command","gopls.run_govulncheck","gopls.run_tests","gopls.start_debugging","gopls.start_profile","gopls.stop_profile","gopls.test","gopls.tidy","gopls.toggle_gc_details","gopls.update_go_sum","gopls.upgrade_dependency","gopls.vendor","gopls.views","gopls.workspace_stats"]},"callHierarchyProvider":true,"semanticTokensProvider":{"legend":{"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"]},"range":true,"full":true},"inlayHintProvider":{},"workspace":{"workspaceFolders":{"supported":true,"changeNotifications":"workspace/didChangeWorkspaceFolders"}}},"serverInfo":{"name":"gopls","version":"{\"GoVersion\":\"devel 20107e05a609b8f2e61a6b5e8dc258237ad046e7\",\"Path\":\"\",\"Main\":{\"Path\":\"\",\"Version\":\"\",\"Sum\":\"\",\"Replace\":null},\"Deps\":null,\"Settings\":null,\"Version\":\"(unknown)\"}"}}

...
panic: test timed out after 10m0s
running tests:
	TestPrepareRenameFailWithUnknownModule (2s)
	TestPrepareRenameFailWithUnknownModule/default (2s)

goroutine 40992 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x40003f1540, 0x4001436680, {0xc3fce9, 0x8b}, 0xd66120, {0x0, 0x0, 0x148268?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2344120808/gopls/internal/test/integration/runner.go:167 +0x3dc
golang.org/x/tools/gopls/internal/test/integration.Run(...)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2344120808/gopls/internal/test/integration/regtest.go:56
golang.org/x/tools/gopls/internal/test/integration/misc.TestPrepareRenameFailWithUnknownModule(0x4001436680?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2344120808/gopls/internal/test/integration/misc/rename_test.go:131 +0x50
testing.tRunner(0x4001436680, 0xd65c38)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1689 +0xec
created by testing.(*T).Run in goroutine 1
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1742 +0x318
2024-02-09 17:45 x_tools-go1.21-netbsd-arm64 tools@96196832 release-branch.go1.21@b214108e x/tools/gopls/internal/test/integration/misc.TestFetchVulncheckResultStd/default [ABORT] (log)
=== RUN   TestFetchVulncheckResultStd/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/10 17:06:23 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestFetchVulncheckResultStd (4s)
	TestFetchVulncheckResultStd/default (3s)

goroutine 54222 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:176 +0x38
...
golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2.2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2797116030/internal/jsonrpc2/handler.go:103 +0x90
created by golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2 in goroutine 54046
	/home/swarming/.swarming/w/ir/x/w/targetrepo2797116030/internal/jsonrpc2/handler.go:100 +0x1d0

goroutine 54221 [chan receive]:
golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2.2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2797116030/internal/jsonrpc2/handler.go:101 +0x60
created by golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2 in goroutine 54046
	/home/swarming/.swarming/w/ir/x/w/targetrepo2797116030/internal/jsonrpc2/handler.go:100 +0x1d0
2024-02-09 20:28 x_tools-go1.21-netbsd-arm64 tools@8cf0a8e2 release-branch.go1.21@b214108e x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (39s)
	TestRunVulncheckPackageDiagnostics/invalid (9s)
	TestRunVulncheckPackageDiagnostics/invalid/default (9s)

goroutine 55495 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
...
golang.org/x/tools/gopls/internal/test/integration/fake.(*Sandbox).Close(0x40030ce6c0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo792330823/gopls/internal/test/integration/fake/sandbox.go:292 +0x9c
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run.func1.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo792330823/gopls/internal/test/integration/runner.go:206 +0x34
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run.func1(0x4004e56340)
	/home/swarming/.swarming/w/ir/x/w/targetrepo792330823/gopls/internal/test/integration/runner.go:255 +0xa08
testing.tRunner(0x4004e56340, 0x4003ae2af0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1595 +0xe8
created by testing.(*T).Run in goroutine 55333
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1648 +0x33c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-09 18:30 x_tools-gotip-netbsd-arm64 tools@730dc3c1 go@4a7f3ac8 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/11 23:24:46 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (43s)
	TestRunVulncheckPackageDiagnostics/invalid (4s)
	TestRunVulncheckPackageDiagnostics/invalid/default (4s)

goroutine 57361 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...

goroutine 56799 [chan receive]:
testing.(*T).Run(0x400254c680, {0xbc94db?, 0xbfa359?}, 0x4000cb6100)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1750 +0x32c
golang.org/x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics(0x400254c680)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1773783150/gopls/internal/test/integration/misc/vuln_test.go:556 +0x214
testing.tRunner(0x400254c680, 0xd65358)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1689 +0xec
created by testing.(*T).Run in goroutine 1
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1742 +0x318
2024-02-12 19:37 x_tools-go1.21-netbsd-arm64 tools@50b4f1b1 release-branch.go1.21@b214108e x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/12 22:55:06 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (52s)
	TestRunVulncheckPackageDiagnostics/invalid (5s)
	TestRunVulncheckPackageDiagnostics/invalid/default (5s)

goroutine 55030 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
...
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x40002cdd60, 0x400235d6c0, {0xc175ca, 0x3a5}, 0x40076511c0, {0x4001c6c8a0, 0x4, 0x0?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo4155060322/gopls/internal/test/integration/runner.go:167 +0x404
golang.org/x/tools/gopls/internal/test/integration.configuredRunner.Run({{0x4001c6c8a0?, 0xee1d76?, 0xf?}}, 0x400235d6c0, {0xc175ca, 0x3a5}, 0x146b6e?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo4155060322/gopls/internal/test/integration/regtest.go:80 +0xf0
golang.org/x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics.func3(0x4001ee16c0?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo4155060322/gopls/internal/test/integration/misc/vuln_test.go:559 +0x148
testing.tRunner(0x400235d6c0, 0x400273bb80)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1595 +0xe8
created by testing.(*T).Run in goroutine 54629
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:1648 +0x33c
2024-02-13 14:38 x_tools-go1.22-netbsd-arm64 tools@1b39a8b6 release-branch.go1.22@20107e05 x/tools/gopls/internal/test/integration/misc.TestRunGovulncheck_Expiry/default [ABORT] (log)
=== RUN   TestRunGovulncheck_Expiry/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/13 18:18:45 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunGovulncheck_Expiry (5s)
	TestRunGovulncheck_Expiry/default (4s)

goroutine 57710 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
created by golang.org/x/tools/internal/jsonrpc2/servertest.(*PipeServer).Connect in goroutine 57671
	/home/swarming/.swarming/w/ir/x/w/targetrepo687698275/internal/jsonrpc2/servertest/servertest.go:84 +0x178

goroutine 57696 [select]:
golang.org/x/tools/gopls/internal/cache.(*Snapshot).AwaitInitialized(0x400292ed80, {0xeae1b0, 0x4003c558c0})
	/home/swarming/.swarming/w/ir/x/w/targetrepo687698275/gopls/internal/cache/snapshot.go:1359 +0x68
golang.org/x/tools/gopls/internal/server.(*server).addFolders.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo687698275/gopls/internal/server/general.go:324 +0x48
created by golang.org/x/tools/gopls/internal/server.(*server).addFolders in goroutine 57704
	/home/swarming/.swarming/w/ir/x/w/targetrepo687698275/gopls/internal/server/general.go:323 +0x454
2024-02-14 14:36 x_tools-go1.22-netbsd-arm64 tools@945a754d release-branch.go1.22@20107e05 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/imports/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/imports/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/14 19:40:58 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (6s)
	TestRunVulncheckPackageDiagnostics/imports (5s)
	TestRunVulncheckPackageDiagnostics/imports/default (5s)

goroutine 56961 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...
os.(*File).WriteTo(0x152a960?, {0xea52e0?, 0x40038a89f0?})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/file.go:247 +0x60
io.copyBuffer({0xea52e0, 0x40038a89f0}, {0xea4ec0, 0x4005ed4378}, {0x0, 0x0, 0x0})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:411 +0x98
io.Copy(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:388
golang.org/x/tools/internal/gocommand.runCmdContext.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2608966774/internal/gocommand/invoke.go:307 +0x4c
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 57000
	/home/swarming/.swarming/w/ir/x/w/targetrepo2608966774/internal/gocommand/invoke.go:306 +0x134
2024-02-14 18:27 x_tools-go1.21-netbsd-arm64 tools@f1914ccb release-branch.go1.21@b214108e x/tools/gopls/internal/test/integration/misc.TestWindowsVendoring_Issue56291/default [ABORT] (log)
=== RUN   TestWindowsVendoring_Issue56291/default
panic: test timed out after 10m0s
running tests:
	TestWindowsVendoring_Issue56291 (22s)
	TestWindowsVendoring_Issue56291/default (21s)

goroutine 53630 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
...
bytes.(*Buffer).ReadFrom(0x4003fbc8a0, {0xe597a0, 0x40039ea288})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/bytes/buffer.go:211 +0x90
io.copyBuffer({0xe59bc0, 0x4003fbc8a0}, {0xe597a0, 0x40039ea288}, {0x0, 0x0, 0x0})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:416 +0x108
io.Copy(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:389
golang.org/x/tools/internal/gocommand.runCmdContext.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3622942568/internal/gocommand/invoke.go:307 +0x44
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 52806
	/home/swarming/.swarming/w/ir/x/w/targetrepo3622942568/internal/gocommand/invoke.go:306 +0x130

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-15 20:20 netbsd-386-9_3 tools@2bd79490 go@5258d4ed x/tools/gopls/internal/test/integration/completion.TestPostfixSnippetCompletion (log)
panic: test timed out after 10m0s
running tests:
	TestPostfixSnippetCompletion (9m40s)
	TestPostfixSnippetCompletion/default (9m40s)

testing.(*T).Run(0x99f6208, {0x8bd0f00, 0x7}, 0xb894510)
	/tmp/workdir/go/src/testing/testing.go:1750 +0x3d2
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x9930120, 0x99f6208, {0x8c1b48c, 0x26}, 0xa9dd680, {0x9d7378c, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x3ab
golang.org/x/tools/gopls/internal/test/integration.configuredRunner.Run({{0x9d7378c, 0x1, 0x1}}, 0x99f6208, {0x8c1b48c, 0x26}, 0xa9dd680)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:80 +0x133
golang.org/x/tools/gopls/internal/test/integration/completion.TestPostfixSnippetCompletion(0x99f6208)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/completion/postfix_snippet_test.go:736 +0x164
testing.tRunner(0x99f6208, 0x8d4d5b8)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-14 21:42 x_tools-go1.21-netbsd-arm64 tools@fef8b627 release-branch.go1.21@b214108e x/tools/gopls/internal/test/integration/misc.TestRenamePackageWithConflicts/default [ABORT] (log)
=== RUN   TestRenamePackageWithConflicts/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/15 04:33:52 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRenamePackageWithConflicts (2s)
	TestRenamePackageWithConflicts/default (2s)

goroutine 40257 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:176 +0x38
...
net.(*TCPListener).Accept(0x400c6272e0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/net/tcpsock.go:315 +0x2c
net/http.(*Server).Serve(0x4006fae5a0, {0xe61f30, 0x400c6272e0})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/net/http/server.go:3056 +0x2b8
net/http.Serve(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/net/http/server.go:2595
golang.org/x/tools/gopls/internal/debug.(*Instance).Serve.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2622843102/gopls/internal/debug/serve.go:483 +0xa74
created by golang.org/x/tools/gopls/internal/debug.(*Instance).Serve in goroutine 4622
	/home/swarming/.swarming/w/ir/x/w/targetrepo2622843102/gopls/internal/debug/serve.go:444 +0x3b0
2024-02-15 16:20 x_tools-gotip-netbsd-arm64 tools@babbbed1 go@b6ca5861 x/tools/gopls/internal/test/integration/misc.TestWindowsVendoring_Issue56291/default [ABORT] (log)
=== RUN   TestWindowsVendoring_Issue56291/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/15 17:31:52 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestWindowsVendoring_Issue56291 (5s)
	TestWindowsVendoring_Issue56291/default (5s)

goroutine 54431 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).WorkspaceMetadata(0x400b75eb40, {0xead830?, 0x4001c040f0?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo565597763/gopls/internal/cache/snapshot.go:1081 +0x44
golang.org/x/tools/gopls/internal/server.(*server).diagnose(0x40060ee000, {0xead830, 0x4000631e60}, 0x400b75eb40)
	/home/swarming/.swarming/w/ir/x/w/targetrepo565597763/gopls/internal/server/diagnostics.go:368 +0x400
golang.org/x/tools/gopls/internal/server.(*server).diagnoseSnapshot(0x40060ee000, 0x400b75eb40, {0x0, 0x0, 0x0}, 0x0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo565597763/gopls/internal/server/diagnostics.go:225 +0x43c
golang.org/x/tools/gopls/internal/server.(*server).addFolders.func3()
	/home/swarming/.swarming/w/ir/x/w/targetrepo565597763/gopls/internal/server/general.go:333 +0x4c
created by golang.org/x/tools/gopls/internal/server.(*server).addFolders in goroutine 54423
	/home/swarming/.swarming/w/ir/x/w/targetrepo565597763/gopls/internal/server/general.go:332 +0x4e0

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-16 15:54 netbsd-386-9_3 tools@0d171942 go@74abbdfe x/tools/gopls/internal/test/integration/diagnostics (log)
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 22243): see golang/go#54461 for more details

goroutine 19990 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xbb62030)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:442 +0x50f
golang.org/x/tools/internal/gocommand.runCmdContext({0x8e81cd8, 0xb77d260}, 0xddb2188)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:375 +0x488
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x9bc09cc, {0x8e81cd8, 0xb77d260}, {0x8e7c794, 0xb77d2d8}, {0x8e7c794, 0xb77d2f0})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:270 +0xe7d
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x9bc09cc, {0x8e81cd8, 0xb77d260}, {0x8e7c794, 0xb77d2d8}, {0x8e7c794, 0xb77d2f0})
...
golang.org/x/tools/gopls/internal/golang.NarrowestMetadataForFile({0x8e81cd8, 0x9a09db8}, 0xb1a2508, {0xab148a0, 0x52})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/golang/snapshot.go:21 +0x42
golang.org/x/tools/gopls/internal/server.(*server).diagnoseChangedFiles(0xc085d98, {0x8e81cd8, 0x9cb3a70}, 0xb1a2508, {0xad00ad0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/server/diagnostics.go:268 +0x36a
golang.org/x/tools/gopls/internal/server.(*server).diagnoseSnapshot(0xc085d98, 0xb1a2508, {0xad00ad0, 0x1, 0x1}, 0x989680)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/server/diagnostics.go:202 +0x370
golang.org/x/tools/gopls/internal/server.(*server).diagnoseChangedViews.func1(0xb1a2508, {0xad00ad0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/server/diagnostics.go:138 +0xc2
created by golang.org/x/tools/gopls/internal/server.(*server).diagnoseChangedViews in goroutine 19989
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/server/diagnostics.go:135 +0x36f

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-16 17:20 x_tools-gotip-netbsd-arm64 tools@451218f6 go@63dd79c0 x/tools/gopls/internal/test/integration/misc.TestReferencesFromWorkspacePackages59674/default [ABORT] (log)
=== RUN   TestReferencesFromWorkspacePackages59674/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        
        #### diagnostics:
...
panic: test timed out after 10m0s
running tests:
	TestReferencesFromWorkspacePackages59674 (2s)
	TestReferencesFromWorkspacePackages59674/default (2s)

goroutine 39617 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
encoding/json.(*Decoder).Decode(0x400023b2c0, {0xa9cda0, 0x400305ad80})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/encoding/json/stream.go:63 +0x5c
golang.org/x/tools/internal/jsonrpc2.(*rawStream).Read(0x40006dafa8, {0xead930, 0x4003f23920})
	/home/swarming/.swarming/w/ir/x/w/targetrepo664960203/internal/jsonrpc2/stream.go:61 +0x70
golang.org/x/tools/gopls/internal/protocol.(*loggingStream).Read(0x400a2615c0, {0xead930?, 0x4003f23920?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo664960203/gopls/internal/protocol/log.go:30 +0x38
golang.org/x/tools/internal/jsonrpc2.(*conn).run(0x4002b74dc0, {0xead930, 0x4003f23920}, 0x40043ca510)
	/home/swarming/.swarming/w/ir/x/w/targetrepo664960203/internal/jsonrpc2/conn.go:196 +0x84
created by golang.org/x/tools/internal/jsonrpc2.(*conn).Go in goroutine 39592
	/home/swarming/.swarming/w/ir/x/w/targetrepo664960203/internal/jsonrpc2/conn.go:189 +0x90
2024-02-16 17:49 x_tools-gotip-netbsd-arm64 tools@c61f99f1 go@cf52e709 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckWarning/default [ABORT] (log)
=== RUN   TestRunVulncheckWarning/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/19 17:01:13 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckWarning (4s)
	TestRunVulncheckWarning/default (3s)

goroutine 57993 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
golang.org/x/tools/go/packages.goListDriver.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo23170584/go/packages/golist.go:155 +0x178
created by golang.org/x/tools/go/packages.goListDriver in goroutine 58024
	/home/swarming/.swarming/w/ir/x/w/targetrepo23170584/go/packages/golist.go:151 +0x258

goroutine 57992 [chan receive]:
golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2.2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo23170584/internal/jsonrpc2/handler.go:101 +0x60
created by golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2 in goroutine 57989
	/home/swarming/.swarming/w/ir/x/w/targetrepo23170584/internal/jsonrpc2/handler.go:100 +0x19c
2024-02-16 18:21 x_tools-go1.21-netbsd-arm64 tools@4231a57f release-branch.go1.21@f38fca30 x/tools/gopls/internal/test/integration/misc.TestWorkspaceSymbolSorting/default [ABORT] (log)
=== RUN   TestWorkspaceSymbolSorting/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/17 17:51:31 go info for /home/swarming/.sw...
        	Info: "2024/02/17 17:51:31 go/packages.Load #317\n\tsnaps...
...
panic: test timed out after 10m0s
running tests:
	TestWorkspaceSymbolSorting (0s)
	TestWorkspaceSymbolSorting/default (0s)

goroutine 56762 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2259 +0x320
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:176 +0x38
...
os.(*File).Write(0x4004e982b0, {0x40010f9ba8?, 0x20, 0x27?})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/file.go:183 +0x5c
golang.org/x/tools/gopls/internal/filecache.writeFileNoTrunc({0x4001d31f80?, 0x27?}, {0x40010f9ba8, 0x20, 0x20}, 0xa?)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3150619579/gopls/internal/filecache/filecache.go:201 +0x4c
golang.org/x/tools/gopls/internal/filecache.Set({0xb8d57f, 0xa}, {0x26, 0xdb, 0xf3, 0x48, 0x6c, 0xa9, 0x3f, 0x7c, ...}, ...)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3150619579/gopls/internal/filecache/filecache.go:182 +0x1ec
golang.org/x/tools/gopls/internal/cache.storePackageResults({0xe63088, 0x4006137d40}, 0x40031d8120, 0x4006011b60)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3150619579/gopls/internal/cache/check.go:592 +0x43c
created by golang.org/x/tools/gopls/internal/cache.(*typeCheckBatch).handleSyntaxPackage in goroutine 56757
	/home/swarming/.swarming/w/ir/x/w/targetrepo3150619579/gopls/internal/cache/check.go:561 +0x5f8
2024-02-16 18:21 x_tools-go1.22-netbsd-arm64 tools@4231a57f release-branch.go1.22@6cbe522f x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log)
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/17 15:29:08 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestRunVulncheckPackageDiagnostics (38s)
	TestRunVulncheckPackageDiagnostics/invalid (4s)
	TestRunVulncheckPackageDiagnostics/invalid/default (4s)

goroutine 57187 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).WorkspaceMetadata(0x4001407200, {0xeae710?, 0x40043f7200?})
	/home/swarming/.swarming/w/ir/x/w/targetrepo692130781/gopls/internal/cache/snapshot.go:1082 +0x44
golang.org/x/tools/gopls/internal/server.(*server).diagnose(0x4001f0e400, {0xeae710, 0x40043f7080}, 0x4001407200)
	/home/swarming/.swarming/w/ir/x/w/targetrepo692130781/gopls/internal/server/diagnostics.go:368 +0x400
golang.org/x/tools/gopls/internal/server.(*server).diagnoseSnapshot(0x4001f0e400, 0x4001407200, {0x0, 0x0, 0x0}, 0x0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo692130781/gopls/internal/server/diagnostics.go:225 +0x43c
golang.org/x/tools/gopls/internal/server.(*server).addFolders.func3()
	/home/swarming/.swarming/w/ir/x/w/targetrepo692130781/gopls/internal/server/general.go:333 +0x4c
created by golang.org/x/tools/gopls/internal/server.(*server).addFolders in goroutine 57072
	/home/swarming/.swarming/w/ir/x/w/targetrepo692130781/gopls/internal/server/general.go:332 +0x4e0
2024-02-16 20:24 gotip-netbsd-arm64 go@f2db96cd cmd/go.TestScript/test_relative_cmdline (log)
=== RUN   TestScript/test_relative_cmdline
=== PAUSE TestScript/test_relative_cmdline
=== CONT  TestScript/test_relative_cmdline
    script_test.go:132: 2024-02-18T08:28:20Z
    script_test.go:134: $WORK=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-2706942533/tmpdir3101133418/test_relative_cmdline435956273
    script_test.go:156: 
        PATH=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-2706942533/tmpdir3101133418/testbin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/cache/tools/bin:/home/swarming/.swarming/w/ir/bbagent_utility_packages:/home/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages:/home/swarming/.swarming/w/ir/cipd_bin_packages/bin:/home/swarming/.swarming/w/ir/cache/cipd_client:/home/swarming/.swarming/w/ir/cache/cipd_client/bin:/home/swarming/.swarming/cipd_cache/bin:/command:/usr/local/bin:/usr/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        r26     0x2008a6610
        r27     0xffffffffffffffc0
        r28     0x4000092fc0
        r29     0xfcbecf7ffc08
        lr      0x20013b58c
        sp      0xfcbecf7ffc10
        pc      0x20017a84c
        fault   0x3e900000cdd
    script_test.go:156: FAIL: testdata/script/test_relative_cmdline.txt:8: go test ./testimport/p.go ./testimport/p_test.go ./testimport/x_test.go: exit status 2
--- FAIL: TestScript/test_relative_cmdline (12.15s)
2024-02-16 21:45 x_tools-gotip-netbsd-arm64 tools@3ac77cb1 go@af5943f9 x/tools/gopls/internal/test/integration/misc.TestWorkspaceSymbolMissingMetadata/default [ABORT] (log)
=== RUN   TestWorkspaceSymbolMissingMetadata/default
    runner.go:253: waiting on:
        Unmet: completed work "diagnosing initial workspace load" 1 times
        
        err:context deadline exceeded
        
        state:
        #### log messages (see RPC logs for full text):
        	Info: "2024/02/18 03:21:14 go info for /home/swarming/.sw...
        
...
panic: test timed out after 10m0s
running tests:
	TestWorkspaceSymbolMissingMetadata (0s)
	TestWorkspaceSymbolMissingMetadata/default (0s)

goroutine 58779 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:177 +0x38
...
os.(*Process).wait(0x40016e9530)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec_unix.go:22 +0x2c
os.(*Process).Wait(...)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec.go:134
os/exec.(*Cmd).Wait(0x4002c1a580)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/exec/exec.go:897 +0x2d
golang.org/x/tools/internal/gocommand.runCmdContext.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3409104656/internal/gocommand/invoke.go:362 +0x28
created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 58755
	/home/swarming/.swarming/w/ir/x/w/targetrepo3409104656/internal/gocommand/invoke.go:361 +0x284

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-27 17:43 netbsd-386-9_3 tools@fc703543 go@96e9838f x/tools/gopls/internal/test/integration/diagnostics.Test_Issue38211 (log)
#### Start Gopls Test Logs for "Test_Issue38211/default"
[Trace - 00:07:48.189 AM] Sending request 'initialize - (1)'.
Params: {"processId":0,"clientInfo":{"name":"fake.Editor","version":"v1.0.0"},"rootUri":"","capabilities":{"workspace":{"workspaceEdit":{"resourceOperations":["rename"]},"didChangeConfiguration":{},"didChangeWatchedFiles":{"dynamicRegistration":true},"configuration":true},"textDocument":{"completion":{"completionItem":{"snippetSupport":true,"tagSupport":{"valueSet":[1]}}},"documentSymbol":{"hierarchicalDocumentSymbolSupport":true},"codeAction":{"codeActionLiteralSupport":{"codeActionKind":{"valueSet":null}}},"publishDiagnostics":{},"semanticTokens":{"requests":{"full":true},"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator","label"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"],"formats":null}},"window":{"workDoneProgress":true}},"initializationOptions":{"completionBudget":"0s","diagnosticsDelay":"10ms","env":{"GO111MODULE":"","GOMODCACHE":"","GOPACKAGESDRIVER":"off","GOPATH":"/tmp/workdir/tmp/gopls-test-3438365719/Test_Issue38211/default/gopath","GOPROXY":"file:///tmp/workdir/tmp/gopls-test-3438365719/Test_Issue38211/default/proxy","GOSUMDB":"off"},"verboseWorkDoneProgress":true},"trace":"messages","workspaceFolders":[{"uri":"file:///tmp/workdir/tmp/gopls-test-3438365719/Test_Issue38211/default/work","name":"work"}]}


[Trace - 00:07:48.190 AM] Received response 'initialize - (1)' in 0ms.
Result: {"capabilities":{"textDocumentSync":{"openClose":true,"change":2,"save":{}},"completionProvider":{"triggerCharacters":["."]},"hoverProvider":true,"signatureHelpProvider":{"triggerCharacters":["(",","]},"definitionProvider":true,"typeDefinitionProvider":true,"implementationProvider":true,"referencesProvider":true,"documentHighlightProvider":true,"documentSymbolProvider":true,"codeActionProvider":true,"codeLensProvider":{},"documentLinkProvider":{},"workspaceSymbolProvider":true,"documentFormattingProvider":true,"renameProvider":true,"foldingRangeProvider":true,"selectionRangeProvider":true,"executeCommandProvider":{"commands":["gopls.add_dependency","gopls.add_import","gopls.add_telemetry_counters","gopls.apply_fix","gopls.change_signature","gopls.check_upgrades","gopls.diagnose_files","gopls.edit_go_directive","gopls.fetch_vulncheck_result","gopls.gc_details","gopls.generate","gopls.go_get_package","gopls.list_imports","gopls.list_known_packages","gopls.maybe_prompt_for_telemetry","gopls.mem_stats","gopls.regenerate_cgo","gopls.remove_dependency","gopls.reset_go_mod_diagnostics","gopls.run_go_work_command","gopls.run_govulncheck","gopls.run_tests","gopls.start_debugging","gopls.start_profile","gopls.stop_profile","gopls.test","gopls.tidy","gopls.toggle_gc_details","gopls.update_go_sum","gopls.upgrade_dependency","gopls.vendor","gopls.views","gopls.workspace_stats"]},"callHierarchyProvider":true,"semanticTokensProvider":{"legend":{"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator","label"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"]},"range":true,"full":true},"inlayHintProvider":{},"workspace":{"workspaceFolders":{"supported":true,"changeNotifications":"workspace/didChangeWorkspaceFolders"}}},"serverInfo":{"name":"gopls","version":"{\"GoVersion\":\"devel 96e9838f39d8da2cd249f5ee62869239cbb1e9e7\",\"Path\":\"\",\"Main\":{\"Path\":\"\",\"Version\":\"\",\"Sum\":\"\",\"Replace\":null},\"Deps\":null,\"Settings\":null,\"Version\":\"(unknown)\"}"}}


[Trace - 00:07:48.190 AM] Sending notification 'initialized'.
...
panic: test timed out after 10m0s
running tests:
	Test_Issue38211 (9m31s)
	Test_Issue38211/default (9m31s)

testing.(*T).Run(0x9f7c108, {0x8bc4a37, 0x7}, 0xe25d560)
	/tmp/workdir/go/src/testing/testing.go:1750 +0x3d2
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x9c64060, 0x9f7c108, {0x8c36f0d, 0x8e}, 0x8d41f5c, {0xa2f3f8c, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x3ab
golang.org/x/tools/gopls/internal/test/integration.configuredRunner.Run({{0xa2f3f8c, 0x1, 0x1}}, 0x9f7c108, {0x8c36f0d, 0x8e}, 0x8d41f5c)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:80 +0x133
golang.org/x/tools/gopls/internal/test/integration/diagnostics.Test_Issue38211(0x9f7c108)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/diagnostics/diagnostics_test.go:661 +0x9c
testing.tRunner(0x9f7c108, 0x8d41d54)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-28 15:52 netbsd-386-9_3 go@ed07e16f net/http.TestOmitHTTP2Vet (log)
--- FAIL: TestOmitHTTP2Vet (160.97s)
    exec.go:193: test timed out while running command: /tmp/workdir/go/bin/go vet -tags=nethttpomithttp2 net/http
    http_test.go:105: go vet failed: exit status 2, SIGQUIT: quit
        PC=0x80bdc27 m=15 sigcode=0

        goroutine 0 gp=0x9494fc8 m=15 mp=0x8d07708 [idle]:
        runtime.lwp_park(0x3, 0x0, 0x0, 0x0, 0x8d07a90, 0x0)
        	runtime/sys_netbsd_386.s:404 +0x8 fp=0x93b1e6c sp=0x93b1e68 pc=0x80bdc28
        runtime.semasleep(0xffffffffffffffff)
        	runtime/os_netbsd.go:183 +0x24a fp=0x93b1eb4 sp=0x93b1e6c pc=0x808228a
...
        edx    0x8d07708
        edi    0x0
        esi    0x10
        ebp    0xb
        esp    0x93b1e68
        eip    0x80bdc27
        eflags 0x247
        cs     0x17
        fs     0xab
        gs     0xb3

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-02-28 21:26 netbsd-386-9_3 tools@38b0e9bf go@3643147a x/tools/gopls/internal/test/integration/misc.TestRenamePackage (log)
serve.go:441: debug server listening at http://localhost:65429
serve.go:441: debug server listening at http://localhost:65428
panic: test timed out after 10m0s
running tests:
	TestRenamePackage (9m15s)
	TestRenamePackage/default (9m15s)

testing.(*T).Run(0xa232a50, {0x8c14b0b, 0x7}, 0xa21db90)
	/tmp/workdir/go/src/testing/testing.go:1649 +0x3f6
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0x9a46120, 0xa232a50, {0x8c930fa, 0x11a}, 0x8d9a490, {0x0, 0x0, 0x0})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x3cb
golang.org/x/tools/gopls/internal/test/integration.Run(...)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:56
golang.org/x/tools/gopls/internal/test/integration/misc.TestRenamePackage(0xa232a50)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/misc/rename_test.go:302 +0x5a
testing.tRunner(0xa232a50, 0x8d9a1d0)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-01 01:40 netbsd-arm64-bsiegert go@cda1e40b os/exec (log)
panic: test timed out after 30m0s
running tests:
	TestCancelErrors/killed_after_error (29m59s)

goroutine 159 gp=0x4000212000 m=7 mp=0x4000076808 [running]:
panic({0x2e3880?, 0x4000020090?})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:778 +0x15c fp=0x400021cf00 sp=0x400021ce50 pc=0x497ac
testing.(*M).startAlarm.func1()
	/var/gobuilder/buildlet/go/src/testing/testing.go:2366 +0x30c fp=0x400021cfd0 sp=0x400021cf00 pc=0x1089fc
runtime.goexit({})
...
os/exec_test.TestCancelErrors.func3(0x40000961a0)
	/var/gobuilder/buildlet/go/src/os/exec/exec_test.go:1650 +0x21c fp=0x400021ff60 sp=0x400021fe70 pc=0x2bb10c
testing.tRunner(0x40000961a0, 0x38b9a0)
	/var/gobuilder/buildlet/go/src/testing/testing.go:1689 +0xec fp=0x400021ffb0 sp=0x400021ff60 pc=0x104ddc
testing.(*T).Run.gowrap1()
	/var/gobuilder/buildlet/go/src/testing/testing.go:1742 +0x2c fp=0x400021ffd0 sp=0x400021ffb0 pc=0x105c2c
runtime.goexit({})
	/var/gobuilder/buildlet/go/src/runtime/asm_arm64.s:1222 +0x4 fp=0x400021ffd0 sp=0x400021ffd0 pc=0x84084
created by testing.(*T).Run in goroutine 61
	/var/gobuilder/buildlet/go/src/testing/testing.go:1742 +0x318

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-08 22:34 netbsd-amd64-9_3 go@24fa7544 cmd/go.TestScript (log)
vcs-test.golang.org rerouted to http://127.0.0.1:53860
https://vcs-test.golang.org rerouted to https://127.0.0.1:53859
go test proxy running at GOPROXY=http://127.0.0.1:53858/mod
--- FAIL: TestScript (0.08s)
    --- FAIL: TestScript/build_single_error (460.34s)
        script_test.go:136: 2024-03-08T22:45:40Z
        script_test.go:138: $WORK=/tmp/workdir/tmp/cmd-go-test-573216584/tmpdir3928386525/build_single_error1843845124
        script_test.go:160: 
            # go test ./... with a bad package should report the error once (#44624). (460.338s)
            > ! go test ./...
...
            r13    0x1
            r14    0xc000424e00
            r15    0x1
            rip    0x47a583
            rflags 0x213
            cs     0x47
            fs     0x0
            gs     0x0
            [exit status 2]
        script_test.go:160: FAIL: testdata/script/build_single_error.txt:2: context deadline exceeded

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-08 23:48 netbsd-386-9_3 tools@c1eaf76c go@db6097f8 (log)
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x86bc4bf, 0x14})
	runtime/panic.go:1023 +0x4d fp=0x908ff00 sp=0x908feec pc=0x808484d
runtime.(*workbuf).checkempty(0x9da4000)
	runtime/mgcwork.go:344 +0x34 fp=0x908ff0c sp=0x908ff00 pc=0x80753b4
runtime.getempty()
	runtime/mgcwork.go:357 +0x55 fp=0x908ff38 sp=0x908ff0c pc=0x8075415
runtime.handoff(0x9da7800)
...
runtime.selectgo(0x95e8fa4, 0x95e8f60, 0x0, 0x1, 0x1, 0x1)
	runtime/select.go:327 +0xb15 fp=0x95e8f38 sp=0x95e8e54 pc=0x8099915
os/exec.(*Cmd).watchCtx(0x92fe248, 0x9d27940)
	os/exec/exec.go:764 +0xbf fp=0x95e8fe4 sp=0x95e8f38 pc=0x8167bbf
os/exec.(*Cmd).Start.gowrap2()
	os/exec/exec.go:750 +0x28 fp=0x95e8ff0 sp=0x95e8fe4 pc=0x81678b8
runtime.goexit({})
	runtime/asm_386.s:1363 +0x1 fp=0x95e8ff4 sp=0x95e8ff0 pc=0x80bc7d1
created by os/exec.(*Cmd).Start in goroutine 4884
	os/exec/exec.go:750 +0x901

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-11 20:13 netbsd-amd64-9_3 tools@ca94c966 go@db6097f8 x/tools/gopls/internal/test/integration/misc.TestRenamePackage_NestedModule (log)
serve.go:441: debug server listening at http://localhost:65404
serve.go:441: debug server listening at http://localhost:65403
panic: test timed out after 10m0s
running tests:
	TestRenamePackage_NestedModule (8m59s)
	TestRenamePackage_NestedModule/default (8m59s)

testing.(*T).Run(0xc002470d00, {0x10d0228?, 0x10f53b7?}, 0xc002cf9e50)
	/tmp/workdir/go/src/testing/testing.go:1750 +0x3ab
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0xc0000ccaa0, 0xc002470d00, {0x11775de, 0x2c9}, 0x1285398, {0x0, 0x0, 0x49a7ef?})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x485
golang.org/x/tools/gopls/internal/test/integration.Run(...)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:56
golang.org/x/tools/gopls/internal/test/integration/misc.TestRenamePackage_NestedModule(0xc002470d00?)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/misc/rename_test.go:552 +0x3d
testing.tRunner(0xc002470d00, 0x1284eb8)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-18 23:57 gotip-netbsd-arm64 go@1e9875ca cmd/go.TestScript/clean_cache_n (log)
=== RUN   TestScript/clean_cache_n
=== PAUSE TestScript/clean_cache_n
=== CONT  TestScript/clean_cache_n
    script_test.go:136: 2024-03-19T08:23:19Z
    script_test.go:138: $WORK=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-2606064856/tmpdir3045902145/clean_cache_n759623964
    script_test.go:160: 
        PATH=/home/swarming/.swarming/w/ir/x/t/cmd-go-test-2606064856/tmpdir3045902145/testbin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/x/w/goroot/bin:/home/swarming/.swarming/w/ir/cache/tools/bin:/home/swarming/.swarming/w/ir/bbagent_utility_packages:/home/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/home/swarming/.swarming/w/ir/cipd_bin_packages:/home/swarming/.swarming/w/ir/cipd_bin_packages/bin:/home/swarming/.swarming/w/ir/cache/cipd_client:/home/swarming/.swarming/w/ir/cache/cipd_client/bin:/home/swarming/.swarming/cipd_cache/bin:/command:/usr/local/bin:/usr/local/sbin:/usr/pkg/bin:/usr/pkg/sbin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/X11R6/bin
        HOME=/no-home
        CCACHE_DISABLE=1
        GOARCH=arm64
...
        r26     0x4000370bd8
        r27     0x3
        r28     0x4000092a80
        r29     0x4000370cb8
        lr      0x200193d90
        sp      0x4000370cc0
        pc      0x200193dac
        fault   0x3e900001ddc
    script_test.go:160: FAIL: testdata/script/clean_cache_n.txt:5: go build main.go: exit status 2
--- FAIL: TestScript/clean_cache_n (101.31s)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-21 20:17 netbsd-386-9_3 tools@3f9badb7 go@1c864333 x/tools/gopls/internal/test/marker.Test (log)
panic: test timed out after 10m0s
running tests:
	Test/rename/testy.txt (9m16s)

golang.org/x/tools/gopls/internal/test/integration.(*Awaiter).Await(0x17afd200, {0x8ebd4c4, 0xf902e70}, {0xf20b7e0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/env.go:374 +0x264
golang.org/x/tools/gopls/internal/test/marker.newEnv(0x9b57c08, 0x9cc4120, 0x9d966a0, 0x0, {0x0, 0x0, 0x0}, {{0x0, 0x0}, 0x0, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/marker/marker_test.go:816 +0x8ed
golang.org/x/tools/gopls/internal/test/marker.Test.func1(0x9b57c08)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/marker/marker_test.go:151 +0x48b
testing.tRunner(0x9b57c08, 0x98137c0)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-03-26 17:46 netbsd-amd64-9_3 tools@9ed98faa go@d3e5e9fd x/tools/gopls/internal/test/integration/misc.TestGenerateUseNetwork (log)
serve.go:441: debug server listening at http://localhost:65445
serve.go:441: debug server listening at http://localhost:65444
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: test timed out after 10m0s
running tests:
	TestGenerateUseNetwork (9m22s)
	TestGenerateUseNetwork/default (9m22s)

testing.(*T).Run(0xc0016fe820, {0x10f46dc?, 0x111989f?}, 0xc0020c0050)
	/tmp/workdir/go/src/testing/testing.go:1750 +0x3ab
golang.org/x/tools/gopls/internal/test/integration.(*Runner).Run(0xc000320b40, 0xc0016fe820, {0x1180c0a, 0x6e}, 0x12ac340, {0xc00c46af50, 0x1, 0x7f7ff7e99108?})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/runner.go:167 +0x485
golang.org/x/tools/gopls/internal/test/integration.configuredRunner.Run({{0xc00c46af50?, 0xc00c46af50?, 0x475136?}}, 0xc0016fe820, {0x1180c0a, 0x6e}, 0x12ac340)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/regtest.go:80 +0x147
golang.org/x/tools/gopls/internal/test/integration/misc.TestGenerateUseNetwork(0xc0016fe820)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/test/integration/misc/generate_test.go:99 +0x7e
testing.tRunner(0xc0016fe820, 0x12abe28)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-04-12 17:09 netbsd-amd64-9_3 tools@c859ee9e go@74501172 x/tools/gopls/internal/test/integration/misc (log)
serve.go:441: debug server listening at http://localhost:65455
serve.go:441: debug server listening at http://localhost:65454
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 28922): see golang/go#54461 for more details

goroutine 41763 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xc002a4fa70)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:445 +0x3d9
golang.org/x/tools/internal/gocommand.runCmdContext({0x13ba5f0, 0xc00b176d80}, 0xc00b103080)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:378 +0x4a5
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xc00297d548, {0x13ba5f0, 0xc00b176d80}, {0x13b17c0?, 0xc00b176f30}, {0x13b17c0?, 0xc00b176f60})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:273 +0xfaf
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xc00297d510?, {0x13ba5f0, 0xc00b176d80}, {0x13b17c0?, 0xc00b176f30?}, {0x13b17c0?, 0xc00b176f60?})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModWhy.func1({0x13ba628?, 0xc00b673810?}, {0x10abba0?, 0xc000595440?})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/cache/mod.go:247 +0x45
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:187 +0x9c
runtime/trace.WithRegion({0x13ba628?, 0xc00b673810?}, {0xc002c80a20, 0x12}, 0xc001769f90)
	/tmp/workdir/go/src/runtime/trace/annotation.go:141 +0xdd
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:180 +0x138
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 41762
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:179 +0x1c7

watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-NetBSD
Projects
Status: No status
Development

No branches or pull requests

5 participants