Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

runtime: flaky corruption on openbsd #55161

Closed
rsc opened this issue Sep 20, 2022 · 69 comments
Closed

runtime: flaky corruption on openbsd #55161

rsc opened this issue Sep 20, 2022 · 69 comments
Labels
compiler/runtime Issues related to the Go compiler and/or runtime. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-OpenBSD
Milestone

Comments

@rsc
Copy link
Contributor

rsc commented Sep 20, 2022

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`) && date < "2023-08-01"

OpenBSD has been seeing a steady stream of what looks like memory corruption resulting in runtime throws.

@rsc rsc added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Sep 20, 2022
@gopherbot gopherbot added the compiler/runtime Issues related to the Go compiler and/or runtime. label Sep 20, 2022
@gopherbot
Copy link

gopherbot commented Sep 20, 2022

Found new matching flaky dashboard failures.

2022-08-09 21:26 openbsd-386-70 go@d39b5417 (log)
fatal error: workbuf is empty

runtime stack:
runtime.throw({0x86206fc, 0x10})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x458ba844 sp=0x458ba830 pc=0x807e8ad
runtime.(*workbuf).checknonempty(0x6ae88000)
	/tmp/workdir/go/src/runtime/mgcwork.go:337 +0x34 fp=0x458ba850 sp=0x458ba844 pc=0x806f764
runtime.trygetfull()
	/tmp/workdir/go/src/runtime/mgcwork.go:429 +0x31 fp=0x458ba860 sp=0x458ba850 pc=0x806fa91
runtime.(*gcWork).tryGet(0x6a83025c)
	/tmp/workdir/go/src/runtime/mgcwork.go:215 +0x4e fp=0x458ba874 sp=0x458ba860 pc=0x806f52e
runtime.gcDrain(0x6a83025c, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1090 +0x1ec fp=0x458ba8d8 sp=0x458ba874 pc=0x8066bdc
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1326 +0x6b fp=0x458ba904 sp=0x458ba8d8 pc=0x806261b
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x458ba908 sp=0x458ba904 pc=0x80aaec5
2022-08-10 23:27 openbsd-amd64-68 go@29b07037 cmd/api (log)
2022/08/10 16:41:32 loading imports: exit status 2
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa47d87?, 0x3?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x292bab418 sp=0x292bab3e8 pc=0x43625d
runtime.(*limiterEvent).stop(0x100000000000800?, 0x4, 0xb59cc6?)
	/tmp/workdir/go/src/runtime/mgclimit.go:455 +0x145 fp=0x292bab440 sp=0x292bab418 pc=0x41e385
runtime.pidleget(0xdf91e0?)
...
cmd/go/internal/work.(*Builder).build(0xc0001b8320, {0xb2dc10?, 0xc000026140?}, 0xc0004ce500)
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:476 +0x199 fp=0xc000453db8 sp=0xc000453338 pc=0x8bf9d9
cmd/go/internal/work.(*Builder).Do.func2({0xb2dc10, 0xc000026140}, 0xc0004ce500)
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:139 +0x5fc fp=0xc000453f20 sp=0xc000453db8 pc=0x8bd2fc
cmd/go/internal/work.(*Builder).Do.func3()
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:201 +0xb9 fp=0xc000453fe0 sp=0xc000453f20 pc=0x8bcb19
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000453fe8 sp=0xc000453fe0 pc=0x466941
created by cmd/go/internal/work.(*Builder).Do
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:187 +0x3f5
2022-08-11 20:13 openbsd-amd64-68 go@87431981 (log)
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa47e87?, 0x3?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x28baa2e88 sp=0x28baa2e58 pc=0x43625d
runtime.(*limiterEvent).stop(0x100058800?, 0x4, 0xb59f00?)
	/tmp/workdir/go/src/runtime/mgclimit.go:455 +0x145 fp=0x28baa2eb0 sp=0x28baa2e88 pc=0x41e385
runtime.pidleget(0x28baa2f40?)
	/tmp/workdir/go/src/runtime/proc.go:5735 +0x130 fp=0x28baa2ee8 sp=0x28baa2eb0 pc=0x4451d0
...
cmd/go/internal/work.(*Builder).build(0xc000250c80, {0xc000026150?, 0x0?}, 0xc0003f9900)
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:870 +0x2b79 fp=0xc000731db8 sp=0xc000731338 pc=0x8c2af9
cmd/go/internal/work.(*Builder).Do.func2({0xb2ddd0, 0xc000026150}, 0xc0003f9900)
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:139 +0x5fc fp=0xc000731f20 sp=0xc000731db8 pc=0x8bda3c
cmd/go/internal/work.(*Builder).Do.func3()
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:201 +0xb9 fp=0xc000731fe0 sp=0xc000731f20 pc=0x8bd259
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000731fe8 sp=0xc000731fe0 pc=0x466941
created by cmd/go/internal/work.(*Builder).Do
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:187 +0x3f5
2022-08-26 14:32 openbsd-amd64-70 go@d7a3fa12 (log)
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0xa2cbb7?, 0x0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f7ffffe5f80 sp=0x7f7ffffe5f50 pc=0x434a7d
runtime.(*workbuf).checknonempty(0x0?)
	/tmp/workdir/go/src/runtime/mgcwork.go:338 +0x36 fp=0x7f7ffffe5fa0 sp=0x7f7ffffe5f80 pc=0x426376
...
runtime.(*gcWork).tryGet(0xc000047738)
	/tmp/workdir/go/src/runtime/mgcwork.go:216 +0x5b fp=0x2555ad4e8 sp=0x2555ad4b8 pc=0x4260fb
runtime.gcDrain(0xc000047738, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1092 +0x185 fp=0x2555ad548 sp=0x2555ad4e8 pc=0x41f3e5
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1326 +0x6d fp=0x2555ad598 sp=0x2555ad548 pc=0x41bb0d
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x2555ad5a0 sp=0x2555ad598 pc=0x4640c9

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std cmd: exit status 2
2022-09-02 06:06 openbsd-amd64-68 go@134cd34c (log)
wirep: p->m=0(0) p->status=2
fatal error: wirep: invalid p state
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa2cfc5?, 0x21f41c8d0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x21f41c890 sp=0x21f41c860 pc=0x434a3d
runtime.wirep(0xc000502820?)
	/tmp/workdir/go/src/runtime/proc.go:5028 +0x105 fp=0x21f41c8c8 sp=0x21f41c890 pc=0x441be5
...
runtime.pidleget(0x465e24?)
	/tmp/workdir/go/src/runtime/proc.go:5806 +0x131 fp=0x2886a0f18 sp=0x2886a0ee0 pc=0x443911
runtime.exitsyscallfast_pidle()
	/tmp/workdir/go/src/runtime/proc.go:3971 +0x2c fp=0x2886a0f38 sp=0x2886a0f18 pc=0x43f42c
runtime.exitsyscallfast.func1()
	/tmp/workdir/go/src/runtime/proc.go:3927 +0x38 fp=0x2886a0f68 sp=0x2886a0f38 pc=0x43f298
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x2886a0f70 sp=0x2886a0f68 pc=0x463f69

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std cmd: exit status 2
2022-09-06 18:16 openbsd-386-70 go@ef69718d (log)
runtime: pointer 0x64002680 to unused region of span span.base()=0x642d8000 span.limit=0x642e0000 span.state=1
runtime: found in object at *(0x64239340+0x1fc)
object=0x64239340 s.base()=0x64238000 s.limit=0x64239e40 s.spanclass=58 s.elemsize=704 s.state=mSpanInUse
 *(object+0) = 0x63d808a0
 *(object+4) = 0x1b
 *(object+8) = 0x63c9e2d4
 *(object+12) = 0x7
 *(object+16) = 0x0
 *(object+20) = 0x0
 *(object+24) = 0x31bf3cca
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0x8644df0, 0x3e})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x128b8688 sp=0x128b8674 pc=0x807d85d
runtime.badPointer(0x3a99c820, 0x64002680, 0x64239340, 0x1fc)
	/tmp/workdir/go/src/runtime/mbitmap.go:314 +0x96 fp=0x128b86a8 sp=0x128b8688 pc=0x805ab76
runtime.findObject(0x64002680, 0x64239340, 0x1fc)
	/tmp/workdir/go/src/runtime/mbitmap.go:357 +0x9f fp=0x128b86c0 sp=0x128b86a8 pc=0x805adcf
runtime.scanobject(0x64239340, 0x63c2ef5c)
...
runtime.gcDrainN(0x63c2ef5c, 0x10000)
	/tmp/workdir/go/src/runtime/mgcmark.go:1194 +0x20b fp=0x128b8734 sp=0x128b8710 pc=0x806652b
runtime.gcAssistAlloc1(0x63c07b30, 0x10000)
	/tmp/workdir/go/src/runtime/mgcmark.go:569 +0x12e fp=0x128b8794 sp=0x128b8734 pc=0x8064bbe
runtime.gcAssistAlloc.func1()
	/tmp/workdir/go/src/runtime/mgcmark.go:476 +0x28 fp=0x128b87a4 sp=0x128b8794 pc=0x8064a78
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x128b87a8 sp=0x128b87a4 pc=0x80ab095

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-09-07 18:41 openbsd-386-70 go@e828fbdf (log)
fatal error: workbuf is not empty
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x862b06b, 0x14})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x341aefac sp=0x341aef98 pc=0x807d85d
runtime.(*workbuf).checkempty(0x67ebd000)
	/tmp/workdir/go/src/runtime/mgcwork.go:344 +0x34 fp=0x341aefb8 sp=0x341aefac pc=0x806e8a4
runtime.getempty()
	/tmp/workdir/go/src/runtime/mgcwork.go:357 +0x55 fp=0x341aefe4 sp=0x341aefb8 pc=0x806e905
...
	/tmp/workdir/go/src/runtime/mgcwork.go:439 +0x14 fp=0x22356cc8 sp=0x22356cb4 pc=0x806ebc4
runtime.(*gcWork).balance(0x67836f5c)
	/tmp/workdir/go/src/runtime/mgcwork.go:297 +0x31 fp=0x22356cd4 sp=0x22356cc8 pc=0x806e7d1
runtime.gcDrain(0x67836f5c, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1087 +0x1a2 fp=0x22356d38 sp=0x22356cd4 pc=0x8065f62
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1326 +0x6b fp=0x22356d64 sp=0x22356d38 pc=0x8061a5b
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x22356d68 sp=0x22356d64 pc=0x80ab0f5
go tool dist: Failed: exit status 2
2022-09-07 20:10 openbsd-amd64-68 go@454a058f (log)
XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64
runtime: marked free object in span 0x2cd1e1c20, elemsize=32 freeindex=7 (bad use of unsafe.Pointer? try -d=checkptr)
0xc0000fa000 alloc marked  
0xc0000fa020 alloc marked  
0xc0000fa040 alloc marked  
0xc0000fa060 alloc marked  
...
fatal error: found pointer to free object

runtime stack:
runtime.throw({0xa302d3?, 0xc0000fb660?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2c1f0e598 sp=0x2c1f0e568 pc=0x434a5d
runtime.(*mspan).reportZombies(0x2cd1e1c20)
	/tmp/workdir/go/src/runtime/mgcsweep.go:788 +0x2e5 fp=0x2c1f0e618 sp=0x2c1f0e598 pc=0x425b05
runtime.(*sweepLocked).sweep(0xc000358338?, 0x0)
	/tmp/workdir/go/src/runtime/mgcsweep.go:612 +0x8f6 fp=0x2c1f0e6f8 sp=0x2c1f0e618 pc=0x425516
runtime.(*mcentral).uncacheSpan(0x2d76d3060?, 0xc0006da340?)
...
runtime.gcMarkDone()
	/tmp/workdir/go/src/runtime/mgc.go:918 +0x2aa fp=0xc000052f50 sp=0xc000052ef0 pc=0x41a82a
runtime.gcBgMarkWorker()
	/tmp/workdir/go/src/runtime/mgc.go:1366 +0x327 fp=0xc000052fe0 sp=0xc000052f50 pc=0x41b8e7
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000052fe8 sp=0xc000052fe0 pc=0x466261
created by runtime.gcBgMarkStartWorkers
	/tmp/workdir/go/src/runtime/mgc.go:1158 +0x25

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-09-08 14:57 openbsd-amd64-68 go@530a2369 (log)
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x43a482]

runtime stack:
runtime.throw({0xa3be47?, 0xc0004031e0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x22c11b5a0 sp=0x22c11b570 pc=0x434a5d
runtime.sigpanic()
	/tmp/workdir/go/src/runtime/signal_unix.go:821 +0x369 fp=0x22c11b5f8 sp=0x22c11b5a0 pc=0x44a609
runtime.runSafePointFn()
	/tmp/workdir/go/src/runtime/proc.go:1683 +0x42 fp=0x22c11b610 sp=0x22c11b5f8 pc=0x43a482
runtime.findRunnable()
	/tmp/workdir/go/src/runtime/proc.go:2590 +0x6b fp=0x22c11b718 sp=0x22c11b610 pc=0x43c06b
runtime.schedule()
	/tmp/workdir/go/src/runtime/proc.go:3264 +0xb1 fp=0x22c11b750 sp=0x22c11b718 pc=0x43d8d1
runtime.park_m(0xc000302ea0?)
	/tmp/workdir/go/src/runtime/proc.go:3413 +0x12d fp=0x22c11b780 sp=0x22c11b750 pc=0x43ddcd
runtime.mcall()
	/tmp/workdir/go/src/runtime/asm_amd64.s:448 +0x43 fp=0x22c11b790 sp=0x22c11b780 pc=0x464003
2022-09-14 16:11 openbsd-amd64-68 go@4baa4869 (log)
XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa44ec5?, 0x3?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x217806990 sp=0x217806960 pc=0x434a5d
runtime.(*limiterEvent).stop(0x0?, 0x4, 0x1?)
	/tmp/workdir/go/src/runtime/mgclimit.go:453 +0x145 fp=0x2178069b8 sp=0x217806990 pc=0x41cee5
runtime.pidleget(0xc000050f10?)
	/tmp/workdir/go/src/runtime/proc.go:5806 +0x131 fp=0x2178069f0 sp=0x2178069b8 pc=0x4439b1
runtime.pidlegetSpinning(0xc000028120?)
	/tmp/workdir/go/src/runtime/proc.go:5824 +0x19 fp=0x217806a08 sp=0x2178069f0 pc=0x443a39
runtime.wakep()
	/tmp/workdir/go/src/runtime/proc.go:2430 +0x70 fp=0x217806a38 sp=0x217806a08 pc=0x43b970
runtime.resetspinning()
	/tmp/workdir/go/src/runtime/proc.go:3148 +0x49 fp=0x217806a58 sp=0x217806a38 pc=0x43d509
runtime.schedule()
	/tmp/workdir/go/src/runtime/proc.go:3270 +0xd1 fp=0x217806a90 sp=0x217806a58 pc=0x43d8f1
runtime.park_m(0xc000082b60?)
	/tmp/workdir/go/src/runtime/proc.go:3413 +0x12d fp=0x217806ac0 sp=0x217806a90 pc=0x43ddcd
runtime.mcall()
	/tmp/workdir/go/src/runtime/asm_amd64.s:448 +0x43 fp=0x217806ad0 sp=0x217806ac0 pc=0x463fe3

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-09-15 21:05 openbsd-amd64-70 go@629c0b3a (log)
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0xa26d67?, 0x298d9225?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2141449d8 sp=0x2141449a8 pc=0x434a3d
runtime.(*workbuf).checknonempty(0x3?)
...
	/tmp/workdir/go/src/runtime/mgcwork.go:430 +0x65 fp=0x2490de568 sp=0x2490de548 pc=0x426745
runtime.(*gcWork).tryGet(0xc00003bc38)
	/tmp/workdir/go/src/runtime/mgcwork.go:216 +0x5b fp=0x2490de598 sp=0x2490de568 pc=0x4260bb
runtime.gcDrain(0xc00003bc38, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1092 +0x185 fp=0x2490de5f8 sp=0x2490de598 pc=0x41f385
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1327 +0x6d fp=0x2490de648 sp=0x2490de5f8 pc=0x41ba8d
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x2490de650 sp=0x2490de648 pc=0x464049
go tool dist: Failed: exit status 2
2022-09-16 17:59 openbsd-amd64-68 go@a84f46a2 (log)
fatal error: forEachP: P did not run fn

runtime stack:
runtime.throw({0xa2c7c3?, 0xc0001fa1a0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x280401998 sp=0x280401968 pc=0x434b7d
runtime.forEachP(0xa856a0)
	/tmp/workdir/go/src/runtime/proc.go:1710 +0x2fe fp=0x280401a00 sp=0x280401998 pc=0x43a5be
runtime.gcMarkDone.func1()
	/tmp/workdir/go/src/runtime/mgc.go:814 +0x47 fp=0x280401a28 sp=0x280401a00 pc=0x45f1a7
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x280401a30 sp=0x280401a28 pc=0x4642e9

watchflakes

@gopherbot
Copy link

gopherbot commented Sep 20, 2022

Sorry, but there were parse errors in the watchflakes script. The script I found was:

#!watchflakes
post <- goos == "openbsd" && `runtime.throw` || `Test ".*" ran over .* limit` ||

And the problems were:

script:3.1: unexpected end of script

watchflakes

@gopherbot
Copy link

gopherbot commented Sep 20, 2022

Found new matching flaky dashboard failures for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit`)
2022-08-23 18:13 openbsd-amd64-68 go@72a76ca1 (log)
Test "go_test:cmd/compile/internal/ir" ran over 20m0s limit (20m0.000456651s); saw output:

XXXBANNERXXX:Test execution environment.
2022-09-16 20:39 openbsd-amd64-68 go@2d89bec2 (log)
Test "go_test:encoding/pem" ran over 20m0s limit (20m0.000756227s); saw output:

XXXBANNERXXX:Test execution environment.

watchflakes

@gopherbot
Copy link

gopherbot commented Sep 20, 2022

Found new matching flaky dashboard failures for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit`)
2022-09-20 02:27 openbsd-386-70 debug@00090926 go@225bcec9 (log)
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x862473a, 0x14})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x3594ad5c sp=0x3594ad48 pc=0x807e64d
runtime.(*workbuf).checkempty(0x708fb800)
	/tmp/workdir/go/src/runtime/mgcwork.go:343 +0x34 fp=0x3594ad68 sp=0x3594ad5c pc=0x806f544
runtime.getempty()
	/tmp/workdir/go/src/runtime/mgcwork.go:356 +0x55 fp=0x3594ad94 sp=0x3594ad68 pc=0x806f5a5
runtime.handoff(0x708fb800)
	/tmp/workdir/go/src/runtime/mgcwork.go:438 +0x14 fp=0x3594ada8 sp=0x3594ad94 pc=0x806f864
runtime.(*gcWork).balance(0x70034f5c)
	/tmp/workdir/go/src/runtime/mgcwork.go:296 +0x31 fp=0x3594adb4 sp=0x3594ada8 pc=0x806f471
runtime.gcDrain(0x70034f5c, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1085 +0x1a1 fp=0x3594ae18 sp=0x3594adb4 pc=0x8066aa1
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1327 +0x6b fp=0x3594ae44 sp=0x3594ae18 pc=0x806253b
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x3594ae48 sp=0x3594ae44 pc=0x80aacd5

watchflakes

@rsc
Copy link
Contributor Author

rsc commented Sep 27, 2022

Updated pattern to match panic test timed out.

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-08-04 18:51 openbsd-386-70 tools@99fd76f9 go@39728f41 x/tools/gopls/internal/regtest/misc.TestFailingDiagnosticClearingOnEdit (log)
serve.go:442: debug server listening at http://localhost:41121
serve.go:442: debug server listening at http://localhost:28768
#### Start Gopls Test Logs for "TestFailingDiagnosticClearingOnEdit/default"
[Trace - 12:57:49.544 PM] Sending request 'initialize - (1)'.
Params: {"processId":0,"clientInfo":{"name":"fakeclient","version":"v1.0.0"},"rootUri":"","capabilities":{"workspace":{"didChangeConfiguration":{},"didChangeWatchedFiles":{"dynamicRegistration":true},"executeCommand":{},"semanticTokens":{},"codeLens":{},"inlineValue":{},"inlayHint":{},"configuration":true},"textDocument":{"synchronization":{},"completion":{"completionItem":{"snippetSupport":true,"tagSupport":{"valueSet":[1]},"resolveSupport":{"properties":null},"insertTextModeSupport":{"valueSet":null}},"completionItemKind":{},"completionList":{}},"hover":{},"signatureHelp":{"signatureInformation":{"parameterInformation":{}}},"declaration":{},"definition":{},"typeDefinition":{},"implementation":{},"references":{},"documentHighlight":{},"documentSymbol":{"symbolKind":{},"tagSupport":{"valueSet":null}},"codeAction":{"codeActionLiteralSupport":{"codeActionKind":{"valueSet":null}},"resolveSupport":{"properties":null}},"codeLens":{},"documentLink":{},"colorProvider":{},"formatting":{},"rangeFormatting":{},"onTypeFormatting":{},"rename":{},"foldingRange":{},"selectionRange":{},"publishDiagnostics":{"tagSupport":{"valueSet":null}},"callHierarchy":{},"semanticTokens":{"requests":{"full":true},"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"],"tokenModifiers":null,"formats":null},"linkedEditingRange":{},"moniker":{},"typeHierarchy":{},"inlineValue":{},"inlayHint":{"resolveSupport":{"properties":null}}},"window":{"workDoneProgress":true,"showMessage":{"messageActionItem":{}},"showDocument":{"support":false}},"general":{"staleRequestSupport":{"cancel":false,"retryOnContentModified":null},"regularExpressions":{"engine":""},"markdown":{"parser":""}}},"initializationOptions":{"completionBudget":"10s","diagnosticsDelay":"10ms","env":{"GO111MODULE":"","GOMODCACHE":"","GOPACKAGESDRIVER":"off","GOPATH":"/tmp/workdir/tmp/gopls-regtest-1768495668/TestFailingDiagnosticClearingOnEdit/default/gopath","GOPROXY":"file:///tmp/workdir/tmp/gopls-regtest-1768495668/TestFailingDiagnosticClearingOnEdit/default/proxy","GOSUMDB":"off"},"verboseWorkDoneProgress":true},"trace":"messages","workspaceFolders":[{"uri":"file:///tmp/workdir/tmp/gopls-regtest-1768495668/TestFailingDiagnosticClearingOnEdit/default/work","name":"work"}]}


[Trace - 12:57:49.546 PM] Received response 'initialize - (1)' in 1ms.
Result: {"capabilities":{"textDocumentSync":{"openClose":true,"change":2,"save":{}},"completionProvider":{"triggerCharacters":["."],"completionItem":{}},"hoverProvider":true,"signatureHelpProvider":{"triggerCharacters":["(",","]},"definitionProvider":true,"typeDefinitionProvider":true,"implementationProvider":true,"referencesProvider":true,"documentHighlightProvider":true,"documentSymbolProvider":true,"codeActionProvider":true,"codeLensProvider":{},"documentLinkProvider":{},"workspaceSymbolProvider":true,"documentFormattingProvider":true,"documentOnTypeFormattingProvider":{"firstTriggerCharacter":""},"renameProvider":true,"foldingRangeProvider":true,"executeCommandProvider":{"commands":["gopls.add_dependency","gopls.add_import","gopls.apply_fix","gopls.check_upgrades","gopls.edit_go_directive","gopls.gc_details","gopls.generate","gopls.generate_gopls_mod","gopls.go_get_package","gopls.list_imports","gopls.list_known_packages","gopls.regenerate_cgo","gopls.remove_dependency","gopls.run_tests","gopls.run_vulncheck_exp","gopls.start_debugging","gopls.test","gopls.tidy","gopls.toggle_gc_details","gopls.update_go_sum","gopls.upgrade_dependency","gopls.vendor"]},"callHierarchyProvider":true,"workspace":{"workspaceFolders":{"supported":true,"changeNotifications":"workspace/didChangeWorkspaceFolders"}},"inlayHintProvider":{}},"serverInfo":{"name":"gopls","version":"{\"GoVersion\":\"devel 39728f412d5fb6d97568cc84a42f1caf07dbaedc\",\"Path\":\"\",\"Main\":{\"Path\":\"\",\"Version\":\"\",\"Sum\":\"\",\"Replace\":null},\"Deps\":null,\"Settings\":null,\"Version\":\"master\"}"}}

...
--- FAIL: TestFailingDiagnosticClearingOnEdit (464.32s)
    --- FAIL: TestFailingDiagnosticClearingOnEdit/default (464.32s)
        env.go:279: waiting on:
            Met: no diagnostics for "a.go"
            Unmet: no diagnostics for "b.go"

            err:context deadline exceeded

            state:
            #### log messages (see RPC logs for full text):
...


#### End Gopls Test Logs for "TestCRLFLineEndings/47200/default"
panic: test timed out after 10m0s

goroutine 18591 [running]:
testing.(*M).startAlarm.func1()
	/tmp/workdir/go/src/testing/testing.go:2036 +0xc5
created by time.goFunc
	/tmp/workdir/go/src/time/sleep.go:176 +0x29
2022-08-08 18:11 openbsd-386-70 tools@92d58ea4 go@0981d9ff x/tools/gopls/internal/regtest/misc.TestFailingDiagnosticClearingOnEdit (log)
serve.go:442: debug server listening at http://localhost:26925
serve.go:442: debug server listening at http://localhost:44022
#### Start Gopls Test Logs for "TestFailingDiagnosticClearingOnEdit/default"
[Trace - 07:53:17.205 AM] Sending request 'initialize - (1)'.
Params: {"processId":0,"clientInfo":{"name":"fakeclient","version":"v1.0.0"},"rootUri":"","capabilities":{"workspace":{"didChangeConfiguration":{},"didChangeWatchedFiles":{"dynamicRegistration":true},"executeCommand":{},"semanticTokens":{},"codeLens":{},"inlineValue":{},"inlayHint":{},"configuration":true},"textDocument":{"synchronization":{},"completion":{"completionItem":{"snippetSupport":true,"tagSupport":{"valueSet":[1]},"resolveSupport":{"properties":null},"insertTextModeSupport":{"valueSet":null}},"completionItemKind":{},"completionList":{}},"hover":{},"signatureHelp":{"signatureInformation":{"parameterInformation":{}}},"declaration":{},"definition":{},"typeDefinition":{},"implementation":{},"references":{},"documentHighlight":{},"documentSymbol":{"symbolKind":{},"tagSupport":{"valueSet":null}},"codeAction":{"codeActionLiteralSupport":{"codeActionKind":{"valueSet":null}},"resolveSupport":{"properties":null}},"codeLens":{},"documentLink":{},"colorProvider":{},"formatting":{},"rangeFormatting":{},"onTypeFormatting":{},"rename":{},"foldingRange":{},"selectionRange":{},"publishDiagnostics":{"tagSupport":{"valueSet":null}},"callHierarchy":{},"semanticTokens":{"requests":{"full":true},"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"],"tokenModifiers":null,"formats":null},"linkedEditingRange":{},"moniker":{},"typeHierarchy":{},"inlineValue":{},"inlayHint":{"resolveSupport":{"properties":null}}},"window":{"workDoneProgress":true,"showMessage":{"messageActionItem":{}},"showDocument":{"support":false}},"general":{"staleRequestSupport":{"cancel":false,"retryOnContentModified":null},"regularExpressions":{"engine":""},"markdown":{"parser":""}}},"initializationOptions":{"completionBudget":"10s","diagnosticsDelay":"10ms","env":{"GO111MODULE":"","GOMODCACHE":"","GOPACKAGESDRIVER":"off","GOPATH":"/tmp/workdir/tmp/gopls-regtest-1009992577/TestFailingDiagnosticClearingOnEdit/default/gopath","GOPROXY":"file:///tmp/workdir/tmp/gopls-regtest-1009992577/TestFailingDiagnosticClearingOnEdit/default/proxy","GOSUMDB":"off"},"verboseWorkDoneProgress":true},"trace":"messages","workspaceFolders":[{"uri":"file:///tmp/workdir/tmp/gopls-regtest-1009992577/TestFailingDiagnosticClearingOnEdit/default/work","name":"work"}]}


[Trace - 07:53:17.210 AM] Received response 'initialize - (1)' in 4ms.
Result: {"capabilities":{"textDocumentSync":{"openClose":true,"change":2,"save":{}},"completionProvider":{"triggerCharacters":["."],"completionItem":{}},"hoverProvider":true,"signatureHelpProvider":{"triggerCharacters":["(",","]},"definitionProvider":true,"typeDefinitionProvider":true,"implementationProvider":true,"referencesProvider":true,"documentHighlightProvider":true,"documentSymbolProvider":true,"codeActionProvider":true,"codeLensProvider":{},"documentLinkProvider":{},"workspaceSymbolProvider":true,"documentFormattingProvider":true,"documentOnTypeFormattingProvider":{"firstTriggerCharacter":""},"renameProvider":true,"foldingRangeProvider":true,"executeCommandProvider":{"commands":["gopls.add_dependency","gopls.add_import","gopls.apply_fix","gopls.check_upgrades","gopls.edit_go_directive","gopls.gc_details","gopls.generate","gopls.generate_gopls_mod","gopls.go_get_package","gopls.list_imports","gopls.list_known_packages","gopls.regenerate_cgo","gopls.remove_dependency","gopls.run_tests","gopls.run_vulncheck_exp","gopls.start_debugging","gopls.test","gopls.tidy","gopls.toggle_gc_details","gopls.update_go_sum","gopls.upgrade_dependency","gopls.vendor"]},"callHierarchyProvider":true,"workspace":{"workspaceFolders":{"supported":true,"changeNotifications":"workspace/didChangeWorkspaceFolders"}},"inlayHintProvider":{}},"serverInfo":{"name":"gopls","version":"{\"GoVersion\":\"devel 0981d9fff1fa5601a2b7833473955252425bd923\",\"Path\":\"\",\"Main\":{\"Path\":\"\",\"Version\":\"\",\"Sum\":\"\",\"Replace\":null},\"Deps\":null,\"Settings\":null,\"Version\":\"master\"}"}}

...
--- FAIL: TestFailingDiagnosticClearingOnEdit (467.22s)
    --- FAIL: TestFailingDiagnosticClearingOnEdit/default (467.22s)
        env.go:286: waiting on:
            Met: no diagnostics for "a.go"
            Unmet: no diagnostics for "b.go"

            err:context deadline exceeded

            state:
            #### log messages (see RPC logs for full text):
...


#### End Gopls Test Logs for "TestCRLFLineEndings/47200/default"
panic: test timed out after 10m0s

goroutine 19174 [running]:
testing.(*M).startAlarm.func1()
	/tmp/workdir/go/src/testing/testing.go:2036 +0xc5
created by time.goFunc
	/tmp/workdir/go/src/time/sleep.go:176 +0x29
2022-09-26 16:36 openbsd-amd64-68 go@c3728b75 (log)
PASS





XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
...
fatal error: wirep: invalid p state
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa2acb1?, 0x2f7628418?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2f76283d8 sp=0x2f76283a8 pc=0x434b3d
runtime.wirep(0xc00046c680?)
	/tmp/workdir/go/src/runtime/proc.go:5085 +0x105 fp=0x2f7628410 sp=0x2f76283d8 pc=0x441e05
runtime.acquirep(0xc000036500)
...
runtime.pidleget(0x466224?)
	/tmp/workdir/go/src/runtime/proc.go:5863 +0x131 fp=0x26f0f1818 sp=0x26f0f17e0 pc=0x443b31
runtime.exitsyscallfast_pidle()
	/tmp/workdir/go/src/runtime/proc.go:4028 +0x2c fp=0x26f0f1838 sp=0x26f0f1818 pc=0x43f62c
runtime.exitsyscallfast.func1()
	/tmp/workdir/go/src/runtime/proc.go:3984 +0x38 fp=0x26f0f1868 sp=0x26f0f1838 pc=0x43f498
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x26f0f1870 sp=0x26f0f1868 pc=0x464369

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-09-26 22:21 openbsd-386-68 tools@eb45e986 go@e6d9057e command-line-arguments.TestGolden [build] (log)
/tmp/workdir/tmp/stringer3302685186/day_string.go:11:8: invalid argument: index 1 out of bounds [0:1]
/tmp/workdir/tmp/stringer3302685186/day_string.go:12:8: invalid argument: index 1 out of bounds [0:1]
/tmp/workdir/tmp/stringer3302685186/day_string.go:13:8: invalid argument: index 1 out of bounds [0:1]
/tmp/workdir/tmp/stringer3302685186/day_string.go:14:8: invalid argument: index 1 out of bounds [0:1]
/tmp/workdir/tmp/stringer3302685186/day_string.go:15:8: invalid argument: index 1 out of bounds [0:1]
/tmp/workdir/tmp/stringer3302685186/day_string.go:16:8: invalid argument: index 1 out of bounds [0:1]
/tmp/workdir/tmp/stringer3302685186/day_string.go:17:8: invalid argument: index Sunday - 6 (constant -6 of type Day) must not be negative
panic: test timed out after 10m0s

golang.org/x/tools/internal/gocommand.runCmdContext({0x8323128, 0x6bea7e00}, 0x6beaa4d0)
...
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:199 +0x787
golang.org/x/tools/go/packages.defaultDriver(0x6beac604, {0x6be8b1d0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages.go:271 +0x52
golang.org/x/tools/go/packages.Load(0x6bedde24, {0x6be8b1d0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages.go:254 +0x4c
golang.org/x/tools/cmd/stringer.(*Generator).parsePackage(0x6bea7da0, {0x6be8b1d0, 0x1, 0x1}, {0x0, 0x0, 0x0})
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/stringer/stringer.go:226 +0x150
golang.org/x/tools/cmd/stringer.TestGolden(0x6bc823c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/stringer/golden_test.go:474 +0x47f
testing.tRunner(0x6bc823c0, 0x82e7828)
2022-09-26 22:21 openbsd-386-68 tools@eb45e986 go@e6d9057e x/tools/go/packages.TestAll (log)
panic: test timed out after 10m0s

testing.(*T).Run(0x7443e960, {0x82ed5b8, 0x5}, 0x72c10540)
	/tmp/workdir/go/src/testing/testing.go:1529 +0x392
golang.org/x/tools/go/packages_test.testInvalidFilesBeforeOverlayContains(0x7443e960, {0x834578c, 0x84c373c})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/overlay_test.go:815 +0x8f4
golang.org/x/tools/go/packages_test.testAllOrModulesParallel.func1(0x7443e960, {0x834578c, 0x84c373c})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages_test.go:81 +0x185
golang.org/x/tools/go/packages/packagestest.TestAll.func1(0x7443e960)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packagestest/export.go:163 +0x51
testing.tRunner(0x7443e960, 0x72982440)

watchflakes

@mknyszek
Copy link
Contributor

Because #34988 is still open these memory corruption issues are difficult to detangle from these being real runtime issues (vs. fork corruption).

@golang/openbsd Can you please take a look at these and let us know what you think?

@mknyszek mknyszek added this to the Backlog milestone Sep 28, 2022
@mknyszek mknyszek assigned 4a6f656c and unassigned 4a6f656c Sep 28, 2022
@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-09-27 17:14 openbsd-amd64-68 go@6c356787 (log)
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0xa2c91d?, 0x0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x234a9d9f8 sp=0x234a9d9c8 pc=0x434d1d
runtime.(*workbuf).checknonempty(0x0?)
	/tmp/workdir/go/src/runtime/mgcwork.go:338 +0x36 fp=0x234a9da18 sp=0x234a9d9f8 pc=0x4265d6
runtime.trygetfull()
	/tmp/workdir/go/src/runtime/mgcwork.go:430 +0x65 fp=0x234a9da38 sp=0x234a9da18 pc=0x4269e5
...
	/tmp/workdir/go/src/runtime/mgcwork.go:430 +0x65 fp=0x29df31db8 sp=0x29df31d98 pc=0x4269e5
runtime.(*gcWork).tryGet(0xc000039738)
	/tmp/workdir/go/src/runtime/mgcwork.go:216 +0x5b fp=0x29df31de8 sp=0x29df31db8 pc=0x42635b
runtime.gcDrain(0xc000039738, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1090 +0x185 fp=0x29df31e48 sp=0x29df31de8 pc=0x41f5c5
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1339 +0xad fp=0x29df31e98 sp=0x29df31e48 pc=0x41bd0d
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x29df31ea0 sp=0x29df31e98 pc=0x464709
go tool dist: Failed: exit status 2
2022-09-27 21:59 openbsd-amd64-68 go@b16501c0 (log)
XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64
runtime: marked free object in span 0x2bbe4f318, elemsize=16 freeindex=411 (bad use of unsafe.Pointer? try -d=checkptr)
0xc0004e0000 alloc marked  
0xc0004e0010 alloc marked  
0xc0004e0020 alloc marked  
0xc0004e0030 alloc marked  
...
fatal error: found pointer to free object

runtime stack:
runtime.throw({0xa35d95?, 0xc0004e1d20?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x293ccfed8 sp=0x293ccfea8 pc=0x434d5d
runtime.(*mspan).reportZombies(0x2bbe4f318)
	/tmp/workdir/go/src/runtime/mgcsweep.go:810 +0x2e5 fp=0x293ccff58 sp=0x293ccfed8 pc=0x425da5
runtime.(*sweepLocked).sweep(0xc000600000?, 0x0)
	/tmp/workdir/go/src/runtime/mgcsweep.go:634 +0x8f6 fp=0x293cd0038 sp=0x293ccff58 pc=0x4257b6
runtime.(*mcentral).uncacheSpan(0x293cd00c0?, 0x431d9a?)
...
	goroutine running on other thread; stack unavailable
created by runtime.gcBgMarkStartWorkers
	/tmp/workdir/go/src/runtime/mgc.go:1190 +0x25

goroutine 1729 [running]:
	goroutine running on other thread; stack unavailable
created by cmd/go/internal/work.(*Builder).Do
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:187 +0x3f5

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-08-09 01:22 openbsd-mips64-jsing net@f428fae2 go@0d9ed063 (log)
fatal error: unexpected signal during runtime execution
[signal SIGBUS: bus error code=0x1 addr=0x5e9ba3 pc=0x2961c]

runtime stack:
runtime.throw({0x54de23, 0x2a})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x58 fp=0xfffffdbe58 sp=0xfffffdbe30 pc=0x545b0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:821 +0x318 fp=0xfffffdbe88 sp=0xfffffdbe58 pc=0x72d38
runtime.readUintptr(0x5e9ba3)
	/home/gopher/build/go/src/runtime/mbitmap.go:899 +0x4 fp=0xfffffdbe90 sp=0xfffffdbe90 pc=0x2961c
...
	/home/gopher/build/go/src/runtime/asm_mips64x.s:189 +0x80 fp=0xfffffdc108 sp=0xfffffdc100 pc=0x90270

goroutine 1 [running]:
runtime.systemstack_switch()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:150 +0x8 fp=0xc000048780 sp=0xc000048778 pc=0x901d0
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:170 +0x98 fp=0xc0000487d8 sp=0xc000048780 pc=0x57ae0
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:617 +0x4 fp=0xc0000487d8 sp=0xc0000487d8 pc=0x92614
go tool dist: FAILED: /home/gopher/build/go/pkg/tool/openbsd_mips64/go_bootstrap install -i cmd/asm cmd/cgo cmd/compile cmd/link: exit status 2
2022-08-09 01:22 openbsd-mips64-jsing net@f428fae2 go@13bd6ddb (log)
fatal error: unexpected signal during runtime execution
[signal SIGBUS: bus error code=0x1 addr=0x5e9a3b pc=0x2961c]

runtime stack:
runtime.throw({0x54dce3, 0x2a})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x58 fp=0xffffff8328 sp=0xffffff8300 pc=0x54598
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:821 +0x318 fp=0xffffff8358 sp=0xffffff8328 pc=0x72d20
runtime.readUintptr(0x5e9a3b)
	/home/gopher/build/go/src/runtime/mbitmap.go:899 +0x4 fp=0xffffff8360 sp=0xffffff8360 pc=0x2961c
...
	/home/gopher/build/go/src/runtime/asm_mips64x.s:189 +0x80 fp=0xffffff85d8 sp=0xffffff85d0 pc=0x90258

goroutine 1 [running]:
runtime.systemstack_switch()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:150 +0x8 fp=0xc000048780 sp=0xc000048778 pc=0x901b8
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:170 +0x98 fp=0xc0000487d8 sp=0xc000048780 pc=0x57ac8
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:617 +0x4 fp=0xc0000487d8 sp=0xc0000487d8 pc=0x925fc
go tool dist: FAILED: /home/gopher/build/go/pkg/tool/openbsd_mips64/go_bootstrap install -i cmd/asm cmd/cgo cmd/compile cmd/link: exit status 2
2022-08-09 01:22 openbsd-mips64-jsing net@f428fae2 go@5639fcae (log)
fatal error: unexpected signal during runtime execution
[signal SIGBUS: bus error code=0x1 addr=0x5e9a3b pc=0x2961c]

runtime stack:
runtime.throw({0x54dce3, 0x2a})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x58 fp=0xfffffef068 sp=0xfffffef040 pc=0x54598
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:821 +0x318 fp=0xfffffef098 sp=0xfffffef068 pc=0x72d20
runtime.readUintptr(0x5e9a3b)
	/home/gopher/build/go/src/runtime/mbitmap.go:899 +0x4 fp=0xfffffef0a0 sp=0xfffffef0a0 pc=0x2961c
...
	/home/gopher/build/go/src/runtime/asm_mips64x.s:189 +0x80 fp=0xfffffef318 sp=0xfffffef310 pc=0x90258

goroutine 1 [running]:
runtime.systemstack_switch()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:150 +0x8 fp=0xc000048780 sp=0xc000048778 pc=0x901b8
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:170 +0x98 fp=0xc0000487d8 sp=0xc000048780 pc=0x57ac8
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:617 +0x4 fp=0xc0000487d8 sp=0xc0000487d8 pc=0x925fc
go tool dist: FAILED: /home/gopher/build/go/pkg/tool/openbsd_mips64/go_bootstrap install -i cmd/asm cmd/cgo cmd/compile cmd/link: exit status 2
2022-09-28 23:46 openbsd-amd64-68 go@ffdfa9ff (log)
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa4d112?, 0x3?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2ac6be688 sp=0x2ac6be658 pc=0x434d5d
runtime.(*limiterEvent).stop(0xe3bae8?, 0x4, 0x50?)
	/tmp/workdir/go/src/runtime/mgclimit.go:453 +0x165 fp=0x2ac6be6b0 sp=0x2ac6be688 pc=0x41d165
runtime.pidleget(0x2d1c6b680?)
	/tmp/workdir/go/src/runtime/proc.go:5876 +0x131 fp=0x2ac6be6e8 sp=0x2ac6be6b0 pc=0x443dd1
...
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:203 +0xb9 fp=0xc000647fe0 sp=0xc000647f20 pc=0x8c05d9
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000647fe8 sp=0xc000647fe0 pc=0x466921
created by cmd/go/internal/work.(*Builder).Do
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:189 +0x3f5

goroutine 53 [running]:
	goroutine running on other thread; stack unavailable
created by runtime.gcBgMarkStartWorkers
	/tmp/workdir/go/src/runtime/mgc.go:1190 +0x25
2022-09-29 09:05 openbsd-amd64-68 go@a57639a2 (log)
fatal error: forEachP: P did not run fn

runtime stack:
runtime.throw({0xa367f8?, 0x468580?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2ba11d0e8 sp=0x2ba11d0b8 pc=0x434d5d
runtime.forEachP(0xa90840)
	/tmp/workdir/go/src/runtime/proc.go:1713 +0x2fe fp=0x2ba11d150 sp=0x2ba11d0e8 pc=0x43a7be
runtime.gcMarkDone.func1()
	/tmp/workdir/go/src/runtime/mgc.go:814 +0x47 fp=0x2ba11d178 sp=0x2ba11d150 pc=0x45f407
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x2ba11d180 sp=0x2ba11d178 pc=0x464749

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-09-29 20:43 openbsd-386-70 go@4973c16f (log)
fatal error: workbuf is not empty
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x8454ffb, 0x14})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x1e1cc4d8 sp=0x1e1cc4c4 pc=0x807d06d
runtime.(*workbuf).checkempty(0x5b313000)
	/tmp/workdir/go/src/runtime/mgcwork.go:344 +0x34 fp=0x1e1cc4e4 sp=0x1e1cc4d8 pc=0x806dd64
runtime.getempty()
	/tmp/workdir/go/src/runtime/mgcwork.go:357 +0x55 fp=0x1e1cc510 sp=0x1e1cc4e4 pc=0x806ddc5
...
	/tmp/workdir/go/src/runtime/mgcmark.go:1506 +0x186 fp=0x14835f10 sp=0x14835eec pc=0x8065ee6
runtime.scanobject(0x5b13e000, 0x5ac32f5c)
	/tmp/workdir/go/src/runtime/mgcmark.go:1336 +0x1a0 fp=0x14835f60 sp=0x14835f10 pc=0x8065a30
runtime.gcDrain(0x5ac32f5c, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1103 +0x243 fp=0x14835fc4 sp=0x14835f60 pc=0x8065173
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1358 +0x70 fp=0x14835ff0 sp=0x14835fc4 pc=0x8060b00
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x14835ff4 sp=0x14835ff0 pc=0x80aa305
go tool dist: FAILED: /tmp/workdir/go/pkg/tool/openbsd_386/go_bootstrap install -a -i cmd/asm cmd/cgo cmd/compile cmd/link: exit status 2
2022-09-29 23:48 openbsd-amd64-68 go@2fedd335 (log)
Test "go_test:go/token" ran over 20m0s limit (20m0.000270731s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64

XXXBANNERXXX:Testing packages.
2022-09-30 05:48 openbsd-arm64-jsing go@d7dbe011 (log)
Test "go_test:syscall" ran over 1h40m0s limit (1h40m0.001050419s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: arm64
# CPU: 
# GOOS: openbsd
# OS Version: OpenBSD 7.1 OpenBSD 7.1-stable (GENERIC.MP) #4: Fri Jun  3 17:30:51 AEST 2022     joel@gobuilder-arm64.sing.id.au:/usr/src/sys/arch/arm64/compile/GENERIC.MP  arm64

XXXBANNERXXX:Testing packages.
2022-10-01 01:52 openbsd-arm64-jsing go@0cbe3046 (log)
Test "go_test:syscall" ran over 1h40m0s limit (1h40m0.00019561s); saw output:

XXXBANNERXXX:Test execution environment.
# GOARCH: arm64
# CPU: 
# GOOS: openbsd
# OS Version: OpenBSD 7.1 OpenBSD 7.1-stable (GENERIC.MP) #4: Fri Jun  3 17:30:51 AEST 2022     joel@gobuilder-arm64.sing.id.au:/usr/src/sys/arch/arm64/compile/GENERIC.MP  arm64

XXXBANNERXXX:Testing packages.
2022-10-02 02:31 openbsd-amd64-68 go@18888751 (log)
XXXBANNERXXX:Test execution environment.
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa4d7a3?, 0x3?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x22071d870 sp=0x22071d840 pc=0x434d5d
runtime.(*limiterEvent).stop(0x468329?, 0x4, 0x1?)
	/tmp/workdir/go/src/runtime/mgclimit.go:453 +0x165 fp=0x22071d898 sp=0x22071d870 pc=0x41d165
runtime.pidleget(0xa90d10?)
	/tmp/workdir/go/src/runtime/proc.go:5876 +0x131 fp=0x22071d8d0 sp=0x22071d898 pc=0x443dd1
runtime.pidlegetSpinning(0xc000028120?)
	/tmp/workdir/go/src/runtime/proc.go:5894 +0x19 fp=0x22071d8e8 sp=0x22071d8d0 pc=0x443e59
runtime.wakep()
	/tmp/workdir/go/src/runtime/proc.go:2499 +0x70 fp=0x22071d918 sp=0x22071d8e8 pc=0x43bd90
runtime.resetspinning()
	/tmp/workdir/go/src/runtime/proc.go:3217 +0x49 fp=0x22071d938 sp=0x22071d918 pc=0x43d929
runtime.schedule()
	/tmp/workdir/go/src/runtime/proc.go:3339 +0xd1 fp=0x22071d970 sp=0x22071d938 pc=0x43dd11
runtime.park_m(0xc000482b60?)
	/tmp/workdir/go/src/runtime/proc.go:3484 +0x12d fp=0x22071d9a0 sp=0x22071d970 pc=0x43e1ed
runtime.mcall()
	/tmp/workdir/go/src/runtime/asm_amd64.s:448 +0x43 fp=0x22071d9b0 sp=0x22071d9a0 pc=0x4646c3

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-10-17 18:22 openbsd-arm64-jsing go@3e100a22 runtime.TestSegv (log)
--- FAIL: TestSegv (0.00s)
    --- FAIL: TestSegv/SegvInCgo (0.13s)
        testenv.go:458: [/home/gopher/build/tmp/go-build53903603/testprogcgo.exe SegvInCgo] exit status: exit status 2
        crash_cgo_test.go:618: fatal error: unexpected signal during runtime execution
            [signal SIGSEGV: segmentation violation code=0x78787878 addr=0x7878787878787878 pc=0x4511ba0ac]

            runtime stack:
            runtime.throw({0x2482c5?, 0x240?})
            	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x442b38970 sp=0x442b38940 pc=0x367080
            runtime.sigpanic()
            	/home/gopher/build/go/src/runtime/signal_unix.go:821 +0x244 fp=0x442b389b0 sp=0x442b38970 pc=0x37e7c4
            runtime.syscall()
            	/home/gopher/build/go/src/runtime/sys_openbsd_arm64.s:375 +0x28 fp=0x442b389d0 sp=0x442b389c0 pc=0x39bf68
            runtime.asmcgocall(0x45116d3f4, 0x442b38a10)
            	/home/gopher/build/go/src/runtime/asm_arm64.s:973 +0x7c fp=0x442b389e0 sp=0x442b389d0 pc=0x39a98c

        crash_cgo_test.go:649: unexpectedly saw "fatal error: " in output
2022-10-18 20:45 openbsd-arm64-jsing go@54ad7f33 runtime.TestSegv (log)
--- FAIL: TestSegv (0.00s)
    --- FAIL: TestSegv/SegvInCgo (0.13s)
        testenv.go:459: [/home/gopher/build/tmp/go-build1564381460/testprogcgo.exe SegvInCgo] exit status: exit status 2
        crash_cgo_test.go:618: fatal error: unexpected signal during runtime execution
            [signal SIGSEGV: segmentation violation code=0xb addr=0x61110000000b pc=0x4ae943ad4]

            runtime stack:
            runtime.throw({0x248305?, 0x240?})
            	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x458818dc0 sp=0x458818d90 pc=0x3671d0
            runtime.sigpanic()
            	/home/gopher/build/go/src/runtime/signal_unix.go:821 +0x244 fp=0x458818e00 sp=0x458818dc0 pc=0x37e984
            runtime.syscall()
            	/home/gopher/build/go/src/runtime/sys_openbsd_arm64.s:375 +0x28 fp=0x458818e20 sp=0x458818e10 pc=0x39c158
            runtime.asmcgocall(0x4ae9cba80, 0x458818e60)
            	/home/gopher/build/go/src/runtime/asm_arm64.s:973 +0x7c fp=0x458818e30 sp=0x458818e20 pc=0x39ab7c

        crash_cgo_test.go:649: unexpectedly saw "fatal error: " in output
2022-10-24 21:26 openbsd-386-68 go@3f84a3f3 (log)
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x8631aee, 0x14})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x1366c768 sp=0x1366c754 pc=0x807dc0d
runtime.(*workbuf).checkempty(0x57280000)
	/tmp/workdir/go/src/runtime/mgcwork.go:344 +0x34 fp=0x1366c774 sp=0x1366c768 pc=0x806f094
runtime.getempty()
	/tmp/workdir/go/src/runtime/mgcwork.go:357 +0x55 fp=0x1366c7a0 sp=0x1366c774 pc=0x806f0f5
runtime.(*gcWork).put(0x56c2dc5c, 0x56f91aa0)
	/tmp/workdir/go/src/runtime/mgcwork.go:130 +0x52 fp=0x1366c7b0 sp=0x1366c7a0 pc=0x806ebd2
runtime.greyobject(0x56f91aa0, 0x5724a000, 0x39ac, 0x33427588, 0x56c2dc5c, 0x354)
	/tmp/workdir/go/src/runtime/mgcmark.go:1506 +0x186 fp=0x1366c7d4 sp=0x1366c7b0 pc=0x8067596
runtime.scanobject(0x5724a000, 0x56c2dc5c)
	/tmp/workdir/go/src/runtime/mgcmark.go:1336 +0x1a0 fp=0x1366c824 sp=0x1366c7d4 pc=0x80670e0
runtime.gcDrain(0x56c2dc5c, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1103 +0x247 fp=0x1366c888 sp=0x1366c824 pc=0x8066827
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1348 +0xa9 fp=0x1366c8b4 sp=0x1366c888 pc=0x80622c9
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x1366c8b8 sp=0x1366c8b4 pc=0x80abae5

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-10-27 17:38 openbsd-arm-jsing go@7f255ba0 (log)
runtime: netpollBreak write failed with 14
fatal error: runtime: netpollBreak write failed

goroutine 4 [running]:
runtime.throw({0x638dbc, 0x22})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x4c fp=0xc33f0c sp=0xc33ef8 pc=0x4b550
runtime.netpollBreak()
	/home/gopher/build/go/src/runtime/netpoll_kqueue.go:101 +0xe0 fp=0xc33f28 sp=0xc33f0c pc=0x478a0
runtime.wakeNetPoller(0x9ec786b02232f)
	/home/gopher/build/go/src/runtime/proc.go:3209 +0xb8 fp=0xc33f38 sp=0xc33f28 pc=0x55684
runtime.modtimer(0xc58000, 0x9ec786b02232f, 0x0, 0x675290, {0x601f48, 0x9f0508}, 0x0)
	/home/gopher/build/go/src/runtime/time.go:514 +0x520 fp=0xc33f64 sp=0xc33f38 pc=0x6ec3c
runtime.resettimer(...)
	/home/gopher/build/go/src/runtime/time.go:555
time.resetTimer(...)
	/home/gopher/build/go/src/runtime/time.go:235
runtime.(*scavengerState).sleep(0x9f0508, 0x4113083c00000000)
	/home/gopher/build/go/src/runtime/mgcscavenge.go:475 +0x140 fp=0xc33fc8 sp=0xc33f64 pc=0x37338
runtime.bgscavenge(0xc26080)
	/home/gopher/build/go/src/runtime/mgcscavenge.go:637 +0x8c fp=0xc33fe4 sp=0xc33fc8 pc=0x3788c
runtime.gcenable.func2()
	/home/gopher/build/go/src/runtime/mgc.go:179 +0x28 fp=0xc33fec sp=0xc33fe4 pc=0x2a088
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm.s:831 +0x4 fp=0xc33fec sp=0xc33fec pc=0x804cc
created by runtime.gcenable
	/home/gopher/build/go/src/runtime/mgc.go:179 +0xbc
2022-11-01 21:03 openbsd-386-68 tools@32e1cb7a go@fb4f7fdb x/tools/go/internal/gcimporter.TestImportTestdata (log)
panic: test timed out after 10m0s
running tests:
	TestImportTestdata (10m16s)

syscall.syscall6(0x80b9db0, 0xc42f, 0x6e85cb94, 0x0, 0x6e822370, 0x0, 0x0)
	/tmp/workdir/go/src/runtime/sys_openbsd3.go:46 +0x20
syscall.wait4(0xc42f, 0x6e85cb94, 0x0, 0x6e822370)
	/tmp/workdir/go/src/syscall/zsyscall_openbsd_386.go:43 +0x5d
syscall.Wait4(0xc42f, 0x6e85cbb8, 0x0, 0x6e822370)
	/tmp/workdir/go/src/syscall/syscall_bsd.go:144 +0x3b
...
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/goroot/importcfg.go:26 +0x2e
golang.org/x/tools/internal/testenv.WriteImportcfg({0x839aeac, 0x6e806d20}, {0x6e822320, 0x45}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/testenv/testenv.go:340 +0x1f
golang.org/x/tools/go/internal/gcimporter.compilePkg(0x6e806d20, {0x833202b, 0x8}, {0x8332b9f, 0xa}, {0x6e84c400, 0x33}, 0x0, {0x8330a86, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/gcimporter/gcimporter_test.go:68 +0x2d6
golang.org/x/tools/go/internal/gcimporter.compile(...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/gcimporter/gcimporter_test.go:53
golang.org/x/tools/go/internal/gcimporter.TestImportTestdata(0x6e806d20)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/gcimporter/gcimporter_test.go:142 +0x138
testing.tRunner(0x6e806d20, 0x8348c64)
2022-11-01 21:03 openbsd-386-68 tools@32e1cb7a go@fb4f7fdb x/tools/go/packages.TestAll (log)
panic: test timed out after 10m0s
running tests:
	TestInvalidFilesBeforeOverlayContains (9m7s)
	TestInvalidFilesBeforeOverlayContains/Modules (8m16s)
	TestInvalidFilesBeforeOverlayContains/Modules/xtest (1m13s)

testing.(*T).Run(0x74d4a4b0, {0x82ef7e7, 0x5}, 0x69cd25a0)
	/tmp/workdir/go/src/testing/testing.go:1612 +0x415
golang.org/x/tools/go/packages_test.testInvalidFilesBeforeOverlayContains(0x74d4a4b0, {0x8354858, 0x84d95bc})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/overlay_test.go:815 +0x8f4
golang.org/x/tools/go/packages_test.testAllOrModulesParallel.func1(0x74d4a4b0, {0x8354858, 0x84d95bc})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages_test.go:81 +0x185
golang.org/x/tools/go/packages/packagestest.TestAll.func1(0x74d4a4b0)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packagestest/export.go:162 +0x51
testing.tRunner(0x74d4a4b0, 0x73fe4910)
2022-11-01 21:03 openbsd-386-68 tools@32e1cb7a go@fb4f7fdb x/tools/go/ssa.TestBuildPackageGo117 (log)
panic: test timed out after 10m0s
running tests:
	TestBuildPackageGo117 (10m15s)
	TestBuildPackageGo117/unsafe_add (10m15s)
	TestBuildPackageGo117/unsafe_slice (10m15s)

sync.runtime_SemacquireMutex(0x85b1308, 0x0, 0x1)
	/tmp/workdir/go/src/runtime/sema.go:77 +0x39
sync.(*Mutex).lockSlow(0x85b1304)
	/tmp/workdir/go/src/sync/mutex.go:171 +0x247
...
	/tmp/workdir/go/src/go/types/resolver.go:254 +0xb9b
go/types.(*Checker).checkFiles(0x594823c0, {0x59494080, 0x1, 0x1})
	/tmp/workdir/go/src/go/types/check.go:326 +0xc8
go/types.(*Checker).Files(...)
	/tmp/workdir/go/src/go/types/check.go:304
golang.org/x/tools/go/ssa/ssautil.BuildPackage(0x59498150, 0x59498000, 0x59498120, {0x59494080, 0x1, 0x1}, 0x8)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/ssa/ssautil/load.go:150 +0x199
golang.org/x/tools/go/ssa_test.TestBuildPackageGo117.func1(0x59571680)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/ssa/builder_go117_test.go:46 +0x1be
testing.tRunner(0x59571680, 0x59572d80)
2022-11-01 21:03 openbsd-386-68 tools@32e1cb7a go@fb4f7fdb x/tools/go/ssa/ssautil.TestBuildPackage (log)
panic: test timed out after 10m0s
running tests:
	TestBuildPackage (10m15s)

syscall.syscall6(0x80b9f30, 0xc309, 0x6ed4f56c, 0x0, 0x6ed56410, 0x0, 0x0)
	/tmp/workdir/go/src/runtime/sys_openbsd3.go:46 +0x20
syscall.wait4(0xc309, 0x6ed4f56c, 0x0, 0x6ed56410)
	/tmp/workdir/go/src/syscall/zsyscall_openbsd_386.go:43 +0x5d
syscall.Wait4(0xc309, 0x6ed4f590, 0x0, 0x6ed56410)
	/tmp/workdir/go/src/syscall/syscall_bsd.go:144 +0x3b
...
	/tmp/workdir/go/src/go/types/resolver.go:254 +0xb9b
go/types.(*Checker).checkFiles(0x6ed164b0, {0x6ed0c688, 0x1, 0x1})
	/tmp/workdir/go/src/go/types/check.go:326 +0xc8
go/types.(*Checker).Files(...)
	/tmp/workdir/go/src/go/types/check.go:304
golang.org/x/tools/go/ssa/ssautil.BuildPackage(0x6ed01230, 0x6ed010e0, 0x6ed011d0, {0x6ed0c688, 0x1, 0x1}, 0x8)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/ssa/ssautil/load.go:150 +0x199
golang.org/x/tools/go/ssa/ssautil_test.TestBuildPackage(0x6ed162d0)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/ssa/ssautil/load_test.go:50 +0x226
testing.tRunner(0x6ed162d0, 0x8382084)
2022-11-03 17:41 openbsd-amd64-68 go@5c0d314a (log)
PASS




runtime: max = 4, npages = 4
runtime: searchIdx = 319, p.searchAddr = 0xc00067e000
fatal error: bad summary data

runtime stack:
...
os/exec.(*Cmd).writerDescriptor.func1()
	/tmp/workdir/go/src/os/exec/exec.go:557 +0x3a fp=0xc000111f58 sp=0xc000111ef8 pc=0x51313a
os/exec.(*Cmd).Start.func2(0xc000111f98?)
	/tmp/workdir/go/src/os/exec/exec.go:714 +0x32 fp=0xc000111fc8 sp=0xc000111f58 pc=0x513e92
os/exec.(*Cmd).Start.func3()
	/tmp/workdir/go/src/os/exec/exec.go:726 +0x2a fp=0xc000111fe0 sp=0xc000111fc8 pc=0x513e2a
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1594 +0x1 fp=0xc000111fe8 sp=0xc000111fe0 pc=0x467381
created by os/exec.(*Cmd).Start
	/tmp/workdir/go/src/os/exec/exec.go:713 +0xa33

watchflakes

@bcmills
Copy link
Contributor

bcmills commented Nov 16, 2022

@bcmills
Copy link
Contributor

bcmills commented Nov 16, 2022

@golang/openbsd, is anyone looking into this issue? It seems to affect all OpenBSD builders and TryBots to at least some extent.

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-11-07 21:17 openbsd-amd64-70 go@f3d656be (log)
XXXBANNERXXX:Test execution environment.
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
...
	/tmp/workdir/go/src/runtime/mgcwork.go:430 +0x65 fp=0x232fd1958 sp=0x232fd1938 pc=0x427165
runtime.(*gcWork).tryGet(0xc000042b38)
	/tmp/workdir/go/src/runtime/mgcwork.go:216 +0x5b fp=0x232fd1988 sp=0x232fd1958 pc=0x426adb
runtime.gcDrain(0xc000042b38, 0x7)
	/tmp/workdir/go/src/runtime/mgcmark.go:1090 +0x185 fp=0x232fd19e8 sp=0x232fd1988 pc=0x41fbc5
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1367 +0x7a fp=0x232fd1a38 sp=0x232fd19e8 pc=0x41c2da
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x232fd1a40 sp=0x232fd1a38 pc=0x465289
go tool dist: Failed logging metadata: exit status 2
2022-11-08 08:14 openbsd-386-70 go@0b7aa9fa runtime.TestSegv (log)
--- FAIL: TestSegv (0.00s)
    --- FAIL: TestSegv/Segv (0.11s)
        crash_test.go:58: /tmp/workdir/tmp/go-build3511201098/testprogcgo.exe Segv: exit status 2
        crash_cgo_test.go:618: fatal error: unexpected signal during runtime execution
            [signal SIGSEGV: segmentation violation code=0x10 addr=0x2 pc=0x41d4bfb]

            runtime stack:
            runtime.throw({0x43c492, 0x2a})
            	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x35606ad4 sp=0x35606ac0 pc=0x54b18d
            runtime.sigpanic()
            	/tmp/workdir/go/src/runtime/signal_unix.go:821 +0x2b0 fp=0x35606aec sp=0x35606ad4 pc=0x5614b0
            runtime.syscall()
            	/tmp/workdir/go/src/runtime/sys_openbsd_386.s:637 +0x22 fp=0x35606af4 sp=0x35606aec pc=0x57da02

        crash_cgo_test.go:649: unexpectedly saw "fatal error: " in output
2022-11-11 21:32 openbsd-amd64-70 go@c6539796 (log)
fatal error: workbuf is empty

runtime stack:
runtime.throw({0xa290f7?, 0x2030000c914970?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x20c914950 sp=0x20c914920 pc=0x43611d
runtime.(*workbuf).checknonempty(0x427d9d?)
	/tmp/workdir/go/src/runtime/mgcwork.go:337 +0x36 fp=0x20c914970 sp=0x20c914950 pc=0x4278d6
runtime.trygetfull()
	/tmp/workdir/go/src/runtime/mgcwork.go:429 +0x65 fp=0x20c914990 sp=0x20c914970 pc=0x427ce5
runtime.(*gcWork).tryGet(0xc000037c40)
	/tmp/workdir/go/src/runtime/mgcwork.go:215 +0x5b fp=0x20c9149c0 sp=0x20c914990 pc=0x42765b
runtime.gcDrainN(0xc000037c40, 0x498c3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1170 +0x105 fp=0x20c9149f0 sp=0x20c9149c0 pc=0x420b45
runtime.gcAssistAlloc1(0xc0001e1520, 0x9927c0?)
	/tmp/workdir/go/src/runtime/mgcmark.go:567 +0x113 fp=0x20c914a58 sp=0x20c9149f0 pc=0x41f673
runtime.gcAssistAlloc.func1()
	/tmp/workdir/go/src/runtime/mgcmark.go:474 +0x25 fp=0x20c914a78 sp=0x20c914a58 pc=0x41f545
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:492 +0x49 fp=0x20c914a80 sp=0x20c914a78 pc=0x464649

FAILED
2022-11-14 19:44 openbsd-386-68 go@dc6b7c86 (log)
fatal error: workbuf is not empty
fatal error: workbuf is not empty
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x863fcfd, 0x14})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x4219f8ec sp=0x4219f8d8 pc=0x807d9ed
runtime.(*workbuf).checkempty(0x672b4800)
	/tmp/workdir/go/src/runtime/mgcwork.go:344 +0x34 fp=0x4219f8f8 sp=0x4219f8ec pc=0x806ee04
runtime.getempty()
...
runtime.(*gcWork).balance(0x66c2dc5c)
	/tmp/workdir/go/src/runtime/mgcwork.go:297 +0x31 fp=0x215bf1e4 sp=0x215bf1d8 pc=0x806ed31
runtime.gcDrain(0x66c2dc5c, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1085 +0x1a4 fp=0x215bf248 sp=0x215bf1e4 pc=0x8066674
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1348 +0xa9 fp=0x215bf274 sp=0x215bf248 pc=0x80621e9
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x215bf278 sp=0x215bf274 pc=0x80abaf5

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-11-15 16:24 openbsd-amd64-68 go@787f8167 (log)
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0xa405d5?, 0x4435de?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x29bfc1348 sp=0x29bfc1318 pc=0x4354fd
runtime.(*workbuf).checknonempty(0x421bb0?)
	/tmp/workdir/go/src/runtime/mgcwork.go:338 +0x36 fp=0x29bfc1368 sp=0x29bfc1348 pc=0x426c96
...
	/tmp/workdir/go/src/runtime/mgcwork.go:430 +0x65 fp=0x26cd6f928 sp=0x26cd6f908 pc=0x4270a5
runtime.(*gcWork).tryGet(0xc000037238)
	/tmp/workdir/go/src/runtime/mgcwork.go:216 +0x5b fp=0x26cd6f958 sp=0x26cd6f928 pc=0x426a1b
runtime.gcDrain(0xc000037238, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1090 +0x185 fp=0x26cd6f9b8 sp=0x26cd6f958 pc=0x41fbe5
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1348 +0xad fp=0x26cd6fa08 sp=0x26cd6f9b8 pc=0x41c32d
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:496 +0x49 fp=0x26cd6fa10 sp=0x26cd6fa08 pc=0x465389
go tool dist: Failed: exit status 2
2022-11-16 14:37 openbsd-amd64-68 go@80c5bbc6 (log)
fatal error: forEachP: P did not run fn

runtime stack:
runtime.throw({0xa422de?, 0x469240?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x289a6c4d8 sp=0x289a6c4a8 pc=0x43553d
runtime.forEachP(0xa9c508)
	/tmp/workdir/go/src/runtime/proc.go:1720 +0x2fe fp=0x289a6c540 sp=0x289a6c4d8 pc=0x43affe
runtime.gcMarkDone.func1()
	/tmp/workdir/go/src/runtime/mgc.go:814 +0x47 fp=0x289a6c568 sp=0x289a6c540 pc=0x45ff27
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:496 +0x49 fp=0x289a6c570 sp=0x289a6c568 pc=0x465409
2022-11-16 21:35 openbsd-amd64-68 go@36ce2ece (log)
XXXBANNERXXX:Test execution environment.
# GOARCH: amd64
# CPU: Intel(R) Xeon(R) CPU @ 2.80GHz
# GOOS: openbsd
# OS Version: OpenBSD 6.8 OpenBSD 6.8 (GENERIC.MP) #2: Sat Dec  5 07:17:48 MST 2020     root@syspatch-68-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP  amd64
fatal error: forEachP: P did not run fn

runtime stack:
runtime.throw({0xa4229e?, 0x0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x270d2d3c8 sp=0x270d2d398 pc=0x43553d
runtime.forEachP(0xa9c4c8)
	/tmp/workdir/go/src/runtime/proc.go:1720 +0x2fe fp=0x270d2d430 sp=0x270d2d3c8 pc=0x43affe
runtime.gcMarkDone.func1()
	/tmp/workdir/go/src/runtime/mgc.go:814 +0x47 fp=0x270d2d458 sp=0x270d2d430 pc=0x45ff27
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:496 +0x49 fp=0x270d2d460 sp=0x270d2d458 pc=0x465409

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std: exit status 2
2022-11-16 21:35 openbsd-amd64-68 go@4d1052b0 (log)
releasep: m=0xc000600000 m->p=0xc000044000 p->m=0x0 p->status=0
fatal error: releasep: invalid p state

runtime stack:
runtime.throw({0xa41ab4?, 0xc000044000?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2243a2da8 sp=0x2243a2d78 pc=0x43553d
runtime.releasep()
	/tmp/workdir/go/src/runtime/proc.go:5133 +0x12a fp=0x2243a2df0 sp=0x2243a2da8 pc=0x442a0a
runtime.findRunnable()
	/tmp/workdir/go/src/runtime/proc.go:2850 +0x56a fp=0x2243a2ef8 sp=0x2243a2df0 pc=0x43d1aa
runtime.schedule()
	/tmp/workdir/go/src/runtime/proc.go:3351 +0xb1 fp=0x2243a2f30 sp=0x2243a2ef8 pc=0x43e511
runtime.park_m(0xc0000071e0?)
	/tmp/workdir/go/src/runtime/proc.go:3502 +0x12d fp=0x2243a2f60 sp=0x2243a2f30 pc=0x43ea0d
runtime.mcall()
	/tmp/workdir/go/src/runtime/asm_amd64.s:452 +0x43 fp=0x2243a2f70 sp=0x2243a2f60 pc=0x465383

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std cmd: exit status 2

watchflakes

@qbit
Copy link
Member

qbit commented Nov 17, 2022

I'll do some poking - Is the process of adding build servers documented anywhere? 6.8 and 7.0 are both pretty old at this point (7.2 and 7.1 are the official OpenBSD supported releases atm), might not be worth tracking down issues on older releases that won't see fixes anyway (if it's an OpenBSD problem)

@bcmills
Copy link
Contributor

bcmills commented Nov 17, 2022

@qbit, see https://cs.opensource.google/go/x/build/+/master:env/openbsd-amd64/README. You'll likely need someone on @golang/release to help with deployment.

@bcmills
Copy link
Contributor

bcmills commented Nov 17, 2022

(The last OpenBSD builder upgrade was #48977.)

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-11-02 19:48 openbsd-mips64-jsing sys@fc697a31 go@14018c8b (log)
runtime: failed to create new OS thread (have 1 already; errno=-334018)
fatal error: runtime.newosproc

runtime stack:
runtime.throw({0x5547ea, 0x11})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x58 fp=0xfffffc8f58 sp=0xfffffc8f30 pc=0x55c60
runtime.newosproc(0xc00004c000)
	/home/gopher/build/go/src/runtime/os_openbsd_syscall.go:49 +0x1f4 fp=0xfffffc8fc8 sp=0xfffffc8f58 pc=0x525e4
runtime.newm1(0xc00004c000)
	/home/gopher/build/go/src/runtime/proc.go:2244 +0x110 fp=0xfffffc9000 sp=0xfffffc8fc8 pc=0x5ed98
runtime.newm(0x5909c8, 0x0, 0xffffffffffffffff)
	/home/gopher/build/go/src/runtime/proc.go:2219 +0x1b8 fp=0xfffffc9030 sp=0xfffffc9000 pc=0x5ec18
runtime.main.func1()
	/home/gopher/build/go/src/runtime/proc.go:171 +0x54 fp=0xfffffc9050 sp=0xfffffc9030 pc=0x5907c
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:189 +0x80 fp=0xfffffc9058 sp=0xfffffc9050 pc=0x933b8

goroutine 1 [running]:
runtime.systemstack_switch()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:150 +0x8 fp=0xc000048780 sp=0xc000048778 pc=0x93318
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:170 +0x98 fp=0xc0000487d8 sp=0xc000048780 pc=0x59128
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_mips64x.s:624 +0x4 fp=0xc0000487d8 sp=0xc0000487d8 pc=0x9575c
go tool dist: FAILED: /home/gopher/build/go/pkg/tool/openbsd_mips64/go_bootstrap install cmd/asm cmd/cgo cmd/compile cmd/link: exit status 2
2022-11-17 15:49 openbsd-amd64-68 go@42d975e5 (log)
fatal error: forEachP: P did not run fn

runtime stack:
runtime.throw({0xa422bf?, 0x469240?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2dd271748 sp=0x2dd271718 pc=0x43553d
runtime.forEachP(0xa9c588)
	/tmp/workdir/go/src/runtime/proc.go:1720 +0x2fe fp=0x2dd2717b0 sp=0x2dd271748 pc=0x43affe
runtime.gcMarkDone.func1()
	/tmp/workdir/go/src/runtime/mgc.go:814 +0x47 fp=0x2dd2717d8 sp=0x2dd2717b0 pc=0x45ff27
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:496 +0x49 fp=0x2dd2717e0 sp=0x2dd2717d8 pc=0x465409
2022-11-17 18:31 openbsd-amd64-68 go@249e51e5 (log)
runtime: pointer 0xc0002b4000 to unallocated span span.base()=0xc000338000 span.limit=0xc00033a000 span.state=0
runtime: found in object at *(0xc000226a80+0x38)
object=0xc000226a80 s.base()=0xc000226000 s.limit=0xc000227fe0 s.spanclass=16 s.elemsize=96 s.state=mSpanInUse
 *(object+0) = 0x0
 *(object+8) = 0x0
 *(object+16) = 0x7
 *(object+24) = 0x0
 *(object+32) = 0x0
 *(object+40) = 0x100000000
 *(object+48) = 0x10101
...
fatal error: found bad pointer in Go heap (incorrect use of unsafe or cgo?)

runtime stack:
runtime.throw({0xa59ccd?, 0x6?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x28718bd00 sp=0x28718bcd0 pc=0x43553d
runtime.badPointer(0x204296998, 0x28718bd70?, 0xc000226a80, 0x47cc60?)
	/tmp/workdir/go/src/runtime/mbitmap.go:314 +0x150 fp=0x28718bd50 sp=0x28718bd00 pc=0x415b70
runtime.findObject(0xdda7ed4a90?, 0x1?, 0x0?)
	/tmp/workdir/go/src/runtime/mbitmap.go:357 +0xa6 fp=0x28718bd88 sp=0x28718bd50 pc=0x415d06
runtime.scanobject(0xc000226a80?, 0xc000047738)
...
cmd/go/internal/work.ActorFunc.Act(0xb321c8?, 0xc000028140?, {0xb321c8?, 0xc000028140?}, 0x448125?)
	/tmp/workdir/go/src/cmd/go/internal/work/action.go:76 +0x33 fp=0xc0004fbdb8 sp=0xc0004fbd88 pc=0x8b91b3
cmd/go/internal/work.(*Builder).Do.func2({0xb321c8, 0xc000028140}, 0xc0003cbb80)
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:143 +0x644 fp=0xc0004fbf20 sp=0xc0004fbdb8 pc=0x8c7d44
cmd/go/internal/work.(*Builder).Do.func3()
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:207 +0xb9 fp=0xc0004fbfe0 sp=0xc0004fbf20 pc=0x8c7519
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004fbfe8 sp=0xc0004fbfe0 pc=0x4675e1
created by cmd/go/internal/work.(*Builder).Do
	/tmp/workdir/go/src/cmd/go/internal/work/exec.go:193 +0x3f5
2022-11-17 19:55 openbsd-arm-jsing go@81c9b1d6 runtime.TestSegv (log)
--- FAIL: TestSegv (0.00s)
    --- FAIL: TestSegv/Segv (0.15s)
        crash_test.go:58: /home/gopher/build/tmp/go-build3507456985/testprogcgo.exe Segv: exit status 2
        crash_cgo_test.go:618: fatal error: unexpected signal during runtime execution
            [signal SIGSEGV: segmentation violation code=0x5 addr=0x14f4480 pc=0x76c7cc94]

            runtime stack:
            runtime.throw({0x4710a, 0x2a})
            	/home/gopher/build/go/src/runtime/panic.go:1047 +0x4c fp=0xbffe7ab8 sp=0xbffe7aa4 pc=0x166c04
            runtime.sigpanic()
            	/home/gopher/build/go/src/runtime/signal_unix.go:821 +0x298 fp=0xbffe7ad4 sp=0xbffe7ab8 pc=0x18056c
            runtime.syscall()
            	/home/gopher/build/go/src/runtime/sys_openbsd_arm.s:500 +0x24 fp=0xbffe7adc sp=0xbffe7ad8 pc=0x19f324

        crash_cgo_test.go:649: unexpectedly saw "fatal error: " in output
2022-11-18 18:50 openbsd-amd64-68 go@f64c2a2c (log)
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa5a15b?, 0x3?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2de9b6ec8 sp=0x2de9b6e98 pc=0x43559d
runtime.(*limiterEvent).stop(0x8?, 0x4, 0xd432c65cc5?)
	/tmp/workdir/go/src/runtime/mgclimit.go:453 +0x165 fp=0x2de9b6ef0 sp=0x2de9b6ec8 pc=0x41d765
runtime.pidleget(0xc000028120?)
	/tmp/workdir/go/src/runtime/proc.go:5903 +0x131 fp=0x2de9b6f28 sp=0x2de9b6ef0 pc=0x444691
...
runtime.chansend1(0x1000000010000?, 0xc00002cea0?)
	/tmp/workdir/go/src/runtime/chan.go:145 +0x1d fp=0xc000720f58 sp=0xc000720f28 pc=0x406d5d
os/exec.(*Cmd).Start.func2(0xc000720f98?)
	/tmp/workdir/go/src/os/exec/exec.go:725 +0xb5 fp=0xc000720fc8 sp=0xc000720f58 pc=0x515075
os/exec.(*Cmd).Start.func3()
	/tmp/workdir/go/src/os/exec/exec.go:729 +0x2a fp=0xc000720fe0 sp=0xc000720fc8 pc=0x514f8a
runtime.goexit()
	/tmp/workdir/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000720fe8 sp=0xc000720fe0 pc=0x467681
created by os/exec.(*Cmd).Start
	/tmp/workdir/go/src/os/exec/exec.go:716 +0xa33
2022-11-19 22:39 openbsd-386-70 go@8205d83f (log)
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x863e493, 0x14})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x4d fp=0x46170380 sp=0x4617036c pc=0x807dacd
runtime.(*workbuf).checkempty(0x6dae1000)
	/tmp/workdir/go/src/runtime/mgcwork.go:344 +0x34 fp=0x4617038c sp=0x46170380 pc=0x806ee24
runtime.getempty()
	/tmp/workdir/go/src/runtime/mgcwork.go:357 +0x55 fp=0x461703b8 sp=0x4617038c pc=0x806ee85
runtime.(*gcWork).init(0x6d430f5c)
	/tmp/workdir/go/src/runtime/mgcwork.go:101 +0x14 fp=0x461703c0 sp=0x461703b8 pc=0x806e8d4
runtime.(*gcWork).tryGet(0x6d430f5c)
	/tmp/workdir/go/src/runtime/mgcwork.go:207 +0x25 fp=0x461703d4 sp=0x461703c0 pc=0x806eb85
runtime.gcDrain(0x6d430f5c, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1090 +0x1ef fp=0x46170438 sp=0x461703d4 pc=0x80666cf
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1348 +0xa9 fp=0x46170464 sp=0x46170438 pc=0x80621f9
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x46170468 sp=0x46170464 pc=0x80abc15
2022-11-19 22:39 openbsd-amd64-68 go@bda02354 (log)
fatal error: workbuf is empty

runtime stack:
runtime.throw({0xa3dfed?, 0x43cca5?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x23a498530 sp=0x23a498500 pc=0x43559d
runtime.(*workbuf).checknonempty(0xc00042d000?)
	/tmp/workdir/go/src/runtime/mgcwork.go:338 +0x36 fp=0x23a498550 sp=0x23a498530 pc=0x426cb6
runtime.trygetfull()
	/tmp/workdir/go/src/runtime/mgcwork.go:430 +0x65 fp=0x23a498570 sp=0x23a498550 pc=0x4270c5
runtime.(*gcWork).init(0xc00003c138)
	/tmp/workdir/go/src/runtime/mgcwork.go:102 +0x29 fp=0x23a498580 sp=0x23a498570 pc=0x426689
runtime.(*gcWork).putBatch(0xc00003c138, {0xc00003c170, 0x1, 0x200})
	/tmp/workdir/go/src/runtime/mgcwork.go:175 +0x46 fp=0x23a4985d8 sp=0x23a498580 pc=0x426826
runtime.wbBufFlush1(0xc00003af00)
	/tmp/workdir/go/src/runtime/mwbbuf.go:287 +0x24f fp=0x23a498620 sp=0x23a4985d8 pc=0x43128f
runtime.gcMarkDone.func1.1(0xc00003af00)
	/tmp/workdir/go/src/runtime/mgc.go:817 +0x1e fp=0x23a498638 sp=0x23a498620 pc=0x45ff1e
runtime.runSafePointFn()
	/tmp/workdir/go/src/runtime/proc.go:1758 +0x4a fp=0x23a498650 sp=0x23a498638 pc=0x43b12a
runtime.findRunnable()
	/tmp/workdir/go/src/runtime/proc.go:2686 +0x6b fp=0x23a498758 sp=0x23a498650 pc=0x43cd4b
runtime.schedule()
	/tmp/workdir/go/src/runtime/proc.go:3360 +0xb1 fp=0x23a498790 sp=0x23a498758 pc=0x43e5b1
runtime.exitsyscall0(0xc0005be9c0)
	/tmp/workdir/go/src/runtime/proc.go:4123 +0x15f fp=0x23a4987c0 sp=0x23a498790 pc=0x44037f
runtime.mcall()
	/tmp/workdir/go/src/runtime/asm_amd64.s:452 +0x43 fp=0x23a4987d0 sp=0x23a4987c0 pc=0x465423
2022-11-19 23:11 openbsd-amd64-70 go@cf93b253 (log)
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0xa412d9?, 0x0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2bdfd7720 sp=0x2bdfd76f0 pc=0x43559d
runtime.(*workbuf).checkempty(0x0?)
	/tmp/workdir/go/src/runtime/mgcwork.go:344 +0x36 fp=0x2bdfd7740 sp=0x2bdfd7720 pc=0x426d16
runtime.getempty()
	/tmp/workdir/go/src/runtime/mgcwork.go:357 +0x1e8 fp=0x2bdfd77a0 sp=0x2bdfd7740 pc=0x426f28
runtime.(*gcWork).put(0xc000039738, 0xc0005b9600)
	/tmp/workdir/go/src/runtime/mgcwork.go:130 +0x67 fp=0x2bdfd77c8 sp=0x2bdfd77a0 pc=0x426727
runtime.greyobject(0xc0005b9600, 0x2bdfd7880?, 0x426f28?, 0x2bdfd7850?, 0x427031?, 0x12c0?)
	/tmp/workdir/go/src/runtime/mgcmark.go:1506 +0x18f fp=0x2bdfd7818 sp=0x2bdfd77c8 pc=0x4209af
runtime.scanobject(0xc000039738?, 0xc000039738)
	/tmp/workdir/go/src/runtime/mgcmark.go:1336 +0x187 fp=0x2bdfd78a8 sp=0x2bdfd7818 pc=0x420407
runtime.gcDrain(0xc000039738, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1103 +0x1d4 fp=0x2bdfd7908 sp=0x2bdfd78a8 pc=0x41fc54
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1348 +0xad fp=0x2bdfd7958 sp=0x2bdfd7908 pc=0x41c34d
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:496 +0x49 fp=0x2bdfd7960 sp=0x2bdfd7958 pc=0x4654a9

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std cmd: exit status 2

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-11-21 22:16 openbsd-amd64-68 go@995c0f31 (log)
Test "go_test:context" ran over 20m0s limit (20m0.000106475s); saw output:


XXXBANNERXXX:Testing packages.
2022-11-21 22:43 openbsd-amd64-68 go@7656cba9 cmd/go.TestScript (log)
vcs-test.golang.org rerouted to http://127.0.0.1:1378
https://vcs-test.golang.org rerouted to https://127.0.0.1:35814
go test proxy running at GOPROXY=http://127.0.0.1:24293/mod
runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0x344a36?, 0x0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x7f7ffffc0f08 sp=0x7f7ffffc0ed8 pc=0x7c8a7d
runtime.(*limiterEvent).stop(0x0?, 0x4, 0x0?)
...
	/tmp/workdir/go/src/cmd/go/internal/script/engine.go:566 +0x1bf fp=0xc0009cd908 sp=0xc0009cd838 pc=0xda7e9f
cmd/go/internal/script.(*Engine).Execute(0xc000012510, 0xc000410270, {0xc00056fba0, 0x12}, 0xc00064dc50?, {0x439b60, 0xc000b4a400})
	/tmp/workdir/go/src/cmd/go/internal/script/engine.go:292 +0x96f fp=0xc0009cdbc8 sp=0xc0009cd908 pc=0xda566f
cmd/go/internal/script/scripttest.Run.func1({0x442248, 0xc0004fb860}, 0xc000410270, 0x2c5db4508?, {0xc00056fba0, 0x12}, {0x438600?, 0xc000e6c5d0})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:89 +0x59d fp=0xc0009cdd90 sp=0xc0009cdbc8 pc=0xdbbf5d
cmd/go/internal/script/scripttest.Run({0x442248, 0xc0004fb860}, 0x3136f3?, 0xc00064dee8?, {0xc00056fba0, 0x12}, {0x438600, 0xc000e6c5d0})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:90 +0x9a fp=0xc0009cde10 sp=0xc0009cdd90 pc=0xdbb7ba
cmd/go_test.TestScript.func3(0xc0004fb860)
	/tmp/workdir/go/src/cmd/go/script_test.go:154 +0x60d fp=0xc0009cdf70 sp=0xc0009cde10 pc=0xdd88cd
testing.tRunner(0xc0004fb860, 0xc0004dea50)
2022-11-22 15:56 openbsd-arm64-jsing go@08c611b1 strings (log)
runtime: g 1: unexpected return pc for strings_test.init called from 0x0
stack: frame={sp:0x400011fcf0, fp:0x400013ff90} stack=[0x4000100000,0x4000140000)
0x000000400011fbf0:  0x3ff0000000000000  0x0000000000000000 
0x000000400011fc00:  0x3fd3333333333333  0x0000000000000400 
0x000000400011fc10:  0xfa9b65817b7849cc  0x0000000000000000 
0x000000400011fc20:  0x0000000000000000  0x0000000000000000 
0x000000400011fc30:  0x0000000000000000  0x0000000000000000 
0x000000400011fc40:  0x0000000000000000  0x0000000000000000 
0x000000400011fc50:  0x0000000000000000  0x0000000000000000 
0x000000400011fc60:  0x0000000000000000  0x0000000000000000 
...
fatal error: unknown caller pc

runtime stack:
runtime.throw({0x157409?, 0x257940?})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x4b3d1ec90 sp=0x4b3d1ec60 pc=0x42d70
runtime.gentraceback(0x4b3d1f028?, 0x73648?, 0x4b3d1f038?, 0x40000021a0, 0x0, 0x0, 0x7fffffff, 0x4b3d1f1f0, 0x4b3d1f078?, 0x0)
	/home/gopher/build/go/src/runtime/traceback.go:270 +0x14bc fp=0x4b3d1f000 sp=0x4b3d1ec90 pc=0x6831c
runtime.scanstack(0x40000021a0, 0x400002a138)
	/home/gopher/build/go/src/runtime/mgcmark.go:804 +0x1a8 fp=0x4b3d1f210 sp=0x4b3d1f000 pc=0x2b9f8
runtime.markroot.func1()
...
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:239 +0xb4 fp=0x4b3d1f260 sp=0x4b3d1f210 pc=0x2a814
runtime.markroot(0x400002a138, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:213 +0x1cc fp=0x4b3d1f300 sp=0x4b3d1f260 pc=0x2a4ec
runtime.gcDrain(0x400002a138, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3fc fp=0x4b3d1f360 sp=0x4b3d1f300 pc=0x2c4dc
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1367 +0x74 fp=0x4b3d1f3b0 sp=0x4b3d1f360 pc=0x28744
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x4b3d1f3c0 sp=0x4b3d1f3b0 pc=0x7125c
2022-11-22 16:07 openbsd-arm64-jsing go@9160e154 strings (log)
runtime: g 1: unexpected return pc for strings_test.init called from 0x0
stack: frame={sp:0x400019fcf0, fp:0x40001bff90} stack=[0x4000180000,0x40001c0000)
0x000000400019fbf0:  0x3ff0000000000000  0x0000000000000000 
0x000000400019fc00:  0x3fd3333333333333  0x0000000000000400 
0x000000400019fc10:  0x0e67052048436790  0x0000000000000000 
0x000000400019fc20:  0x0000000000000000  0x0000000000000000 
0x000000400019fc30:  0x0000000000000000  0x0000000000000000 
0x000000400019fc40:  0x0000000000000000  0x0000000000000000 
0x000000400019fc50:  0x0000000000000000  0x0000000000000000 
0x000000400019fc60:  0x0000000000000000  0x0000000000000000 
...
fatal error: unknown caller pc

runtime stack:
runtime.throw({0x157409?, 0x257940?})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x4d421acc0 sp=0x4d421ac90 pc=0x42d70
runtime.gentraceback(0x40000b4800?, 0x10?, 0x1?, 0x40000021a0, 0x0, 0x0, 0x7fffffff, 0x4d421b220, 0x4d421b0b8?, 0x0)
	/home/gopher/build/go/src/runtime/traceback.go:270 +0x14bc fp=0x4d421b030 sp=0x4d421acc0 pc=0x6831c
runtime.scanstack(0x40000021a0, 0x400002a138)
	/home/gopher/build/go/src/runtime/mgcmark.go:804 +0x1a8 fp=0x4d421b240 sp=0x4d421b030 pc=0x2b9f8
runtime.markroot.func1()
...
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:239 +0xb4 fp=0x4d421b290 sp=0x4d421b240 pc=0x2a814
runtime.markroot(0x400002a138, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:213 +0x1cc fp=0x4d421b330 sp=0x4d421b290 pc=0x2a4ec
runtime.gcDrain(0x400002a138, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3fc fp=0x4d421b390 sp=0x4d421b330 pc=0x2c4dc
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1367 +0x74 fp=0x4d421b3e0 sp=0x4d421b390 pc=0x28744
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x4d421b3f0 sp=0x4d421b3e0 pc=0x7125c
2022-11-22 18:11 openbsd-amd64-68 go@7a00f973 (log)
PASS




runtime: want=4 got=0
fatal error: limiterEvent.stop: found wrong event in p's limiter event slot

runtime stack:
runtime.throw({0xa65624?, 0x293ed8c50?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x293ed8c00 sp=0x293ed8bd0 pc=0x43559d
runtime.(*limiterEvent).stop(0x4?, 0x4, 0x0?)
	/tmp/workdir/go/src/runtime/mgclimit.go:453 +0x165 fp=0x293ed8c28 sp=0x293ed8c00 pc=0x41d765
runtime.pidleget(0xc000024040?)
	/tmp/workdir/go/src/runtime/proc.go:5903 +0x131 fp=0x293ed8c60 sp=0x293ed8c28 pc=0x444691
runtime.findRunnable()
	/tmp/workdir/go/src/runtime/proc.go:2981 +0x7b4 fp=0x293ed8d68 sp=0x293ed8c60 pc=0x43d494
runtime.schedule()
	/tmp/workdir/go/src/runtime/proc.go:3360 +0xb1 fp=0x293ed8da0 sp=0x293ed8d68 pc=0x43e5b1
runtime.exitsyscall0(0xc00026f380)
	/tmp/workdir/go/src/runtime/proc.go:4123 +0x15f fp=0x293ed8dd0 sp=0x293ed8da0 pc=0x44037f
runtime.mcall()
	/tmp/workdir/go/src/runtime/asm_amd64.s:452 +0x43 fp=0x293ed8de0 sp=0x293ed8dd0 pc=0x465423
2022-11-23 19:34 openbsd-arm64-jsing go@a8510f92 strings (log)
runtime: g 1: unexpected return pc for strings_test.init called from 0x0
stack: frame={sp:0x400011fcf0, fp:0x400013ff90} stack=[0x4000100000,0x4000140000)
0x000000400011fbf0:  0x3ff0000000000000  0x0000000000000000 
0x000000400011fc00:  0x3fd3333333333333  0x0000000000000400 
0x000000400011fc10:  0x60426ad943f59872  0x0000000000000000 
0x000000400011fc20:  0x0000000000000000  0x0000000000000000 
0x000000400011fc30:  0x0000000000000000  0x0000000000000000 
0x000000400011fc40:  0x0000000000000000  0x0000000000000000 
0x000000400011fc50:  0x0000000000000000  0x0000000000000000 
0x000000400011fc60:  0x0000000000000000  0x0000000000000000 
...
fatal error: unknown caller pc

runtime stack:
runtime.throw({0x157409?, 0x257940?})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x4b8638b00 sp=0x4b8638ad0 pc=0x42d70
runtime.gentraceback(0x400000004?, 0x300000002?, 0x4b8638f68?, 0x40000021a0, 0x0, 0x0, 0x7fffffff, 0x4b8639060, 0x0?, 0x0)
	/home/gopher/build/go/src/runtime/traceback.go:270 +0x14bc fp=0x4b8638e70 sp=0x4b8638b00 pc=0x6831c
runtime.scanstack(0x40000021a0, 0x400002a138)
	/home/gopher/build/go/src/runtime/mgcmark.go:804 +0x1a8 fp=0x4b8639080 sp=0x4b8638e70 pc=0x2b9f8
runtime.markroot.func1()
...
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:239 +0xb4 fp=0x4b86390d0 sp=0x4b8639080 pc=0x2a814
runtime.markroot(0x400002a138, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:213 +0x1cc fp=0x4b8639170 sp=0x4b86390d0 pc=0x2a4ec
runtime.gcDrain(0x400002a138, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3fc fp=0x4b86391d0 sp=0x4b8639170 pc=0x2c4dc
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1367 +0x74 fp=0x4b8639220 sp=0x4b86391d0 pc=0x28744
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x4b8639230 sp=0x4b8639220 pc=0x7125c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-11-28 19:33 openbsd-arm64-jsing go@61f5a672 strings (log)
runtime: g 1: unexpected return pc for strings_test.init called from 0x0
stack: frame={sp:0x400019fcf0, fp:0x40001bff90} stack=[0x4000180000,0x40001c0000)
0x000000400019fbf0:  0x3ff0000000000000  0x0000000000000000 
0x000000400019fc00:  0x3fd3333333333333  0x0000000000000400 
0x000000400019fc10:  0x0d6c577f29b2a10e  0x0000000000000000 
0x000000400019fc20:  0x0000000000000000  0x0000000000000000 
0x000000400019fc30:  0x0000000000000000  0x0000000000000000 
0x000000400019fc40:  0x0000000000000000  0x0000000000000000 
0x000000400019fc50:  0x0000000000000000  0x0000000000000000 
0x000000400019fc60:  0x0000000000000000  0x0000000000000000 
...
fatal error: unknown caller pc

runtime stack:
runtime.throw({0x1573d0?, 0x247900?})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x401212f50 sp=0x401212f20 pc=0x42d70
runtime.gentraceback(0x4000142800?, 0x10?, 0x1884f8?, 0x40000021a0, 0x0, 0x0, 0x7fffffff, 0x4012134b0, 0x401213348?, 0x0)
	/home/gopher/build/go/src/runtime/traceback.go:270 +0x14bc fp=0x4012132c0 sp=0x401212f50 pc=0x6831c
runtime.scanstack(0x40000021a0, 0x400002a138)
	/home/gopher/build/go/src/runtime/mgcmark.go:804 +0x1a8 fp=0x4012134d0 sp=0x4012132c0 pc=0x2b9f8
runtime.markroot.func1()
...
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:239 +0xb4 fp=0x401213520 sp=0x4012134d0 pc=0x2a814
runtime.markroot(0x400002a138, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:213 +0x1cc fp=0x4012135c0 sp=0x401213520 pc=0x2a4ec
runtime.gcDrain(0x400002a138, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3fc fp=0x401213620 sp=0x4012135c0 pc=0x2c4dc
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1367 +0x74 fp=0x401213670 sp=0x401213620 pc=0x28744
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x401213680 sp=0x401213670 pc=0x7125c
2022-12-02 18:13 openbsd-arm64-jsing go@3e2ab204 strings (log)
runtime: g 1: unexpected return pc for strings_test.init called from 0x0
stack: frame={sp:0x400011fcf0, fp:0x400013ff90} stack=[0x4000100000,0x4000140000)
0x000000400011fbf0:  0x3ff0000000000000  0x0000000000000000 
0x000000400011fc00:  0x3fd3333333333333  0x0000000000000400 
0x000000400011fc10:  0x2bff436971851537  0x0000000000000000 
0x000000400011fc20:  0x0000000000000000  0x0000000000000000 
0x000000400011fc30:  0x0000000000000000  0x0000000000000000 
0x000000400011fc40:  0x0000000000000000  0x0000000000000000 
0x000000400011fc50:  0x0000000000000000  0x0000000000000000 
0x000000400011fc60:  0x0000000000000000  0x0000000000000000 
...
fatal error: unknown caller pc

runtime stack:
runtime.throw({0x1573d0?, 0x247900?})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x4476678c0 sp=0x447667890 pc=0x42d70
runtime.gentraceback(0x447667c58?, 0x0?, 0x1884f8?, 0x40000021a0, 0x0, 0x0, 0x7fffffff, 0x447667e20, 0x447667cb8?, 0x0)
	/home/gopher/build/go/src/runtime/traceback.go:270 +0x14bc fp=0x447667c30 sp=0x4476678c0 pc=0x6831c
runtime.scanstack(0x40000021a0, 0x400002a138)
	/home/gopher/build/go/src/runtime/mgcmark.go:804 +0x1a8 fp=0x447667e40 sp=0x447667c30 pc=0x2b9f8
runtime.markroot.func1()
...
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:239 +0xb4 fp=0x447667e90 sp=0x447667e40 pc=0x2a814
runtime.markroot(0x400002a138, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:213 +0x1cc fp=0x447667f30 sp=0x447667e90 pc=0x2a4ec
runtime.gcDrain(0x400002a138, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3fc fp=0x447667f90 sp=0x447667f30 pc=0x2c4dc
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1367 +0x74 fp=0x447667fe0 sp=0x447667f90 pc=0x28744
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x447667ff0 sp=0x447667fe0 pc=0x7125c
2022-12-02 22:24 openbsd-arm64-jsing go@7ab36153 strings (log)
runtime: g 1: unexpected return pc for strings_test.init called from 0x0
stack: frame={sp:0x400019fcf0, fp:0x40001bff90} stack=[0x4000180000,0x40001c0000)
0x000000400019fbf0:  0x3ff0000000000000  0x0000000000000000 
0x000000400019fc00:  0x3fd3333333333333  0x0000000000000400 
0x000000400019fc10:  0x90491837233ea80c  0x0000000000000000 
0x000000400019fc20:  0x0000000000000000  0x0000000000000000 
0x000000400019fc30:  0x0000000000000000  0x0000000000000000 
0x000000400019fc40:  0x0000000000000000  0x0000000000000000 
0x000000400019fc50:  0x0000000000000000  0x0000000000000000 
0x000000400019fc60:  0x0000000000000000  0x0000000000000000 
...
fatal error: unknown caller pc

runtime stack:
runtime.throw({0x1573d0?, 0x247900?})
	/home/gopher/build/go/src/runtime/panic.go:1047 +0x40 fp=0x418c34cb0 sp=0x418c34c80 pc=0x42d70
runtime.gentraceback(0x40000b3800?, 0x10?, 0x1884f8?, 0x40000021a0, 0x0, 0x0, 0x7fffffff, 0x418c35210, 0x418c350a8?, 0x0)
	/home/gopher/build/go/src/runtime/traceback.go:270 +0x14bc fp=0x418c35020 sp=0x418c34cb0 pc=0x6831c
runtime.scanstack(0x40000021a0, 0x4000027c38)
	/home/gopher/build/go/src/runtime/mgcmark.go:804 +0x1a8 fp=0x418c35230 sp=0x418c35020 pc=0x2b9f8
runtime.markroot.func1()
...
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:239 +0xb4 fp=0x418c35280 sp=0x418c35230 pc=0x2a814
runtime.markroot(0x4000027c38, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:213 +0x1cc fp=0x418c35320 sp=0x418c35280 pc=0x2a4ec
runtime.gcDrain(0x4000027c38, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3fc fp=0x418c35380 sp=0x418c35320 pc=0x2c4dc
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1367 +0x74 fp=0x418c353d0 sp=0x418c35380 pc=0x28744
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x418c353e0 sp=0x418c353d0 pc=0x7125c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-12-05 18:57 openbsd-amd64-68 go@29863589 (log)
wirep: p->m=0(0) p->status=2
fatal error: wirep: invalid p state

runtime stack:
runtime.throw({0xa46824?, 0x0?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2ee47fd00 sp=0x2ee47fcd0 pc=0x43559d
runtime.wirep(0x200044b2c?)
	/tmp/workdir/go/src/runtime/proc.go:5125 +0x105 fp=0x2ee47fd38 sp=0x2ee47fd00 pc=0x442965
runtime.acquirep(0xc000046500)
	/tmp/workdir/go/src/runtime/proc.go:5094 +0x1e fp=0x2ee47fd50 sp=0x2ee47fd38 pc=0x44281e
runtime.mstart1()
	/tmp/workdir/go/src/runtime/proc.go:1502 +0xb4 fp=0x2ee47fd78 sp=0x2ee47fd50 pc=0x43aa34
runtime.mstart0()
	/tmp/workdir/go/src/runtime/proc.go:1455 +0x6c fp=0x2ee47fda0 sp=0x2ee47fd78 pc=0x43a94c
runtime.mstart()
	/tmp/workdir/go/src/runtime/asm_amd64.s:394 +0x5 fp=0x2ee47fda8 sp=0x2ee47fda0 pc=0x4653a5

go tool dist: FAILED: go list -f={{if .Stale}}	STALE {{.ImportPath}}: {{.StaleReason}}{{end}} std cmd: exit status 2
2022-12-06 19:00 openbsd-386-70 go@76cad4ed (log)
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0x85dde4d, 0x10})
	/tmp/workdir/go/src/runtime/panic.go:992 +0x64 fp=0x16520244 sp=0x16520230 pc=0x807bbd4
runtime.(*workbuf).checknonempty(0x69158800)
	/tmp/workdir/go/src/runtime/mgcwork.go:336 +0x34 fp=0x16520250 sp=0x16520244 pc=0x806d234
...
	/tmp/workdir/go/src/runtime/mgcmark.go:1146 +0x11a fp=0x20184d80 sp=0x20184d5c pc=0x8065a3a
runtime.gcAssistAlloc1(0x68f02780, 0x10000)
	/tmp/workdir/go/src/runtime/mgcmark.go:558 +0xfa fp=0x20184dd4 sp=0x20184d80 pc=0x806425a
runtime.gcAssistAlloc.func1()
	/tmp/workdir/go/src/runtime/mgcmark.go:469 +0x28 fp=0x20184de4 sp=0x20184dd4 pc=0x8064148
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_386.s:370 +0x35 fp=0x20184de8 sp=0x20184de4 pc=0x80a7175
2022/12/06 12:31:10 Failed: exit status 2

FAILED

watchflakes

@qbit
Copy link
Member

qbit commented Dec 7, 2022

I have updates to the build script working. I will submit a PR for it here pretty quick (testing my doc changes).

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2022-12-06 15:29 openbsd-amd64-68 crypto@eb2c4062 go@eaf0e3d4 (log)
fatal error: workbuf is not empty
fatal error: workbuf is not empty
fatal error: workbuf is not empty
fatal error: workbuf is not empty
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0xa44c57?, 0x2493b64a8?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x2493b6480 sp=0x2493b6450 pc=0x43559d
runtime.(*workbuf).checkempty(0x247eeee38?)
...
runtime.handoff(0xc00121f800)
	/tmp/workdir/go/src/runtime/mgcwork.go:439 +0x25 fp=0x235e082b0 sp=0x235e08280 pc=0x427125
runtime.(*gcWork).balance(0xc000039c38)
	/tmp/workdir/go/src/runtime/mgcwork.go:297 +0x45 fp=0x235e082c8 sp=0x235e082b0 pc=0x426c05
runtime.gcDrain(0xc000039c38, 0x3)
	/tmp/workdir/go/src/runtime/mgcmark.go:1085 +0x125 fp=0x235e08328 sp=0x235e082c8 pc=0x41fba5
runtime.gcBgMarkWorker.func2()
	/tmp/workdir/go/src/runtime/mgc.go:1348 +0xad fp=0x235e08378 sp=0x235e08328 pc=0x41c34d
runtime.systemstack()
	/tmp/workdir/go/src/runtime/asm_amd64.s:496 +0x49 fp=0x235e08380 sp=0x235e08378 pc=0x465489

watchflakes

qbit added a commit to qbit/build that referenced this issue Dec 8, 2022
While here modify make.bash to accept a VERSION variable.

For golang/go#55161
@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-14 16:55 openbsd-arm64-jsing go@2b92c39f os/signal.test [build] (log)
go.go(/home/gopher/build/tmp/go-link-126487995/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls
unexpected fault address 0x349bf4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349bf4 pc=0x349a34]

goroutine 1 [running]:
runtime.throw({0x239c13?, 0x40000021a0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b7c0 sp=0x400004b790 pc=0x35eac0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b820 sp=0x400004b7c0 pc=0x375cdc
...
testing.runTests(0x40000760a0?, {0x469300, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46d060?})
	/home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc50 sp=0x400004bb50 pc=0x3ed294
testing.(*M).Run(0x40000760a0)
	/home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bea0 sp=0x400004bc50 pc=0x3ebfb4
main.main()
	_testmain.go:87 +0x1a8 fp=0x400004bf30 sp=0x400004bea0 pc=0x42f5e8
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:266 +0x2b8 fp=0x400004bfd0 sp=0x400004bf30 pc=0x361198
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393214

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-14 16:28 openbsd-arm64-jsing go@d4bcfe4e os/signal.test.TestReset [build] (log)
go.go(/home/gopher/build/tmp/go-link-1962637983/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls
unexpected fault address 0x3499b4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x3499b4 pc=0x3497f4]

runtime.throw({0x239a93?, 0x4000083040?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x4000047ba0 sp=0x4000047b70 pc=0x35e880
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x4000047c00 sp=0x4000047ba0 pc=0x375a0c
runtime.(*gcControllerState).startCycle(0x246b70?, 0x335b64?, 0x4000047cc8?, {0x335b78?, 0x4000047cb8?, 0x34a890?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047c70 sp=0x4000047c10 pc=0x3497f4
runtime.gcStart({0x4000120000?, 0x50?, 0x48?})
	/home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x4000047d20 sp=0x4000047c70 pc=0x342d8c
runtime.mallocgc(0x48, 0x22e8c0, 0x1)
	/home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x4000047d90 sp=0x4000047d20 pc=0x336460
runtime.newobject(0x273ff134?)
	/home/gopher/build/go/src/runtime/malloc.go:1257 +0x2c fp=0x4000047dc0 sp=0x4000047d90 pc=0x33668c
time.Sleep(0x2faf080)
	/home/gopher/build/go/src/runtime/time.go:186 +0x3c fp=0x4000047e00 sp=0x4000047dc0 pc=0x38fa2c
os/signal.quiesce()
	/home/gopher/build/go/src/os/signal/signal_test.go:115 +0x50 fp=0x4000047e40 sp=0x4000047e00 pc=0x3f9500
os/signal.testCancel(0x400010e1a0, 0x0)
	/home/gopher/build/go/src/os/signal/signal_test.go:235 +0x214 fp=0x4000047f40 sp=0x4000047e40 pc=0x3f9d54
os/signal.TestReset(0x0?)
	/home/gopher/build/go/src/os/signal/signal_test.go:261 +0x20 fp=0x4000047f60 sp=0x4000047f40 pc=0x3f9fa0
testing.tRunner(0x400010e1a0, 0x246988)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-14 16:08 openbsd-arm64-jsing go@4bd20ec8 os/signal (log)
unexpected fault address 0x3499b4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x3499b4 pc=0x3497f4]

goroutine 34 [running]:
runtime.throw({0x239a93?, 0x4000083040?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x4000047b00 sp=0x4000047ad0 pc=0x35e880
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x4000047b60 sp=0x4000047b00 pc=0x375a0c
runtime.(*gcControllerState).startCycle(0x246b70?, 0x335b64?, 0x4000047c28?, {0x335b78?, 0x4000047c18?, 0x34a890?})
...
testing.tRunner.func1()
	/home/gopher/build/go/src/testing/testing.go:1586 +0x414 fp=0x4000047f60 sp=0x4000047df0 pc=0x3eaaf4
testing.tRunner(0x4000104340, 0x2469b0)
	/home/gopher/build/go/src/testing/testing.go:1601 +0x124 fp=0x4000047fb0 sp=0x4000047f60 pc=0x3ea654
testing.(*T).Run.func1()
	/home/gopher/build/go/src/testing/testing.go:1648 +0x2c fp=0x4000047fd0 sp=0x4000047fb0 pc=0x3eb42c
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x4000047fd0 sp=0x4000047fd0 pc=0x392f44
created by testing.(*T).Run in goroutine 1
	/home/gopher/build/go/src/testing/testing.go:1648 +0x33c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-13 17:28 openbsd-arm64-jsing go@b5a7f2ee os/signal.TestDetectNohup (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

runtime.throw({0x239a93?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004c740 sp=0x400004c710 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004c7a0 sp=0x400004c740 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004c868?, {0x336078?, 0x400004c858?, 0x34aca0?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004c810 sp=0x400004c7b0 pc=0x349c04
...
	/home/gopher/build/go/src/os/exec.go:109 +0x50 fp=0x400004cc40 sp=0x400004cbf0 pc=0x3b2380
os/exec.(*Cmd).Start(0x4000130000)
	/home/gopher/build/go/src/os/exec/exec.go:693 +0x4a0 fp=0x400004cdc0 sp=0x400004cc40 pc=0x3f3f60
os/exec.(*Cmd).Run(0x400004ced0?)
	/home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x400004cde0 sp=0x400004cdc0 pc=0x3f3a80
os/exec.(*Cmd).CombinedOutput(0x4000130000)
	/home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x400004ce10 sp=0x400004cde0 pc=0x3f50b8
os/signal.TestDetectNohup(0x4000182d00)
	/home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x400004cf60 sp=0x400004ce10 pc=0x3fa7cc
testing.tRunner(0x4000182d00, 0x2468f8)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-13 15:58 openbsd-arm64-jsing go@0742e6db os/signal.TestReset (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

runtime.throw({0x239a93?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb70 sp=0x400004cb40 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cbd0 sp=0x400004cb70 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004cc98?, {0x336078?, 0x400004cc88?, 0x34aca0?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cc40 sp=0x400004cbe0 pc=0x349c04
runtime.gcStart({0x4ed7da108?, 0xf?, 0xed7e5728?})
	/home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004ccf0 sp=0x400004cc40 pc=0x34319c
runtime.mallocgc(0x50, 0x227e60, 0x1)
	/home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004cd60 sp=0x400004ccf0 pc=0x336960
runtime.newobject(...)
	/home/gopher/build/go/src/runtime/malloc.go:1257
runtime.mapassign_fast64(0x217500, 0x4000076480, 0x3f9540)
	/home/gopher/build/go/src/runtime/map_fast64.go:110 +0x90 fp=0x400004cda0 sp=0x400004cd60 pc=0x33a910
testing.(*common).Helper(0x4000082d00)
	/home/gopher/build/go/src/testing/testing.go:1140 +0xe0 fp=0x400004ce00 sp=0x400004cda0 pc=0x3e9d10
os/signal.waitSig(0x4000082d00, 0x400004ced8?, {0x26bc90, 0x26ac78})
	/home/gopher/build/go/src/os/signal/signal_test.go:67 +0x30 fp=0x400004ce40 sp=0x400004ce00 pc=0x3f9540
os/signal.testCancel(0x4000082d00, 0x0)
	/home/gopher/build/go/src/os/signal/signal_test.go:210 +0x12c fp=0x400004cf40 sp=0x400004ce40 pc=0x3fa15c
os/signal.TestReset(0x0?)
	/home/gopher/build/go/src/os/signal/signal_test.go:261 +0x20 fp=0x400004cf60 sp=0x400004cf40 pc=0x3fa490
testing.tRunner(0x4000082d00, 0x246948)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-13 17:46 openbsd-arm64-jsing go@74c296b6 os/signal (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

goroutine 1 [running]:
runtime.throw({0x239a93?, 0x40000021a0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b800 sp=0x400004b7d0 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b860 sp=0x400004b800 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004b928?, {0x336078?, 0x400004b918?, 0x34aca0?})
...
testing.runTests(0x40001060a0?, {0x46a580, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46e2c0?})
	/home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc90 sp=0x400004bb90 pc=0x3ed594
testing.(*M).Run(0x40001060a0)
	/home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bee0 sp=0x400004bc90 pc=0x3ec2b4
main.main()
	_testmain.go:87 +0x1a8 fp=0x400004bf70 sp=0x400004bee0 pc=0x42f808
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:261 +0x21c fp=0x400004bfd0 sp=0x400004bf70 pc=0x36146c
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393514

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-13 15:29 openbsd-arm64-jsing go@3f747d09 os/signal.TestDetectNohup (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

runtime.throw({0x239a93?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cad0 sp=0x400004caa0 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cb30 sp=0x400004cad0 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004cbf8?, {0x336078?, 0x400004cbe8?, 0x34aca0?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cba0 sp=0x400004cb40 pc=0x349c04
runtime.gcStart({0x0?, 0x0?, 0x0?})
	/home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004cc50 sp=0x400004cba0 pc=0x34319c
runtime.mallocgc(0x90, 0x233040, 0x1)
	/home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004ccc0 sp=0x400004cc50 pc=0x336960
runtime.newobject(0x4000096090?)
	/home/gopher/build/go/src/runtime/malloc.go:1257 +0x2c fp=0x400004ccf0 sp=0x400004ccc0 pc=0x336b8c
os.(*Process).wait(0x40000c0000)
	/home/gopher/build/go/src/os/exec_unix.go:38 +0x38 fp=0x400004cd50 sp=0x400004ccf0 pc=0x3b29c8
os.(*Process).Wait(...)
	/home/gopher/build/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x40000aa000)
	/home/gopher/build/go/src/os/exec/exec.go:890 +0x38 fp=0x400004cdc0 sp=0x400004cd50 pc=0x3f4ab8
os/exec.(*Cmd).Run(0x400004ced0?)
	/home/gopher/build/go/src/os/exec/exec.go:590 +0x38 fp=0x400004cde0 sp=0x400004cdc0 pc=0x3f3a98
os/exec.(*Cmd).CombinedOutput(0x40000aa000)
	/home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x400004ce10 sp=0x400004cde0 pc=0x3f50b8
os/signal.TestDetectNohup(0x4000184680)
	/home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x400004cf60 sp=0x400004ce10 pc=0x3fa7cc
testing.tRunner(0x4000184680, 0x2468f8)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-13 15:25 openbsd-arm64-jsing go@eed0cda4 os/signal (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

goroutine 1 [running]:
runtime.throw({0x239a93?, 0x40000021a0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b800 sp=0x400004b7d0 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b860 sp=0x400004b800 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004b928?, {0x336078?, 0x400004b918?, 0x34aca0?})
...
testing.runTests(0x40001060a0?, {0x46a580, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46e2c0?})
	/home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc90 sp=0x400004bb90 pc=0x3ed594
testing.(*M).Run(0x40001060a0)
	/home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bee0 sp=0x400004bc90 pc=0x3ec2b4
main.main()
	_testmain.go:87 +0x1a8 fp=0x400004bf70 sp=0x400004bee0 pc=0x42f808
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:261 +0x21c fp=0x400004bfd0 sp=0x400004bf70 pc=0x36146c
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393514

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-12 20:33 openbsd-arm64-jsing go@f3e6f0f2 os/signal (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

goroutine 1 [running]:
runtime.throw({0x239a93?, 0x40000021a0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004b800 sp=0x400004b7d0 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004b860 sp=0x400004b800 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004b928?, {0x336078?, 0x400004b918?, 0x34aca0?})
...
testing.runTests(0x40001060a0?, {0x46a580, 0x13, 0x13}, {0x40000609c0?, 0x40?, 0x46e2c0?})
	/home/gopher/build/go/src/testing/testing.go:2053 +0x3b4 fp=0x400004bc90 sp=0x400004bb90 pc=0x3ed594
testing.(*M).Run(0x40001060a0)
	/home/gopher/build/go/src/testing/testing.go:1925 +0x534 fp=0x400004bee0 sp=0x400004bc90 pc=0x3ec2b4
main.main()
	_testmain.go:87 +0x1a8 fp=0x400004bf70 sp=0x400004bee0 pc=0x42f808
runtime.main()
	/home/gopher/build/go/src/runtime/proc.go:261 +0x21c fp=0x400004bfd0 sp=0x400004bf70 pc=0x36146c
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004bfd0 sp=0x400004bfd0 pc=0x393514

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-12 20:33 openbsd-arm64-jsing go@d528f72d os/signal (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

goroutine 34 [running]:
runtime.throw({0x239a93?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb00 sp=0x400004cad0 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cb60 sp=0x400004cb00 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x400004cc28?, {0x336078?, 0x400004cc18?, 0x34aca0?})
...
testing.tRunner.func1()
	/home/gopher/build/go/src/testing/testing.go:1586 +0x414 fp=0x400004cf60 sp=0x400004cdf0 pc=0x3eb0c4
testing.tRunner(0x4000224000, 0x246970)
	/home/gopher/build/go/src/testing/testing.go:1601 +0x124 fp=0x400004cfb0 sp=0x400004cf60 pc=0x3eac24
testing.(*T).Run.func1()
	/home/gopher/build/go/src/testing/testing.go:1648 +0x2c fp=0x400004cfd0 sp=0x400004cfb0 pc=0x3eb9fc
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1196 +0x4 fp=0x400004cfd0 sp=0x400004cfd0 pc=0x393514
created by testing.(*T).Run in goroutine 1
	/home/gopher/build/go/src/testing/testing.go:1648 +0x33c

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-12 20:06 openbsd-arm64-jsing go@b3a194aa os/signal.TestDetectNohup (log)
unexpected fault address 0x349dc4
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349dc4 pc=0x349c04]

runtime.throw({0x239a93?, 0x4000106d00?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x4000047740 sp=0x4000047710 pc=0x35ee30
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x40000477a0 sp=0x4000047740 pc=0x37600c
runtime.(*gcControllerState).startCycle(0x246b30?, 0x336064?, 0x4000047868?, {0x336078?, 0x4000047858?, 0x34aca0?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047810 sp=0x40000477b0 pc=0x349c04
...
	/home/gopher/build/go/src/os/exec.go:109 +0x50 fp=0x4000047c40 sp=0x4000047bf0 pc=0x3b2380
os/exec.(*Cmd).Start(0x400015e000)
	/home/gopher/build/go/src/os/exec/exec.go:693 +0x4a0 fp=0x4000047dc0 sp=0x4000047c40 pc=0x3f3f60
os/exec.(*Cmd).Run(0x4000047ed0?)
	/home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x4000047de0 sp=0x4000047dc0 pc=0x3f3a80
os/exec.(*Cmd).CombinedOutput(0x400015e000)
	/home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x4000047e10 sp=0x4000047de0 pc=0x3f50b8
os/signal.TestDetectNohup(0x4000082680)
	/home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x4000047f60 sp=0x4000047e10 pc=0x3fa7cc
testing.tRunner(0x4000082680, 0x2468f8)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-12 16:04 openbsd-arm64-jsing go@d91d8325 os/signal.test.TestReset [build] (log)
go.go(/home/gopher/build/tmp/go-link-2743407894/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls
unexpected fault address 0x349b64
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4]

runtime.throw({0x239a73?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb70 sp=0x400004cb40 pc=0x35ebd0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cbd0 sp=0x400004cb70 pc=0x375dac
runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x400004cc98?, {0x335e18?, 0x400004cc88?, 0x34aa40?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cc40 sp=0x400004cbe0 pc=0x3499a4
runtime.gcStart({0x4e16a2a68?, 0xf?, 0x2fe65c08?})
	/home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004ccf0 sp=0x400004cc40 pc=0x342f3c
runtime.mallocgc(0x50, 0x227e60, 0x1)
	/home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004cd60 sp=0x400004ccf0 pc=0x336700
runtime.newobject(...)
	/home/gopher/build/go/src/runtime/malloc.go:1257
runtime.mapassign_fast64(0x217500, 0x4000198060, 0x3f92e0)
	/home/gopher/build/go/src/runtime/map_fast64.go:110 +0x90 fp=0x400004cda0 sp=0x400004cd60 pc=0x33a6b0
testing.(*common).Helper(0x4000083040)
	/home/gopher/build/go/src/testing/testing.go:1140 +0xe0 fp=0x400004ce00 sp=0x400004cda0 pc=0x3e9ab0
os/signal.waitSig(0x4000083040, 0x400004ced8?, {0x26bc30, 0x26ac00})
	/home/gopher/build/go/src/os/signal/signal_test.go:67 +0x30 fp=0x400004ce40 sp=0x400004ce00 pc=0x3f92e0
os/signal.testCancel(0x4000083040, 0x0)
	/home/gopher/build/go/src/os/signal/signal_test.go:210 +0x12c fp=0x400004cf40 sp=0x400004ce40 pc=0x3f9efc
os/signal.TestReset(0x0?)
	/home/gopher/build/go/src/os/signal/signal_test.go:261 +0x20 fp=0x400004cf60 sp=0x400004cf40 pc=0x3fa230
testing.tRunner(0x4000083040, 0x246920)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-12 15:45 openbsd-arm64-jsing go@b7428b7c os/signal.TestIgnore (log)
unexpected fault address 0x349b64
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4]

runtime.throw({0x239a73?, 0x4000083040?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x4000047ba0 sp=0x4000047b70 pc=0x35ebd0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x4000047c00 sp=0x4000047ba0 pc=0x375dac
runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x4000047cc8?, {0x335e18?, 0x4000047cb8?, 0x34aa40?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047c70 sp=0x4000047c10 pc=0x3499a4
runtime.gcStart({0x465872f18?, 0x400003d005?, 0x47d88?})
	/home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x4000047d20 sp=0x4000047c70 pc=0x342f3c
runtime.mallocgc(0xc, 0x21bb40, 0x1)
	/home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x4000047d90 sp=0x4000047d20 pc=0x336700
runtime.newobject(0x689374b5?)
	/home/gopher/build/go/src/runtime/malloc.go:1257 +0x2c fp=0x4000047dc0 sp=0x4000047d90 pc=0x33692c
os/signal.Notify(0x40000621e0, {0x4000047ed8, 0x1, 0x2699d0?})
	/home/gopher/build/go/src/os/signal/signal.go:134 +0x13c fp=0x4000047e40 sp=0x4000047dc0 pc=0x3f7f7c
os/signal.testCancel(0x4000186680, 0x1)
	/home/gopher/build/go/src/os/signal/signal_test.go:254 +0x2ec fp=0x4000047f40 sp=0x4000047e40 pc=0x3fa0bc
os/signal.TestIgnore(0x0?)
	/home/gopher/build/go/src/os/signal/signal_test.go:266 +0x20 fp=0x4000047f60 sp=0x4000047f40 pc=0x3fa270
testing.tRunner(0x4000186680, 0x2468e0)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-11 20:56 openbsd-arm64-jsing go@319b75ed os/signal.test.TestDetectNohup [build] (log)
go.go(/home/gopher/build/tmp/go-link-3270113097/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls
unexpected fault address 0x349b64
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4]

runtime.throw({0x239a73?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004c7a0 sp=0x400004c770 pc=0x35ebd0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004c800 sp=0x400004c7a0 pc=0x375dac
runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x400004c8c8?, {0x335e18?, 0x400004c8b8?, 0x34aa40?})
...
	/home/gopher/build/go/src/os/exec/exec.go:1196 +0x174 fp=0x400004cc40 sp=0x400004cbb0 pc=0x3f50c4
os/exec.(*Cmd).Start(0x40000c4000)
	/home/gopher/build/go/src/os/exec/exec.go:688 +0x3fc fp=0x400004cdc0 sp=0x400004cc40 pc=0x3f3c5c
os/exec.(*Cmd).Run(0x400004ced0?)
	/home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x400004cde0 sp=0x400004cdc0 pc=0x3f3820
os/exec.(*Cmd).CombinedOutput(0x40000c4000)
	/home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x400004ce10 sp=0x400004cde0 pc=0x3f4e58
os/signal.TestDetectNohup(0x400011ad00)
	/home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x400004cf60 sp=0x400004ce10 pc=0x3fa56c
testing.tRunner(0x400011ad00, 0x2468d0)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-11 20:56 openbsd-arm64-jsing go@f7f0d395 os/signal.test.TestReset [build] (log)
go.go(/home/gopher/build/tmp/go-link-3860712551/go.o:(syscall.libc_syscall_trampoline.abi0)): warning: syscall() may go away, please rewrite code to use direct calls
unexpected fault address 0x349b64
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4]

runtime.throw({0x239a73?, 0x400011a4e0?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x400004cb70 sp=0x400004cb40 pc=0x35ebd0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x400004cbd0 sp=0x400004cb70 pc=0x375dac
runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x400004cc98?, {0x335e18?, 0x400004cc88?, 0x34aa40?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x400004cc40 sp=0x400004cbe0 pc=0x3499a4
runtime.gcStart({0x452d01f18?, 0x3000000100000f?, 0xa3dcf448?})
	/home/gopher/build/go/src/runtime/mgc.go:678 +0x3bc fp=0x400004ccf0 sp=0x400004cc40 pc=0x342f3c
runtime.mallocgc(0x50, 0x227e60, 0x1)
	/home/gopher/build/go/src/runtime/malloc.go:1175 +0x7a0 fp=0x400004cd60 sp=0x400004ccf0 pc=0x336700
runtime.newobject(...)
	/home/gopher/build/go/src/runtime/malloc.go:1257
runtime.mapassign_fast64(0x217500, 0x4000218000, 0x3f92e0)
	/home/gopher/build/go/src/runtime/map_fast64.go:110 +0x90 fp=0x400004cda0 sp=0x400004cd60 pc=0x33a6b0
testing.(*common).Helper(0x4000082820)
	/home/gopher/build/go/src/testing/testing.go:1140 +0xe0 fp=0x400004ce00 sp=0x400004cda0 pc=0x3e9ab0
os/signal.waitSig(0x4000082820, 0x400004ced8?, {0x26bc30, 0x26ac00})
	/home/gopher/build/go/src/os/signal/signal_test.go:67 +0x30 fp=0x400004ce40 sp=0x400004ce00 pc=0x3f92e0
os/signal.testCancel(0x4000082820, 0x0)
	/home/gopher/build/go/src/os/signal/signal_test.go:210 +0x12c fp=0x400004cf40 sp=0x400004ce40 pc=0x3f9efc
os/signal.TestReset(0x0?)
	/home/gopher/build/go/src/os/signal/signal_test.go:261 +0x20 fp=0x400004cf60 sp=0x400004cf40 pc=0x3fa230
testing.tRunner(0x4000082820, 0x246920)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-04-11 20:54 openbsd-arm64-jsing go@ee591c84 os/signal.TestDetectNohup (log)
unexpected fault address 0x349b64
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x2 addr=0x349b64 pc=0x3499a4]

runtime.throw({0x239a73?, 0x4000083040?})
	/home/gopher/build/go/src/runtime/panic.go:1076 +0x40 fp=0x40000477a0 sp=0x4000047770 pc=0x35ebd0
runtime.sigpanic()
	/home/gopher/build/go/src/runtime/signal_unix.go:866 +0x22c fp=0x4000047800 sp=0x40000477a0 pc=0x375dac
runtime.(*gcControllerState).startCycle(0x246b08?, 0x335e04?, 0x40000478c8?, {0x335e18?, 0x40000478b8?, 0x34aa40?})
	/home/gopher/build/go/src/runtime/mgcpacer.go:423 +0x144 fp=0x4000047870 sp=0x4000047810 pc=0x3499a4
...
	/home/gopher/build/go/src/os/exec/exec.go:1196 +0x174 fp=0x4000047c40 sp=0x4000047bb0 pc=0x3f50c4
os/exec.(*Cmd).Start(0x4000196000)
	/home/gopher/build/go/src/os/exec/exec.go:688 +0x3fc fp=0x4000047dc0 sp=0x4000047c40 pc=0x3f3c5c
os/exec.(*Cmd).Run(0x4000047ed0?)
	/home/gopher/build/go/src/os/exec/exec.go:587 +0x20 fp=0x4000047de0 sp=0x4000047dc0 pc=0x3f3820
os/exec.(*Cmd).CombinedOutput(0x4000196000)
	/home/gopher/build/go/src/os/exec/exec.go:1005 +0x98 fp=0x4000047e10 sp=0x4000047de0 pc=0x3f4e58
os/signal.TestDetectNohup(0x4000083380)
	/home/gopher/build/go/src/os/signal/signal_test.go:307 +0x18c fp=0x4000047f60 sp=0x4000047e10 pc=0x3fa56c
testing.tRunner(0x4000083380, 0x2468d0)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-05-09 12:49 openbsd-386-72 go@59d19ba7 net.TestNotTemporaryRead (log)
panic: test timed out after 3m0s
running tests:
	TestNotTemporaryRead (2m54s)

runtime.gopark(0x82c2d4c, 0x13fc5320, 0x2, 0x1b, 0x5)
	/tmp/workdir/go/src/runtime/proc.go:387 +0xfa fp=0x611a9e08 sp=0x611a9df4 pc=0x808413a
runtime.netpollblock(0x13fc5310, 0x72, 0x0)
	/tmp/workdir/go/src/runtime/netpoll.go:556 +0xe4 fp=0x611a9e20 sp=0x611a9e08 pc=0x807d3f4
internal/poll.runtime_pollWait(0x13fc5310, 0x72)
	/tmp/workdir/go/src/runtime/netpoll.go:335 +0x4c fp=0x611a9e34 sp=0x611a9e20 pc=0x80b08ec
internal/poll.(*pollDesc).wait(0x6119c568, 0x72, 0x0)
	/tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:84 +0x31 fp=0x611a9e48 sp=0x611a9e34 pc=0x80d8a31
internal/poll.(*pollDesc).waitRead(...)
	/tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x6119c550, {0x6138a3ba, 0x1, 0x1})
	/tmp/workdir/go/src/internal/poll/fd_unix.go:167 +0x210 fp=0x611a9e98 sp=0x611a9e48 pc=0x80d9620
net.(*netFD).Read(0x6119c550, {0x6138a3ba, 0x1, 0x1})
	/tmp/workdir/go/src/net/fd_posix.go:55 +0x39 fp=0x611a9ec4 sp=0x611a9e98 pc=0x818b219
net.(*conn).Read(0x61188230, {0x6138a3ba, 0x1, 0x1})
	/tmp/workdir/go/src/net/net.go:179 +0x49 fp=0x611a9ef4 sp=0x611a9ec4 pc=0x819d7d9
net.(*TCPConn).Read(0x61188230, {0x6138a3ba, 0x1, 0x1})
	<autogenerated>:1 +0x3c fp=0x611a9f14 sp=0x611a9ef4 pc=0x824c12c
net.TestNotTemporaryRead(0x612f2690)
	/tmp/workdir/go/src/net/net_test.go:557 +0x2e2 fp=0x611a9f98 sp=0x611a9f14 pc=0x8208e62
testing.tRunner(0x612f2690, 0x82c2604)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-05-11 16:11 openbsd-386-72 go@2e7d864f net.TestNotTemporaryRead (log)
panic: test timed out after 3m0s
running tests:
	TestNotTemporaryRead (2m55s)

runtime.gopark(0x82c6d64, 0x348452a0, 0x2, 0x1b, 0x5)
	/tmp/workdir/go/src/runtime/proc.go:387 +0xfa fp=0x588b8e08 sp=0x588b8df4 pc=0x8084caa
runtime.netpollblock(0x34845290, 0x72, 0x0)
	/tmp/workdir/go/src/runtime/netpoll.go:556 +0xe4 fp=0x588b8e20 sp=0x588b8e08 pc=0x807df64
internal/poll.runtime_pollWait(0x34845290, 0x72)
	/tmp/workdir/go/src/runtime/netpoll.go:335 +0x4c fp=0x588b8e34 sp=0x588b8e20 pc=0x80b128c
internal/poll.(*pollDesc).wait(0x58a185b8, 0x72, 0x0)
	/tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:84 +0x31 fp=0x588b8e48 sp=0x588b8e34 pc=0x80d90c1
internal/poll.(*pollDesc).waitRead(...)
	/tmp/workdir/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0x58a185a0, {0x58c820ac, 0x1, 0x1})
	/tmp/workdir/go/src/internal/poll/fd_unix.go:167 +0x210 fp=0x588b8e98 sp=0x588b8e48 pc=0x80d9cb0
net.(*netFD).Read(0x58a185a0, {0x58c820ac, 0x1, 0x1})
	/tmp/workdir/go/src/net/fd_posix.go:55 +0x39 fp=0x588b8ec4 sp=0x588b8e98 pc=0x818d879
net.(*conn).Read(0x58a900f8, {0x58c820ac, 0x1, 0x1})
	/tmp/workdir/go/src/net/net.go:179 +0x49 fp=0x588b8ef4 sp=0x588b8ec4 pc=0x819fe39
net.(*TCPConn).Read(0x58a900f8, {0x58c820ac, 0x1, 0x1})
	<autogenerated>:1 +0x3c fp=0x588b8f14 sp=0x588b8ef4 pc=0x824e78c
net.TestNotTemporaryRead(0x58c8a0f0)
	/tmp/workdir/go/src/net/net_test.go:557 +0x2e2 fp=0x588b8f98 sp=0x588b8f14 pc=0x820b4c2
testing.tRunner(0x58c8a0f0, 0x82c661c)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out`)
2023-05-26 16:17 openbsd-arm64-jsing go@4c1d8bf5 syscall.TestExecPtrace (log)
panic: test timed out after 15m0s
running tests:
	TestExecPtrace (14m59s)

syscall.syscall(0x8a180, 0x6, 0x40000a6cb0, 0x8)
	/home/gopher/build/go/src/runtime/sys_openbsd3.go:24 +0x1c fp=0x40000a6ba0 sp=0x40000a6b80 pc=0x77c6c
syscall.syscall(0x40000a6c28?, 0x8476c?, 0x4d9?, 0x84ea0?)
	<autogenerated>:1 +0x20 fp=0x40000a6bf0 sp=0x40000a6ba0 pc=0x7d020
syscall.readlen(0x6?, 0x40000a6cb0?, 0x8?)
	/home/gopher/build/go/src/syscall/zsyscall_openbsd_arm64.go:1698 +0x3c fp=0x40000a6c30 sp=0x40000a6bf0 pc=0x8948c
syscall.forkExec({0x40000ae000?, 0x1c258?}, {0x40000a6f00, 0x1, 0x1}, 0x80?)
	/home/gopher/build/go/src/syscall/exec_unix.go:217 +0x374 fp=0x40000a6d50 sp=0x40000a6c30 pc=0x84854
syscall.StartProcess(...)
	/home/gopher/build/go/src/syscall/exec_unix.go:334
os.startProcess({0x40000ae000, 0x7}, {0x40000a6f00, 0x1, 0x1}, 0x40000a6f10)
	/home/gopher/build/go/src/os/exec_posix.go:54 +0x238 fp=0x40000a6e40 sp=0x40000a6d50 pc=0x9fba8
os.StartProcess({0x40000ae000, 0x7}, {0x40000a6f00, 0x1, 0x1}, 0x40000a6f18?)
	/home/gopher/build/go/src/os/exec.go:109 +0x50 fp=0x40000a6e90 sp=0x40000a6e40 pc=0x9f8c0
syscall_test.TestExecPtrace(0x4000082820)
	/home/gopher/build/go/src/syscall/syscall_ptrace_test.go:30 +0xc4 fp=0x40000a6f60 sp=0x40000a6e90 pc=0x1275e4
testing.tRunner(0x4000082820, 0x17caf0)

watchflakes

@bcmills
Copy link
Contributor

bcmills commented Jun 28, 2023

The unexpected fault address 0x349dc4 failure mode on openbsd-arm64-jsing is remarkably consistent. I've pulled that one out to a separate issue (#61048).

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`)
2023-07-18 19:54 openbsd-386-72 tools@03275ec1 go@813aad51 x/tools/go/packages.TestParseFileModifyAST (log)
--- FAIL: TestParseFileModifyAST (33.41s)
    --- FAIL: TestParseFileModifyAST/Modules (1.32s)
        packages_test.go:917: err: exit status 2: stderr: fatal error: all goroutines are asleep - deadlock!

panic: runtime error: index out of range [0] with length 0 [recovered]
	panic: runtime error: index out of range [0] with length 0

goroutine 4024 [running]:
testing.tRunner.func1.2({0x82e67a0, 0x6deda3e0})
	/tmp/workdir/go/src/testing/testing.go:1545 +0x2a5
testing.tRunner.func1()
	/tmp/workdir/go/src/testing/testing.go:1548 +0x438
panic({0x82e67a0, 0x6deda3e0})
	/tmp/workdir/go/src/runtime/panic.go:914 +0x1e0
golang.org/x/tools/go/packages_test.testParseFileModifyAST(0x6aed42d0, {0x83696b8, 0x84e56e0})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages_test.go:921 +0x2f1
golang.org/x/tools/go/packages_test.testAllOrModulesParallel.func1(0x6aed42d0, {0x83696b8, 0x84e56e0})
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packages_test.go:81 +0x185
golang.org/x/tools/go/packages/packagestest.TestAll.func1(0x6aed42d0)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/packagestest/export.go:162 +0x51
testing.tRunner(0x6aed42d0, 0x6a6a9e30)
	/tmp/workdir/go/src/testing/testing.go:1595 +0x11a
created by testing.(*T).Run in goroutine 77
	/tmp/workdir/go/src/testing/testing.go:1648 +0x3d7
2023-07-18 23:25 openbsd-amd64-72 tools@84f829e2 go@cd6c4e05 x/tools/go/packages.TestConfigFlags (log)
--- FAIL: TestConfigFlags (0.00s)
    --- FAIL: TestConfigFlags/Modules (1.95s)
        packages_test.go:537: err: exit status 2: stderr: fatal error: all goroutines are asleep - deadlock!
2023-07-18 23:51 openbsd-386-72 go@8e1ec1cb cmd/go.TestScript (log)
vcs-test.golang.org rerouted to http://127.0.0.1:6906
https://vcs-test.golang.org rerouted to https://127.0.0.1:27007
go test proxy running at GOPROXY=http://127.0.0.1:13589/mod
--- FAIL: TestScript (0.49s)
    --- FAIL: TestScript/doc (8.59s)
        script_test.go:132: 2023-07-19T00:18:47Z
        script_test.go:134: $WORK=/tmp/workdir/tmp/cmd-go-test-1792972832/tmpdir3603819314/doc2905635927
        script_test.go:156: 
            # go doc --help (0.790s)
            # go help doc (0.133s)
...
            fatal error: all goroutines are asleep - deadlock!

            runtime stack:
            runtime.fatal({0x81b9055, 0x25})
            	runtime/panic.go:1096 +0x4d fp=0xcf7edb14 sp=0xcf7edb00 pc=0x807d3ed
            runtime.checkdead()
            	runtime/proc.go:5498 +0x294 fp=0xcf7edb60 sp=0xcf7edb14 pc=0x808a784
            runtime.mput(0x82b74a0)
            	runtime/proc.go:5933 +0x2e fp=0xcf7edb64 sp=0xcf7edb60 pc=0x808bf2e
            runtime.stopm()
            	runtime/proc.go:2534 +0x68 fp=0xcf7edb78 sp=0xcf7edb64 pc=0x80839e8
            runtime.findRunnable()
            	runtime/proc.go:3229 +0xb6d fp=0xcf7edc14 sp=0xcf7edb78 pc=0x808524d
            runtime.schedule()
            	runtime/proc.go:3582 +0xb1 fp=0xcf7edc30 sp=0xcf7edc14 pc=0x8086381
            runtime.park_m(0x62408100)
            	runtime/proc.go:3745 +0x155 fp=0xcf7edc4c sp=0xcf7edc30 pc=0x8086a65
            runtime.mcall()
            	runtime/asm_386.s:329 +0x40 fp=0xcf7edc54 sp=0xcf7edc4c pc=0x80aaf00

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`)
2023-08-07 22:48 openbsd-arm64-jsing go@b9153f6e context (log)
panic: test timed out after 15m0s

goroutine 304 [running]:
panic({0x161860?, 0x40001c4010?})
	/home/gopher/build/go/src/runtime/panic.go:621 +0x140 fp=0x4000047f00 sp=0x4000047e50 pc=0x46800
testing.(*M).startAlarm.func1()
	/home/gopher/build/go/src/testing/testing.go:2259 +0x30c fp=0x4000047fd0 sp=0x4000047f00 pc=0xdd86c
runtime.goexit()
	/home/gopher/build/go/src/runtime/asm_arm64.s:1197 +0x4 fp=0x4000047fd0 sp=0x4000047fd0 pc=0x7c4c4
created by time.goFunc
	/home/gopher/build/go/src/time/sleep.go:177 +0x38

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "openbsd" && (`runtime.throw` || `Test ".*" ran over .* limit` || `panic: test timed out` || `fatal error: all goroutines are asleep`) && !(log ~ `unexpected fault address 0x349dc4`)
2023-08-20 05:56 openbsd-arm64-jsing go@a2ec545e strings (log)
runtime: g1: frame.sp=0x400011fe00 top=0x400013ffd0
	stack=[0x4000100000-0x4000140000
fatal error: traceback did not unwind completely

runtime stack:
runtime.throw({0x171b13?, 0x400013ffb0?})
	/home/gopher/build/go/src/runtime/panic.go:1018 +0x40 fp=0x4dff20360 sp=0x4dff20330 pc=0x452a0
runtime.(*unwinder).finishInternal(0x202f0?)
	/home/gopher/build/go/src/runtime/traceback.go:561 +0x110 fp=0x4dff203a0 sp=0x4dff20360 pc=0x6b7a0
runtime.(*unwinder).next(0x4dff20478?)
	/home/gopher/build/go/src/runtime/traceback.go:442 +0x2a4 fp=0x4dff20430 sp=0x4dff203a0 pc=0x6b5e4
runtime.scanstack(0x40000021a0, 0x7?)
	/home/gopher/build/go/src/runtime/mgcmark.go:802 +0x23c fp=0x4dff20870 sp=0x4dff20430 pc=0x2d8dc
runtime.markroot.func1()
	/home/gopher/build/go/src/runtime/mgcmark.go:240 +0xb4 fp=0x4dff208c0 sp=0x4dff20870 pc=0x2c664
runtime.markroot(0x400002a140, 0x14, 0x1)
	/home/gopher/build/go/src/runtime/mgcmark.go:214 +0x1cc fp=0x4dff20970 sp=0x4dff208c0 pc=0x2c32c
runtime.gcDrain(0x400002a140, 0x7)
	/home/gopher/build/go/src/runtime/mgcmark.go:1069 +0x3f8 fp=0x4dff209d0 sp=0x4dff20970 pc=0x2e308
runtime.gcBgMarkWorker.func2()
	/home/gopher/build/go/src/runtime/mgc.go:1405 +0x74 fp=0x4dff20a20 sp=0x4dff209d0 pc=0x2a504
runtime.systemstack()
	/home/gopher/build/go/src/runtime/asm_arm64.s:243 +0x6c fp=0x4dff20a30 sp=0x4dff20a20 pc=0x765bc

watchflakes

@bcmills
Copy link
Contributor

bcmills commented Aug 21, 2023

I'm going to close this issue as obsolete, and add a date constraint on the watchflakes pattern.

@bcmills bcmills closed this as not planned Won't fix, can't repro, duplicate, stale Aug 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
compiler/runtime Issues related to the Go compiler and/or runtime. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-OpenBSD
Projects
Status: Done
Development

No branches or pull requests

6 participants