Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

runtime/trace: flaky test crash #55261

Open
gopherbot opened this issue Sep 20, 2022 · 8 comments
Open

runtime/trace: flaky test crash #55261

gopherbot opened this issue Sep 20, 2022 · 8 comments
Assignees
@mknyszek
Labels
compiler/runtime Issues related to the Go compiler and/or runtime. FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Milestone
Backlog

Comments

@gopherbot
Copy link 

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`

Bug automatically created to track these flakes.

— watchflakes
@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Sep 20, 2022
@gopherbot
Copy link
Author

gopherbot commented Sep 20, 2022 •
edited

Found new matching flaky dashboard failures for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2022-08-18 13:16 linux-arm-aws go@38edd9bd runtime/trace (log) 
SIGQUIT: quit
PC=0x86d24 m=7 sigcode=0

goroutine 82 [running]:
	goroutine running on other thread; stack unavailable
created by runtime/trace.Start
	/workdir/go/src/runtime/trace/trace.go:128 +0xd4

trap    0x0
error   0x0
...
r9      0xec3ff4c0
r10     0x1802ff0
fp      0x6
ip      0xaf
sp      0xec3fed9c
lr      0x4a424
pc      0x86d24
cpsr    0xa0870010
fault   0x0
*** Test killed with quit: ran too long (7m0s).

— watchflakes

@gopherbot gopherbot added the compiler/runtime Issues related to the Go compiler and/or runtime. label Sep 20, 2022
@bcmills
Copy link
Contributor

bcmills commented Sep 20, 2022

Duplicate of #54594

@bcmills bcmills marked this as a duplicate of #54594 Sep 20, 2022
@bcmills bcmills closed this as not planned Won't fix, can't repro, duplicate, stale Sep 21, 2022
@golang golang locked and limited conversation to collaborators Sep 21, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2023-11-20 15:56 openbsd-386-72 go@1d187fd0 runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8201b63, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x21321c84 sp=0x21321c70 pc=0x8082dfd
runtime.sysMapOS(0xae400000, 0x800000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x21321cb0 sp=0x21321c84 pc=0x805ef12
runtime.sysMap(0xae400000, 0x800000, 0x834f118)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x21321cc0 sp=0x21321cb0 pc=0x805ecef
runtime.(*mheap).grow(0x8341de0, 0x375)
...
runtime.gopark(0x0, 0x0, 0xa, 0x10, 0x1)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x6f4c2fd4 sp=0x6f4c2fc0 pc=0x8085dba
runtime.block()
	/tmp/workdir/go/src/runtime/select.go:103 +0x32 fp=0x6f4c2fe8 sp=0x6f4c2fd4 pc=0x80968b2
runtime/trace_test.TestTraceStressStartStop.func1.10()
	/tmp/workdir/go/src/runtime/trace/trace_test.go:496 +0x23 fp=0x6f4c2ff0 sp=0x6f4c2fe8 pc=0x81b6b73
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x6f4c2ff4 sp=0x6f4c2ff0 pc=0x80b77b1
created by runtime/trace_test.TestTraceStressStartStop.func1 in goroutine 35
	/tmp/workdir/go/src/runtime/trace/trace_test.go:494 +0x6c8

— watchflakes

@gopherbot gopherbot reopened this Nov 20, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2023-11-21 16:29 openbsd-386-72 go@78d037b0 runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8201b63, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x3dd75914 sp=0x3dd75900 pc=0x8082dfd
runtime.sysMapOS(0x9f800000, 0x400000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x3dd75940 sp=0x3dd75914 pc=0x805ef12
runtime.sysMap(0x9f800000, 0x400000, 0x834f118)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x3dd75950 sp=0x3dd75940 pc=0x805ecef
runtime.(*mheap).grow(0x8341de0, 0x1)
...

goroutine 116 gp=0x60982488 m=nil [GC worker (idle)]:
runtime.gopark(0x820c1dc, 0x6098e060, 0x1a, 0x14, 0x0)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x60a03794 sp=0x60a03780 pc=0x8085dba
runtime.gcBgMarkWorker()
	/tmp/workdir/go/src/runtime/mgc.go:1310 +0xe5 fp=0x60a037f0 sp=0x60a03794 pc=0x8064575
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x60a037f4 sp=0x60a037f0 pc=0x80b77b1
created by runtime.gcBgMarkStartWorkers in goroutine 35
	/tmp/workdir/go/src/runtime/mgc.go:1234 +0x1f

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2023-11-21 17:59 openbsd-386-72 go@070139a1 runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8201b6f, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x212e0044 sp=0x212e0030 pc=0x8082dfd
runtime.sysMapOS(0x82c00000, 0x400000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x212e0070 sp=0x212e0044 pc=0x805ef12
runtime.sysMap(0x82c00000, 0x400000, 0x834f138)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x212e0080 sp=0x212e0070 pc=0x805ecef
runtime.(*mheap).grow(0x8341e00, 0x12)
...
runtime.gopark(0x0, 0x0, 0xa, 0x10, 0x1)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x4fd067d4 sp=0x4fd067c0 pc=0x8085dba
runtime.block()
	/tmp/workdir/go/src/runtime/select.go:103 +0x32 fp=0x4fd067e8 sp=0x4fd067d4 pc=0x80968b2
runtime/trace_test.TestTraceStressStartStop.func1.10()
	/tmp/workdir/go/src/runtime/trace/trace_test.go:496 +0x23 fp=0x4fd067f0 sp=0x4fd067e8 pc=0x81b6b73
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x4fd067f4 sp=0x4fd067f0 pc=0x80b77b1
created by runtime/trace_test.TestTraceStressStartStop.func1 in goroutine 35
	/tmp/workdir/go/src/runtime/trace/trace_test.go:494 +0x6c8

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2023-11-21 20:34 openbsd-386-72 go@00715d08 runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8201b6f, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x46bb8494 sp=0x46bb8480 pc=0x8082dfd
runtime.sysMapOS(0xa9c00000, 0x1000000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x46bb84c0 sp=0x46bb8494 pc=0x805ef12
runtime.sysMap(0xa9c00000, 0x1000000, 0x834f138)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x46bb84d0 sp=0x46bb84c0 pc=0x805ecef
runtime.(*mheap).grow(0x8341e00, 0x6c4)
...

goroutine 87 gp=0x6a9027e8 m=nil [GC worker (idle)]:
runtime.gopark(0x820c1e8, 0x6a92a078, 0x1a, 0x14, 0x0)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x6a8c0794 sp=0x6a8c0780 pc=0x8085dba
runtime.gcBgMarkWorker()
	/tmp/workdir/go/src/runtime/mgc.go:1310 +0xe5 fp=0x6a8c07f0 sp=0x6a8c0794 pc=0x8064575
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x6a8c07f4 sp=0x6a8c07f0 pc=0x80b77b1
created by runtime.gcBgMarkStartWorkers in goroutine 35
	/tmp/workdir/go/src/runtime/mgc.go:1234 +0x1f

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2023-11-21 21:27 openbsd-386-72 go@351d8520 runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8202d22, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x27d50c24 sp=0x27d50c10 pc=0x808372d
runtime.sysMapOS(0xa0400000, 0x400000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x27d50c50 sp=0x27d50c24 pc=0x805f032
runtime.sysMap(0xa0400000, 0x400000, 0x8350218)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x27d50c60 sp=0x27d50c50 pc=0x805ee0f
runtime.(*mheap).grow(0x8342ee0, 0x1)
...

goroutine 131 gp=0x61500368 m=nil [GC worker (idle)]:
runtime.gopark(0x820d3b4, 0x61510018, 0x1a, 0x14, 0x0)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x61482f94 sp=0x61482f80 pc=0x80866ea
runtime.gcBgMarkWorker()
	/tmp/workdir/go/src/runtime/mgc.go:1310 +0xe5 fp=0x61482ff0 sp=0x61482f94 pc=0x8064695
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x61482ff4 sp=0x61482ff0 pc=0x80b8121
created by runtime.gcBgMarkStartWorkers in goroutine 35
	/tmp/workdir/go/src/runtime/mgc.go:1234 +0x1f
2023-11-21 21:27 openbsd-386-72 go@48a6362d runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8202d22, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x217318c4 sp=0x217318b0 pc=0x808372d
runtime.sysMapOS(0xa3800000, 0x400000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x217318f0 sp=0x217318c4 pc=0x805f032
runtime.sysMap(0xa3800000, 0x400000, 0x8350218)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x21731900 sp=0x217318f0 pc=0x805ee0f
runtime.(*mheap).grow(0x8342ee0, 0x1)
...
runtime.gopark(0x0, 0x0, 0xa, 0x10, 0x1)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x649037d4 sp=0x649037c0 pc=0x80866ea
runtime.block()
	/tmp/workdir/go/src/runtime/select.go:103 +0x32 fp=0x649037e8 sp=0x649037d4 pc=0x8097232
runtime/trace_test.TestTraceStressStartStop.func1.10()
	/tmp/workdir/go/src/runtime/trace/trace_test.go:496 +0x23 fp=0x649037f0 sp=0x649037e8 pc=0x81b7523
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x649037f4 sp=0x649037f0 pc=0x80b8121
created by runtime/trace_test.TestTraceStressStartStop.func1 in goroutine 35
	/tmp/workdir/go/src/runtime/trace/trace_test.go:494 +0x6c8
2023-11-21 21:29 openbsd-386-72 go@90ba4452 runtime/trace (log) 
fatal error: runtime: out of memory

runtime stack:
runtime.throw({0x8202d22, 0x16})
	/tmp/workdir/go/src/runtime/panic.go:1023 +0x4d fp=0x2ec54984 sp=0x2ec54970 pc=0x808372d
runtime.sysMapOS(0x95c00000, 0x400000)
	/tmp/workdir/go/src/runtime/mem_bsd.go:81 +0x142 fp=0x2ec549b0 sp=0x2ec54984 pc=0x805f032
runtime.sysMap(0x95c00000, 0x400000, 0x8350218)
	/tmp/workdir/go/src/runtime/mem.go:155 +0x3f fp=0x2ec549c0 sp=0x2ec549b0 pc=0x805ee0f
runtime.(*mheap).grow(0x8342ee0, 0x12)
...
runtime.gopark(0x0, 0x0, 0xa, 0x10, 0x1)
	/tmp/workdir/go/src/runtime/proc.go:402 +0xfa fp=0x5683afd4 sp=0x5683afc0 pc=0x80866ea
runtime.block()
	/tmp/workdir/go/src/runtime/select.go:103 +0x32 fp=0x5683afe8 sp=0x5683afd4 pc=0x8097232
runtime/trace_test.TestTraceStressStartStop.func1.10()
	/tmp/workdir/go/src/runtime/trace/trace_test.go:496 +0x23 fp=0x5683aff0 sp=0x5683afe8 pc=0x81b7523
runtime.goexit({})
	/tmp/workdir/go/src/runtime/asm_386.s:1363 +0x1 fp=0x5683aff4 sp=0x5683aff0 pc=0x80b8121
created by runtime/trace_test.TestTraceStressStartStop.func1 in goroutine 35
	/tmp/workdir/go/src/runtime/trace/trace_test.go:494 +0x6c8

— watchflakes

@mknyszek mknyszek self-assigned this Nov 29, 2023
@mknyszek mknyszek added this to the Backlog milestone Nov 29, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "runtime/trace" && test == "" && !`panic: test timed out`
2023-11-21 17:27 openbsd-riscv64-jsing go@3255fca9 runtime/trace (log) 
runtime: inUse=4 npages=82
fatal error: allocated pages below zero?

runtime stack:
runtime.throw({0x1ca689?, 0x10d0b81e0?})
	/home/gopher/build/go/src/runtime/panic.go:1023 +0x44 fp=0x10d0b8180 sp=0x10d0b8158 pc=0x45bc4
runtime.(*scavChunkData).free(0x1?, 0x52, 0x4ca64?)
	/home/gopher/build/go/src/runtime/mgcscavenge.go:1338 +0xd8 fp=0x10d0b81a0 sp=0x10d0b8180 pc=0x33260
runtime.(*scavengeIndex).free(0x33dfa0, 0x120, 0x1ae, 0x52)
	/home/gopher/build/go/src/runtime/mgcscavenge.go:1151 +0xa4 fp=0x10d0b81d8 sp=0x10d0b81a0 pc=0x32e9c
...

goroutine 72 gp=0x48191a00 m=nil [runnable, locked to thread]:
runtime.Gosched(...)
	/home/gopher/build/go/src/runtime/proc.go:342
runtime/trace_test.TestTraceStressStartStop.func1.5()
	/home/gopher/build/go/src/runtime/trace/trace_test.go:417 +0x3c fp=0x4803dfd8 sp=0x4803dfb8 pc=0x1658c4
runtime.goexit({})
	/home/gopher/build/go/src/runtime/asm_riscv64.s:540 +0x4 fp=0x4803dfd8 sp=0x4803dfd8 pc=0x78c5c
created by runtime/trace_test.TestTraceStressStartStop.func1 in goroutine 66
	/home/gopher/build/go/src/runtime/trace/trace_test.go:410 +0x1dc

— watchflakes

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@mknyszek mknyszek

Labels
compiler/runtime Issues related to the Go compiler and/or runtime. FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
Go Compiler / Runtime
Status: Todo
Test Flakes
Status: Done
Milestone
Backlog
Development

No branches or pull requests
3 participants
@mknyszek @bcmills @gopherbot