Skip to content

runtime: corruption on linux-riscv64-unmatched #62185

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
bcmills opened this issue Aug 21, 2023 · 4 comments
Closed

runtime: corruption on linux-riscv64-unmatched #62185

bcmills opened this issue Aug 21, 2023 · 4 comments
Labels
arch-riscv Issues solely affecting the riscv64 architecture. compiler/runtime Issues related to the Go compiler and/or runtime. FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Linux WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.
Milestone
Backlog

Comments

@bcmills
Copy link
Contributor

bcmills commented Aug 21, 2023 •
edited
Loading 

#!watchflakes
post <- builder == "linux-riscv64-unmatched" && (
	log ~ `runtime.throw\(` ||
	log ~ `^\s*fatal error:` ||
	log ~ `inconsistent poll.fdMutex` ||
	log ~ `internal compiler error`) && date < "2023-08-25"

(Pulled out from #55167 (comment).)

(attn @mengzhuo; CC @golang/riscv64)
@bcmills bcmills added OS-Linux arch-riscv Issues solely affecting the riscv64 architecture. labels Aug 21, 2023
@bcmills bcmills added this to the Backlog milestone Aug 21, 2023
@gopherbot gopherbot added the compiler/runtime Issues related to the Go compiler and/or runtime. label Aug 21, 2023
@cagedmantis cagedmantis added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Aug 21, 2023
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "linux-riscv64-unmatched" && (log ~ `runtime.throw\(` || log ~ `^\s*fatal error:`)
2023-07-31 18:05 linux-riscv64-unmatched go@789980ec (log) 
fatal error: workbuf is not empty

runtime stack:
runtime.throw({0x176436?, 0x2ee68?})
	runtime/panic.go:837 +0x44 fp=0x3ffff27490 sp=0x3ffff27468 pc=0x44d74
runtime.(*workbuf).checkempty(0x0?)
	runtime/mgcwork.go:344 +0x48 fp=0x3ffff274a8 sp=0x3ffff27490 pc=0x36340
runtime.getempty()
	runtime/mgcwork.go:357 +0x1f0 fp=0x3ffff27500 sp=0x3ffff274a8 pc=0x36538
runtime.handoff(0x3f8844a800)
	runtime/mgcwork.go:439 +0x2c fp=0x3ffff27528 sp=0x3ffff27500 pc=0x366fc
runtime.(*gcWork).balance(0x3f88025740)
	runtime/mgcwork.go:297 +0x50 fp=0x3ffff27538 sp=0x3ffff27528 pc=0x36220
runtime.gcDrain(0x3f88025740, 0x400000002?)
	runtime/mgcmark.go:1085 +0x154 fp=0x3ffff275a0 sp=0x3ffff27538 pc=0x2e6cc
runtime.gcBgMarkWorker.func2()
	runtime/mgc.go:1405 +0x84 fp=0x3ffff275e8 sp=0x3ffff275a0 pc=0x2abe4
runtime.systemstack()
	runtime/asm_riscv64.s:133 +0x54 fp=0x3ffff275f0 sp=0x3ffff275e8 pc=0x72ca4
2023-07-31 22:18 linux-riscv64-unmatched go@be0e0b06 cmd/go/internal/par.TestWork (log) 
fatal error: sync: unlock of unlocked mutex

runtime.gopark(0x3f880aa180?, 0x1?, 0xac?, 0xa1?, 0x1e?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:398 +0x10c fp=0x3f8809fd50 sp=0x3f8809fd38 pc=0x4957c
runtime.goparkunlock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:404
runtime.semacquire1(0x3f880e2014, 0x0?, 0x3, 0x1, 0x94?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:160 +0x218 fp=0x3f8809fda0 sp=0x3f8809fd50 pc=0x59fd0
sync.runtime_SemacquireMutex(0x24ece0?, 0x94?, 0x3f880e2014?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:77 +0x44 fp=0x3f8809fdd0 sp=0x3f8809fda0 pc=0x75494
sync.(*Mutex).lockSlow(0x3f880e2010)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:171 +0x180 fp=0x3f8809fe20 sp=0x3f8809fdd0 pc=0x7e860
sync.(*Mutex).Lock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:90
cmd/go/internal/par.(*Work[...]).Add(0x176d80, 0x128e)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:36 +0x80 fp=0x3f8809fe80 sp=0x3f8809fe20 pc=0x1038a8
cmd/go/internal/par.TestWork.func1(0x128f)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work_test.go:22 +0x5c fp=0x3f8809feb0 sp=0x3f8809fe80 pc=0x102e84
cmd/go/internal/par.(*Work[...]).runner(0x102d2c)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:102 +0x40 fp=0x3f8809fee0 sp=0x3f8809feb0 pc=0x103538
cmd/go/internal/par.(*Work[...]).Do(0x176d80, 0x64, 0x0)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:70 +0x138 fp=0x3f8809ff10 sp=0x3f8809fee0 pc=0x1037f0
cmd/go/internal/par.TestWork(0x3f880831e0)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work_test.go:19 +0xc4 fp=0x3f8809ff78 sp=0x3f8809ff10 pc=0x102d84
testing.tRunner(0x3f880831e0, 0x151a50)
2023-08-01 13:51 linux-riscv64-unmatched go@91387436 cmd/go/internal/par.TestWork (log) 
fatal error: sync: inconsistent mutex state

runtime.gopark(0x24ebc0?, 0x0?, 0x40?, 0xab?, 0x1039e8?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:398 +0x10c fp=0x3f7010dde0 sp=0x3f7010ddc8 pc=0x4957c
runtime.goparkunlock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:404
runtime.semacquire1(0x3f70070014, 0x0?, 0x3, 0x1, 0x76?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:160 +0x218 fp=0x3f7010de30 sp=0x3f7010dde0 pc=0x59fd0
sync.runtime_SemacquireMutex(0x24ebc0?, 0x10?, 0x3f70070010?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:77 +0x44 fp=0x3f7010de60 sp=0x3f7010de30 pc=0x75494
sync.(*Mutex).lockSlow(0x3f70070010)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:171 +0x180 fp=0x3f7010deb0 sp=0x3f7010de60 pc=0x7e860
sync.(*Mutex).Lock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:90
cmd/go/internal/par.(*Work[...]).runner(0x102d2c)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:79 +0x88 fp=0x3f7010dee0 sp=0x3f7010deb0 pc=0x103580
cmd/go/internal/par.(*Work[...]).Do(0x176d80, 0x64, 0x0)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:70 +0x138 fp=0x3f7010df10 sp=0x3f7010dee0 pc=0x1037f0
cmd/go/internal/par.TestWork(0x3f70001520)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work_test.go:19 +0xc4 fp=0x3f7010df78 sp=0x3f7010df10 pc=0x102d84
testing.tRunner(0x3f70001520, 0x151a50)
2023-08-01 14:26 linux-riscv64-unmatched go@d4b46b09 cmd/trace [build] (log) 
runtime: marked free object in span 0x3fb03caa58, elemsize=16 freeindex=0 (bad use of unsafe.Pointer? try -d=checkptr)
0x3fac2c6000 free  unmarked
0x3fac2c6010 alloc marked  
0x3fac2c6020 alloc marked  
0x3fac2c6030 free  unmarked
0x3fac2c6040 free  unmarked
0x3fac2c6050 alloc marked  
0x3fac2c6060 free  unmarked
0x3fac2c6070 alloc marked  
0x3fac2c6080 alloc marked  
...
fatal error: found pointer to free object

goroutine 3 [running]:
runtime.throw({0x301a46?, 0x3fac2c75d0?})
	runtime/panic.go:837 +0x44 fp=0x3fac035598 sp=0x3fac035570 pc=0x452b4
runtime.(*mspan).reportZombies(0x3fb03caa58)
	runtime/mgcsweep.go:861 +0x2f0 fp=0x3fac035618 sp=0x3fac035598 pc=0x35c88
runtime.(*sweepLocked).sweep(0x5486c0?, 0x58?)
	runtime/mgcsweep.go:644 +0x9c4 fp=0x3fac035728 sp=0x3fac035618 pc=0x35464
runtime.sweepone()
	runtime/mgcsweep.go:393 +0x140 fp=0x3fac035780 sp=0x3fac035728 pc=0x347c0
runtime.bgsweep(0x0?)
	runtime/mgcsweep.go:301 +0x14c fp=0x3fac0357c8 sp=0x3fac035780 pc=0x3451c
runtime.gcenable.func1()
	runtime/mgc.go:203 +0x2c fp=0x3fac0357d8 sp=0x3fac0357c8 pc=0x28d4c
runtime.goexit()
	runtime/asm_riscv64.s:512 +0x4 fp=0x3fac0357d8 sp=0x3fac0357d8 pc=0x750a4
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:203 +0x70
2023-08-01 17:41 linux-riscv64-unmatched net@8ffa475f go@fb6f38dd x/net/internal/timeseries [build] (log) 
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0x2fc22e?, 0x10eb0cad125ad?})
	runtime/panic.go:837 +0x44 fp=0x3f8004fed0 sp=0x3f8004fea8 pc=0x452b4
runtime.(*workbuf).checknonempty(0x364e4?)
	runtime/mgcwork.go:338 +0x48 fp=0x3f8004fee8 sp=0x3f8004fed0 pc=0x36558
runtime.trygetfull()
...
runtime.trygetfull()
	runtime/mgcwork.go:430 +0x74 fp=0x3f8004bf00 sp=0x3f8004bee8 pc=0x36914
runtime.(*gcWork).tryGet(0x3f8002e140)
	runtime/mgcwork.go:216 +0x68 fp=0x3f8004bf28 sp=0x3f8004bf00 pc=0x362f0
runtime.gcDrain(0x3f8002e140, 0x400000002?)
	runtime/mgcmark.go:1090 +0x1b4 fp=0x3f8004bf90 sp=0x3f8004bf28 pc=0x2e9a4
runtime.gcBgMarkWorker.func2()
	runtime/mgc.go:1405 +0x84 fp=0x3f8004bfd8 sp=0x3f8004bf90 pc=0x2aebc
runtime.systemstack()
	runtime/asm_riscv64.s:133 +0x54 fp=0x3f8004bfe0 sp=0x3f8004bfd8 pc=0x72ed4
2023-08-02 15:24 linux-riscv64-unmatched go@0f1491de cmd/go/internal/par.TestWork (log) 
fatal error: sync: unlock of unlocked mutex
fatal error: sync: inconsistent mutex state

runtime.gopark(0x3f88181a40?, 0x0?, 0xac?, 0xa1?, 0x3f0000001e?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:398 +0x10c fp=0x3f88032550 sp=0x3f88032538 pc=0x4957c
runtime.goparkunlock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:404
runtime.semacquire1(0x3f88162014, 0x0?, 0x3, 0x1, 0x78?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:160 +0x218 fp=0x3f880325a0 sp=0x3f88032550 pc=0x59fd0
sync.runtime_SemacquireMutex(0x25f000?, 0x84?, 0x103a6c?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:77 +0x44 fp=0x3f880325d0 sp=0x3f880325a0 pc=0x75494
sync.(*Mutex).lockSlow(0x3f88162010)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:171 +0x180 fp=0x3f88032620 sp=0x3f880325d0 pc=0x7e860
sync.(*Mutex).Lock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:90
cmd/go/internal/par.(*Work[...]).Add(0x176e00, 0x3a4)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:36 +0x80 fp=0x3f88032680 sp=0x3f88032620 pc=0x1039d8
cmd/go/internal/par.TestWork.func1(0x3a5)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work_test.go:22 +0x5c fp=0x3f880326b0 sp=0x3f88032680 pc=0x102fb4
cmd/go/internal/par.(*Work[...]).runner(0x102e5c)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:102 +0x40 fp=0x3f880326e0 sp=0x3f880326b0 pc=0x103668
cmd/go/internal/par.(*Work[...]).Do(0x176e00, 0x64, 0x0)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:70 +0x138 fp=0x3f88032710 sp=0x3f880326e0 pc=0x103920
cmd/go/internal/par.TestWork(0x3f88103860)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work_test.go:19 +0xc4 fp=0x3f88032778 sp=0x3f88032710 pc=0x102eb4
testing.tRunner(0x3f88103860, 0x151a50)
2023-08-03 05:31 linux-riscv64-unmatched go@83c4e533 encoding/gob [build] (log) 
fatal error: bad sweepgen in refill

goroutine 542 [running]:
runtime.throw({0x922bdd?, 0x3fa3b6a000?})
	runtime/panic.go:837 +0x44 fp=0x3f98319448 sp=0x3f98319420 pc=0x5379c
runtime.(*mcache).refill(...)
	runtime/mcache.go:157
runtime.(*mcache).nextFree(0x3feb10a5b8, 0x10)
	runtime/malloc.go:923 +0x4a0 fp=0x3f983194d0 sp=0x3f98319448 pc=0x1f818
runtime.mallocgc(0x60, 0x8b9e80, 0x1)
...
cmd/compile/internal/ssagen.Compile(0x3fa20f8420, 0x8079a4?)
	cmd/compile/internal/ssagen/pgen.go:187 +0x44 fp=0x3f9831df78 sp=0x3f9831ddd8 pc=0x6237ec
cmd/compile/internal/gc.compileFunctions.func5.1(0x0?)
	cmd/compile/internal/gc/compile.go:184 +0x48 fp=0x3f9831dfb0 sp=0x3f9831df78 pc=0x8075e8
cmd/compile/internal/gc.compileFunctions.func3.1()
	cmd/compile/internal/gc/compile.go:166 +0x40 fp=0x3f9831dfd8 sp=0x3f9831dfb0 pc=0x807998
runtime.goexit()
	runtime/asm_riscv64.s:512 +0x4 fp=0x3f9831dfd8 sp=0x3f9831dfd8 pc=0x8a564
created by cmd/compile/internal/gc.compileFunctions.func3 in goroutine 22
	cmd/compile/internal/gc/compile.go:165 +0x1f8
2023-08-07 00:28 linux-riscv64-unmatched go@41981930 path/filepath [build] (log) 
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0x2fc5de?, 0x0?})
	runtime/panic.go:845 +0x44 fp=0x3f74093ed0 sp=0x3f74093ea8 pc=0x45384
runtime.(*workbuf).checknonempty(0x364e4?)
	runtime/mgcwork.go:338 +0x48 fp=0x3f74093ee8 sp=0x3f74093ed0 pc=0x36558
...
runtime.(*gcWork).tryGet(0x3f74023240)
	runtime/mgcwork.go:207 +0x34 fp=0x3fffa162d8 sp=0x3fffa162b0 pc=0x362bc
runtime.gcDrainN(0x3f74023240, 0x10000)
	runtime/mgcmark.go:1170 +0x118 fp=0x3fffa16300 sp=0x3fffa162d8 pc=0x2ed28
runtime.gcAssistAlloc1(0x3f740001a0, 0x3f743f21a0?)
	runtime/mgcmark.go:568 +0x144 fp=0x3fffa16360 sp=0x3fffa16300 pc=0x2d8c4
runtime.gcAssistAlloc.func1()
	runtime/mgcmark.go:476 +0x28 fp=0x3fffa16378 sp=0x3fffa16360 pc=0x2d760
runtime.systemstack()
	runtime/asm_riscv64.s:133 +0x54 fp=0x3fffa16380 sp=0x3fffa16378 pc=0x72fa4
2023-08-07 23:13 linux-riscv64-unmatched go@3393155a cmd/go/internal/par.TestWork (log) 
fatal error: sync: unlock of unlocked mutex
fatal error: sync: inconsistent mutex state

runtime.gopark(0x3fa806c180?, 0x5a42c?, 0x3?, 0x0?, 0x59ff4?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:398 +0x10c fp=0x3fa8061da0 sp=0x3fa8061d88 pc=0x497fc
runtime.goparkunlock(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:404
runtime.semacquire1(0x3fa81a0014, 0x0?, 0x3, 0x1, 0x34?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:160 +0x218 fp=0x3fa8061df0 sp=0x3fa8061da0 pc=0x5a250
sync.runtime_SemacquireMutex(0x7ed90?, 0x0?, 0x7d480?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/sema.go:77 +0x44 fp=0x3fa8061e20 sp=0x3fa8061df0 pc=0x75754
sync.(*Mutex).lockSlow(0x3fa81a0010)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:171 +0x180 fp=0x3fa8061e70 sp=0x3fa8061e20 pc=0x7eb08
sync.(*Mutex).Lock(0x3fa81a0048?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/mutex.go:90 +0x58 fp=0x3fa8061e80 sp=0x3fa8061e70 pc=0x7e978
sync.(*Cond).Wait(0x3fa81a0038)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/sync/cond.go:71 +0xc4 fp=0x3fa8061eb0 sp=0x3fa8061e80 pc=0x7d494
cmd/go/internal/par.(*Work[...]).runner(0x103224)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:88 +0x130 fp=0x3fa8061ee0 sp=0x3fa8061eb0 pc=0x103b20
cmd/go/internal/par.(*Work[...]).Do(0x177200, 0x64, 0x0)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work.go:70 +0x138 fp=0x3fa8061f10 sp=0x3fa8061ee0 pc=0x103ce8
cmd/go/internal/par.TestWork(0x3fa818e000)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/cmd/go/internal/par/work_test.go:19 +0xc4 fp=0x3fa8061f78 sp=0x3fa8061f10 pc=0x10327c
testing.tRunner(0x3fa818e000, 0x151b08)
2023-08-08 21:20 linux-riscv64-unmatched go@fe1daf2e net/http_test [build] (log) 
fatal error: workbuf is empty
fatal error: workbuf is empty

runtime stack:
runtime.throw({0x2fc5be?, 0x0?})
	runtime/panic.go:859 +0x44 fp=0x3f80091ed0 sp=0x3f80091ea8 pc=0x453fc
runtime.(*workbuf).checknonempty(0x36504?)
	runtime/mgcwork.go:338 +0x48 fp=0x3f80091ee8 sp=0x3f80091ed0 pc=0x36578
runtime.trygetfull()
	runtime/mgcwork.go:430 +0x74 fp=0x3f80091f00 sp=0x3f80091ee8 pc=0x36934
...
runtime.(*gcWork).tryGet(0x3f80025740)
	runtime/mgcwork.go:207 +0x34 fp=0x3f80043f38 sp=0x3f80043f10 pc=0x362dc
runtime.gcDrainN(0x3f80025740, 0x10000)
	runtime/mgcmark.go:1170 +0x118 fp=0x3f80043f60 sp=0x3f80043f38 pc=0x2ed48
runtime.gcAssistAlloc1(0x3f800001a0, 0x3f803326b0?)
	runtime/mgcmark.go:568 +0x144 fp=0x3f80043fc0 sp=0x3f80043f60 pc=0x2d8c4
runtime.gcAssistAlloc.func1()
	runtime/mgcmark.go:476 +0x28 fp=0x3f80043fd8 sp=0x3f80043fc0 pc=0x2d760
runtime.systemstack()
	runtime/asm_riscv64.s:133 +0x54 fp=0x3f80043fe0 sp=0x3f80043fd8 pc=0x73174
2023-08-08 21:48 linux-riscv64-unmatched go@6e434079 bootstrap/cmd/link/internal/ld [build] (log) 
runtime: checkdead: find g 768 in status 1
fatal error: checkdead: runnable g

runtime stack:
runtime.throw({0x95256c?, 0x50300?})
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/panic.go:1047 +0x44 fp=0x3fac051da8 sp=0x3fac051d80 pc=0x478cc
runtime.checkdead.func1(0x3fa6746d00)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5235 +0x114 fp=0x3fac051dd8 sp=0x3fac051da8 pc=0x55874
runtime.forEachG(0x3fac051e38)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:591 +0x70 fp=0x3fac051e00 sp=0x3fac051dd8 pc=0x4aed8
runtime.checkdead()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5222 +0x114 fp=0x3fac051e48 sp=0x3fac051e00 pc=0x55524
runtime.mput(0x4fa6c?)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5715 +0x58 fp=0x3fac051e50 sp=0x3fac051e48 pc=0x56ad8
runtime.stopm()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:2333 +0x60 fp=0x3fac051e78 sp=0x3fac051e50 pc=0x4e4f0
runtime.findRunnable()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3025 +0xae4 fp=0x3fac051f70 sp=0x3fac051e78 pc=0x4ff04
runtime.schedule()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3378 +0xa4 fp=0x3fac051fa0 sp=0x3fac051f70 pc=0x50f7c
runtime.park_m(0x3fac3ea4e0?)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3529 +0x11c fp=0x3fac051fc8 sp=0x3fac051fa0 pc=0x514c4
runtime.mcall()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/asm_riscv64.s:291 +0x40 fp=0x3fac051fd8 sp=0x3fac051fc8 pc=0x78bd0
2023-08-09 15:15 linux-riscv64-unmatched go@cd589c8a bootstrap/debug/dwarf [build] (log) 
runtime: checkdead: find g 193 in status 1
fatal error: checkdead: runnable g

runtime stack:
runtime.throw({0x95256c?, 0x50300?})
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/panic.go:1047 +0x44 fp=0x3f98051da8 sp=0x3f98051d80 pc=0x478cc
runtime.checkdead.func1(0x3f9834d860)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5235 +0x114 fp=0x3f98051dd8 sp=0x3f98051da8 pc=0x55874
runtime.forEachG(0x3f98051e38)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:591 +0x70 fp=0x3f98051e00 sp=0x3f98051dd8 pc=0x4aed8
runtime.checkdead()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5222 +0x114 fp=0x3f98051e48 sp=0x3f98051e00 pc=0x55524
runtime.mput(0x4fa6c?)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5715 +0x58 fp=0x3f98051e50 sp=0x3f98051e48 pc=0x56ad8
runtime.stopm()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:2333 +0x60 fp=0x3f98051e78 sp=0x3f98051e50 pc=0x4e4f0
runtime.findRunnable()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3025 +0xae4 fp=0x3f98051f70 sp=0x3f98051e78 pc=0x4ff04
runtime.schedule()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3378 +0xa4 fp=0x3f98051fa0 sp=0x3f98051f70 pc=0x50f7c
runtime.park_m(0x3f983a8000?)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3529 +0x11c fp=0x3f98051fc8 sp=0x3f98051fa0 pc=0x514c4
runtime.mcall()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/asm_riscv64.s:291 +0x40 fp=0x3f98051fd8 sp=0x3f98051fc8 pc=0x78bd0
2023-08-11 01:59 linux-riscv64-unmatched go@33cdafed (log) 
runtime: inUse=510 npages=4
fatal error: too many pages allocated in chunk?

runtime stack:
runtime.throw({0x623bf2?, 0x1fc7?})
	runtime/panic.go:859 +0x44 fp=0x3f8c331e38 sp=0x3f8c331e10 pc=0x4a10c
runtime.(*scavChunkData).alloc(0x48?, 0x4, 0xfe31?)
	runtime/mgcscavenge.go:1364 +0xf0 fp=0x3f8c331e58 sp=0x3f8c331e38 pc=0x37eb8
runtime.(*scavengeIndex).alloc(0xae4860, 0xfe31, 0xa72600?)
	runtime/mgcscavenge.go:1142 +0x98 fp=0x3f8c331e90 sp=0x3f8c331e58 pc=0x37958
...
cmd/go/internal/work.ActorFunc.Act(0x70d830?, 0xaeb220?, {0x70d830?, 0xaeb220?}, 0x5de08?)
	cmd/go/internal/work/action.go:78 +0x68 fp=0x3f8c053d80 sp=0x3f8c053d58 pc=0x477310
cmd/go/internal/work.(*Builder).Do.func3({0x70d830, 0xaeb220}, 0x3f8c59a420)
	cmd/go/internal/work/exec.go:151 +0x62c fp=0x3f8c053f18 sp=0x3f8c053d80 pc=0x484d04
cmd/go/internal/work.(*Builder).Do.func4()
	cmd/go/internal/work/exec.go:219 +0xa0 fp=0x3f8c053fd8 sp=0x3f8c053f18 pc=0x484518
runtime.goexit()
	runtime/asm_riscv64.s:512 +0x4 fp=0x3f8c053fd8 sp=0x3f8c053fd8 pc=0x7edcc
created by cmd/go/internal/work.(*Builder).Do in goroutine 1
	cmd/go/internal/work/exec.go:205 +0x37c
2023-08-16 17:51 linux-riscv64-unmatched go@91bea5a2 go/types.TestStdFixed (log) 
fatal error: workbuf is empty

runtime stack:
runtime.throw({0x2e8224?, 0x365d8?})
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/panic.go:1018 +0x44 fp=0x3f8820ded0 sp=0x3f8820dea8 pc=0x47614
runtime.(*workbuf).checknonempty(0x36b6c?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/mgcwork.go:338 +0x48 fp=0x3f8820dee8 sp=0x3f8820ded0 pc=0x36be0
runtime.trygetfull()
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/mgcwork.go:430 +0x74 fp=0x3f8820df00 sp=0x3f8820dee8 pc=0x36f9c
runtime.(*gcWork).tryGet(0x3f88027c40)
...
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/go/types/check.go:384 +0x1ec fp=0x3f8aa37a90 sp=0x3f8aa37a08 pc=0x17de9c
go/types.(*Checker).Files(...)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/go/types/check.go:344
go/types.(*Config).Check(0x3f888e1b60, {0x3f8970c050?, 0x45?}, 0x3f88fc6c00, {0x3f89bbfcf8, 0x1, 0x1}, 0x0)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/go/types/api.go:436 +0x18c fp=0x3f8aa37ae0 sp=0x3f8aa37a90 pc=0x16aba4
go/types_test.testTestDir(0x3f88ebeb60, {0x3f886eda80, 0x3b}, {0x3f883a0d98, 0x1d, 0xe3830?})
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/go/types/stdlib_test.go:270 +0x544 fp=0x3f8aa37d30 sp=0x3f8aa37ae0 pc=0x25f33c
go/types_test.TestStdFixed(0x3f88ebeb60)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/go/types/stdlib_test.go:310 +0x140 fp=0x3f8aa37f78 sp=0x3f8aa37d30 pc=0x25f840
testing.tRunner(0x3f88ebeb60, 0x309dd8)
2023-08-17 16:36 linux-riscv64-unmatched go@36fc7214 cmd/go.TestScript (log) 
vcs-test.golang.org rerouted to http://127.0.0.1:42337
https://vcs-test.golang.org rerouted to https://127.0.0.1:45671
go test proxy running at GOPROXY=http://127.0.0.1:38415/mod
2023/08/17 18:58:32 http: TLS handshake error from 127.0.0.1:57746: read tcp 127.0.0.1:45671->127.0.0.1:57746: read: connection reset by peer
--- FAIL: TestScript (0.23s)
    --- FAIL: TestScript/test_match_no_tests_with_subtests (0.18s)
        script_test.go:132: 2023-08-17T18:57:48Z
        script_test.go:134: $WORK=/tmp/workdir-host-linux-riscv64-unmatched/tmp/cmd-go-test-1038997126/tmpdir172886230/test_match_no_tests_with_subtests741029011
        script_test.go:156: 
            # Matches no tests with subtests (0.177s)
...
            fatal error: mismatched begin/end of activeSweep

            runtime stack:
            runtime.throw({0x72af2e?, 0x0?})
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/panic.go:1018 +0x44 fp=0x3f767fb710 sp=0x3f767fb6e8 pc=0x4d6ac
            runtime.(*activeSweep).end(0x200000001?, {0x3f368?, 0x0?})
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/mgcsweep.go:172 +0x198 fp=0x3f767fb748 sp=0x3f767fb710 pc=0x3a288
            runtime.(*mspan).ensureSwept(0x3f8443a7a8)
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/mgcsweep.go:482 +0xdc fp=0x3f767fb770 sp=0x3f767fb748 pc=0x3aa3c
            runtime.removespecial(0x3f80127aa0, 0x1)
...
            os.(*file).close(0x3f80127aa0)
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/os/file_unix.go:323 +0x19c fp=0x3f8005c580 sp=0x3f8005c530 pc=0xce784
            runtime.call32(0x0, 0x773398, 0x3f80036020, 0x20, 0x20, 0x20, 0x3f8005c618)
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/asm_riscv64.s:466 +0x64 fp=0x3f8005c5a8 sp=0x3f8005c580 pc=0x8128c
            runtime.runfinq()
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/mfinal.go:255 +0x3b8 fp=0x3f8005c7d8 sp=0x3f8005c5a8 pc=0x2de98
            runtime.goexit()
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/asm_riscv64.s:512 +0x4 fp=0x3f8005c7d8 sp=0x3f8005c7d8 pc=0x82efc
            created by runtime.createfing in goroutine 1
            	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/mfinal.go:163 +0x64
2023-08-17 16:42 linux-riscv64-unmatched go@aaa384cf cmd/compile/internal/ssa [build] (log) 
unexpected fault address 0x6e8e9a1d43
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0x6e8e9a1d43 pc=0x1d800]

goroutine 1 [running]:
runtime.throw({0x8fe9f8?, 0x0?})
	runtime/panic.go:1018 +0x44 fp=0x3fa75c04a0 sp=0x3fa75c0478 pc=0x53ed4
runtime.sigpanic()
	runtime/signal_unix.go:876 +0x23c fp=0x3fa75c04f8 sp=0x3fa75c04a0 pc=0x6c65c
runtime.convI2I(0x3fa28cd668?, 0xa677f0?)
...
cmd/compile/internal/noder.LoadPackage({0x3fac01c810, 0x54, 0x5f})
	cmd/compile/internal/noder/noder.go:77 +0x3fc fp=0x3fa75c1a58 sp=0x3fa75c1910 pc=0x7b76bc
cmd/compile/internal/gc.Main(0x93bee8)
	cmd/compile/internal/gc/main.go:197 +0xb1c fp=0x3fa75c1f08 sp=0x3fa75c1a58 pc=0x7ffd34
main.main()
	cmd/compile/main.go:57 +0x118 fp=0x3fa75c1f60 sp=0x3fa75c1f08 pc=0x8266b8
runtime.main()
	runtime/proc.go:267 +0x2b0 fp=0x3fa75c1fd8 sp=0x3fa75c1f60 pc=0x568d0
runtime.goexit()
	runtime/asm_riscv64.s:512 +0x4 fp=0x3fa75c1fd8 sp=0x3fa75c1fd8 pc=0x8acfc
2023-08-17 19:37 linux-riscv64-unmatched go@c8adb300 regexp [build] (log) 
runtime: checkdead: find g 127 in status 1
fatal error: checkdead: runnable g

runtime stack:
runtime.throw({0x7124ee?, 0x52000?})
	../../go/src/runtime/panic.go:1047 +0x44 fp=0x3fa8051d90 sp=0x3fa8051d68 pc=0x4947c
runtime.checkdead.func1(0x3fa9302000)
	../../go/src/runtime/proc.go:5235 +0x114 fp=0x3fa8051dc0 sp=0x3fa8051d90 pc=0x5761c
runtime.forEachG(0x3fa8051e20)
	../../go/src/runtime/proc.go:591 +0x70 fp=0x3fa8051de8 sp=0x3fa8051dc0 pc=0x4cb10
runtime.checkdead()
	../../go/src/runtime/proc.go:5222 +0x114 fp=0x3fa8051e30 sp=0x3fa8051de8 pc=0x572cc
runtime.mput(0x516dc?)
	../../go/src/runtime/proc.go:5715 +0x58 fp=0x3fa8051e38 sp=0x3fa8051e30 pc=0x58a18
runtime.stopm()
	../../go/src/runtime/proc.go:2333 +0x60 fp=0x3fa8051e60 sp=0x3fa8051e38 pc=0x50148
runtime.findRunnable()
	../../go/src/runtime/proc.go:3025 +0xae4 fp=0x3fa8051f58 sp=0x3fa8051e60 pc=0x51b74
runtime.schedule()
	../../go/src/runtime/proc.go:3378 +0xa4 fp=0x3fa8051f88 sp=0x3fa8051f58 pc=0x52d2c
runtime.goexit0(0x3fa944e340)
	../../go/src/runtime/proc.go:3705 +0x28c fp=0x3fa8051fc8 sp=0x3fa8051f88 pc=0x53c2c
runtime.mcall()
	../../go/src/runtime/asm_riscv64.s:291 +0x40 fp=0x3fa8051fd8 sp=0x3fa8051fc8 pc=0x78eb0
2023-08-17 23:32 linux-riscv64-unmatched go@60dd8311 bootstrap/cmd/compile/internal/types2 [build] (log) 
runtime: checkdead: find g 790 in status 1
fatal error: checkdead: runnable g

runtime stack:
runtime.throw({0x95256c?, 0x50300?})
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/panic.go:1047 +0x44 fp=0x3fb408dd90 sp=0x3fb408dd68 pc=0x478cc
runtime.checkdead.func1(0x3fb04e8d00)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5235 +0x114 fp=0x3fb408ddc0 sp=0x3fb408dd90 pc=0x55874
runtime.forEachG(0x3fb408de20)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:591 +0x70 fp=0x3fb408dde8 sp=0x3fb408ddc0 pc=0x4aed8
runtime.checkdead()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5222 +0x114 fp=0x3fb408de30 sp=0x3fb408dde8 pc=0x55524
runtime.mput(0x4fa6c?)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:5715 +0x58 fp=0x3fb408de38 sp=0x3fb408de30 pc=0x56ad8
runtime.stopm()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:2333 +0x60 fp=0x3fb408de60 sp=0x3fb408de38 pc=0x4e4f0
runtime.findRunnable()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3025 +0xae4 fp=0x3fb408df58 sp=0x3fb408de60 pc=0x4ff04
runtime.schedule()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3378 +0xa4 fp=0x3fb408df88 sp=0x3fb408df58 pc=0x50f7c
runtime.goexit0(0x3fb246b040)
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/proc.go:3705 +0x288 fp=0x3fb408dfc8 sp=0x3fb408df88 pc=0x51e78
runtime.mcall()
	/tmp/genbootstrap-3479644045/go-linux-riscv64-bootstrap/src/runtime/asm_riscv64.s:291 +0x40 fp=0x3fb408dfd8 sp=0x3fb408dfc8 pc=0x78bd0

— watchflakes

@bcmills bcmills mentioned this issue Aug 21, 2023
Open
@bcmills bcmills added the WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. label Aug 23, 2023
This was referenced Aug 23, 2023
Closed
Closed
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "linux-riscv64-unmatched" && (
	log ~ `runtime.throw\(` ||
	log ~ `^\s*fatal error:` ||
	log ~ `inconsistent poll.fdMutex`)
2023-08-09 21:29 linux-riscv64-unmatched go@e6637f32 internal/poll.TestMutexStress (log) 
panic: inconsistent poll.fdMutex

runtime.gopark(0x1c5e8?, 0x3fa41a00c0?, 0x40?, 0x0?, 0x38?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/proc.go:398 +0x10c fp=0x3fa4032648 sp=0x3fa4032630 pc=0x4a98c
runtime.chanrecv(0x3fa4194070, 0x3fa403270f, 0x28?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/chan.go:583 +0x430 fp=0x3fa40326c0 sp=0x3fa4032648 pc=0x16078
runtime.chanrecv1(0x4?, 0x4?)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/runtime/chan.go:442 +0x14 fp=0x3fa40326e0 sp=0x3fa40326c0 pc=0x15c2c
internal/poll_test.TestMutexStress(0x3fa4196000)
	/tmp/workdir-host-linux-riscv64-unmatched/go/src/internal/poll/fd_mutex_test.go:212 +0x1e4 fp=0x3fa4032778 sp=0x3fa40326e0 pc=0x10b9dc
testing.tRunner(0x3fa4196000, 0x152238)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder == "linux-riscv64-unmatched" && (
	log ~ `runtime.throw\(` ||
	log ~ `^\s*fatal error:` ||
	log ~ `inconsistent poll.fdMutex` ||
	log ~ `internal compiler error`)
2023-08-16 16:51 linux-riscv64-unmatched go@e82cb142 runtime [build] (log) 
<autogenerated>:1: internal compiler error: want STRUCT, but have uint8

goroutine 1 [running]:
runtime/debug.Stack()
	runtime/debug/stack.go:24 +0x6c
cmd/compile/internal/base.FatalfAt({0x0?, 0x0?}, {0x9118ea, 0x14}, {0x3f8ba6afc8, 0x2, 0x2})
	cmd/compile/internal/base/print.go:230 +0x23c
cmd/compile/internal/base.Fatalf(...)
	cmd/compile/internal/base/print.go:199
cmd/compile/internal/types.(*Type).wantEtype(...)
...
cmd/compile/internal/reflectdata.WriteRuntimeTypes()
	cmd/compile/internal/reflectdata/reflect.go:1260 +0x2e0
cmd/compile/internal/gc.dumpdata()
	cmd/compile/internal/gc/obj.go:117 +0x5c
cmd/compile/internal/gc.Main(0x93bd30)
	cmd/compile/internal/gc/main.go:335 +0x1390
main.main()
	cmd/compile/main.go:57 +0x118

go tool dist: FAILED: /tmp/workdir-host-linux-riscv64-unmatched/go/pkg/tool/linux_riscv64/go_bootstrap install cmd: exit status 1

— watchflakes

@mengzhuo
Copy link
Contributor

Sorry for the inconvenience. Unmatched is discontinued, I'm looking for an alternative of it.
All this failures related to licheepi4a-1, I've done Litmus testing on it and it passed.
I've contacted tech support of Licheepi, they confirm it's a kernel bug on mutex and will fix it soon.
Right now I've offline this Licheepi and using my old Visionfive2 board.

This was referenced Aug 25, 2023
Closed
Closed
@mknyszek mknyszek mentioned this issue Oct 11, 2023
Closed
@yang-f yang-f mentioned this issue Dec 1, 2023
Closed
@golang golang locked and limited conversation to collaborators Aug 24, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
arch-riscv Issues solely affecting the riscv64 architecture. compiler/runtime Issues related to the Go compiler and/or runtime. FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Linux WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.
Projects
Test Flakes
Archived in project
Milestone
Backlog
Development

No branches or pull requests
4 participants
@cagedmantis @mengzhuo @bcmills @gopherbot