Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cmd/dist,x/build/cmd/coordinator: test logs missing errors or final status #61069

Open
bcmills opened this issue Jun 29, 2023 · 17 comments
Open
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Milestone

Comments

@bcmills
Copy link
Contributor

bcmills commented Jun 29, 2023

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)

(pulled out from #57995 (comment))

@bcmills bcmills added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Jun 29, 2023
@bcmills bcmills added this to the Backlog milestone Jun 29, 2023
@gopherbot

This comment was marked as resolved.

@golang golang deleted a comment from gopherbot Jun 29, 2023
@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|go tool dist: |Test .* ran over .* limit)`)
2023-06-24 02:06 freebsd-arm-paulzhol go@65092835 (log)

watchflakes

@gopherbot

This comment was marked as resolved.

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*error))`)
2023-06-20 17:19 freebsd-arm-paulzhol go@ebbff91f (log)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*error))`)
2023-11-02 10:34 freebsd-arm-paulzhol go@54452b96 (log)
/tmp/workdir-host-freebsd-arm-paulzhol/go/src/make.bash: line 226:  1155 Segmentation fault      ./cmd/dist/dist bootstrap -a $vflag $GO_DISTFLAGS "$@"

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*error))`)
2023-11-10 15:50 windows-arm64-11 go@9d914015 TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (2.64s)
    --- FAIL: TestTraceCPUProfile/Default (2.62s)
        reader_test.go:65: unexpected error while reading the trace: expected a proc but didn't have one
        trace_test.go:567: found bad trace; dumping to test log...
        trace_test.go:568: Trace Go1.22
            EventBatch gen=1 m=2144 time=23479457578 size=65458
            ProcStart dt=1 p=2 p_seq=2
            ProcStop dt=1
            ProcStart dt=1 p=2 p_seq=3
            ProcStop dt=1
...
            GoStart dt=1 g=1 g_seq=3938
            GoStop dt=1 reason_string=20 stack=14
            GoStart dt=1 g=1 g_seq=3939
            GoStop dt=1 reason_string=20 stack=14
            GoStart dt=1 g=1 g_seq=3940
            GoStop dt=1 reason_string=20 stack=14
            GoStart dt=1 g=1 g_seq=3941
            GoStop dt=1 reason_st

... log truncated ...
2023-11-10 15:51 windows-arm64-11 go@3b303fa9 TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (2.70s)
    --- FAIL: TestTraceCPUProfile/Default (2.68s)
        reader_test.go:65: unexpected error while reading the trace: per-M streams are out-of-order
        trace_test.go:567: found bad trace; dumping to test log...
        trace_test.go:568: Trace Go1.22
            EventBatch gen=1 m=9936 time=23496448275 size=65455
            ProcStart dt=1 p=0 p_seq=3
            ProcStop dt=1
            ProcStart dt=1 p=0 p_seq=4
            ProcStop dt=1
...
            GoStop dt=1 reason_string=20 stack=16
            GoStart dt=1 g=1 g_seq=19041
            GoStop dt=1 reason_string=20 stack=16
            GoStart dt=1 g=1 g_seq=19042
            GoStop dt=1 reason_string=20 stack=16
            GoStart dt=1 g=1 g_seq=19043
            GoStop dt=1 reason_string=20 stack=16


... log truncated ...
2023-11-10 16:18 windows-arm64-11 go@abf84221 TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (2.63s)
    --- FAIL: TestTraceCPUProfile/Default (2.62s)
        reader_test.go:65: unexpected error while reading the trace: per-M streams are out-of-order
        trace_test.go:569: found bad trace; dumping to test log...
        trace_test.go:570: Trace Go1.22
            EventBatch gen=1 m=1420 time=27049777477 size=65457
            ProcStart dt=1 p=0 p_seq=1
            ProcStop dt=1
            ProcStart dt=1 p=0 p_seq=2
            ProcStop dt=1
...
            ProcStop dt=1
            ProcStart dt=1 p=1 p_seq=2698
            ProcStop dt=1
            ProcStart dt=1 p=1 p_seq=2699
            ProcStop dt=1
            ProcStart dt=1 p=1 p_seq=2700
            ProcStop dt=1
            ProcStart dt=1 p=

... log truncated ...

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*error))`)
2023-11-13 22:12 freebsd-arm64-dmgk go@773039ed TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (4.69s)
    --- FAIL: TestTraceCPUProfile/Default (4.65s)
        trace_test.go:177: execution trace did not include all CPU profile samples; 29 in profile, 21 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:130|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 18 in profile, 12 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:125|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 4 in profile, 3 in trace
        trace_test.go:195: CPU profile included 1 samples at stack "runtime/internal/atomic.(*Uint32).CompareAndSwap:236|runtime.casgstatus:1135|runtime.execute:3051|runtime.schedule:3862|runtime.goschedImpl:4009|runtime.gosched_m:4014|runtime.mcall:192" not present in execution trace
        trace_test.go:202: execution trace CPU samples:
        trace_test.go:204: 1: "runtime.traceLocker.GoStop:425|runtime.traceLocker.GoSched:415|runtime.goschedImpl:3995|runtime.gosched_m:4014|runtime.mcall:192"
        trace_test.go:204: 1: "runtime.duffzero:8|runtime.traceStack:40|runtime.traceLocker.stack:166|runtime.traceLocker.GoStop:425|runtime.traceLocker.GoSched:415|runtime.goschedImpl:3995|runtime.gosched_m:4014|runtime.mcall:192"
        trace_test.go:204: 1: "runtime/internal/atomic.(*Uint32).Load:194|runtime.(*traceSchedResourceState).statusWasTraced:191|runtime.traceLocker.eventWriter:113|runtime.traceLocker.GoStop:425|runtime.traceLocker.GoSched:415|runtime.goschedImpl:3995|runtime.gosched_m:4014|runtime.mcall:192"
...
            GoStop dt=89 reason_string=20 stack=13
            GoStart dt=47 g=1 g_seq=13463
            GoStop dt=87 reason_string=20 stack=13
            GoStart dt=48 g=1 g_seq=13464
            GoStop dt=87 reason_string=20 stack=13
            GoStart dt=45 g=1 g_seq=13465
            GoStop dt=88 reason_string=20 stack=13
            GoStart dt=48 g=

... log truncated ...

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*error))`)
2023-11-15 20:08 freebsd-arm64-dmgk go@2380862c TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (4.27s)
    --- FAIL: TestTraceCPUProfile/Default (4.23s)
        trace_test.go:177: execution trace did not include all CPU profile samples; 28 in profile, 14 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:126|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 2 in profile, 1 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:130|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 20 in profile, 9 in trace
        trace_test.go:195: CPU profile included 1 samples at stack "aeshashbody:711|runtime.(*traceMap).put:62|runtime.(*traceStackTable).put:95|runtime.traceStack:79|runtime.traceLocker.stack:166|runtime.traceLocker.GoStop:425|runtime.traceLocker.GoSched:415|runtime.goschedImpl:4051|runtime.gosched_m:4070|runtime.mcall:192" not present in execution trace
        trace_test.go:195: CPU profile included 1 samples at stack "runtime.traceStack:70|runtime.traceLocker.stack:166|runtime.traceLocker.GoStop:425|runtime.traceLocker.GoSched:415|runtime.goschedImpl:4051|runtime.gosched_m:4070|runtime.mcall:192" not present in execution trace
        trace_test.go:202: execution trace CPU samples:
        trace_test.go:204: 9: "main.cpuHog0:130|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"
        trace_test.go:204: 1: "main.cpuHog0:126|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"
...
            GoStart dt=50 g=1 g_seq=13593
            GoStop dt=89 reason_string=20 stack=12
            GoStart dt=50 g=1 g_seq=13594
            GoStop dt=89 reason_string=20 stack=12
            GoStart dt=49 g=1 g_seq=13595
            GoStop dt=92 reason_string=20 stack=12
            GoStart dt=50 g=1 g_seq=13596
            GoStop

... log truncated ...

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2023-11-17 23:00 linux-arm64-longtest go@3cdc2a13 TestTraceStacks (log)
--- FAIL: TestTraceStacks (2.53s)
    --- FAIL: TestTraceStacks/Stress (0.68s)
        reader_test.go:65: unexpected error while reading the trace: inconsistent status for proc 1: old Syscall vs. new Running
        trace_test.go:569: found bad trace; dumping to test log...
        trace_test.go:570: Trace Go1.22
            EventBatch gen=1 m=18446744073709551615 time=8166829984 size=5
            Frequency freq=15625000
            EventBatch gen=1 m=117706 time=8166829111 size=68
            ProcStart dt=61 p=2 p_seq=1
            GoStart dt=86 g=21 g_seq=1
...
            EventBatch gen=273 m=117705 time=8167201385 size=28
            ProcStatus dt=1 p=1 pstatus=2
            ProcStart dt=1 p=1 p_seq=1
            ProcStop dt=33
            ProcStart dt=949 p=4 p_seq=8
            GoUnblock dt=9 g=21 g_seq=4 stack=0
            GoStart dt=48 g=21 g_seq=5


... log truncated ...

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2023-11-21 22:23 freebsd-arm64-dmgk go@ff05cdbd TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (2.16s)
    --- FAIL: TestTraceCPUProfile/Default (2.13s)
        trace_test.go:177: execution trace did not include all CPU profile samples; 25 in profile, 4 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:130|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 19 in profile, 1 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:125|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 4 in profile, 1 in trace
        trace_test.go:202: execution trace CPU samples:
        trace_test.go:204: 1: "main.cpuHog0:130|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"
        trace_test.go:204: 1: "main.cpuHog0:126|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"
        trace_test.go:204: 1: "main.cpuHog0:125|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"
        trace_test.go:204: 1: "runtime.releasem:586|runtime.traceRelease:238|runtime.execute:3133|runtime.schedule:3922|runtime.goschedImpl:4069|runtime.gosched_m:4074|runtime.mcall:192"
...
            GoStop dt=73 reason_string=20 stack=14
            GoStart dt=7 g=1 g_seq=13726
            GoStop dt=73 reason_string=20 stack=14
            GoStart dt=7 g=1 g_seq=13727
            GoStop dt=74 reason_string=20 stack=14
            GoStart dt=8 g=1 g_seq=13728
            GoStop dt=74 reason_string=20 stack=14
            GoStart dt=6 g=1 g_seq=13729

... log truncated ...

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2023-11-21 19:04 plan9-arm go@4e6bbbe6 (log)
---
Installed Go for plan9/arm in /boot/workdir/go
Installed commands in /boot/workdir/go/bin
*** You need to bind /boot/workdir/go/bin before /bin.

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2023-11-21 17:24 freebsd-arm64-dmgk go@0cb45bac TestTraceCPUProfile (log)
--- FAIL: TestTraceCPUProfile (4.36s)
    --- FAIL: TestTraceCPUProfile/Default (4.31s)
        trace_test.go:177: execution trace did not include all CPU profile samples; 29 in profile, 14 in trace
        trace_test.go:187: execution trace did not include all CPU profile samples for stack "main.cpuHog0:130|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271"; 20 in profile, 9 in trace
        trace_test.go:195: CPU profile included 1 samples at stack "runtime.acquirem:577|runtime.traceAcquireEnabled:193|runtime.traceAcquire:176|runtime.execute:3124|runtime.schedule:3921|runtime.goschedImpl:4068|runtime.gosched_m:4073|runtime.mcall:192" not present in execution trace
        trace_test.go:195: CPU profile included 1 samples at stack "runtime.releasem:584|runtime.traceRelease:238|runtime.execute:3132|runtime.schedule:3921|runtime.goschedImpl:4068|runtime.gosched_m:4073|runtime.mcall:192" not present in execution trace
        trace_test.go:195: CPU profile included 2 samples at stack "main.cpuHog0:125|main.cpuHog1:120|main.cpuHogger:107|main.main.func1.1:44|runtime/pprof.Do:51|main.main.func1:43|main.main:50|runtime.main:271" not present in execution trace
        trace_test.go:202: execution trace CPU samples:
        trace_test.go:204: 1: "runtime/internal/atomic.(*Uint32).Load:194|runtime.(*traceSchedResourceState).statusWasTraced:191|runtime.traceLocker.eventWriter:113|runtime.traceLocker.GoStart:398|runtime.execute:3131|runtime.schedule:3921|runtime.goschedImpl:4068|runtime.gosched_m:4073|runtime.mcall:192"
        trace_test.go:204: 1: "runtime.vdsoClockGettime:81|runtime.nanotime1:101|runtime.nanotime:19|runtime.traceClockNow:56|runtime.traceWriter.event:146|runtime.traceEventWriter.write:131|runtime.traceLocker.GoStart:399|runtime.execute:3131|runtime.schedule:3921|runtime.goschedImpl:4068|runtime.gosched_m:4073|runtime.mcall:192"
...
            GoStop dt=81 reason_string=20 stack=12
            GoStart dt=53 g=1 g_seq=12759
            GoStop dt=78 reason_string=20 stack=12
            GoStart dt=51 g=1 g_seq=12760
            GoStop dt=83 reason_string=20 stack=12
            GoStart dt=53 g=1 g_seq=12761
            GoStop dt=78 reason_string=20 stack=12
            GoStart dt=49 g=1 g_seq=12

... log truncated ...

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2024-01-29 22:19 go1.22-linux-amd64-racecompile release-branch.go1.22@117d7b10 [build] (log)
2024-01-29 22:55 gotip-linux-amd64-racecompile go@0c64be46 [build] (log)
2024-01-30 00:16 gotip-linux-amd64-racecompile go@4afb155c [build] (log)

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2024-02-20 17:18 gotip-darwin-amd64_12 go@02785362 [build] (log)
Building Go cmd/dist using /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap. (go1.20.6 darwin/amd64)
../../../../cache/tools/go_bootstrap/src/os/exec/exec.go:95:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/context/x_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/context/x_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/base64/base64.go:9:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/binary/varint.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/binary/varint.go: device error
cmd/dist/build.go:9:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/json/bench_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/json/bench_test.go: device error
cmd/dist/build.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/flag/example_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/flag/example_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/json/decode.go:13:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/fmt/doc.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/fmt/doc.go: device error
../../../../cache/tools/go_bootstrap/src/internal/bytealg/bytealg.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/cpu/cpu_arm64_hwcap.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/cpu/cpu_arm64_hwcap.go: device error
../../../../cache/tools/go_bootstrap/src/internal/reflectlite/swapper.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/goarch/goarch.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/goarch/goarch.go: device error
../../../../cache/tools/go_bootstrap/src/os/exec/exec.go:97:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/godebug/godebug.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/godebug/godebug.go: device error
../../../../cache/tools/go_bootstrap/src/os/file.go:44:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/poll/fd.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/poll/fd.go: device error
../../../../cache/tools/go_bootstrap/src/os/file.go:45:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/safefilepath/path_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/safefilepath/path_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/reflectlite/swapper.go:9:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/unsafeheader/unsafeheader_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/unsafeheader/unsafeheader_test.go: device error
../../../../cache/tools/go_bootstrap/src/os/dir.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/io/fs/readdir_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/io/fs/readdir_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/binary/binary.go:27:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/const.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/const.go: device error
../../../../cache/tools/go_bootstrap/src/math/fma.go:7:8: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/bits/bits_tables.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/bits/bits_tables.go: device error
../../../../cache/tools/go_bootstrap/src/fmt/print.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/dir_darwin.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/dir_darwin.go: device error
cmd/dist/build.go:16:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/exec/lp_unix.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/exec/lp_unix.go: device error
../../../../cache/tools/go_bootstrap/src/io/fs/glob.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/path/example_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/path/example_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/binary/binary.go:28:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/reflect/deepequal.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/reflect/deepequal.go: device error
../../../../cache/tools/go_bootstrap/src/regexp/backtrack.go:18:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/regexp/syntax/parse_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/regexp/syntax/parse_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/reflectlite/value.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/abi_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/abi_test.go: device error
../../../../cache/tools/go_bootstrap/src/runtime/arena.go:87:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/internal/atomic/atomic_amd64.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/internal/atomic/atomic_amd64.go: device error
../../../../cache/tools/go_bootstrap/src/internal/fmtsort/sort.go:13:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sort/example_search_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sort/example_search_test.go: device error
../../../../cache/tools/go_bootstrap/src/reflect/type.go:20:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strconv/decimal.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strconv/decimal.go: device error
../../../../cache/tools/go_bootstrap/src/bufio/bufio.go:14:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strings/builder_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strings/builder_test.go: device error
../../../../cache/tools/go_bootstrap/src/io/io.go:17:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sync/map_bench_test.go: unexpected NUL in input
../../../../cache/tools/go_bootstrap/src/sync/cond.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sync/atomic/example_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sync/atomic/example_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/syscall/unix/at_libc2.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/syscall/getdirentries_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/syscall/getdirentries_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/poll/fd_poll_runtime.go:13:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/time/internal_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/time/internal_test.go: device error
../../../../cache/tools/go_bootstrap/src/bytes/bytes.go:11:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/unicode/script_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/unicode/script_test.go: device error
2024-02-20 17:57 gotip-darwin-amd64_12 go@c1828fbc [build] (log)
Building Go cmd/dist using /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap. (go1.20.6 darwin/amd64)
../../../../cache/tools/go_bootstrap/src/os/exec/exec.go:95:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/context/x_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/context/x_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/base64/base64.go:9:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/binary/varint.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/binary/varint.go: device error
cmd/dist/build.go:9:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/json/bench_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/encoding/json/bench_test.go: device error
cmd/dist/build.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/flag/example_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/flag/example_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/json/decode.go:13:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/fmt/doc.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/fmt/doc.go: device error
../../../../cache/tools/go_bootstrap/src/internal/bytealg/bytealg.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/cpu/cpu_arm64_hwcap.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/cpu/cpu_arm64_hwcap.go: device error
../../../../cache/tools/go_bootstrap/src/internal/reflectlite/swapper.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/goarch/goarch.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/goarch/goarch.go: device error
../../../../cache/tools/go_bootstrap/src/os/exec/exec.go:97:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/godebug/godebug.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/godebug/godebug.go: device error
../../../../cache/tools/go_bootstrap/src/os/file.go:44:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/poll/fd.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/poll/fd.go: device error
../../../../cache/tools/go_bootstrap/src/os/file.go:45:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/safefilepath/path_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/safefilepath/path_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/reflectlite/swapper.go:9:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/unsafeheader/unsafeheader_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/internal/unsafeheader/unsafeheader_test.go: device error
../../../../cache/tools/go_bootstrap/src/os/dir.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/io/fs/readdir_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/io/fs/readdir_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/binary/binary.go:27:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/const.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/const.go: device error
../../../../cache/tools/go_bootstrap/src/math/fma.go:7:8: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/bits/bits_tables.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/math/bits/bits_tables.go: device error
../../../../cache/tools/go_bootstrap/src/fmt/print.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/dir_darwin.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/dir_darwin.go: device error
cmd/dist/build.go:16:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/exec/lp_unix.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/os/exec/lp_unix.go: device error
../../../../cache/tools/go_bootstrap/src/io/fs/glob.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/path/example_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/path/example_test.go: device error
../../../../cache/tools/go_bootstrap/src/encoding/binary/binary.go:28:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/reflect/deepequal.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/reflect/deepequal.go: device error
../../../../cache/tools/go_bootstrap/src/regexp/backtrack.go:18:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/regexp/syntax/parse_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/regexp/syntax/parse_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/reflectlite/value.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/abi_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/abi_test.go: device error
../../../../cache/tools/go_bootstrap/src/runtime/arena.go:87:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/internal/atomic/atomic_amd64.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/runtime/internal/atomic/atomic_amd64.go: device error
../../../../cache/tools/go_bootstrap/src/internal/fmtsort/sort.go:13:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sort/example_search_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sort/example_search_test.go: device error
../../../../cache/tools/go_bootstrap/src/reflect/type.go:20:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strconv/decimal.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strconv/decimal.go: device error
../../../../cache/tools/go_bootstrap/src/bufio/bufio.go:14:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strings/builder_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/strings/builder_test.go: device error
../../../../cache/tools/go_bootstrap/src/io/io.go:17:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sync/map_bench_test.go: unexpected NUL in input
../../../../cache/tools/go_bootstrap/src/sync/cond.go:8:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sync/atomic/example_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/sync/atomic/example_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/syscall/unix/at_libc2.go:10:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/syscall/getdirentries_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/syscall/getdirentries_test.go: device error
../../../../cache/tools/go_bootstrap/src/internal/poll/fd_poll_runtime.go:13:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/time/internal_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/time/internal_test.go: device error
../../../../cache/tools/go_bootstrap/src/bytes/bytes.go:11:2: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/unicode/script_test.go: read /Users/swarming/.swarming/w/ir/cache/tools/go_bootstrap/src/unicode/script_test.go: device error

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2024-03-06 19:20 gotip-linux-amd64_debian12-perf_vs_release go@70fbc882 [build] (log)
2024/03/06 19:57:40 run starting
[I2024-03-06T19:57:40.635605Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:40.636670Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:40.637154Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:40.637229Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:40.637439Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:40.637642Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:40.637828Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-03-06T19:57:43.230208Z 378 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
2024/03/06 19:57:43 installed tools
...
	<title>502 Server Error</title>
	</head>
	<body text=#000000 bgcolor=#ffffff>
	<h1>Error: Server Error</h1>
	<h2>The server encountered a temporary error and could not complete your request.<p>Please try again in 30 seconds.</h2>
	<h2></h2>
	</body></html>
	

Links:

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2024-03-27 18:23 gotip-windows-arm64 go@d4cc35c4 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-27 20:42 gotip-windows-arm64 go@0c561209 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-27 21:58 gotip-windows-arm64 go@2e1003e2 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 14:40 gotip-windows-386 go@ed9aed1c [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 14:40 gotip-windows-amd64 go@ed9aed1c [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 14:40 gotip-windows-amd64-longtest go@ed9aed1c [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 14:40 gotip-windows-amd64-race go@ed9aed1c [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 18:16 gotip-windows-386 go@33fd95b8 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 18:16 gotip-windows-amd64 go@33fd95b8 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 18:16 gotip-windows-amd64-longtest go@33fd95b8 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 18:16 gotip-windows-amd64-race go@33fd95b8 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found
2024-03-28 18:16 gotip-windows-arm64 go@33fd95b8 [build] (log)
ERROR: start fetch: rpc error: code = NotFound desc = stream path not found

watchflakes

@gopherbot
Copy link

Found new dashboard test flakes for:

#!watchflakes
post <- repo == "go" && !(log ~ `^(All tests passed|FAIL|build failed|fatal error:|panic:|WARNING: DATA RACE|go tool dist: |(Test .* ran over .* limit)|([^ ]*make.bash: .*(error|fault)))`)
2024-04-19 16:55 gotip-linux-386-softfloat go@f0d6ddfa [build] (log)
2024/04/19 09:56:45 run starting
[I2024-04-19T09:56:45.549576-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.550870-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.550909-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.551015-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.551093-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.551798-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.552453-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.665490-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[I2024-04-19T09:56:45.665564-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
...
[I2024-04-19T09:56:46.740843-07:00 4953 0 options.go:162] dropping Batch(len(Data): 1, Meta: <nil>)
[E2024-04-19T09:56:47.551585-07:00 4953 0 errors.go:128] set status: FAILURE: rpc error: code = Internal desc = Authentication backend internal server error. Please retry.
  with SummaryMarkdown:
**FAILURE**

* go on master ([commit f0d6ddf](https://go.googlesource.com/go/+/f0d6ddfac03c1c3048f20d595fd50352c79e1849))

Error: `rpc error: code = Internal desc = Authentication backend internal server error. Please retry.`

Links:

watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
Status: No status
Development

No branches or pull requests

2 participants