cmd/go: occasional network and server errors in tests that connect to rsc.io #49954

bcmills · 2021-12-03T14:46:04Z

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

greplogs --dashboard -md -l -e 'Get "https://rsc\.io/.*read: connection reset by peer' --since=2021-01-01

2021-12-01T10:19:34-0e1d553/linux-386-longtest
2021-11-24T20:51:25-5d8c49a/linux-386-longtest
2021-11-16T17:13:33-29ec902/linux-386-longtest
2021-11-15T19:24:28-9265558/linux-386-longtest
2021-09-30T18:10:18-205640e/linux-amd64-longtest
2021-02-24T19:25:49-bf48163/linux-386-longtest
2021-02-23T21:49:20-0458d8c/linux-amd64-longtest
2021-02-13T15:15:13-66c2709/linux-amd64-longtest

The text was updated successfully, but these errors were encountered:

rsc · 2022-01-10T21:04:01Z

rsc.io is just about the most trivial App Engine server ever. Except for App Engine taking it down for being too old a Go version, it's never had any appreciable downtime. It's possible that App Engine really is hanging up on the connection, but it seems equally possible that the VM is hanging up on the connection. I wonder if we should respond to ECONNRESET by trying one more time?

bcmills · 2022-01-11T19:14:25Z

One more, from a SlowBot on CL 376655:
https://storage.googleapis.com/go-build-log/2af499b1/linux-amd64-longtest_dabf7ba2.log

bcmills · 2022-01-11T19:24:52Z

It's possible that App Engine really is hanging up on the connection, but it seems equally possible that the VM is hanging up on the connection. I wonder if we should respond to ECONNRESET by trying one more time?

It's curious that this failure mode happens so much for frequently for rsc.io than for other services (like gopkg.in, golang.org/x, or vcs-test.golang.org).

Scanning the failures over the last year:

greplogs --dashboard -md -l -e 'https://.*: connection reset by peer(?:.*\n)*FAIL\s+cmd/go' --since=2021-01-01

To me that suggests a problem specific to the App Engine service — perhaps either a bug in the App Engine version of the Go runtime, or flakiness in some network infrastructure sitting it front of the service.

bcmills · 2022-05-06T13:51:38Z

greplogs -l -e 'https://.*: connection reset by peer(?:.*\n)*FAIL\s+cmd/go' --since=2021-12-09
2022-05-05T18:17:08-7b1f8b6/linux-amd64-longtest (rsc.io, but with a failed git pull to github.com/rsc/pdfxxx in another test)
2022-04-26T22:08:00-79db59d/linux-386-longtest (rsc.io)
2022-03-30T18:02:38-a7e76b8/linux-386-longtest (rsc.io)
2022-03-28T16:29:15-b10164b/linux-386-longtest (rsc.io)
2022-02-18T18:46:44-d93cc8c/linux-386-longtest (rsc.io)
2022-02-09T21:52:21-2e2ef31/linux-386-longtest (rsc.io)
2022-01-26T17:03:32-0f4bd92/linux-amd64-longtest (swtch.com)
2022-01-24T17:07:30-f88c3b9/linux-386-longtest (rsc.io)

heschi · 2022-07-06T20:21:00Z

2022-06-28T16:41:48-47e792e/linux-amd64-longtest

bcmills · 2022-09-14T14:54:39Z

greplogs -l -e 'https://.*: connection reset by peer(?:.*\n)*FAIL\s+cmd/go' --since=2022-05-06
2022-08-22T23:36:38-0f42e35/linux-386-longtest
2022-06-28T16:41:48-47e792e/linux-amd64-longtest
2022-05-17T00:58:22-f2b1cde/linux-386-longtest
2022-05-10T21:29:25-d28616d/linux-386-longtest
2022-05-08T17:19:07-4c565a5/linux-amd64-longtest

And a related failure mode:
greplogs -l -e 'https://.*: network is unreachable(?:.*\n)*FAIL\s+cmd/go' --since=2022-05-06
2022-09-07T05:37:53-c011270/linux-386-longtest
2022-09-06T21:53:23-86f8b8d/linux-386-longtest
2022-09-02T17:45:18-274528e/linux-amd64-longtest

gopherbot · 2022-09-20T20:17:45Z

Found new matching dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `Get "https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable)`

2022-08-22 23:36 linux-386-longtest go@0f42e35f cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:33351/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/govcs (10.53s)
        script_test.go:282: 
            # (2022-08-23T00:09:02Z)
            # GOVCS stops go get (0.057s)
            # public pattern works (0.012s)
            # private pattern works (0.030s)
            # other patterns work (for more patterns, see TestGOVCS) (0.035s)
            # bad patterns are reported (for more bad patterns, see TestGOVCSErrors) (0.064s)
            # bad GOVCS patterns do not stop commands that do not need to check VCS (0.117s)
            # svn is disallowed by default (0.032s)
            # fossil is disallowed by default (0.041s)
            # bzr is disallowed by default (0.052s)
            # git is OK by default (10.088s)
            > env GOVCS=
            > env GONOSUMDB='*'
            > [net] [exec:git] [!short] go get rsc.io/sampler
            [stderr]
            go: unrecognized import path "rsc.io/sampler": https fetch: Get "https://rsc.io/sampler?go-get=1": read tcp 10.128.1.43:53588->216.239.32.21:443: read: connection reset by peer
            [exit status 1]
            FAIL: testdata/script/govcs.txt:70: unexpected command failure

2022-08-29 19:17 linux-amd64-longtest go@37cedd26 cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:44621/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/mod_sumdb_golang (37.22s)
        script_test.go:259: 
            # Test default GOPROXY and GOSUMDB (0.214s)
            # Download direct from github. (20.030s)
            # Download from proxy.golang.org with go.sum entry already.
            # Use 'go list' instead of 'go get' since the latter may download extra go.mod
            # files not listed in go.sum. (2.045s)
            # Download again.
...
            > stderr github.com/rsc
            > go list -mod=mod -x rsc.io/quote  # Download module source.
            [stderr]
            go: downloading rsc.io/quote v1.5.2
            # get https://proxy.golang.org/rsc.io/quote/@v/v1.5.2.zip: 404 testing (0.000s)
            # get https://rsc.io/quote?go-get=1
            # get https://rsc.io/quote?go-get=1: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.1.86:37196->216.239.34.21:443: read: connection reset by peer
            unrecognized import path "rsc.io/quote": https fetch: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.1.86:37196->216.239.34.21:443: read: connection reset by peer
            [exit status 1]
            FAIL: testdata/script/mod_sumdb_golang.txt:74: unexpected command failure

2022-09-06 21:53 linux-386-longtest go@86f8b8d3 cmd/go.TestIssue11457 (log)

go test proxy running at GOPROXY=http://127.0.0.1:38493/mod
--- FAIL: TestIssue11457 (0.19s)
    go_test.go:1004: running testgo [get -d -u rsc.io/go-get-issue-11457]
    go_test.go:1004: standard error:
    go_test.go:1004: package rsc.io/go-get-issue-11457: unrecognized import path "rsc.io/go-get-issue-11457": https fetch: Get "https://rsc.io/go-get-issue-11457?go-get=1": dial tcp [2001:4860:4802:32::15]:443: connect: network is unreachable

    go_test.go:1004: go [get -d -u rsc.io/go-get-issue-11457] failed unexpectedly in /workdir/go/src/cmd/go: exit status 1

2022-09-07 05:37 linux-386-longtest go@c011270f cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:33035/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/govcs (0.38s)
        script_test.go:282: 
            # (2022-09-07T06:09:41Z)
            # GOVCS stops go get (0.048s)
            # public pattern works (0.015s)
            # private pattern works (0.007s)
            # other patterns work (for more patterns, see TestGOVCS) (0.026s)
            # bad patterns are reported (for more bad patterns, see TestGOVCSErrors) (0.035s)
            # bad GOVCS patterns do not stop commands that do not need to check VCS (0.124s)
            # svn is disallowed by default (0.011s)
            # fossil is disallowed by default (0.007s)
            # bzr is disallowed by default (0.006s)
            # git is OK by default (0.097s)
            > env GOVCS=
            > env GONOSUMDB='*'
            > [net] [exec:git] [!short] go get rsc.io/sampler
            [stderr]
            go: unrecognized import path "rsc.io/sampler": https fetch: Get "https://rsc.io/sampler?go-get=1": dial tcp [2001:4860:4802:32::15]:443: connect: network is unreachable
            [exit status 1]
            FAIL: testdata/script/govcs.txt:70: unexpected command failure

2022-09-15 20:02 linux-amd64-longtest go@a2973914 cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:45665/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/govcs (0.46s)
        script_test.go:282: 
            # (2022-09-15T20:25:50Z)
            # GOVCS stops go get (0.023s)
            # public pattern works (0.025s)
            # private pattern works (0.015s)
            # other patterns work (for more patterns, see TestGOVCS) (0.049s)
            # bad patterns are reported (for more bad patterns, see TestGOVCSErrors) (0.023s)
            # bad GOVCS patterns do not stop commands that do not need to check VCS (0.074s)
            # svn is disallowed by default (0.021s)
            # fossil is disallowed by default (0.016s)
            # bzr is disallowed by default (0.017s)
            # git is OK by default (0.189s)
            > env GOVCS=
            > env GONOSUMDB='*'
            > [net] [exec:git] [!short] go get rsc.io/sampler
            [stderr]
            go: unrecognized import path "rsc.io/sampler": https fetch: Get "https://rsc.io/sampler?go-get=1": dial tcp [2001:4860:4802:38::15]:443: connect: network is unreachable
            [exit status 1]
            FAIL: testdata/script/govcs.txt:70: unexpected command failure

— watchflakes

gopherbot · 2022-09-23T17:12:19Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `Get "https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable)`

2022-09-23 01:07 linux-386-longtest go@c2ede92a cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:44891/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/govcs (1.25s)
        script_test.go:282: 
            # (2022-09-23T02:39:21Z)
            # GOVCS stops go get (0.153s)
            # public pattern works (0.041s)
            # private pattern works (0.045s)
            # other patterns work (for more patterns, see TestGOVCS) (0.130s)
            # bad patterns are reported (for more bad patterns, see TestGOVCSErrors) (0.185s)
            # bad GOVCS patterns do not stop commands that do not need to check VCS (0.333s)
            # svn is disallowed by default (0.044s)
            # fossil is disallowed by default (0.046s)
            # bzr is disallowed by default (0.063s)
            # git is OK by default (0.209s)
            > env GOVCS=
            > env GONOSUMDB='*'
            > [net] [exec:git] [!short] go get rsc.io/sampler
            [stderr]
            go: unrecognized import path "rsc.io/sampler": https fetch: Get "https://rsc.io/sampler?go-get=1": dial tcp [2001:4860:4802:36::15]:443: connect: network is unreachable
            [exit status 1]
            FAIL: testdata/script/govcs.txt:70: unexpected command failure

— watchflakes

gopherbot · 2022-09-23T18:18:41Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2022-09-23 15:03 linux-amd64-longtest go@65deb9c3 cmd/go/internal/modfetch.TestCodeRepo (log)

--- FAIL: TestCodeRepo (0.00s)
    --- FAIL: TestCodeRepo/swtch.com_testmod/v1.0.0 (10.28s)
        coderepo_test.go:607: repo.Stat("v1.0.0"): unrecognized import path "swtch.com/testmod": reading https://swtch.com/testmod?go-get=1: 500 Internal Server Error

2022-09-23 15:03 linux-amd64-longtest go@65deb9c3 cmd/go/internal/modfetch.TestCodeRepoVersions (log)

--- FAIL: TestCodeRepoVersions (0.00s)
    --- FAIL: TestCodeRepoVersions/parallel (0.00s)
        --- FAIL: TestCodeRepoVersions/parallel/swtch.com_testmod (0.00s)
            coderepo_test.go:832: Versions(""): unrecognized import path "swtch.com/testmod": reading https://swtch.com/testmod?go-get=1: 500 Internal Server Error

2022-09-23 15:03 linux-amd64-longtest go@65deb9c3 cmd/go/internal/modfetch.TestLatest (log)

--- FAIL: TestLatest (0.65s)
    --- FAIL: TestLatest/parallel (0.00s)
        --- FAIL: TestLatest/parallel/swtch.com_testmod (0.00s)
            coderepo_test.go:913: Latest(): unrecognized import path "swtch.com/testmod": reading https://swtch.com/testmod?go-get=1: 500 Internal Server Error

— watchflakes

gopherbot · 2022-09-27T21:13:31Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2022-09-27 16:50 linux-amd64-longtest go@7d157fd0 cmd/go/internal/modfetch.TestCodeRepo (log)

--- FAIL: TestCodeRepo (0.00s)
    --- FAIL: TestCodeRepo/rsc.io_quote/v1.0.0 (0.09s)
        coderepo_test.go:607: repo.Stat("v1.0.0"): unrecognized import path "rsc.io/quote": https fetch: Get "https://rsc.io/quote?go-get=1": dial tcp [2001:4860:4802:36::15]:443: connect: network is unreachable

— watchflakes

gopherbot · 2022-12-17T02:18:32Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2022-12-08 19:06 linux-amd64-longtest-race go@8247b9f1 cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:42985
https://vcs-test.golang.org rerouted to https://127.0.0.1:37429
go test proxy running at GOPROXY=http://127.0.0.1:35869/mod
2022/12/08 20:03:20 http: TLS handshake error from 127.0.0.1:54928: EOF
2022/12/08 20:03:20 http: TLS handshake error from 127.0.0.1:54916: EOF
2022/12/08 20:03:21 http: TLS handshake error from 127.0.0.1:54998: EOF
2022/12/08 20:03:21 http: TLS handshake error from 127.0.0.1:54984: EOF
2022/12/08 20:04:13 http: TLS handshake error from 127.0.0.1:50460: EOF
2022/12/08 20:04:13 http: TLS handshake error from 127.0.0.1:50480: EOF
--- FAIL: TestScript (0.16s)
    --- FAIL: TestScript/mod_sumdb_golang (97.00s)
        script_test.go:134: 2022-12-08T20:02:19Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-4053538976/tmpdir2028403051/mod_sumdb_golang1777452888
        script_test.go:154: 
            # Test default GOPROXY and GOSUMDB (0.200s)
            # Download direct from github. (65.072s)
            # Download from proxy.golang.org with go.sum entry already.
            # Use 'go list' instead of 'go get' since the latter may download extra go.mod
            # files not listed in go.sum. (12.141s)
            # Download again.
...
            > stderr github.com/rsc
            matched: mkdir -p /workdir/tmp/cmd-go-test-4053538976/tmpdir2028403051/mod_sumdb_golang1777452888/gopath/pkg/mod/cache/vcs # git3 https://github.com/rsc/quote
            > go list -mod=mod -x rsc.io/quote  # Download module source.
            [stderr]
            go: downloading rsc.io/quote v1.5.2
            # get https://proxy.golang.org/rsc.io/quote/@v/v1.5.2.zip: 404 testing (0.000s)
            # get https://rsc.io/quote?go-get=1
            # get https://rsc.io/quote?go-get=1: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.0.59:49264->216.239.32.21:443: read: connection reset by peer
            unrecognized import path "rsc.io/quote": https fetch: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.0.59:49264->216.239.32.21:443: read: connection reset by peer
        script_test.go:154: FAIL: mod_sumdb_golang.txt:74: go list -mod=mod -x rsc.io/quote: exit status 1

— watchflakes

gopherbot · 2022-12-27T15:23:13Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2022-12-22 04:34 linux-386-longtest go@de6abd78 cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:42155
https://vcs-test.golang.org rerouted to https://127.0.0.1:32877
go test proxy running at GOPROXY=http://127.0.0.1:34665/mod
2022/12/22 05:20:59 http: TLS handshake error from 127.0.0.1:53496: EOF
2022/12/22 05:21:57 http: TLS handshake error from 127.0.0.1:51052: EOF
2022/12/22 05:21:57 http: TLS handshake error from 127.0.0.1:51076: EOF
2022/12/22 05:21:57 http: TLS handshake error from 127.0.0.1:51058: EOF
2022/12/22 05:21:57 http: TLS handshake error from 127.0.0.1:51096: EOF
2022/12/22 05:21:57 http: TLS handshake error from 127.0.0.1:51106: EOF
2022/12/22 05:21:58 http: TLS handshake error from 127.0.0.1:51130: EOF
...
--- FAIL: TestScript (0.09s)
    --- FAIL: TestScript/mod_sumdb_golang (36.86s)
        script_test.go:134: 2022-12-22T05:20:54Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-416565786/tmpdir643485341/mod_sumdb_golang2464297195
        script_test.go:154: 
            # Test default GOPROXY and GOSUMDB (0.056s)
            # Download direct from github. (19.217s)
            # Download from proxy.golang.org with go.sum entry already.
            # Use 'go list' instead of 'go get' since the latter may download extra go.mod
            # files not listed in go.sum. (2.098s)
...
            > stderr github.com/rsc
            matched: mkdir -p /workdir/tmp/cmd-go-test-416565786/tmpdir643485341/mod_sumdb_golang2464297195/gopath/pkg/mod/cache/vcs # git3 https://github.com/rsc/quote
            > go list -mod=mod -x rsc.io/quote  # Download module source.
            [stderr]
            go: downloading rsc.io/quote v1.5.2
            # get https://proxy.golang.org/rsc.io/quote/@v/v1.5.2.zip: 404 testing (0.000s)
            # get https://rsc.io/quote?go-get=1
            # get https://rsc.io/quote?go-get=1: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.0.160:47778->216.239.34.21:443: read: connection reset by peer
            unrecognized import path "rsc.io/quote": https fetch: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.0.160:47778->216.239.34.21:443: read: connection reset by peer
        script_test.go:154: FAIL: mod_sumdb_golang.txt:74: go list -mod=mod -x rsc.io/quote: exit status 1

— watchflakes

gopherbot · 2023-01-04T21:16:44Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2022-12-19 22:23 linux-386-longtest go@e6adccb3 cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:33419/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/mod_gonoproxy (10.23s)
        script_test.go:259: 
            # disagree with sumdb fails (0.042s)
            # GONOSUMDB bypasses sumdb, for rsc.io/quote, rsc.io/sampler, golang.org/x/text (0.238s)
            # Download .info files needed for 'go list -m all' later.
            # TODO(#42723): either 'go list -m' should not read these files,
            # or 'go get' and 'go mod tidy' should download them. (0.014s)
            # When GOPROXY is not empty but contains no entries, an error should be reported. (0.007s)
            # When GOPROXY=off, fetching modules not matched by GONOPROXY fails. (0.011s)
            # GONOPROXY bypasses proxy (9.914s)
            > [!net] skip
            > [!exec:git] skip
            > env GOPRIVATE=none
            > env GONOPROXY='*/fortune'
            > ! go get rsc.io/fortune # does not exist in real world, only on test proxy
            [stderr]
            go: unrecognized import path "rsc.io/fortune": https fetch: Get "https://rsc.io/fortune?go-get=1": read tcp 10.128.0.225:52584->216.239.36.21:443: read: connection reset by peer
            [exit status 1]
            > stderr 'git ls-remote'
            FAIL: testdata/script/mod_gonoproxy.txt:44: no match for `(?m)git ls-remote` found in stderr

— watchflakes

gopherbot · 2023-01-16T21:45:42Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2023-01-09 17:35 linux-amd64-longtest go@7d06dd61 cmd/go.TestScript (log)

go test proxy running at GOPROXY=http://127.0.0.1:44189/mod
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/mod_sumdb_golang (27.21s)
        script_test.go:270: 
            # (2023-01-09T18:05:29Z)
            # Test default GOPROXY and GOSUMDB (0.075s)
            # Download direct from github. (12.429s)
            # Download from proxy.golang.org with go.sum entry already.
            # Use 'go list' instead of 'go get' since the latter may download extra go.mod
            # files not listed in go.sum. (0.804s)
...
            > stderr github.com/rsc
            > go list -mod=mod -x rsc.io/quote  # Download module source.
            [stderr]
            go: downloading rsc.io/quote v1.5.2
            # get https://proxy.golang.org/rsc.io/quote/@v/v1.5.2.zip: 404 testing (0.000s)
            # get https://rsc.io/quote?go-get=1
            # get https://rsc.io/quote?go-get=1: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.2.143:42036->216.239.36.21:443: read: connection reset by peer
            unrecognized import path "rsc.io/quote": https fetch: Get "https://rsc.io/quote?go-get=1": read tcp 10.128.2.143:42036->216.239.36.21:443: read: connection reset by peer
            [exit status 1]
            FAIL: testdata/script/mod_sumdb_golang.txt:74: unexpected command failure

— watchflakes

gopherbot · 2023-01-25T16:37:07Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2023-01-25 07:07 linux-amd64-longtest-race go@a11b8e37 cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:39541
https://vcs-test.golang.org rerouted to https://127.0.0.1:33087
go test proxy running at GOPROXY=http://127.0.0.1:37631/mod
2023/01/25 08:02:52 http: TLS handshake error from 127.0.0.1:46972: read tcp 127.0.0.1:33087->127.0.0.1:46972: read: connection reset by peer
2023/01/25 08:04:34 http: TLS handshake error from 127.0.0.1:55656: read tcp 127.0.0.1:33087->127.0.0.1:55656: read: connection reset by peer
2023/01/25 08:04:34 http: TLS handshake error from 127.0.0.1:55662: EOF
2023/01/25 08:04:34 http: TLS handshake error from 127.0.0.1:55650: EOF
--- FAIL: TestScript (0.17s)
    --- FAIL: TestScript/mod_download_hash (1.68s)
        script_test.go:134: 2023-01-25T08:04:36Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-1225096490/tmpdir1143070958/mod_download_hash3973697791
        script_test.go:154: 
            > env GO111MODULE=on
            # Testing mod download with non semantic versions; turn off proxy. (1.662s)
            > [!net] skip
            [condition not met]
            > [!git] skip
            [condition not met]
            > env GOPROXY=direct
            > env GOSUMDB=off
            > go mod download rsc.io/quote@a91498bed0a73d4bb9c1fb2597925f7883bc40a7
            > exists $GOPATH/pkg/mod/cache/download/rsc.io/quote/@v/v1.5.3-0.20180709162918-a91498bed0a7.info
            > exists $GOPATH/pkg/mod/cache/download/rsc.io/quote/@v/v1.5.3-0.20180709162918-a91498bed0a7.mod
            > exists $GOPATH/pkg/mod/cache/download/rsc.io/quote/@v/v1.5.3-0.20180709162918-a91498bed0a7.zip
            > go mod download rsc.io/quote@master
            [stderr]
            go: rsc.io/quote@master: unrecognized import path "rsc.io/quote": https fetch: Get "https://rsc.io/quote?go-get=1": dial tcp [2001:4860:4802:32::15]:443: connect: network is unreachable
        script_test.go:154: FAIL: mod_download_hash.txt:14: go mod download rsc.io/quote@master: exit status 1

— watchflakes

gopherbot · 2023-02-02T19:56:51Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2023-01-30 14:56 linux-amd64-longtest-race go@ee5ce77c cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:45939
https://vcs-test.golang.org rerouted to https://127.0.0.1:35717
go test proxy running at GOPROXY=http://127.0.0.1:44955/mod
2023/01/30 15:53:24 http: TLS handshake error from 127.0.0.1:50844: EOF
2023/01/30 15:53:24 http: TLS handshake error from 127.0.0.1:50882: EOF
2023/01/30 15:53:24 http: TLS handshake error from 127.0.0.1:50886: EOF
2023/01/30 15:53:24 http: TLS handshake error from 127.0.0.1:50888: EOF
2023/01/30 15:53:24 http: TLS handshake error from 127.0.0.1:50900: EOF
2023/01/30 15:55:23 http: TLS handshake error from 127.0.0.1:58772: EOF
--- FAIL: TestScript (0.17s)
    --- FAIL: TestScript/govcs (10.96s)
        script_test.go:134: 2023-01-30T15:55:23Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-3833214815/tmpdir2962429290/govcs3755842622
        script_test.go:154: 
            > env GO111MODULE=on
            > env proxy=$GOPROXY
            > env GOPROXY=direct
            # GOVCS stops go get (0.087s)
            # public pattern works (0.038s)
            # private pattern works (0.051s)
...
            # svn is disallowed by default (0.033s)
            # fossil is disallowed by default (0.064s)
            # bzr is disallowed by default (0.083s)
            # git is OK by default (10.145s)
            > env GOVCS=
            > env GONOSUMDB='*'
            > [net] [git] [!short] go get rsc.io/sampler
            [stderr]
            go: unrecognized import path "rsc.io/sampler": https fetch: Get "https://rsc.io/sampler?go-get=1": read tcp 10.128.0.75:47908->216.239.32.21:443: read: connection reset by peer
        script_test.go:154: FAIL: govcs.txt:70: go get rsc.io/sampler: exit status 1

2023-02-01 22:45 linux-arm64-longtest go@40a09869 cmd/go/internal/modfetch.TestCodeRepo (log)

vcs-test.golang.org rerouted to http://127.0.0.1:46853
https://vcs-test.golang.org rerouted to https://127.0.0.1:45781
--- FAIL: TestCodeRepo (0.00s)
    --- FAIL: TestCodeRepo/swtch.com_testmod/v1.0.0 (350.30s)
        coderepo_test.go:633: repo.Stat("v1.0.0"): unrecognized import path "swtch.com/testmod": reading https://swtch.com/testmod?go-get=1: 500 Internal Server Error

2023-02-01 22:45 linux-arm64-longtest go@40a09869 cmd/go/internal/modfetch.TestCodeRepoVersions (log)

--- FAIL: TestCodeRepoVersions (0.00s)
    --- FAIL: TestCodeRepoVersions/parallel (0.00s)
        --- FAIL: TestCodeRepoVersions/parallel/swtch.com_testmod (0.00s)
            coderepo_test.go:858: Versions(""): unrecognized import path "swtch.com/testmod": reading https://swtch.com/testmod?go-get=1: 500 Internal Server Error

2023-02-01 22:45 linux-arm64-longtest go@40a09869 cmd/go/internal/modfetch.TestLatest (log)

--- FAIL: TestLatest (0.22s)
    --- FAIL: TestLatest/parallel (0.00s)
        --- FAIL: TestLatest/parallel/swtch.com_testmod (0.00s)
            coderepo_test.go:939: Latest(): unrecognized import path "swtch.com/testmod": reading https://swtch.com/testmod?go-get=1: 500 Internal Server Error

— watchflakes

gopherbot · 2023-02-24T16:36:50Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2023-02-04 07:03 linux-amd64-longtest-race go@4636c57f cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:39613
https://vcs-test.golang.org rerouted to https://127.0.0.1:33013
go test proxy running at GOPROXY=http://127.0.0.1:43903/mod
2023/02/04 07:58:51 http: TLS handshake error from 127.0.0.1:37386: read tcp 127.0.0.1:33013->127.0.0.1:37386: read: connection reset by peer
2023/02/04 07:59:07 http: TLS handshake error from 127.0.0.1:58226: read tcp 127.0.0.1:33013->127.0.0.1:58226: read: connection reset by peer
2023/02/04 07:59:07 http: TLS handshake error from 127.0.0.1:58288: EOF
2023/02/04 07:59:07 http: TLS handshake error from 127.0.0.1:58296: read tcp 127.0.0.1:33013->127.0.0.1:58296: read: connection reset by peer
2023/02/04 07:59:07 http: TLS handshake error from 127.0.0.1:58258: read tcp 127.0.0.1:33013->127.0.0.1:58258: read: connection reset by peer
2023/02/04 07:59:23 http: TLS handshake error from 127.0.0.1:41096: EOF
2023/02/04 07:59:23 http: TLS handshake error from 127.0.0.1:41152: EOF
2023/02/04 07:59:23 http: TLS handshake error from 127.0.0.1:41146: read tcp 127.0.0.1:33013->127.0.0.1:41146: read: connection reset by peer
--- FAIL: TestScript (0.17s)
    --- FAIL: TestScript/gopath_moved_repo (11.33s)
        script_test.go:134: 2023-02-04T07:58:35Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-2571088681/tmpdir2718063758/gopath_moved_repo983701303
        script_test.go:154: 
            > env GO111MODULE=off
            # Test that 'go get -u' reports packages whose VCS configurations do not
            # match their import paths. (0.000s)
            # We need to execute a custom Go program to break the config files.
            #
            # git will ask for a username and password when we run 'go get -d -f -u',
            # so we also need to set GIT_ASKPASS. Conveniently, a single binary can
            # perform both tasks! (1.360s)
            # Test that 'go get -u' reports moved git packages. (9.973s)
            > [git] go get -d rsc.io/pdf
            [stderr]
            package rsc.io/pdf: unrecognized import path "rsc.io/pdf": https fetch: Get "https://rsc.io/pdf?go-get=1": read tcp 10.128.1.61:58388->216.239.32.21:443: read: connection reset by peer
        script_test.go:154: FAIL: gopath_moved_repo.txt:21: go get -d rsc.io/pdf: exit status 1

2023-02-06 18:37 linux-amd64-longtest go@677038f8 cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:35213
https://vcs-test.golang.org rerouted to https://127.0.0.1:46355
go test proxy running at GOPROXY=http://127.0.0.1:37363/mod
2023/02/06 19:02:37 http: TLS handshake error from 127.0.0.1:36904: EOF
2023/02/06 19:02:51 http: TLS handshake error from 127.0.0.1:48696: EOF
--- FAIL: TestScript (0.06s)
    --- FAIL: TestScript/mod_gonoproxy (10.28s)
        script_test.go:134: 2023-02-06T19:02:44Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-596196379/tmpdir2819675890/mod_gonoproxy1020059091
        script_test.go:154: 
...
            > [!git] skip
            [condition not met]
            > env GOPRIVATE=none
            > env GONOPROXY='*/fortune'
            > ! go get rsc.io/fortune # does not exist in real world, only on test proxy
            [stderr]
            go: unrecognized import path "rsc.io/fortune": https fetch: Get "https://rsc.io/fortune?go-get=1": read tcp 10.128.0.181:43750->216.239.32.21:443: read: connection reset by peer
            [exit status 1]
            > stderr 'git ls-remote'
        script_test.go:154: FAIL: mod_gonoproxy.txt:44: stderr 'git ls-remote': no match for `(?m)git ls-remote` in stderr

2023-02-09 21:13 linux-386-longtest go@da47cd61 cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:46429
https://vcs-test.golang.org rerouted to https://127.0.0.1:45125
go test proxy running at GOPROXY=http://127.0.0.1:37009/mod
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45604: EOF
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45590: EOF
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45636: EOF
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45638: EOF
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45624: EOF
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45668: EOF
2023/02/09 21:54:40 http: TLS handshake error from 127.0.0.1:45650: EOF
...
--- FAIL: TestScript (0.07s)
    --- FAIL: TestScript/mod_gonoproxy (10.42s)
        script_test.go:134: 2023-02-09T21:54:31Z
        script_test.go:136: $WORK=/workdir/tmp/cmd-go-test-190861401/tmpdir3189052847/mod_gonoproxy1413671424
        script_test.go:154: 
            > env GO111MODULE=on
            > env sumdb=$GOSUMDB
            > env proxy=$GOPROXY
            > env GOPRIVATE GOPROXY GONOPROXY GOSUMDB GONOSUMDB
            [stdout]
...
            > [!git] skip
            [condition not met]
            > env GOPRIVATE=none
            > env GONOPROXY='*/fortune'
            > ! go get rsc.io/fortune # does not exist in real world, only on test proxy
            [stderr]
            go: unrecognized import path "rsc.io/fortune": https fetch: Get "https://rsc.io/fortune?go-get=1": read tcp 10.128.0.110:46442->216.239.32.21:443: read: connection reset by peer
            [exit status 1]
            > stderr 'git ls-remote'
        script_test.go:154: FAIL: mod_gonoproxy.txt:44: stderr 'git ls-remote': no match for `(?m)git ls-remote` in stderr

— watchflakes

gopherbot · 2023-10-09T18:40:36Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2023-10-09 17:28 linux-amd64-longtest go@afd7c15c cmd/go/internal/modfetch.TestCodeRepoVersions (log)

vcs-test.golang.org rerouted to http://127.0.0.1:36175
https://vcs-test.golang.org rerouted to https://127.0.0.1:40981
--- FAIL: TestCodeRepoVersions (0.00s)
    --- FAIL: TestCodeRepoVersions/swtch.com_testmod (10.23s)
        coderepo_test.go:837: Versions(""): module swtch.com/testmod: reading https://swtch.com/testmodproxy/swtch.com/testmod/@v/list: 500 Internal Server Error

2023-10-09 17:28 linux-amd64-longtest go@afd7c15c cmd/go/internal/modfetch.TestLatest (log)

--- FAIL: TestLatest (0.00s)
    --- FAIL: TestLatest/swtch.com_testmod (0.20s)
        coderepo_test.go:911: Latest(): module swtch.com/testmod: reading https://swtch.com/testmodproxy/swtch.com/testmod/@v/list: 500 Internal Server Error

— watchflakes

gopherbot · 2024-04-11T17:16:32Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2024-04-11 00:32 windows-amd64-longtest go@b6778c52 cmd/go/internal/modfetch.TestCodeRepo (log)

vcs-test.golang.org rerouted to http://127.0.0.1:56524
https://vcs-test.golang.org rerouted to https://127.0.0.1:56525
--- FAIL: TestCodeRepo (0.00s)
    --- FAIL: TestCodeRepo/swtch.com_testmod/v1.0.0 (10.50s)
        coderepo_test.go:623: repo.Stat("v1.0.0"): swtch.com/testmod@v1.0.0: reading https://swtch.com/testmodproxy/swtch.com/testmod/@v/v1.0.0.info: 500 Internal Server Error
            	server response: internal error

— watchflakes

gopherbot · 2024-04-22T17:59:28Z

Found new dashboard test flakes for:

#!watchflakes
post <- pkg ~ `cmd/go` && `(reading |Get ")https://(swtch.com|rsc.io).*(connection reset by peer|network is unreachable|Internal Server Error)`

2024-04-22 15:29 linux-amd64-longtest go@734fd7a9 cmd/go.TestScript (log)

vcs-test.golang.org rerouted to http://127.0.0.1:44879
https://vcs-test.golang.org rerouted to https://127.0.0.1:41365
go test proxy running at GOPROXY=http://127.0.0.1:40735/mod
2024/04/22 16:02:53 http: TLS handshake error from 127.0.0.1:58274: read tcp 127.0.0.1:41365->127.0.0.1:58274: read: connection reset by peer
--- FAIL: TestScript (0.06s)
    --- FAIL: TestScript/mod_download_hash (11.77s)
        script_test.go:136: 2024-04-22T16:02:56Z
        script_test.go:138: $WORK=/workdir/tmp/cmd-go-test-3965951896/tmpdir277771288/mod_download_hash1287333040
        script_test.go:160: 
            > env GO111MODULE=on
            # Testing mod download with non semantic versions; turn off proxy. (11.764s)
            > [!net:rsc.io] skip
            [condition not met]
            > [!git] skip
            [condition not met]
            > env GOPROXY=direct
            > env GOSUMDB=off
            > go mod download rsc.io/quote@a91498bed0a73d4bb9c1fb2597925f7883bc40a7
            > exists $GOPATH/pkg/mod/cache/download/rsc.io/quote/@v/v1.5.3-0.20180709162918-a91498bed0a7.info
            > exists $GOPATH/pkg/mod/cache/download/rsc.io/quote/@v/v1.5.3-0.20180709162918-a91498bed0a7.mod
            > exists $GOPATH/pkg/mod/cache/download/rsc.io/quote/@v/v1.5.3-0.20180709162918-a91498bed0a7.zip
            > go mod download rsc.io/quote@master
            [stderr]
            go: rsc.io/quote@master: unrecognized import path "rsc.io/quote": reading https://rsc.io/quote?go-get=1: 500 Internal Server Error
        script_test.go:160: FAIL: testdata/script/mod_download_hash.txt:14: go mod download rsc.io/quote@master: exit status 1

— watchflakes

bcmills added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. Testing An issue that has been verified to require only test changes, not just a test failure. labels Dec 3, 2021

bcmills added this to the Backlog milestone Dec 3, 2021

bcmills mentioned this issue Jan 10, 2022

meta: high rate of 5XX errors from go.googlesource.com since 2021-09-08 #50541

Open

bcmills mentioned this issue Sep 7, 2022

cmd/go: TestScript/gopath_moved_repo flake #54933

Closed

bcmills mentioned this issue Sep 14, 2022

build dashboard triage log #52653

Closed

This was referenced Sep 21, 2022

cmd/go/internal/modfetch: TestLatest failures #55289

Open

cmd/go/internal/modfetch: TestCodeRepoVersions failures #55288

Closed

cmd/go/internal/modfetch: TestCodeRepo failures #55287

Closed

bcmills changed the title ~~cmd/go: occasional "connection reset by peer" errors in tests that connect to rsc.io~~ cmd/go: occasional network and server errors in tests that connect to rsc.io Sep 23, 2022

bcmills mentioned this issue May 10, 2023

cmd/go/internal/modfetch: TestCodeRepoVersions failures #60113

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

cmd/go: occasional network and server errors in tests that connect to rsc.io #49954

cmd/go: occasional network and server errors in tests that connect to rsc.io #49954

bcmills commented Dec 3, 2021 •

edited

rsc commented Jan 10, 2022

bcmills commented Jan 11, 2022

bcmills commented Jan 11, 2022

bcmills commented May 6, 2022

heschi commented Jul 6, 2022

bcmills commented Sep 14, 2022

gopherbot commented Sep 20, 2022

gopherbot commented Sep 23, 2022

gopherbot commented Sep 23, 2022

gopherbot commented Sep 27, 2022

gopherbot commented Dec 17, 2022

gopherbot commented Dec 27, 2022

gopherbot commented Jan 4, 2023

gopherbot commented Jan 16, 2023

gopherbot commented Jan 25, 2023

gopherbot commented Feb 2, 2023

gopherbot commented Feb 24, 2023

gopherbot commented Oct 9, 2023

gopherbot commented Apr 11, 2024

gopherbot commented Apr 22, 2024

cmd/go: occasional network and server errors in tests that connect to rsc.io #49954

cmd/go: occasional network and server errors in tests that connect to rsc.io #49954

Comments

bcmills commented Dec 3, 2021 • edited

rsc commented Jan 10, 2022

bcmills commented Jan 11, 2022

bcmills commented Jan 11, 2022

bcmills commented May 6, 2022

heschi commented Jul 6, 2022

bcmills commented Sep 14, 2022

gopherbot commented Sep 20, 2022

gopherbot commented Sep 23, 2022

gopherbot commented Sep 23, 2022

gopherbot commented Sep 27, 2022

gopherbot commented Dec 17, 2022

gopherbot commented Dec 27, 2022

gopherbot commented Jan 4, 2023

gopherbot commented Jan 16, 2023

gopherbot commented Jan 25, 2023

gopherbot commented Feb 2, 2023

gopherbot commented Feb 24, 2023

gopherbot commented Oct 9, 2023

gopherbot commented Apr 11, 2024

gopherbot commented Apr 22, 2024

bcmills commented Dec 3, 2021 •

edited