Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/website/cmd/golangorg: frequent TestWeb failures with "connect: no route to host" to play.golang.org since CL 388016 #51439

Closed
bcmills opened this issue Mar 2, 2022 · 3 comments
Labels
FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. release-blocker Soon This needs to be done soon. (regressions, serious bugs, outages)
Milestone

Comments

@bcmills
Copy link
Contributor

bcmills commented Mar 2, 2022

2022/03/02 11:56:35 readVersions: Get "https://play.golang.org/versions": dial tcp 142.250.148.141:443: connect: no route to host
2022/03/02 11:56:35 newDirTree reading src: open src: no file system
2022/03/02 11:56:38 ERROR share error: Get "https://play.golang.org/p/MAohLsrz7JQ.go": dial tcp 142.250.148.141:443: connect: no route to host
2022/03/02 11:56:38 https://go.dev/
--- FAIL: TestWeb (5.18s)
    --- FAIL: TestWeb/godev.txt (0.16s)
        --- FAIL: TestWeb/godev.txt/GET/https://go.dev/play/p/MAohLsrz7JQ.go (0.01s)
            webtest.go:260: testdata/godev.txt:46: GET https://go.dev/play/p/MAohLsrz7JQ.go
                testdata/godev.txt:50: body does not contain `Hello, 世界` (but should)
                	Internal Server Error
                testdata/godev.txt:47: code = "500", want "200"
                
2022/03/02 11:56:41 newDirTree reading src: open src: no file system
FAIL
FAIL	golang.org/x/website/cmd/golangorg	15.760s

These failures appear to have started as of CL 388016 (attn @jamalc, @dmitshur).
We should probably either roll back that CL or skip the test until the cause of the failure can be diagnosed and fixed.

@golang/release, we may also want to investigate whether this indicates a problem with the builders' network connectivity, the go.dev server, and/or the play.golang.org server.


greplogs --dashboard -md -l -e 'connect: no route to host\n(?:.*\n)*FAIL\s+golang\.org/x/website/cmd/.*'

2022-03-02T11:49:04-d10dfbe-40e24a9/linux-386-stretch
2022-03-02T11:49:04-d10dfbe-40e24a9/linux-amd64-stretch
2022-03-02T11:33:18-d10dfbe-fd2e1e7/linux-386-stretch
2022-03-02T11:33:18-d10dfbe-fd2e1e7/linux-amd64-stretch
2022-03-02T11:28:40-d10dfbe-bebe9aa/linux-386-stretch
2022-03-02T11:28:40-d10dfbe-bebe9aa/linux-amd64-stretch
2022-03-01T23:49:01-d10dfbe-6da16b6/linux-386-stretch
2022-03-01T23:49:01-d10dfbe-6da16b6/linux-amd64-stretch
2022-03-01T23:20:30-d10dfbe-aaa3d39/linux-386-stretch
2022-03-01T23:20:30-d10dfbe-aaa3d39/linux-amd64-stretch
2022-03-01T22:02:33-d10dfbe-d40e7bb/linux-386-stretch
2022-03-01T22:02:33-d10dfbe-d40e7bb/linux-amd64-stretch
2022-03-01T21:27:42-d10dfbe-b0db2f0/linux-386-stretch
2022-03-01T21:27:42-d10dfbe-b0db2f0/linux-amd64-stretch
2022-03-01T20:52:30-d10dfbe-f4722d8/linux-386-stretch
2022-03-01T20:52:30-d10dfbe-f4722d8/linux-amd64-stretch
2022-03-01T19:46:09-d10dfbe-d6d2ebb/linux-386-stretch
2022-03-01T19:46:09-d10dfbe-d6d2ebb/linux-amd64-stretch
2022-03-01T19:33:14-d10dfbe-a222963/linux-386-stretch
2022-03-01T19:33:14-d10dfbe-a222963/linux-amd64-stretch
2022-03-01T19:33:14-d10dfbe-7d8fa65/linux-386-stretch
2022-03-01T19:33:14-d10dfbe-7d8fa65/linux-amd64-stretch
2022-03-01T19:33:14-d10dfbe-620a3c0/linux-386-stretch
2022-03-01T19:33:14-d10dfbe-620a3c0/linux-amd64-stretch
2022-03-01T19:33:14-d10dfbe-258fc75/linux-386-stretch
2022-03-01T19:33:14-d10dfbe-258fc75/linux-amd64-stretch
2022-03-01T18:48:36-c18706c-620a3c0/linux-386-stretch
2022-03-01T18:48:36-c18706c-620a3c0/linux-amd64-stretch
2022-03-01T18:43:08-c18706c-510ad45/linux-386-stretch
2022-03-01T18:43:08-c18706c-510ad45/linux-amd64-stretch
2022-03-01T18:13:15-c18706c-d9fd920/linux-386-stretch
2022-03-01T18:13:15-c18706c-d9fd920/linux-amd64-stretch
2022-03-01T15:19:50-c18706c-a222963/linux-386-stretch
2022-03-01T15:19:50-c18706c-a222963/linux-amd64-stretch
2022-03-01T15:19:50-c18706c-7d8fa65/linux-386-stretch
2022-03-01T15:19:50-c18706c-7d8fa65/linux-amd64-stretch
2022-03-01T15:19:50-c18706c-2199841/linux-386-stretch
2022-03-01T15:19:50-c18706c-2199841/linux-amd64-stretch
2022-03-01T07:36:46-c3d4063-2199841/linux-386-stretch
2022-03-01T07:36:46-c3d4063-2199841/linux-amd64-stretch
2022-03-01T06:01:28-c3d4063-4f04e1d/linux-386-stretch
2022-03-01T06:01:28-c3d4063-4f04e1d/linux-amd64-stretch
2022-02-28T22:24:58-c3d4063-936c7fb/linux-386-stretch
2022-02-28T22:24:58-c3d4063-936c7fb/linux-amd64-stretch
2022-02-28T22:02:43-c3d4063-acc5f55/linux-386-stretch
2022-02-28T22:02:43-c3d4063-acc5f55/linux-amd64-stretch
2022-02-28T21:56:43-c3d4063-f04d5c1/linux-386-stretch
2022-02-28T21:56:43-c3d4063-f04d5c1/linux-amd64-stretch
2022-02-28T21:50:54-c3d4063-f928581/linux-386-stretch
2022-02-28T21:50:54-c3d4063-f928581/linux-amd64-stretch
2022-02-28T19:56:27-c3d4063-eb8198d/linux-386-stretch
2022-02-28T19:56:27-c3d4063-eb8198d/linux-amd64-stretch
2022-02-28T19:56:27-c3d4063-a222963/linux-386-stretch
2022-02-28T19:56:27-c3d4063-a222963/linux-amd64-stretch
2022-02-28T19:56:27-c3d4063-7d8fa65/linux-386-stretch
2022-02-28T19:56:27-c3d4063-7d8fa65/linux-amd64-stretch
2022-02-28T19:38:22-832feb7-eb8198d/linux-386-stretch
2022-02-28T19:38:22-832feb7-eb8198d/linux-amd64-stretch
2022-02-28T19:00:23-832feb7-b33592d/linux-386-stretch
2022-02-28T19:00:23-832feb7-b33592d/linux-amd64-stretch
2022-02-28T17:51:12-832feb7-57e3809/linux-386-stretch
2022-02-28T17:51:12-832feb7-57e3809/linux-amd64-stretch
2022-02-28T15:58:07-832feb7-06a43e4/linux-386-stretch
2022-02-28T15:58:07-832feb7-06a43e4/linux-amd64-stretch
2022-02-28T15:50:51-832feb7-0907d57/linux-386-stretch
2022-02-28T15:50:51-832feb7-0907d57/linux-amd64-stretch
2022-02-28T15:43:07-832feb7-9c4a862/linux-386-stretch
2022-02-28T15:43:07-832feb7-9c4a862/linux-amd64-stretch
2022-02-28T14:59:04-832feb7-57dda97/linux-386-stretch
2022-02-28T14:59:04-832feb7-57dda97/linux-amd64-stretch
2022-02-26T01:16:03-832feb7-a064a4f/linux-386-stretch
2022-02-26T01:16:03-832feb7-a064a4f/linux-amd64-stretch
2022-02-26T00:21:50-832feb7-286e3e6/linux-386-stretch
2022-02-26T00:21:50-832feb7-286e3e6/linux-amd64-stretch
2022-02-25T23:38:11-832feb7-01e522a/linux-386-stretch
2022-02-25T23:38:11-832feb7-01e522a/linux-amd64-stretch
2022-02-25T21:55:09-832feb7-a222963/linux-386-stretch
2022-02-25T21:55:09-832feb7-a222963/linux-amd64-stretch
2022-02-25T21:55:09-832feb7-7d8fa65/linux-386-stretch
2022-02-25T21:55:09-832feb7-7d8fa65/linux-amd64-stretch
2022-02-25T21:55:09-832feb7-26999cf/linux-386-stretch
2022-02-25T21:55:09-832feb7-26999cf/linux-amd64-stretch

@bcmills bcmills added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. release-blocker Soon This needs to be done soon. (regressions, serious bugs, outages) labels Mar 2, 2022
@bcmills bcmills added this to the Go1.19 milestone Mar 2, 2022
@dmitshur
Copy link
Contributor

dmitshur commented Mar 2, 2022

From looking at the build dashboard, this failure isn't just frequent, it happens reproducibly since the test case in CL 388016 was added. And it only happens on linux-{386,amd64}-stretch builders, not any others.

image

There appears to be two separate issues uncovered here.

One, the tests cases that were added in CL 388016 should be moved to live.txt, since they depend on production resources. It just so happens these production resources are normally publicly accessibly when running tests locally, since they use "https://play.golang.org" URLs (as opposed to an internal resource only available to the go.dev server in production). I confirmed this locally by running tests with my internet disabled, as should be the case on many builders. Will send a CL to fix this. (Sent CL 389394.)

The other issue is that this is only caught by the linux-386-stretch and linux-amd64-stretch builders, but not any of the others. In x/build/dashboard, many more builders have GO_DISABLE_OUTBOUND_NETWORK=1 in their configuration, and this shows that might not be having effect on most builders. This needs more investigation. (Filed #51444 for this.)

@gopherbot
Copy link

Change https://go.dev/cl/389394 mentions this issue: cmd/golangorg: move test cases that need internet to live.txt

@gopherbot
Copy link

Change https://go.dev/cl/389394 mentions this issue: cmd/golangorg: move test case that needs internet to live.txt

passionSeven added a commit to passionSeven/website that referenced this issue Oct 18, 2022
One test case added in CL 388016 depends on production resources,
specifically the snippet https://play.golang.org/p/MAohLsrz7JQ.go
served by the production instance of the Go playground.

This would be caught by TryBots where internet access is disabled,
but that didn't happen due to golang/go#51444.

Updates golang/go#51181.
Fixes golang/go#51439.

Change-Id: I4f1c5ea1a6ccad9ae4e5cbb749e3dee0b26731b5
Reviewed-on: https://go-review.googlesource.com/c/website/+/389394
Reviewed-by: Bryan Mills <bcmills@google.com>
Reviewed-by: Jamal Carvalho <jamalcarvalho@google.com>
Trust: Dmitri Shuralyov <dmitshur@google.com>
@golang golang locked and limited conversation to collaborators Mar 2, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. release-blocker Soon This needs to be done soon. (regressions, serious bugs, outages)
Projects
None yet
Development

No branches or pull requests

3 participants