Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build: coordinator tracks dead reverse buildlets for a long time #12666

Closed
crawshaw opened this issue Sep 17, 2015 · 5 comments
Closed

x/build: coordinator tracks dead reverse buildlets for a long time #12666

crawshaw opened this issue Sep 17, 2015 · 5 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge
Milestone
Unplanned

Comments

@crawshaw
Copy link
Member

Only four darwin machines are online right now (the maximum at any time has been 7, and inparticular gomacmini-e has been off for 30 minutes), but farmer.golang.org shows:

Reverse pool summary
darwin-386-10_10: 49/49 (6 + 43 other)
darwin-amd64-10_10: 49/49 (32 + 17 other)
darwin-arm-a5ios: 36/36 (7 + 29 other)
darwin-arm64-a7ios: 32/32 (4 + 28 other)

Reverse pool machine detail
gomacmini-e.local (104.132.34.69:42310) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 3h17m35.814826002s, working as darwin-386-10_10 for 3h17m33.867126261s
gomacmini-e.local (104.132.34.69:32930) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 3h9m36.521373513s, working as darwin-386-10_10 for 3h9m33.86407025s
gomacmini-e.local (104.132.34.69:49153) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 3h3m30.606904575s, working as darwin-amd64-10_10 for 3h3m18.579129036s
gomacmini-e.local (104.132.34.69:61736) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h55m6.401503471s, working as darwin-386-10_10 for 2h55m3.857367117s
gomacmini-e.local (104.132.34.69:58089) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h48m59.307176275s, working as darwin-arm-a5ios for 2h48m48.279092615s
gomacmini-e.local (104.132.34.69:39529) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h48m43.409707113s, working as darwin-386-10_10 for 2h48m33.854782253s
gomacmini-e.local (104.132.34.69:42258) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h38m13.116669338s, working as darwin-arm64-a7ios for 2h38m3.851248607s
gomacmini-e.local (104.132.34.69:42043) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h37m58.516398101s, working as darwin-386-10_10 for 2h37m48.4884505s
gomacmini-e.local (104.132.34.69:42896) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h27m28.154881367s, working as darwin-amd64-10_10 for 2h27m15.126495727s
gomacmini-e.local (104.132.34.69:49605) version 3, darwin-amd64-10_10, darwin-386-10_10, darwin-arm-a5ios, darwin-arm64-a7ios: connected 2h18m14.785819292s, working as darwin-arm-a5ios for 2h18m3.843837063s
...
@crawshaw
Copy link
Member Author

cc @bradfitz

@bradfitz
Copy link
Contributor

On it in 3 hours.

Please capture /debug/goroutines for me in the meantime.

@crawshaw
Copy link
Member Author

In your email (too big for github).

bradfitz added a commit to golang/build that referenced this issue Sep 17, 2015
@bradfitz
buildlet: try a bit harder to cancel slow HTTP requests
d011dfc 
Use the new Go 1.5 mechanism to abort HTTP requests with a channel.
This is respected by the Go 1.5 http.Transport, which we always use.

This CL shouldn't be necessary (CL 14700 was the real bug), but
doesn't hurt. This still would've probably prevented most of
golang/go#12666

Change-Id: I6890e016ee04183fc0d600baed8046c2f79113d8
Reviewed-on: https://go-review.googlesource.com/14701
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
@bradfitz
Copy link
Contributor

Not yet fixed.

@bradfitz bradfitz reopened this Sep 17, 2015
@bradfitz bradfitz self-assigned this Sep 17, 2015
@bradfitz bradfitz added the Builders x/build issues (builders, bots, dashboards) label Sep 17, 2015
@bradfitz bradfitz added this to the Unplanned milestone Sep 17, 2015
@bradfitz
Copy link
Contributor

Fixed by https://go-review.googlesource.com/#/c/14733/

@golang golang locked and limited conversation to collaborators Sep 22, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge
Projects
None yet
Milestone
Unplanned
Development

No branches or pull requests
3 participants
@bradfitz @crawshaw @gopherbot