Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build/env/linux-ppc64/osuosl: go-be-5 is hanging up on us #32236

Closed
bradfitz opened this issue May 24, 2019 · 2 comments
Closed

x/build/env/linux-ppc64/osuosl: go-be-5 is hanging up on us #32236

bradfitz opened this issue May 24, 2019 · 2 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Milestone
Unreleased

Comments

@bradfitz
Copy link
Contributor

1 of our 5 linux/ppc64 big endian VMs at the OSUOSL is hanging up on us a few seconds after connecting:

bradfitz@go:~/src/golang.org/x/build/env/linux-ppc64/osuosl$ time ssh -i ~/.ssh/id_ed25519_golang1 debian@140.211.168.44
packet_write_wait: Connection to 140.211.168.44 port 22: Broken pipe

real    0m0.589s
user    0m0.012s
sys     0m0.000s

bradfitz@go:~/src/golang.org/x/build/env/linux-ppc64/osuosl$ time ssh -i ~/.ssh/id_ed25519_golang1 debian@140.211.168.44
Authentication failed.

real    0m0.394s
user    0m0.012s
sys     0m0.000s

bradfitz@go:~/src/golang.org/x/build/env/linux-ppc64/osuosl$ time ssh -i ~/.ssh/id_ed25519_golang1 debian@140.211.168.44

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
You have new mail.
Last login: Thu Jul 27 14:08:06 2017 from 146.148.92.232
debian@go-be-5:~$ packet_write_wait: Connection to 140.211.168.44 port 22: Broken pipe

real    0m11.510s
user    0m0.012s
sys     0m0.000s

bradfitz@go:~/src/golang.org/x/build/env/linux-ppc64/osuosl$ time ssh -i ~/.ssh/id_ed25519_golang1 debian@140.211.168.44

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
You have new mail.
Last login: Thu Jul 27 14:08:06 2017 from 146.148.92.232
debian@go-be-5:~$ 
debian@go-be-5:~$ 
debian@go-be-5:~$ 
debian@go-be-5:~$ 
debian@go-be-5:~$ 
debian@go-be-5:~$ packet_write_wait: Connection to 140.211.168.44 port 22: Broken pipe
                                                                                                                                                                                                                      real    0m6.697s
user    0m0.016s
sys     0m0.000s

File a ticket with them to fix.

/cc @dmitshur
@bradfitz bradfitz added the Builders x/build issues (builders, bots, dashboards) label May 24, 2019
@gopherbot gopherbot added this to the Unreleased milestone May 24, 2019
@dmitshur
Copy link
Contributor

When I tried it now, it wouldn't even let me connect initially, ssh was giving a ssh_exchange_identification: read: Connection reset by peer error right away. It does respond to pings, however.

File a ticket with them to fix.

I've filed a ticket and will update when we hear back.

@dmitshur dmitshur added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label May 29, 2019
@dmitshur
Copy link
Contributor

We heard back, and this problem has been resolved. The go-be-5 machine is now reachable by SSH, and it has re-connected to the coordinator successfully.

The builder health at https://farmer.golang.org is all "ok" now!

@dmitshur dmitshur added NeedsFix The path to resolution is known, but the work has not been done. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels May 29, 2019
@golang golang locked and limited conversation to collaborators May 28, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
None yet
Milestone
Unreleased
Development

No branches or pull requests
3 participants
@bradfitz @dmitshur @gopherbot