Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build: some darwin-arm64 machines are down #60271

Closed
heschi opened this issue May 17, 2023 · 2 comments
Closed

x/build: some darwin-arm64 machines are down #60271

heschi opened this issue May 17, 2023 · 2 comments
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done. Soon This needs to be done soon. (regressions, serious bugs, outages) Unfortunate
Milestone
Unreleased

Comments

@heschi
Copy link
Contributor

heschi commented May 17, 2023

fishbowl-02 and fishbowl-06 are down, and I'm locked out of our lab so I can't reboot them :(
@heschi heschi added Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done. Soon This needs to be done soon. (regressions, serious bugs, outages) labels May 17, 2023
@heschi heschi added this to the Unreleased milestone May 17, 2023
@heschi heschi changed the title x/build: two darwin-arm64 machines are down x/build: three darwin-arm64 machines are down May 22, 2023
@heschi
Copy link
Contributor Author

heschi commented May 22, 2023

We've lost 03 as well.

@heschi
Copy link
Contributor Author

heschi commented May 23, 2023

Went and rebooted them all yesterday.

It seems like maybe something goes strange when the machines reboot for a crash -- the terminals running the buildlet all showed that they'd been ctrl-Z'd. We don't know why they crashed, but if we have to reboot them once a year that's probably fine.

cc @golang/release

@heschi heschi closed this as completed May 23, 2023
@heschi heschi changed the title x/build: three darwin-arm64 machines are down x/build: some darwin-arm64 machines are down May 23, 2023
@dmitshur dmitshur mentioned this issue Jun 19, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done. Soon This needs to be done soon. (regressions, serious bugs, outages) Unfortunate
Projects
Go Release
Archived in project
Milestone
Unreleased
Development

No branches or pull requests
2 participants
@dmitshur @heschi