Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build: 11 of our 20 Macs are offline, VMware problems #27164

Closed
bradfitz opened this issue Aug 22, 2018 · 5 comments
Closed

x/build: 11 of our 20 Macs are offline, VMware problems #27164

bradfitz opened this issue Aug 22, 2018 · 5 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Milestone
Unreleased

Comments

@bradfitz
Copy link
Contributor

Our 10-node MacMini cluster VMware cluster is unhappy.

11 of our VMs are offline.

makemac keeps trying to get it back to 20 but is failing with:

Aug 22 16:22:43 godns makemac[1309]: 2018/08/22 16:22:43 Error creating 10.11: govc vm.create ...: exit status 1, govc: datastore 'BOOT_5' not found

/cc @dmitshur @andybons
@bradfitz bradfitz added NeedsFix The path to resolution is known, but the work has not been done. Soon This needs to be done soon. (regressions, serious bugs, outages) labels Aug 22, 2018
@gopherbot gopherbot added this to the Unreleased milestone Aug 22, 2018
@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Aug 22, 2018
@bradfitz
Copy link
Contributor Author

vSphere crapped itself. MacStadium restarted something. I'll check on it more tomorrow.

@bradfitz
Copy link
Contributor Author

MacStadium support says:

Hey Brad. We identified an issue with the host configurations that was causing the vCenter service to not start properly. We have remediated the issue and are rebooting the vCenter. It should be back up shortly. I will let you know when it is available again. Thanks.

@bradfitz
Copy link
Contributor Author

(I can authenticate to the vCenter Flash UI now, but I get API errors and all Hosts & VMs are missing in inventory)

@bradfitz bradfitz self-assigned this Aug 24, 2018
@bradfitz bradfitz removed the Soon This needs to be done soon. (regressions, serious bugs, outages) label Aug 24, 2018
@bradfitz
Copy link
Contributor Author

Mostly fixed now (for this round). Few oddities remain.

@bradfitz
Copy link
Contributor Author

All good.

@golang golang locked and limited conversation to collaborators Aug 29, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
None yet
Milestone
Unreleased
Development

No branches or pull requests
2 participants
@bradfitz @gopherbot