Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build/cmd/racebuild: OOM on linux-ppc64le-buildlet builder #52105

Closed
cherrymui opened this issue Apr 1, 2022 · 2 comments
Closed

x/build/cmd/racebuild: OOM on linux-ppc64le-buildlet builder #52105

cherrymui opened this issue Apr 1, 2022 · 2 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
Go Release Team
Milestone
Unreleased

Comments

@cherrymui
Copy link
Member

cherrymui commented Apr 1, 2022 •
edited by dmitshur

I tried to update the race detector syso files, using the racebuild command. The script OOMs consistently on linux-ppc64le-buildlet builder. It seems the OOMing happens at the step when checking out the LLVM repository to /workdir. The repository is rather big.

/workdir is tmpfs. A workaround is to check out the repository to disk, e.g. /tmp, which seems to work.

Or maybe we want to somehow increase the memory of the PPC64 builders (see also #49957).
@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Apr 1, 2022
@gopherbot gopherbot added this to the Unreleased milestone Apr 1, 2022
@gopherbot
Copy link

Change https://go.dev/cl/397480 mentions this issue: cmd/racebuild: work around PPC64LE builder OOMing

@dmitshur dmitshur changed the title x/build/cmd/racebuild: OOM on linux-ppc64le builder x/build/cmd/racebuild: OOM on linux-ppc64le-buildlet builder Apr 1, 2022
@dmitshur
Copy link
Contributor

dmitshur commented Apr 1, 2022 •
edited

From a brief look, the host type of linux-ppc64le-buildlet is host-linux-ppc64le-osu, described as:

Debian Buster; run by Go team on osuosl.org; see x/build/env/linux-ppc64le/osuosl

For increasing the memory, we might need the involvement of the Go team at osuosl.org. The NOTES file in that env directory points to how a ticket can be filed. The workaround seems reasonable to me.

@dmitshur dmitshur added this to Done in Go Release Team Apr 1, 2022
@dmitshur dmitshur added the NeedsFix The path to resolution is known, but the work has not been done. label Apr 1, 2022
@cherrymui cherrymui mentioned this issue Apr 13, 2022
Closed
@golang golang locked and limited conversation to collaborators Apr 1, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
Go Release
Archived in project
Go Release Team
Done
Milestone
Unreleased
Development

No branches or pull requests
3 participants
@dmitshur @gopherbot @cherrymui