Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build/cmd/coordinator: limit number of TryBot reattempts #13026

Open
mdempsky opened this issue Oct 22, 2015 · 4 comments
Open

x/build/cmd/coordinator: limit number of TryBot reattempts #13026

mdempsky opened this issue Oct 22, 2015 · 4 comments
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done.
Milestone

Comments

@mdempsky
Copy link
Member

I started http://farmer.golang.org/try?commit=ed6176f8 about 4.5 hours ago, and it appears to have attempted to start a Plan 9 GCE image every 6 minutes (i.e., ~45 times now). While its determination is laudable, I think it could stop after maybe 3.

CC @bradfitz @adg

@mdempsky mdempsky added the Builders x/build issues (builders, bots, dashboards) label Oct 22, 2015
@mdempsky mdempsky added this to the Unreleased milestone Oct 22, 2015
@adg
Copy link
Contributor

adg commented Oct 23, 2015

agree

On 23 October 2015 at 09:49, Matthew Dempsky notifications@github.com
wrote:

I started http://farmer.golang.org/try?commit=ed6176f8 about 4.5 hours
ago, and it appears to have attempted to start a Plan 9 GCE image every 6
minutes (i.e., ~45 times now). While its determination is laudable, I think
it could stop after maybe 3.

CC @bradfitz https://github.com/bradfitz @adg https://github.com/adg


Reply to this email directly or view it on GitHub
#13026.

@bradfitz
Copy link
Contributor

It used to only try 3. I'm not sure why it's looping forever now. I also can't investigate until Monday or Tuesday, and GCE changes broke Plan 9 anyway, so I just disabled Plan 9 builders for now.

@dmitshur dmitshur added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Sep 26, 2018
@dmitshur
Copy link
Contributor

CC @golang/release.

@dmitshur dmitshur changed the title x/build: limit number of trybot reattempts x/build/cmd/coordinator: limit number of TryBot reattempts Apr 30, 2021
@dmitshur
Copy link
Contributor

dmitshur commented Nov 21, 2021

Fixing this for the rest of the builders involves starting to track the number of retries (for a high-level trybot request on a given repo/commit) due to communication errors, and modifying repeatedCommunicationError to return a non-nil error if that number reaches 3. It's currently a TODO comment in that method:

// TODO: give it two tries at least later (store state
// somewhere; global map?). But for now we're going to
// only give it one try.

@dmitshur dmitshur added NeedsFix The path to resolution is known, but the work has not been done. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Nov 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done.
Projects
None yet
Development

No branches or pull requests

4 participants