Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build/cmd/coordinator/internal/lucipoll, x/build/cmd/watchflakes: occasionally gets stuck (for upwards of 24 hrs) #66687

Open
dmitshur opened this issue Apr 4, 2024 · 1 comment
Open

x/build/cmd/coordinator/internal/lucipoll, x/build/cmd/watchflakes: occasionally gets stuck (for upwards of 24 hrs) #66687

dmitshur opened this issue Apr 4, 2024 · 1 comment
Assignees
@dmitshur
Labels
Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Milestone
Unreleased

Comments

@dmitshur
Copy link
Contributor

dmitshur commented Apr 4, 2024

The pollLoop method that runs in a loop usually takes a minute, but sometimes seems to get stuck and eventually completes in just over 24 hours without any error. This is a tracking issue to sort this out.
@dmitshur dmitshur added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Apr 4, 2024
@dmitshur dmitshur added this to the Unreleased milestone Apr 4, 2024
@dmitshur dmitshur self-assigned this Apr 4, 2024
@gopherbot
Copy link

Change https://go.dev/cl/576658 mentions this issue: cmd/coordinator/internal/lucipoll: retry after 30 minutes

gopherbot pushed a commit to golang/build that referenced this issue Apr 5, 2024
@dmitshur @gopherbot
cmd/coordinator/internal/lucipoll: retry after 30 minutes
45dc22e 
We're still seeing instances where runOnce takes significantly longer
to complete than usual. Add a hard timeout to get more information and
maybe act as a stop-gap to reduce how often build results are missing.

For golang/go#66687.

Change-Id: I5ecddf53d776bd35230eaec0621e0850a5a3cc3e
Reviewed-on: https://go-review.googlesource.com/c/build/+/576658
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
@dmitshur dmitshur changed the title cmd/coordinator/internal/lucipoll: occasionally gets stuck (for upwards of 24 hrs) x/build/cmd/coordinator/internal/lucipoll, x/build/cmd/watchflakes: occasionally gets stuck (for upwards of 24 hrs) Apr 19, 2024
@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dmitshur dmitshur

Labels
Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
Go Release
Status: Planned
Milestone
Unreleased
Development

No branches or pull requests
2 participants
@dmitshur @gopherbot