Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: Migrate builders to LUCI #63471

Open
10 of 20 tasks
joedian opened this issue Oct 9, 2023 · 20 comments
Open
10 of 20 tasks

x/build: Migrate builders to LUCI #63471

joedian opened this issue Oct 9, 2023 · 20 comments
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done. umbrella
Milestone

Comments

@joedian
Copy link

joedian commented Oct 9, 2023

Hi Gophers,

The Go team is currently migrating its builders to LUCI and we need your help. As a trusted contributor and owner of the a builder, your input will ensure availability the builder to fellow gophers.

To get started, use these instructions to migrate your builder. Feel free to provide any feedback/tips you have so we can update them for future users. If you have questions, please tag @golang/release.

If you are tagged, you are listed as a owner of a builder that needs migrating.

Thanks for your ongoing support of Go!

@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Oct 9, 2023
@gopherbot gopherbot added this to the Unreleased milestone Oct 9, 2023
@joedian joedian added the NeedsFix The path to resolution is known, but the work has not been done. label Oct 9, 2023
@0intro
Copy link
Member

0intro commented Oct 9, 2023

@millerresearch

@n2vi
Copy link

n2vi commented Oct 10, 2023

Added #63480 but seem to be unable to assign to myself or add the new-builder label or add a comment.
Also, Github says I can't attach a .csr so I renamed it as a .txt.

@rorth
Copy link

rorth commented Oct 10, 2023

The solaris-amd64 buildbot migration is already handled in x/build: add LUCI solaris-amd64 builder #61666 .

@joedian
Copy link
Author

joedian commented Nov 13, 2023

Friendly ping for those owners whose builders haven't been migrated. Please let the team know if there is a timeline to starting the migration.

@0intro
Copy link
Member

0intro commented Nov 13, 2023

Plan 9 support is ongoing, but we need support from Google (#63599).

@rorth
Copy link

rorth commented Nov 13, 2023

The solaris-amd64 migration is done for some time. I rather wonder when the old buildlets will be turned off: right now, both are running in parallel here, unnecessarily consuming resources.

@millerresearch
Copy link
Contributor

Plan 9 support is ongoing, but we need support from Google (#63599).

We are also awaiting reply to our request for a sight of existing infrastructure for other platforms which will run the swarming bot on a proxy machine separate from the test target, eg android. See issue #62025.

@draganmladjenovic
Copy link

The solaris-amd64 migration is done for some time. I rather wonder when the old buildlets will be turned off: right now, both are running in parallel here, unnecessarily consuming resources.

I could try moving mips*-rtrk builders, but we don't have enough resources for having both type of builders running in parallel.

@bsiegert
Copy link
Contributor

@draganmladjenovic What I did for netbsd-arm64 is to run both the swarming bot and the buildlet on the same machines. That way, the Go team can do the switch when they would like to.

@abner-chenc
Copy link
Contributor

Friendly ping for those owners whose builders haven't been migrated. Please let the team know if there is a timeline to starting the migration.

I will migrate the builder of loong64's platform to LUCI as soon as possible.

@pmur
Copy link
Contributor

pmur commented Feb 8, 2024

I am not sure who is responsible for aix-ppc64 today. I see @trex58, but I suspect they are no longer responsible for it. @golang/aix?

@ayappanec
Copy link

I am not sure who is responsible for aix-ppc64 today. I see @trex58, but I suspect they are no longer responsible for it. @golang/aix?

I am responsible for aix-ppc64 as of now. I will look into this migration.

@gopherbot
Copy link

Change https://go.dev/cl/568196 mentions this issue: dashboard: add a map for hiding builders that migrated to LUCI

gopherbot pushed a commit to golang/build that referenced this issue Feb 29, 2024
This sets a path forward for hiding builders that have migrated.
Outright deleting their configuration is left for a later phase.

For golang/go#65913.
Updates golang/go#63471.

Change-Id: Icaa40cbaf5e9395ef6f82fc70a6febc2ec8bc838
Reviewed-on: https://go-review.googlesource.com/c/build/+/568196
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
@gopherbot
Copy link

Change https://go.dev/cl/574497 mentions this issue: dashboard: mark more builders as ported to LUCI

@gopherbot
Copy link

Change https://go.dev/cl/574496 mentions this issue: dashboard: mark all WebAssembly builders as ported to LUCI

gopherbot pushed a commit to golang/build that referenced this issue Mar 27, 2024
These builders are fully ported to LUCI. Given we're now displaying
build results from LUCI, start hiding the legacy builder duplicates.

For golang/go#65913.
For golang/go#63471.

Change-Id: I57698e225a28f386740c46936f1b97e16351faee
Reviewed-on: https://go-review.googlesource.com/c/build/+/574496
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
gopherbot pushed a commit to golang/build that referenced this issue Mar 27, 2024
Hide additional duplicate builders to reduce noise and make progress
on the migration to LUCI.

This helped me notice that we haven't turned on linux-arm64-longtest
and linux-arm64-race in LUCI yet, so I mailed CL 574559 for that.

For golang/go#65913.
For golang/go#63471.

Change-Id: If90aeb37235fc07e399980bed3096a36a3e53fe2
Reviewed-on: https://go-review.googlesource.com/c/build/+/574497
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
@gopherbot
Copy link

Change https://go.dev/cl/575855 mentions this issue: dashboard: mark linux-arm64-{longtest,race} builders as ported to LUCI

gopherbot pushed a commit to golang/build that referenced this issue Apr 2, 2024
They're available as of CL 574559.

For golang/go#65913.
For golang/go#63471.

Change-Id: I916d9db6d3fefe6f07a363adcce7085b6c72a5b7
Reviewed-on: https://go-review.googlesource.com/c/build/+/575855
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
@abner-chenc
Copy link
Contributor

Friendly ping for those owners whose builders haven't been migrated. Please let the team know if there is a timeline to starting the migration.

I will migrate the builder of loong64's platform to LUCI as soon as possible.

Migrating, see #65398

@gopherbot
Copy link

Change https://go.dev/cl/578042 mentions this issue: dashboard: mark recent clang/boringcrypto builders as ported to LUCI

gopherbot pushed a commit to golang/build that referenced this issue Apr 12, 2024
For golang/go#65913.
For golang/go#63471.

Change-Id: I8db307a98804422e1b004df2a3a9723048e7744e
Reviewed-on: https://go-review.googlesource.com/c/build/+/578042
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Auto-Submit: Dmitri Shuralyov <dmitshur@google.com>
Reviewed-by: Carlos Amedee <carlos@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
@gopherbot
Copy link

Change https://go.dev/cl/578936 mentions this issue: dashboard: stop ported Wasm builders

gopherbot pushed a commit to golang/build that referenced this issue Apr 15, 2024
The Wasm builders have been ported to LUCI. Their previous coordinator
versions aren't being maintained and have stopped passing at tip after
CL 577135, because they're still using an old and unsupported wasmtime.

Stop these builders from doing work and remove them from legacy trybot
set, so that its failure doesn't get in the way of Legacy-TryBots-Pass
which is still used for some builders that haven't been ported to LUCI.

For golang/go#63471.

Change-Id: I4c8b0af80807196b7f03046ecdf1b18851b97b04
Reviewed-on: https://go-review.googlesource.com/c/build/+/578936
Reviewed-by: Cherry Mui <cherryyz@google.com>
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
@gopherbot
Copy link

Change https://go.dev/cl/578975 mentions this issue: dashboard: stop linux-ppc64x builders

gopherbot pushed a commit to golang/build that referenced this issue Apr 15, 2024
All linux/ppc64x builders have been ported. Likewise, remove
the ppc64le health checkers as they will no longer be needed.

Updates golang/go#63471

Change-Id: I539796a1bf9349a17f7e94ea8de81bebcb6ff2b2
Reviewed-on: https://go-review.googlesource.com/c/build/+/578975
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Cherry Mui <cherryyz@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done. umbrella
Projects
Status: In Progress
Development

No branches or pull requests