Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build/internal/task: test failures with signal: killed on darwin #64110

Open
gopherbot opened this issue Nov 14, 2023 · 6 comments
Open

x/build/internal/task: test failures with signal: killed on darwin #64110

gopherbot opened this issue Nov 14, 2023 · 6 comments
Labels
Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Darwin
Milestone
Unreleased

Comments

@gopherbot
Copy link

gopherbot commented Nov 14, 2023 •
edited by bcmills 

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`

Issue created automatically to collect these failures.

Example (log):

--- FAIL: TestUpdateProxyTestRepo (72.20s)
    updateproxytestrepo_test.go:34: git push --tags error: git command failed: signal: killed, stderr

— watchflakes
@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Nov 14, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
default <- pkg == "golang.org/x/build/internal/task" && test == "TestUpdateProxyTestRepo"
2023-11-10 23:32 darwin-amd64-13 build@e10b185a go@42bd21be x/build/internal/task.TestUpdateProxyTestRepo (log) 
--- FAIL: TestUpdateProxyTestRepo (72.20s)
    updateproxytestrepo_test.go:34: git push --tags error: git command failed: signal: killed, stderr

— watchflakes

@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Nov 14, 2023
@gopherbot gopherbot added this to the Unreleased milestone Nov 14, 2023
@bcmills bcmills changed the title x/build/internal/task: TestUpdateProxyTestRepo failures x/build/internal/task: TestUpdateProxyTestRepo failures with signal: killed Nov 14, 2023
@bcmills bcmills mentioned this issue Nov 14, 2023
Open
@bcmills
Copy link
Contributor

bcmills commented Nov 14, 2023

I suspect this is another symptom of #63937.

@bcmills bcmills changed the title x/build/internal/task: TestUpdateProxyTestRepo failures with signal: killed x/build/internal/task: test failures with signal: killed on darwin Nov 20, 2023
@bcmills bcmills mentioned this issue Nov 20, 2023
Closed
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2023-09-22 19:29 darwin-amd64-12_0 build@433076bf go@de3bae19 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (65.35s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-25 20:39:18.905557 -0700 PDT m=+11.981991598	task Select repositories: LOG: Examining repositories [mod tools build sys]
    tagx_test.go:605: task Select repositories: done: [{mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc0007cc210 0xc0007cc228 0xc0007cc240] 1.16 v1.1.5 } {build golang.org/x/build [0xc0007cc258 0xc0007cc270]   } {sys golang.org/x/sys []  v0.1.0 }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task tools: wait for submit: started
    tagx_test.go:601: task tools: generate go.mod: started
...
        ]
    tagx_test.go:601: task tools: mail go.mod: started
    tagx_test.go:605: task tools: mail go.mod: done: cl_7bcf32cefff813a6866965fe313deda91a54de37
    tagx_test.go:601: task tools: wait for submit: started
    tagx_test.go:623: 2023-09-25 20:40:18.866756 -0700 PDT m=+71.943191019	task tools: wait for submit: LOG: Awaiting review/submit of (unparseable change ID "cl_7bcf32cefff813a6866965fe313deda91a54de37")
    tagx_test.go:605: task tools: wait for submit: done: 7bcf32cefff813a6866965fe313deda91a54de37
    tagx_test.go:601: task tools: wait for green post-submit: started
    tagx_test.go:623: 2023-09-25 20:40:18.917388 -0700 PDT m=+71.993822320	task tools: wait for green post-submit: LOG: task failed, will retry (1 of 3): listing project "tools" tags: git command failed: signal: killed, stderr 
    tagx_test.go:601: task tools: wait for green post-submit: started
    tagx_test.go:469: context deadline exceeded
2023-09-27 02:35 darwin-amd64-12_0 build@5d3521b0 go@5152be39 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (91.31s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-26 19:45:02.074048 -0700 PDT m=+15.875628018	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc00056cde0 0xc00056cdf8 0xc00056ce10] 1.16 v1.1.5 } {build golang.org/x/build [0xc00056ce28 0xc00056ce40]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task tools: mail go.mod: started
    tagx_test.go:601: task sys: wait for green post-submit: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: 809e1dc4a09ba8203e68d1ece8e097c7e38ecbb0
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-09-26 19:45:19.441705 -0700 PDT m=+33.243285100	task sys: tag if appropriate: LOG: Tagging sys at 809e1dc4a09ba8203e68d1ece8e097c7e38ecbb0 as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-09-26 19:46:02.164881 -0700 PDT m=+75.966460579	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-3463493718'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-09-27 02:35 darwin-amd64-12_0 build@5d3521b0 go@a15ef1bb x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (79.41s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-26 19:47:34.300647 -0700 PDT m=+18.494665009	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc000544450 0xc000544480 0xc000544498] 1.16 v1.1.5 } {build golang.org/x/build [0xc0005444b0 0xc0005444c8]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task build: mail go.mod: started
    tagx_test.go:601: task build: wait for submit: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: 475d426cd4f392776f380a4b2b38a6ab7dbef7b6
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-09-26 19:48:17.857991 -0700 PDT m=+62.052009153	task sys: tag if appropriate: LOG: Tagging sys at 475d426cd4f392776f380a4b2b38a6ab7dbef7b6 as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-09-26 19:48:34.45264 -0700 PDT m=+78.646658432	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-3607395922'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-09-28 19:51 darwin-amd64-12_0 build@7f885397 go@fa4f9510 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (76.08s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-29 12:37:00.074804 -0700 PDT m=+13.879835326	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc000114e88 0xc000114ea0 0xc000114eb8] 1.16 v1.1.5 } {build golang.org/x/build [0xc000114ed0 0xc000114ee8]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task sys: wait for green post-submit: started
    tagx_test.go:601: task mod: read branch head: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: ecbcccd5010ff295b9fa481ea074afb948458fce
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-09-29 12:37:31.740866 -0700 PDT m=+45.545897929	task sys: tag if appropriate: LOG: Tagging sys at ecbcccd5010ff295b9fa481ea074afb948458fce as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-09-29 12:38:00.623179 -0700 PDT m=+74.428211368	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-2607998828'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-10-03 21:14 darwin-amd64-12_0 build@821668f7 go@a9036396 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (65.49s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-10-04 18:08:46.374458 -0700 PDT m=+13.986602872	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc000740ed0 0xc000740ee8 0xc000740f00] 1.16 v1.1.5 } {build golang.org/x/build [0xc000740f18 0xc000740f30]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:601: task sys: wait for green post-submit: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: 59b99114bb263517b745cbe8b1a35745134ba7b4
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-10-04 18:08:59.348955 -0700 PDT m=+26.961100223	task sys: tag if appropriate: LOG: Tagging sys at 59b99114bb263517b745cbe8b1a35745134ba7b4 as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-10-04 18:09:46.646396 -0700 PDT m=+74.258541211	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-382914932'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-10-04 18:06 darwin-amd64-12_0 build@4772d0e4 go@e47cab13 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (64.67s)
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-10-04 11:29:07.030649 -0700 PDT m=+12.667482300	task Select repositories: LOG: Examining repositories [mod tools build sys]
    tagx_test.go:605: task Select repositories: done: [{mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc0006948e8 0xc000694900 0xc000694918] 1.16 v1.1.5 } {build golang.org/x/build [0xc000694930 0xc000694948]   } {sys golang.org/x/sys []  v0.1.0 }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task tools: tag if appropriate: started
    tagx_test.go:601: task build: mail go.mod: started
...
    tagx_test.go:601: task tools: wait for green post-submit: started
    tagx_test.go:605: task tools: wait for green post-submit: done: 5738e13e33d872b6a93dc18e72a3262929142cd8
    tagx_test.go:601: task tools: tag if appropriate: started
    tagx_test.go:623: 2023-10-04 11:30:06.009587 -0700 PDT m=+71.646420744	task tools: tag if appropriate: LOG: Tagging tools at 5738e13e33d872b6a93dc18e72a3262929142cd8 as v1.2.0
    tagx_test.go:605: task tools: tag if appropriate: done: {tools golang.org/x/tools [0xc000694630 0xc000694648 0xc000694660] 1.16 v1.1.5 v1.2.0}
    tagx_test.go:601: task build: generate go.mod: started
    tagx_test.go:623: 2023-10-04 11:30:07.052786 -0700 PDT m=+72.689619971	task build: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-553727786'...
        done.
    tagx_test.go:601: task build: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-10-24 17:53 darwin-amd64-13 build@a966970d go@f9a31cda x/build/internal/task.TestTagSingleRepo (log) 
--- FAIL: TestTagSingleRepo (89.14s)
    --- FAIL: TestTagSingleRepo/with_post-submit_check (82.63s)
        tagx_test.go:600: task Create single-repo plan: started
        tagx_test.go:600: task Load all repositories: started
        tagx_test.go:600: task Load all repositories: started
        tagx_test.go:622: 2023-10-24 14:01:42.887343 -0400 EDT m=+69.593814980	task Load all repositories: LOG: Examining repositories [mod foo]
        tagx_test.go:604: task Load all repositories: done: [{mod golang.org/x/mod []  v1.1.0 } {foo golang.org/x/foo [0xc0005b9128]  v1.1.5 }]
        tagx_test.go:600: task Create single-repo plan: started
        tagx_test.go:604: task Create single-repo plan: done: <nil>
        tagx_test.go:600: task foo: mail go.mod: started
...
            ]
        tagx_test.go:600: task foo: mail go.mod: started
        tagx_test.go:604: task foo: mail go.mod: done: cl_7980548793978b0973e5233cd7a6b23e902b52cb
        tagx_test.go:600: task foo: wait for submit: started
        tagx_test.go:622: 2023-10-24 14:02:33.211424 -0400 EDT m=+119.917896620	task foo: wait for submit: LOG: Awaiting review/submit of (unparseable change ID "cl_7980548793978b0973e5233cd7a6b23e902b52cb")
        tagx_test.go:604: task foo: wait for submit: done: 7980548793978b0973e5233cd7a6b23e902b52cb
        tagx_test.go:600: task foo: wait for green post-submit: started
        tagx_test.go:622: 2023-10-24 14:02:43.317282 -0400 EDT m=+130.023754115	task foo: wait for green post-submit: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr 
        tagx_test.go:600: task foo: wait for green post-submit: started
        tagx_test.go:565: context deadline exceeded
2023-11-19 20:11 darwin-amd64-12_0 build@c3768868 go@06145fe0 x/build/internal/task.TestSyncPrivate (log) 
--- FAIL: TestSyncPrivate (81.19s)
    tagx_test.go:599: task Sync go-private master to public: started
    tagx_test.go:599: task Sync go-private master to public: started
    tagx_test.go:621: 2023-11-19 13:53:48.249599 -0800 PST m=+62.498902576	task Sync go-private master to public: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-1676881493'...
        done.
    tagx_test.go:599: task Sync go-private master to public: started
    sync_private_test.go:37: context deadline exceeded

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2023-12-18 17:56 darwin-amd64-13 build@0ce25ffd go@761e10be x/build/internal/task.TestUpdateProxyTestRepo (log) 
--- FAIL: TestUpdateProxyTestRepo (65.28s)
    updateproxytestrepo_test.go:34: git push --tags error: git command failed: signal: killed, stderr

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2024-03-11 17:58 darwin-amd64-12_0 build@503d6b5b go@63992def x/build/internal/task.TestPrivXPatch (log) 
--- FAIL: TestPrivXPatch (72.68s)
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:468: task Publish change: started
    tagx_test.go:468: task Create single-repo plan: started
    tagx_test.go:468: task Wait to Announce: started
    tagx_test.go:468: task Mail announcement: started
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:490: 2024-03-11 11:15:22.131392 -0700 PDT m=+1.015612424	task Load all repositories: LOG: Examining repositories [net]
    tagx_test.go:472: task Load all repositories: done: [{net golang.org/x/net []  v1.0.0 }]
    tagx_test.go:468: task Publish change: started
    tagx_test.go:490: 2024-03-11 11:15:46.94144 -0700 PDT m=+25.825660461	task Publish change: LOG: cloned repo into /tmp/buildlet/tmp/relui-git-clone-2548663649
    tagx_test.go:490: 2024-03-11 11:15:46.94637 -0700 PDT m=+25.830590420	task Publish change: LOG: fetching refs/changes/1234/5 from /tmp/buildlet/tmp/TestPrivXPatch4099315828/001/net
    tagx_test.go:490: 2024-03-11 11:15:52.810919 -0700 PDT m=+31.695138506	task Publish change: LOG: fetched
    tagx_test.go:490: 2024-03-11 11:16:23.239968 -0700 PDT m=+62.124188193	task Publish change: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr 
    tagx_test.go:468: task Publish change: started
    privx_test.go:130: context deadline exceeded

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2024-03-11 18:47 darwin-amd64-12_0 build@7c2d52f7 go@2ab9218c x/build/internal/task.TestPrivXPatch (log) 
--- FAIL: TestPrivXPatch (65.98s)
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:468: task Publish change: started
    tagx_test.go:468: task Create single-repo plan: started
    tagx_test.go:468: task Wait to Announce: started
    tagx_test.go:468: task Mail announcement: started
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:490: 2024-03-11 16:15:06.120952 -0700 PDT m=+1.586512017	task Load all repositories: LOG: Examining repositories [net]
    tagx_test.go:472: task Load all repositories: done: [{net golang.org/x/net []  v1.0.0 }]
    tagx_test.go:468: task Publish change: started
    tagx_test.go:490: 2024-03-11 16:15:37.802435 -0700 PDT m=+33.267994278	task Publish change: LOG: cloned repo into /tmp/buildlet/tmp/relui-git-clone-2771525298
    tagx_test.go:490: 2024-03-11 16:15:37.843506 -0700 PDT m=+33.309065321	task Publish change: LOG: fetching refs/changes/1234/5 from /tmp/buildlet/tmp/TestPrivXPatch2424427232/001/net
    tagx_test.go:490: 2024-03-11 16:15:58.814652 -0700 PDT m=+54.280210881	task Publish change: LOG: fetched
    tagx_test.go:490: 2024-03-11 16:16:06.273555 -0700 PDT m=+61.739113959	task Publish change: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr 
    tagx_test.go:468: task Publish change: started
    privx_test.go:130: context deadline exceeded

— watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Darwin
Projects
Test Flakes
Status: No status
Milestone
Unreleased
Development

No branches or pull requests
2 participants
@bcmills @gopherbot