Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/pkgsite/internal/fetchdatasource: TestLocalGetUnitMeta failures #61053

Closed
gopherbot opened this issue Jun 28, 2023 · 6 comments
Closed

x/pkgsite/internal/fetchdatasource: TestLocalGetUnitMeta failures #61053

gopherbot opened this issue Jun 28, 2023 · 6 comments
Assignees
@matloob
Labels
pkgsite
Milestone
Unreleased

Comments

@gopherbot
Copy link 

#!watchflakes
post <- pkg == "golang.org/x/pkgsite/internal/fetchdatasource" && test == "TestLocalGetUnitMeta"

Issue created automatically to collect these failures.

Example (log):

2023/06/28 19:50:23 Info: go/packages.Load(["./..."]) loaded 2 packages from /workdir/tmp/289464056 in 23.039133ms
2023/06/28 19:50:23 Info: go/packages.Load(["./..."]) loaded 1 packages from /workdir/tmp/1151966531 in 18.30367ms
2023/06/28 19:50:23 Info: FetchDataSource: fetching example.com/single@v1.0.0
2023/06/28 19:50:24 Info: FetchDataSource: fetched example.com/single@v1.0.0 using *fetch.proxyModuleGetter in 1.382949665s with error <nil>
2023/06/28 19:50:24 Debug: LatestModuleVersions("example.com/single") => (raw="v1.0.0" cooked="v1.0.0", <nil>)
2023/06/28 19:50:24 Info: FetchDataSource: fetching example.com/single/pkg@v1.0.0
2023/06/28 19:50:24 Info: FetchDataSource: fetched example.com/single/pkg@v1.0.0 using <nil> in 216.938µs with error example.com/single/pkg@v1.0.0: not found
2023/06/28 19:50:24 Info: FetchDataSource: fetching example.com/basic@latest
2023/06/28 19:50:24 Info: FetchDataSource: fetched example.com/basic@latest using *fetch.proxyModuleGetter in 1.036983ms with error <nil>
2023/06/28 19:50:24 Debug: LatestModuleVersions("example.com/basic") => (raw="v1.1.0" cooked="v1.1.0", <nil>)
...
--- FAIL: TestLocalGetUnitMeta (10.02s)
    --- FAIL: TestLocalGetUnitMeta/net/http (10.00s)
        fetchdatasource_test.go:434: GetUnitMeta("net/http", "std"): FetchDataSource.GetUnitMeta("net/http", "std", "v0.0.0"): FetchDataSource.findModule("net/http", "std", "v0.0.0"): FetchDataSource.getModule("std", "v0.0.0"): FetchModule("std", "v0.0.0"): stdlib.ZipInfo("v0.0.0"): semanticVersion("v0.0.0"): stdlib.Versions(): remoteGoRepo.refs: context deadline exceeded; wantErr = invalid argument)
2023/06/28 19:50:34 Info: FetchDataSource: fetching github.com/my/module@
2023/06/28 19:50:34 Info: FetchDataSource: fetched github.com/my/module@ using *fetch.goPackagesModuleGetter in 1.244645ms with error <nil>
2023/06/28 19:50:34 Info: FetchDataSource: fetching github.com/no/license@
2023/06/28 19:50:34 Info: LICENSE license coverage too low ({Percent:0 Match:[]}), skipping
2023/06/28 19:50:34 Info: FetchDataSource: fetched github.com/no/license@ using *fetch.goPackagesModuleGetter in 514.585µs with error <nil>
2023/06/28 19:50:34 Info: FetchDataSource: fetching unknownModulePath@
2023/06/28 19:50:34 Info: FetchDataSource: fetched unknownModulePath@ using <nil> in 12.305µs with error unknownModulePath@: not found
2023/06/28 19:50:34 Info: FetchDataSource: fetching example.com/build-constraints@latest
2023/06/28 19:50:34 Info: FetchDataSource: fetched example.com/build-constraints@latest using *fetch.proxyModuleGetter in 4.859618ms with error <nil>
2023/06/28 19:50:34 Debug: LatestModuleVersions("example.com/build-constraints") => (raw="v1.0.0" cooked="v1.0.0", <nil>)

— watchflakes
@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Jun 28, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "golang.org/x/pkgsite/internal/fetchdatasource" && test == "TestLocalGetUnitMeta"
2023-06-28 17:58 linux-amd64-fedora pkgsite@a9d9eedc go@79d4defa x/pkgsite/internal/fetchdatasource.TestLocalGetUnitMeta (log) 
2023/06/28 19:50:23 Info: go/packages.Load(["./..."]) loaded 2 packages from /workdir/tmp/289464056 in 23.039133ms
2023/06/28 19:50:23 Info: go/packages.Load(["./..."]) loaded 1 packages from /workdir/tmp/1151966531 in 18.30367ms
2023/06/28 19:50:23 Info: FetchDataSource: fetching example.com/single@v1.0.0
2023/06/28 19:50:24 Info: FetchDataSource: fetched example.com/single@v1.0.0 using *fetch.proxyModuleGetter in 1.382949665s with error <nil>
2023/06/28 19:50:24 Debug: LatestModuleVersions("example.com/single") => (raw="v1.0.0" cooked="v1.0.0", <nil>)
2023/06/28 19:50:24 Info: FetchDataSource: fetching example.com/single/pkg@v1.0.0
2023/06/28 19:50:24 Info: FetchDataSource: fetched example.com/single/pkg@v1.0.0 using <nil> in 216.938µs with error example.com/single/pkg@v1.0.0: not found
2023/06/28 19:50:24 Info: FetchDataSource: fetching example.com/basic@latest
2023/06/28 19:50:24 Info: FetchDataSource: fetched example.com/basic@latest using *fetch.proxyModuleGetter in 1.036983ms with error <nil>
2023/06/28 19:50:24 Debug: LatestModuleVersions("example.com/basic") => (raw="v1.1.0" cooked="v1.1.0", <nil>)
...
--- FAIL: TestLocalGetUnitMeta (10.02s)
    --- FAIL: TestLocalGetUnitMeta/net/http (10.00s)
        fetchdatasource_test.go:434: GetUnitMeta("net/http", "std"): FetchDataSource.GetUnitMeta("net/http", "std", "v0.0.0"): FetchDataSource.findModule("net/http", "std", "v0.0.0"): FetchDataSource.getModule("std", "v0.0.0"): FetchModule("std", "v0.0.0"): stdlib.ZipInfo("v0.0.0"): semanticVersion("v0.0.0"): stdlib.Versions(): remoteGoRepo.refs: context deadline exceeded; wantErr = invalid argument)
2023/06/28 19:50:34 Info: FetchDataSource: fetching github.com/my/module@
2023/06/28 19:50:34 Info: FetchDataSource: fetched github.com/my/module@ using *fetch.goPackagesModuleGetter in 1.244645ms with error <nil>
2023/06/28 19:50:34 Info: FetchDataSource: fetching github.com/no/license@
2023/06/28 19:50:34 Info: LICENSE license coverage too low ({Percent:0 Match:[]}), skipping
2023/06/28 19:50:34 Info: FetchDataSource: fetched github.com/no/license@ using *fetch.goPackagesModuleGetter in 514.585µs with error <nil>
2023/06/28 19:50:34 Info: FetchDataSource: fetching unknownModulePath@
2023/06/28 19:50:34 Info: FetchDataSource: fetched unknownModulePath@ using <nil> in 12.305µs with error unknownModulePath@: not found
2023/06/28 19:50:34 Info: FetchDataSource: fetching example.com/build-constraints@latest
2023/06/28 19:50:34 Info: FetchDataSource: fetched example.com/build-constraints@latest using *fetch.proxyModuleGetter in 4.859618ms with error <nil>
2023/06/28 19:50:34 Debug: LatestModuleVersions("example.com/build-constraints") => (raw="v1.0.0" cooked="v1.0.0", <nil>)

— watchflakes

@gopherbot gopherbot added this to the Unreleased milestone Jun 28, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "golang.org/x/pkgsite/internal/fetchdatasource" && test == "TestLocalGetUnitMeta"
2023-06-28 17:58 linux-arm-aws pkgsite@a9d9eedc go@08a58dd8 x/pkgsite/internal/fetchdatasource.TestLocalGetUnitMeta (log) 
2023/06/28 20:27:05 Info: go/packages.Load(["./..."]) loaded 2 packages from /workdir/tmp/3623011963 in 39.897571ms
2023/06/28 20:27:05 Info: go/packages.Load(["./..."]) loaded 1 packages from /workdir/tmp/1907984855 in 31.3909ms
2023/06/28 20:27:05 Info: FetchDataSource: fetching example.com/single@v1.0.0
2023/06/28 20:27:07 Info: FetchDataSource: fetched example.com/single@v1.0.0 using *fetch.proxyModuleGetter in 2.247896346s with error <nil>
2023/06/28 20:27:07 Debug: LatestModuleVersions("example.com/single") => (raw="v1.0.0" cooked="v1.0.0", <nil>)
2023/06/28 20:27:07 Info: FetchDataSource: fetching example.com/single/pkg@v1.0.0
2023/06/28 20:27:07 Info: FetchDataSource: fetched example.com/single/pkg@v1.0.0 using <nil> in 329.287µs with error example.com/single/pkg@v1.0.0: not found
2023/06/28 20:27:07 Info: FetchDataSource: fetching example.com/basic@latest
2023/06/28 20:27:07 Info: FetchDataSource: fetched example.com/basic@latest using *fetch.proxyModuleGetter in 1.340072ms with error <nil>
2023/06/28 20:27:07 Debug: LatestModuleVersions("example.com/basic") => (raw="v1.1.0" cooked="v1.1.0", <nil>)
...
--- FAIL: TestLocalGetUnitMeta (10.06s)
    --- FAIL: TestLocalGetUnitMeta/net/http (10.00s)
        fetchdatasource_test.go:434: GetUnitMeta("net/http", "std"): FetchDataSource.GetUnitMeta("net/http", "std", "v0.0.0"): FetchDataSource.findModule("net/http", "std", "v0.0.0"): FetchDataSource.getModule("std", "v0.0.0"): FetchModule("std", "v0.0.0"): stdlib.ZipInfo("v0.0.0"): semanticVersion("v0.0.0"): stdlib.Versions(): remoteGoRepo.refs: Get "https://go.googlesource.com/go/info/refs?service=git-upload-pack": context deadline exceeded; wantErr = invalid argument)
2023/06/28 20:27:17 Info: FetchDataSource: fetching github.com/my/module@
2023/06/28 20:27:17 Info: FetchDataSource: fetched github.com/my/module@ using *fetch.goPackagesModuleGetter in 1.042341ms with error <nil>
2023/06/28 20:27:17 Info: FetchDataSource: fetching github.com/no/license@
2023/06/28 20:27:17 Info: LICENSE license coverage too low ({Percent:0 Match:[]}), skipping
2023/06/28 20:27:17 Info: FetchDataSource: fetched github.com/no/license@ using *fetch.goPackagesModuleGetter in 391.8µs with error <nil>
2023/06/28 20:27:17 Info: FetchDataSource: fetching unknownModulePath@
2023/06/28 20:27:17 Info: FetchDataSource: fetched unknownModulePath@ using <nil> in 10.535µs with error unknownModulePath@: not found
2023/06/28 20:27:17 Info: FetchDataSource: fetching example.com/build-constraints@latest
2023/06/28 20:27:17 Info: FetchDataSource: fetched example.com/build-constraints@latest using *fetch.proxyModuleGetter in 64.564386ms with error <nil>
2023/06/28 20:27:17 Debug: LatestModuleVersions("example.com/build-constraints") => (raw="v1.0.0" cooked="v1.0.0", <nil>)

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "golang.org/x/pkgsite/internal/fetchdatasource" && test == "TestLocalGetUnitMeta"
2023-06-29 16:27 linux-ppc64le-power9osu pkgsite@caabbd68 go@499458f7 x/pkgsite/internal/fetchdatasource.TestLocalGetUnitMeta (log) 
2023/06/29 17:17:19 Info: go/packages.Load(["./..."]) loaded 2 packages from /workdir/tmp/747647238 in 83.808537ms
2023/06/29 17:17:19 Info: go/packages.Load(["./..."]) loaded 1 packages from /workdir/tmp/212126008 in 25.983989ms
2023/06/29 17:17:19 Info: FetchDataSource: fetching example.com/single@v1.0.0
2023/06/29 17:17:22 Info: FetchDataSource: fetched example.com/single@v1.0.0 using *fetch.proxyModuleGetter in 2.926567952s with error <nil>
2023/06/29 17:17:22 Debug: LatestModuleVersions("example.com/single") => (raw="v1.0.0" cooked="v1.0.0", <nil>)
2023/06/29 17:17:22 Info: FetchDataSource: fetching example.com/single/pkg@v1.0.0
2023/06/29 17:17:22 Info: FetchDataSource: fetched example.com/single/pkg@v1.0.0 using <nil> in 398.371µs with error example.com/single/pkg@v1.0.0: not found
2023/06/29 17:17:22 Info: FetchDataSource: fetching example.com/basic@latest
2023/06/29 17:17:22 Info: FetchDataSource: fetched example.com/basic@latest using *fetch.proxyModuleGetter in 1.487177ms with error <nil>
2023/06/29 17:17:22 Debug: LatestModuleVersions("example.com/basic") => (raw="v1.1.0" cooked="v1.1.0", <nil>)
...
--- FAIL: TestLocalGetUnitMeta (10.03s)
    --- FAIL: TestLocalGetUnitMeta/net/http (10.00s)
        fetchdatasource_test.go:434: GetUnitMeta("net/http", "std"): FetchDataSource.GetUnitMeta("net/http", "std", "v0.0.0"): FetchDataSource.findModule("net/http", "std", "v0.0.0"): FetchDataSource.getModule("std", "v0.0.0"): FetchModule("std", "v0.0.0"): stdlib.ZipInfo("v0.0.0"): semanticVersion("v0.0.0"): stdlib.Versions(): remoteGoRepo.refs: Get "https://go.googlesource.com/go/info/refs?service=git-upload-pack": context deadline exceeded; wantErr = invalid argument)
2023/06/29 17:17:32 Info: FetchDataSource: fetching github.com/my/module@
2023/06/29 17:17:32 Info: FetchDataSource: fetched github.com/my/module@ using *fetch.goPackagesModuleGetter in 1.852692ms with error <nil>
2023/06/29 17:17:32 Info: FetchDataSource: fetching github.com/no/license@
2023/06/29 17:17:32 Info: LICENSE license coverage too low ({Percent:0 Match:[]}), skipping
2023/06/29 17:17:32 Info: FetchDataSource: fetched github.com/no/license@ using *fetch.goPackagesModuleGetter in 667.386µs with error <nil>
2023/06/29 17:17:32 Info: FetchDataSource: fetching unknownModulePath@
2023/06/29 17:17:32 Info: FetchDataSource: fetched unknownModulePath@ using <nil> in 14.295µs with error unknownModulePath@: not found
2023/06/29 17:17:32 Info: FetchDataSource: fetching example.com/build-constraints@latest
2023/06/29 17:17:32 Info: FetchDataSource: fetched example.com/build-constraints@latest using *fetch.proxyModuleGetter in 8.74601ms with error <nil>
2023/06/29 17:17:32 Debug: LatestModuleVersions("example.com/build-constraints") => (raw="v1.0.0" cooked="v1.0.0", <nil>)

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "golang.org/x/pkgsite/internal/fetchdatasource" && test == "TestLocalGetUnitMeta"
2023-06-30 19:55 linux-386-sid pkgsite@32beeac0 go@c4590af1 x/pkgsite/internal/fetchdatasource.TestLocalGetUnitMeta (log) 
2023/06/30 19:58:55 Info: go/packages.Load(["./..."]) loaded 2 packages from /workdir/tmp/146376960 in 75.877556ms
2023/06/30 19:58:55 Info: go/packages.Load(["./..."]) loaded 1 packages from /workdir/tmp/1301850332 in 48.116033ms
2023/06/30 19:58:55 Info: FetchDataSource: fetching example.com/single@v1.0.0
2023/06/30 19:58:57 Info: FetchDataSource: fetched example.com/single@v1.0.0 using *fetch.proxyModuleGetter in 2.546089744s with error <nil>
2023/06/30 19:58:57 Debug: LatestModuleVersions("example.com/single") => (raw="v1.0.0" cooked="v1.0.0", <nil>)
2023/06/30 19:58:57 Info: FetchDataSource: fetching example.com/single/pkg@v1.0.0
2023/06/30 19:58:57 Info: FetchDataSource: fetched example.com/single/pkg@v1.0.0 using <nil> in 533.045µs with error example.com/single/pkg@v1.0.0: not found
2023/06/30 19:58:57 Info: FetchDataSource: fetching example.com/basic@latest
2023/06/30 19:58:57 Info: FetchDataSource: fetched example.com/basic@latest using *fetch.proxyModuleGetter in 1.717111ms with error <nil>
2023/06/30 19:58:57 Debug: LatestModuleVersions("example.com/basic") => (raw="v1.1.0" cooked="v1.1.0", <nil>)
...
--- FAIL: TestLocalGetUnitMeta (10.03s)
    --- FAIL: TestLocalGetUnitMeta/net/http (10.00s)
        fetchdatasource_test.go:434: GetUnitMeta("net/http", "std"): FetchDataSource.GetUnitMeta("net/http", "std", "v0.0.0"): FetchDataSource.findModule("net/http", "std", "v0.0.0"): FetchDataSource.getModule("std", "v0.0.0"): FetchModule("std", "v0.0.0"): stdlib.ZipInfo("v0.0.0"): semanticVersion("v0.0.0"): stdlib.Versions(): remoteGoRepo.refs: Get "https://go.googlesource.com/go/info/refs?service=git-upload-pack": context deadline exceeded; wantErr = invalid argument)
2023/06/30 19:59:08 Info: FetchDataSource: fetching github.com/my/module@
2023/06/30 19:59:08 Info: FetchDataSource: fetched github.com/my/module@ using *fetch.goPackagesModuleGetter in 1.200968ms with error <nil>
2023/06/30 19:59:08 Info: FetchDataSource: fetching github.com/no/license@
2023/06/30 19:59:08 Info: LICENSE license coverage too low ({Percent:0 Match:[]}), skipping
2023/06/30 19:59:08 Info: FetchDataSource: fetched github.com/no/license@ using *fetch.goPackagesModuleGetter in 490.716µs with error <nil>
2023/06/30 19:59:08 Info: FetchDataSource: fetching unknownModulePath@
2023/06/30 19:59:08 Info: FetchDataSource: fetched unknownModulePath@ using <nil> in 12.045µs with error unknownModulePath@: not found
2023/06/30 19:59:08 Info: FetchDataSource: fetching example.com/build-constraints@latest
2023/06/30 19:59:08 Info: FetchDataSource: fetched example.com/build-constraints@latest using *fetch.proxyModuleGetter in 16.573041ms with error <nil>
2023/06/30 19:59:08 Debug: LatestModuleVersions("example.com/build-constraints") => (raw="v1.0.0" cooked="v1.0.0", <nil>)

— watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "golang.org/x/pkgsite/internal/fetchdatasource" && test == "TestLocalGetUnitMeta"
2023-06-30 19:55 linux-s390x-ibm pkgsite@32beeac0 go@5fa6923b x/pkgsite/internal/fetchdatasource.TestLocalGetUnitMeta (log) 
2023/07/06 16:20:28 Info: go/packages.Load(["./..."]) loaded 2 packages from /data/golang/workdir/tmp/3073683865 in 110.077715ms
2023/07/06 16:20:28 Info: go/packages.Load(["./..."]) loaded 1 packages from /data/golang/workdir/tmp/1234017924 in 65.284828ms
2023/07/06 16:20:28 Info: FetchDataSource: fetching example.com/single@v1.0.0
2023/07/06 16:20:30 Info: FetchDataSource: fetched example.com/single@v1.0.0 using *fetch.proxyModuleGetter in 1.924161118s with error <nil>
2023/07/06 16:20:30 Debug: LatestModuleVersions("example.com/single") => (raw="v1.0.0" cooked="v1.0.0", <nil>)
2023/07/06 16:20:30 Info: FetchDataSource: fetching example.com/single/pkg@v1.0.0
2023/07/06 16:20:30 Info: FetchDataSource: fetched example.com/single/pkg@v1.0.0 using <nil> in 225.585µs with error example.com/single/pkg@v1.0.0: not found
2023/07/06 16:20:30 Info: FetchDataSource: fetching example.com/basic@latest
2023/07/06 16:20:30 Info: FetchDataSource: fetched example.com/basic@latest using *fetch.proxyModuleGetter in 677.048µs with error <nil>
2023/07/06 16:20:30 Debug: LatestModuleVersions("example.com/basic") => (raw="v1.1.0" cooked="v1.1.0", <nil>)
...
--- FAIL: TestLocalGetUnitMeta (10.02s)
    --- FAIL: TestLocalGetUnitMeta/net/http (10.00s)
        fetchdatasource_test.go:434: GetUnitMeta("net/http", "std"): FetchDataSource.GetUnitMeta("net/http", "std", "v0.0.0"): FetchDataSource.findModule("net/http", "std", "v0.0.0"): FetchDataSource.getModule("std", "v0.0.0"): FetchModule("std", "v0.0.0"): stdlib.ZipInfo("v0.0.0"): semanticVersion("v0.0.0"): stdlib.Versions(): remoteGoRepo.refs: context deadline exceeded; wantErr = invalid argument)
2023/07/06 16:20:40 Info: FetchDataSource: fetching github.com/my/module@
2023/07/06 16:20:40 Info: FetchDataSource: fetched github.com/my/module@ using *fetch.goPackagesModuleGetter in 881.558µs with error <nil>
2023/07/06 16:20:40 Info: FetchDataSource: fetching github.com/no/license@
2023/07/06 16:20:40 Info: LICENSE license coverage too low ({Percent:0 Match:[]}), skipping
2023/07/06 16:20:40 Info: FetchDataSource: fetched github.com/no/license@ using *fetch.goPackagesModuleGetter in 195.872µs with error <nil>
2023/07/06 16:20:40 Info: FetchDataSource: fetching unknownModulePath@
2023/07/06 16:20:40 Info: FetchDataSource: fetched unknownModulePath@ using <nil> in 4.94µs with error unknownModulePath@: not found
2023/07/06 16:20:40 Info: FetchDataSource: fetching example.com/build-constraints@latest
2023/07/06 16:20:40 Info: FetchDataSource: fetched example.com/build-constraints@latest using *fetch.proxyModuleGetter in 5.799572ms with error <nil>
2023/07/06 16:20:40 Debug: LatestModuleVersions("example.com/build-constraints") => (raw="v1.0.0" cooked="v1.0.0", <nil>)

— watchflakes

@hyangah hyangah assigned matloob and unassigned hyangah Jul 7, 2023
@hyangah
Copy link
Contributor

hyangah commented Jul 7, 2023

This test depends on external network availability to access the Go repo. @matloob made the test skip when there is no network in https://go-review.git.corp.google.com/c/pkgsite/+/508295

@hyangah hyangah closed this as completed Jul 7, 2023
@hyangah hyangah removed the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Jul 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@matloob matloob

Labels
pkgsite
Projects
Test Flakes
Status: Done
Milestone
Unreleased
Development

No branches or pull requests
4 participants
@hyangah @bcmills @gopherbot @matloob