Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cmd/go: look only at dependencies in use in 'go run' #31057

Closed
josharian opened this issue Mar 26, 2019 · 6 comments
Closed

cmd/go: look only at dependencies in use in 'go run' #31057

josharian opened this issue Mar 26, 2019 · 6 comments
Labels
FrozenDueToAge GoCommand cmd/go modules NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.
Milestone
Go1.13

Comments

@josharian
Copy link
Contributor

With no network access:

$ cd $GOROOT/src/cmd/compile/internal/gc
$ go run mkbuiltin.go
go: golang.org/x/sys@v0.0.0-20190322080309-f49334f85ddc: unrecognized import path "golang.org/x/sys" (https fetch: Get https://golang.org/x/sys?go-get=1: dial tcp: lookup golang.org: no such host)
go: golang.org/x/crypto@v0.0.0-20190325154230-a5d413f7728c: unrecognized import path "golang.org/x/crypto" (https fetch: Get https://golang.org/x/crypto?go-get=1: dial tcp: lookup golang.org: no such host)
go: golang.org/x/tools@v0.0.0-20190325223049-1d95b17f1b04: unrecognized import path "golang.org/x/tools" (https fetch: Get https://golang.org/x/tools?go-get=1: dial tcp: lookup golang.org: no such host)
go: error loading module requirements

But the imports used by mkbuiltin.go are 100% standard library with no dependency that I see on those three repos.

It looks to my untrained eye like the cmd/compile/internal/gc package depends on those repos, but not mkbuiltin.go. Assuming that that is accurate, and given that go run x.go is effectively independent of the location of x.go on disk, it seems to me that my go run command should have succeeded.

cc @bcmills @jayconrod

Apologies if this is a duplicate; I'm having a hard time keeping track of the various go modules issues.
@josharian josharian added the GoCommand cmd/go label Mar 26, 2019
@josharian josharian added this to the Go1.13 milestone Mar 26, 2019
@josharian josharian added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Mar 26, 2019
@robpike
Copy link
Contributor

robpike commented Mar 27, 2019

Does go build with this case have the same problem? I've been seeing surprising output from go build lately.

@josharian
Copy link
Contributor Author

I’m not sure. I still haven’t fully wrapped my head around modules, but I have noticed that cmd/go needs a surprising amount of network access. (I’m used to basically everything working without the internet, and am disconcerted by the notion that I do not understand enough to be able to plan for an airplane trip, much less not have to plan at all.) But I am working under the assumption that all of the foregoing is my problem.

@robpike
Copy link
Contributor

robpike commented Mar 27, 2019

It might not be just your problem. I see much network access (and slowness) that I cannot explain.

@bcmills
Copy link
Contributor

bcmills commented Mar 27, 2019 •
edited

Could you attach the output of go version and go env from within that working directory?

If you're using go run with a 1.12 compiler, then it won't have the special-case vendor logic required to avoid fetching the dependencies listed for the cmd module.

I've been testing these sorts of issues using GOPATH=$(mktemp -d) GOPROXY=off PATH=~/minbin, where ~/minbin does not contain any binaries that (to my knowledge) provide network access. (Setting GOPATH to an empty directory and GOPROXY=off ensures that the go command does not have access to a cached or proxied copy of those modules.)

For the command line you provided, a go build from head does not seem to fetch anything.

~/go/src/cmd/compile/internal/gc$ go version
go version devel +591193b01f Wed Mar 27 21:04:34 2019 +0000 linux/amd64

~/go/src/cmd/compile/internal/gc$ go env
GOARCH="amd64"
GOBIN=""
GOCACHE="/usr/local/google/home/bcmills/.cache/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/usr/local/google/home/bcmills"
GOPROXY=""
GORACE=""
GOROOT="/usr/local/google/home/bcmills/go"
GOTMPDIR=""
GOTOOLDIR="/usr/local/google/home/bcmills/go/pkg/tool/linux_amd64"
GCCGO="/usr/local/google/home/bcmills/bin/gccgo"
CC="gcc"
CXX="c++"
CGO_ENABLED="1"
GOMOD="/usr/local/google/home/bcmills/go/src/cmd/go.mod"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build587017954=/tmp/go-build -gno-record-gcc-switches"

~/go/src/cmd/compile/internal/gc$ GOPATH=$(mktemp -d) GOPROXY=off PATH=~/minbin go run mkbuiltin.go

~/go/src/cmd/compile/internal/gc$ ls ~/minbin
ar  as  cat  clang  echo  env  gcc  go  ld  pwd  uname  whoami

~/go/src/cmd/compile/internal/gc$

@bcmills bcmills added the WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. label Mar 27, 2019
@bcmills
Copy link
Contributor

bcmills commented Mar 27, 2019

CC @jayconrod

@josharian
Copy link
Contributor Author

Ahhh. I was indeed using go run with a 1.12 compiler.

Thanks for the heads up about how to narrow down and reproduce these.

@golang golang locked and limited conversation to collaborators Mar 31, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
FrozenDueToAge GoCommand cmd/go modules NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.
Projects
None yet
Milestone
Go1.13
Development

No branches or pull requests
4 participants
@josharian @robpike @bcmills @gopherbot