go/types: cannot locate transient dependency saved via Go modules #27556

dradtke · 2018-09-07T14:49:02Z

What version of Go are you using (`go version`)?

go version go1.11 linux/amd64

Does this issue reproduce with the latest release?

Yes.

What operating system and processor architecture are you using (`go env`)?

GOARCH="amd64"
GOBIN=""
GOCACHE="/home/damien/.cache/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/damien/go"
GOPROXY=""
GORACE=""
GOROOT="/usr/local/go"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build423725469=/tmp/go-build -gno-record-gcc-switches"

What did you do?

1. Ensure a clean slate.

Steps 2 and 3 set up a fresh Go development environment on a new Linux server for maximum reproducibility (I spun up a new CentOS server on Vultr). Alternatively, delete ${GOPATH}/pkg and ${GOPATH}/src/golang.org/x/text if they exist.

2. Install the latest Go:

# run as root
$ cd /usr/local
$ wget https://dl.google.com/go/go1.11.linux-amd64.tar.gz
$ tar xvf go1.11.linux-amd64.tar.gz

# also need to install Git on a fresh server
$ yum install git

3. Create a new user and set them up for Go development:

# run as root
$ useradd --create-home damien
$ su - damien

# now run as damien
$ mkdir go
$ export GOPATH=~/go
$ export PATH=/usr/local/go/bin:${PATH}

4. Create a new project outside of GOPATH.

I created a new workspace directory, and inside that added app/app.go:

// ~/workspace/app/app.go
package app

import (
	"golang.org/x/text/unicode/norm"
)

func UnicodeVersion() string {
	return norm.Version
}

I then ran the following to enable Go modules and install its dependency:

$ go mod init app
$ go get golang.org/x/text/unicode/norm

The app folder now contains 3 files: app.go, go.mod, and go.sum, all with the expected contents. Of note is the fact that go.mod does not contain a direct reference to golang.org/x/text/unicode/norm, but instead its parent package:

module app

require golang.org/x/text v0.3.0 // indirect

Running go build ensures that everything works, and indeed we can see the dependency stored at ~/go/pkg/mod/golang.org/x/text\@v0.3.0/.

5. Use `go/types` to type-check it.

I wrote a small program that uses the go/types package to typecheck a program: https://play.golang.org/p/5wWtuNqYv1n, which should be saved in ~/workspace.

What did you expect to see?

Given that the program builds fine, I would expect to see no errors when type-checking it.

What did you see instead?

The program fails with the following error:

2018/09/07 14:43:05 app/app.go:4:2: could not import golang.org/x/text/unicode/norm (type-checking package "golang.org/x/text/unicode/norm" failed (/home/damien/go/pkg/mod/golang.org/x/text@v0.3.0/unicode/norm/normalize.go:15:2: could not import golang.org/x/text/transform (cannot find package "golang.org/x/text/transform" in any of:
	/usr/local/go/src/golang.org/x/text/transform (from $GOROOT)
	/home/damien/go/src/golang.org/x/text/transform (from $GOPATH))))
exit status 1

In addition, using importer.Default() instead results in an even simpler error:

2018/09/07 14:47:04 app/app.go:4:2: could not import golang.org/x/text/unicode/norm (can't find import: "golang.org/x/text/unicode/norm")
exit status 1

The text was updated successfully, but these errors were encountered:

myitcv · 2018-09-07T15:05:22Z

With Go modules, you need to use golang.org/x/tools/go/packages (often shorted to just go/packages) to type check your code. go/packages uses the Go tool in order to be module-aware. As you can see from the definition of go/packages.Package, it has a field of type go/types.Package.

There is more discussion about go/packages happening in https://groups.google.com/forum/#!forum/golang-tools and in #tools on Gophers Slack.

I can't really say this is "working as intended", but I'm going to close the issue in any case. Please feel free to join us in golang-tools in case you have any queries about the use of go/packages.

dradtke · 2018-09-07T15:57:08Z

@myitcv How stable would you say go/packages is? I see an all-caps note at the top of the docs page saying that it's not yet ready for widespread use.

myitcv · 2018-09-07T16:30:30Z

That warning is more relevant to pre the Go 1.11 release (cc @matloob - any update required here?).

go/packages is being used as the basis for the rewrite of many (if not all) go tools: #24661. It is build system agnostic, understands modules, will be more powerful etc. It should be used for all tools requiring anything from module/package file lists, to syntax trees, type information and much more.

Hence that warning should probably be read as "please start using and road testing go/packages, on the understanding we might make minor API changes".

@ianthehat's team is responsible for go/packages so I'll let him add anything I might have missed.

ianthehat · 2018-09-07T16:35:33Z

We will probably be changing the warning soon, at this point its more along the lines of: the API is fairly stable, we will be trying hard not to break it without a really good reason, and we would prefer if you are using it you come talk to us in golang-tools in case we do need to break it so we can let you know. We are not yet ready to promise it's fully stable, we need to be able to make changes when we find a tool that really needs something it cannot support.

dradtke mentioned this issue Sep 7, 2018

Mage fails to locate transient dependencies saved via Go modules magefile/mage#140

Closed

myitcv closed this as completed Sep 7, 2018

agnivade mentioned this issue Oct 23, 2018

go/types doesn't support go module? #28328

Closed

golang locked and limited conversation to collaborators Sep 7, 2019

gopherbot added the FrozenDueToAge label Sep 7, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

go/types: cannot locate transient dependency saved via Go modules #27556

go/types: cannot locate transient dependency saved via Go modules #27556

dradtke commented Sep 7, 2018

myitcv commented Sep 7, 2018

dradtke commented Sep 7, 2018

myitcv commented Sep 7, 2018

ianthehat commented Sep 7, 2018

go/types: cannot locate transient dependency saved via Go modules #27556

go/types: cannot locate transient dependency saved via Go modules #27556

Comments

dradtke commented Sep 7, 2018

What version of Go are you using (go version)?

Does this issue reproduce with the latest release?

What operating system and processor architecture are you using (go env)?

What did you do?

1. Ensure a clean slate.

2. Install the latest Go:

3. Create a new user and set them up for Go development:

4. Create a new project outside of GOPATH.

5. Use go/types to type-check it.

What did you expect to see?

What did you see instead?

myitcv commented Sep 7, 2018

dradtke commented Sep 7, 2018

myitcv commented Sep 7, 2018

ianthehat commented Sep 7, 2018

What version of Go are you using (`go version`)?

What operating system and processor architecture are you using (`go env`)?

5. Use `go/types` to type-check it.