cmd/go: `go install` with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

glycerine · 2017-02-07T17:05:41Z

Please answer these questions before submitting your issue. Thanks!

What version of Go are you using (`go version`)?

[jaten@biggie tmp]$ go version
go version go1.8rc3 linux/amd64 ## also happens on go1.7.4
[jaten@biggie tmp]$

What operating system and processor architecture are you using (`go env`)?

[jaten@biggie tmp]$ go env
GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/home/jaten/go"
GORACE=""
GOROOT="/usr/local/go"
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
GOGCCFLAGS="-fPIC -m64 -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build885638224=/tmp/go-build -gno-record-gcc-switches"
CXX="g++"
CGO_ENABLED="0"
PKG_CONFIG="pkg-config"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
[jaten@biggie tmp]$

What did you do?

I ran make for https://github.com/glycerine/vhaline
Makefile does go install on the library github.com/glycerine/vhaline/vhaline and then on a test executable; github.com/glycerine/vhaline/cmd/vhaline

What did you expect to see?

successful build. build is successful without CGO_ENABLED=0

What did you see instead?

[jaten@biggie vhaline]$ make                                                                                                  
cd vhaline && go install && cd ../cmd/vhaline && go install                                                                   
go install net: open /usr/local/go/pkg/linux_amd64/net.a: permission denied                  ### problem!                                 
make: *** [build] Error 1                                                                                                     
[jaten@biggie vhaline]$ go version                                                                                            
go version go1.8rc3 linux/amd64                                                                                               
[jaten@biggie vhaline]$ env|grep GO                                                                                           
CGO_ENABLED=0                                                                                                                 
GOROOT=/usr/local/go                                                                                                          
GODEBUG=netdns=go                                                                                                             
GOPATH=/home/jaten/go                                                                                                         
[jaten@biggie vhaline]$ ls -al /usr/local/go/pkg/linux_amd64/net.a                                                            
-rw-r--r-- 1 root root 1209910 Jan 26 18:55 /usr/local/go/pkg/linux_amd64/net.a                                               
[jaten@biggie vhaline]$ file /usr/local/go/pkg/linux_amd64/net.a                                                              
/usr/local/go/pkg/linux_amd64/net.a: current ar archive                                                                       
[jaten@biggie vhaline]$ mkdir tmp                                                                                             
[jaten@biggie vhaline]$ cd tmp                                                                                                
[jaten@biggie tmp]$ ar x /usr/local/go/pkg/linux_amd64/net.a                                                                  
[jaten@biggie tmp]$ ls -al                                                                                                    
total 1192                                                                                                                    
drwxrwxr-x 2 jaten jaten      48 Feb  7 16:57 .                                                                               
drwxrwxr-x 7 jaten jaten    4096 Feb  7 16:57 ..                                                                              
-rw-r--r-- 1 jaten jaten   19172 Feb  7 16:57 _all.o                                                                          
-rw-r--r-- 1 jaten jaten 1169185 Feb  7 16:57 _go_.o                                                                          
-rw-r--r-- 1 jaten jaten   21364 Feb  7 16:57 __.PKGDEF                                                                       
[jaten@biggie tmp]$ go env    
GOARCH="amd64"                                                                                                                
GOBIN=""                                                                                                                      
GOEXE=""                                                                                                                      
GOHOSTARCH="amd64"                                                                                                            
GOHOSTOS="linux"                                                                                                              
GOOS="linux"                                                                                                                  
GOPATH="/home/jaten/go"                                                                                                       
GORACE=""                                                                                                                     
GOROOT="/usr/local/go"                                                                                                        
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"                                                                                
GCCGO="gccgo"                                                                                                                 
CC="gcc"                                                                                                                      
GOGCCFLAGS="-fPIC -m64 -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build885638224=/tmp/go-build -gno-record-gcc-switches"   
CXX="g++"                                                                                                                     
CGO_ENABLED="0"                                                                                                               
PKG_CONFIG="pkg-config"                                                                                                       
CGO_CFLAGS="-g -O2"                                                                                                           
CGO_CPPFLAGS=""                                                                                                               
CGO_CXXFLAGS="-g -O2"                                                                                                         
CGO_FFLAGS="-g -O2"                                                                                                           
CGO_LDFLAGS="-g -O2"                                                                                                          
[jaten@biggie tmp]$ go version                                                                                                
go version go1.8rc3 linux/amd64                                                                                               
[jaten@biggie tmp]$ unset CGO_ENABLED                                                                                         
[jaten@biggie tmp]$ cd ..                                                                                                     
[jaten@biggie vhaline]$ make                                                                                                  
cd vhaline && go install && cd ../cmd/vhaline && go install                                                                   
[jaten@biggie vhaline]$ #successful build

The text was updated successfully, but these errors were encountered:

davecheney · 2017-02-07T17:15:06Z

Your makefile is calling go install, which fails because your user does not have permission to write to that directory.

Either use go build to skip writing stdlib packages to a directory the user doesn't own, or build go from source in a directory you don't own. I recommend the second option.

https://dave.cheney.net/2014/04/20/how-to-install-multiple-versions-of-go

glycerine · 2017-02-07T18:13:38Z

Your makefile is calling go install, which fails because your user does not have permission to write to that directory.

wait.... go install is trying to write to $GOROOT, i.e. /usr/local/go? really? I thought go install would write only to $GOPATH, which is ~/go here.

ianlancetaylor · 2017-02-07T18:27:33Z

I agree that a simple go install for 1.8rc3 should not write to $GOROOT. Can you reproduce this without running make? What does go install -x print?

davecheney · 2017-02-07T18:47:25Z

wait.... go install is trying to write to $GOROOT, i.e. /usr/local/go? really? I thought go install would write only to $GOPATH, which is ~/go here.

If you set CGO_ENABLED=0 then the go tool has to rebuild all the standard lib packages, and because you used go install, it will try to write them back to their original locations. This is the same as cross compilation using the binary install of Go.

https://dave.cheney.net/2015/08/22/cross-compilation-with-go-1-5, see comparison of go build vs go install.

glycerine · 2017-02-07T19:18:33Z

What does go install -x print?

[jaten@biggie vhaline]$ export CGO_ENABLED=0                                                                                                    
[jaten@biggie vhaline]$ env|grep GO                                                                                                             
CGO_ENABLED=0                                                                                                                                   
GOPATH=/home/jaten/go                                                                                                                           
[jaten@biggie vhaline]$ go build                                                                                                                  
[jaten@biggie vhaline]$ go install -x                                                                                                           
WORK=/tmp/go-build958770575                                                                                                                     
mkdir -p $WORK/net/_obj/                                                                                                                        
mkdir -p $WORK/                                                                                                                                 
cd /usr/local/go/src/net                                                                                                                        
/usr/local/go/pkg/tool/linux_amd64/compile -o $WORK/net.a -trimpath $WORK -p net -buildid 9b4851ad605915a6fa99ce0ea2840f1da29dd007 -D _/usr/loc\
al/go/src/net -I $WORK -pack ./addrselect.go ./cgo_stub.go ./conf.go ./dial.go ./dnsclient.go ./dnsclient_unix.go ./dnsconfig_unix.go ./dnsmsg.\
go ./fd_mutex.go ./fd_poll_runtime.go ./fd_posix.go ./fd_unix.go ./file.go ./file_unix.go ./hook.go ./hook_cloexec.go ./hook_unix.go ./hosts.go\
 ./interface.go ./interface_linux.go ./ip.go ./iprawsock.go ./iprawsock_posix.go ./ipsock.go ./ipsock_posix.go ./lookup.go ./lookup_unix.go ./m\
ac.go ./net.go ./nss.go ./parse.go ./pipe.go ./port.go ./port_unix.go ./sendfile_linux.go ./sock_cloexec.go ./sock_linux.go ./sock_posix.go ./s\
ockopt_linux.go ./sockopt_posix.go ./sockoptip_linux.go ./sockoptip_posix.go ./tcpsock.go ./tcpsock_posix.go ./tcpsockopt_posix.go ./tcpsockopt\
_unix.go ./udpsock.go ./udpsock_posix.go ./unixsock.go ./unixsock_posix.go ./writev_unix.go                                                     
mkdir -p /usr/local/go/pkg/linux_amd64/                                                                                                         
cp $WORK/net.a /usr/local/go/pkg/linux_amd64/net.a                                                                                              
go install net: open /usr/local/go/pkg/linux_amd64/net.a: permission denied                                                                     
[jaten@biggie vhaline]$ cd ../cmd/vhaline/                                                                                                      
[jaten@biggie vhaline]$ go build                                                                                                                
[jaten@biggie vhaline]$ ldd ./vhaline                                                                                                           
    not a dynamic executable                                                                                                                    
[jaten@biggie vhaline]$   ##yeah! successfully built without cgo

Okay, then. So my immediately problem is solved. Thank you, Dave, for pointing the surprising difference between go build and go install under CGO_ENABLED=0.

@ianlancetaylor This is really pretty surprising behavior; I wouldn't have expected that CGO_ENABLED=0 would require a rebuild of the entire standard lib. If you want to leave the ticket open as a bug, that's okay with me. I'm also okay with closing it, at your discretion. Dave's cross-compilation post makes it clear for cross-compilation, but its not clear to me that setting CGO_ENABLED=0 is, or should be thought of, the same as cross-compiling.

Using go build vs go install

When cross compiling, you should use go build, not go install. This is the one of the few cases where go build is preferable to go install.

The reason for this is go install always caches compiled packages, .a files, into the pkg/ directory that matches the root of the source code.

For example, if you are building $GOPATH/src/github.com/lib/pq, then the compiled package will be >installed into $GOPATH/pkg/$GOOS_$GOARCH/github.com/lib/pq.a.

This logic also holds true for the standard library, which lives in /usr/local/go/src, so will be compiled to /usr/local/go/pkg/$GOOS_$GOARCH. This is a problem, because when cross compiling the go tool needs to rebuild the standard library for your target, but the binary distribution expects that /usr/local/go is not writeable.

Using go build rather that go install is the solution here, because go build builds, then throws away most of the result (rather than caching it for later), leaving you with the final binary in the current directory, which is most likely writeable by you.
-- from https://dave.cheney.net/2015/08/22/cross-compilation-with-go-1-5

rakyll · 2017-02-07T19:35:03Z

Standard library builds (e.g. go install std) are going under GOROOT, wished it was somewhere under GOPATH at the cost of not being able to share prebuilt standard libraries (for various combinations of GOOS, GOARCH, CGO_ENABLED) between different GOPATHs.

glycerine · 2017-02-07T19:58:33Z

(tongue in cheek...) perhaps $GOROOT==$GOPATH could mean "write my standard libs" under GOPATH.

ianlancetaylor · 2017-02-07T20:33:23Z

Setting CGO_ENABLED=0 does not require rebuilding the entire standard library, but it does require rebuilding the standard library packages that use cgo. Those packages are: net, os/user, crypto/x509.

That said, it does seem wrong that go install tries to install a standard library package in this case. If the package is not mentioned on the command line, it seems to me that it should be built but not installed.

davecheney · 2017-02-07T20:35:16Z

Ian, does that argument extend to cross compilation? That's the place most users hit this issue.

…

On Wed, 8 Feb 2017, 07:33 Ian Lance Taylor ***@***.***> wrote: Setting CGO_ENABLED=0 does not require rebuilding the entire standard library, but it does require rebuilding the standard library packages that use cgo. Those packages are: net, os/user, crypto/x509. That said, it does seem wrong that go install tries to install a standard library package in this case. If the package is not mentioned on the command line, it seems to me that it should be built but not installed. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#18981 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAAcA2W8umf9_BB9Pfh2H8x1CIPIYzvUks5raNUUgaJpZM4L5xMh> .

ianlancetaylor · 2017-02-07T20:51:49Z

My feeling right now is that if you are using a release, then running go install without explicitly mentioning any standard library package should not attempt to install any standard library package. Clearly if you run go install std or go install net then it should install the standard library package (if it is out of date). But if you don't do that, I don't think go install should be trying to write files into GOROOT.

Happy to hear counter-arguments.

davecheney · 2017-02-07T20:57:09Z

That would be wonderful if that was the outcome of this ticket, the "official binary + cross compile + go install" story is the last remaining hurdle to Go developers having a seamless cross compilation experience with our official builds.

…

On Wed, Feb 8, 2017 at 7:51 AM, Ian Lance Taylor ***@***.***> wrote: My feeling right now is that if you are using a release, then running go install without explicitly mentioning any standard library package should not attempt to install any standard library package. Clearly if you run go install std or go install net then it should install the standard library package (if it is out of date). But if you don't do that, I don't think go install should be trying to write files into GOROOT. Happy to hear counter-arguments. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#18981 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAAcAys1VIUMFRjtrCS5AQseaeynhzgNks5raNlngaJpZM4L5xMh> .

petemoore · 2017-03-03T11:24:53Z

Note, in our case, this occurred with go version go1.7.3 linux/amd64 - see taskcluster/taskcluster-worker#190 (comment)

stapelberg · 2017-03-18T17:20:58Z

Strongly agree with @davecheney.

In https://gokrazy.github.io/, a hurdle which multiple users have stumbled over is that Go installations from installers and distribution packages will fail cross-compilation with a “permission denied” error in the standard library.

I.e., people run something like GOOS=linux GOARCH=arm64 go get -u github.com/gokrazy/hello and the command fails with go install runtime/internal/sys: mkdir /usr/lib/go-1.7/pkg/linux_arm64: permission denied. The error message is from Debian, but the problem also affects macOS.

I think many of us are blind to that issue because we install Go from source. End users typically don’t.

rsc · 2017-06-22T19:45:34Z

Work on better caching will fix this. I have a prototype. Not for Go 1.9 but probably for Go 1.10.

gopherbot · 2017-11-03T19:39:04Z

Change https://golang.org/cl/75850 mentions this issue: cmd/go: do not install dependencies during "go install"

It was writing to stdlib packages net, x/crypto, etc. and failing when it didn't have write access to them (which it often shouldn't) Fixes issue #941 Explained in golang issue: golang/go#18981 (fixed in develop/1.10)

This works around golang/go#18981 until that fix makes it into an official release.

This gets us a fixed 'CGO_ENABLED=0 go install' [1,2] and avoids 1.8 (which is no longer supported upstream now that 1.10 has been released [3]). I've also dropped the version information from the build comment (it's mentioned just before in the "Requirements" section) to DRY things up a bit. [1]: golang/go#18981 [2]: golang/go@8f70e1f8a91 [3]: https://golang.org/doc/devel/release.html#policy

GOBIN (documented in [1]) defaults to DIR/bin, but it's a configurable variable in its own right. The old logic was just looking at GOPATH, though, and not respecting GOBIN. This commit updates our install target to lean on Go's build caching (instead of using Make's dependency trees) to ensure a fresh-enough build lands in the appropriate directory. This approach relies on Go 1.10+ to avoid [2], but we've required Go 1.10+ since b859ebf (Documentation/development: Bump minimum Go version to 1.10, 2018-04-03, kubernetes-retired#955). For the build documentation, I've switched to 'go env GOPATH' to get the (platform-specific [1]) default value when the environment variable is not set. And I've used cut [3] (instead of the awk [4] the Makefile used to use) to pull out the first component of GOPATH. Both are in POSIX, but cut is a simpler tool for this particular problem. [1]: https://golang.org/cmd/go/#hdr-GOPATH_environment_variable [2]: golang/go#18981 [3]: http://pubs.opengroup.org/onlinepubs/9699919799/utilities/cut.html [4]: http://pubs.opengroup.org/onlinepubs/9699919799/utilities/awk.html

GOBIN (documented in [1]) defaults to DIR/bin, but it's a configurable variable in its own right. The old logic was just looking at GOPATH, though, and not respecting GOBIN. This commit updates our install target to lean on Go's build caching (instead of using Make's dependency trees) to ensure a fresh-enough build lands in the appropriate directory. This approach relies on Go 1.10+ to avoid [2], but we've required Go 1.10+ since b859ebf (Documentation/development: Bump minimum Go version to 1.10, 2018-04-03, #955). For the build documentation, I've switched to 'go env GOPATH' to get the (platform-specific [1]) default value when the environment variable is not set. And I've used cut [3] (instead of the awk [4] the Makefile used to use) to pull out the first component of GOPATH. Both are in POSIX, but cut is a simpler tool for this particular problem. [1]: https://golang.org/cmd/go/#hdr-GOPATH_environment_variable [2]: golang/go#18981 [3]: http://pubs.opengroup.org/onlinepubs/9699919799/utilities/cut.html [4]: http://pubs.opengroup.org/onlinepubs/9699919799/utilities/awk.html

glycerine changed the title ~~linux/amd64 can't build with CGO_ENABLED=0: o install net: open /usr/local/go/pkg/linux_amd64/net.a: permission denied~~ linux/amd64 can't build with CGO_ENABLED=0: go install net: open /usr/local/go/pkg/linux_amd64/net.a: permission denied Feb 7, 2017

ianlancetaylor changed the title ~~linux/amd64 can't build with CGO_ENABLED=0: go install net: open /usr/local/go/pkg/linux_amd64/net.a: permission denied~~ cmd/go: building with CGO_ENABLED=0 tries to install standard packages, which can fail Feb 7, 2017

ianlancetaylor added this to the Go1.9 milestone Feb 7, 2017

ianlancetaylor changed the title ~~cmd/go: building with CGO_ENABLED=0 tries to install standard packages, which can fail~~ cmd/go: go install with CGO_ENABLED=0 tries to install standard packages, which can fail Feb 7, 2017

mxinden mentioned this issue Mar 2, 2017

promu failing to produce static binaries prometheus/promu#60

Closed

petemoore mentioned this issue Mar 2, 2017

make rebuild no longer works taskcluster/taskcluster-worker#190

Open

stapelberg mentioned this issue Apr 16, 2017

Problem with permissions on Debian Stretch gokrazy/gokrazy#23

Closed

rsc mentioned this issue Jun 5, 2017

cmd/compile, cmd/link: support arbitrary import file map configurations #20579

Closed

rsc modified the milestones: Go1.10, Go1.9 Jun 22, 2017

benesch mentioned this issue Jul 6, 2017

cmd/go: -pkgdir doesn't respect -installsuffix or its variants #20137

Closed

ilovezfs mentioned this issue Aug 30, 2017

bin-local Makefile target is missing hashicorp/consul-template#999

Closed

Nutomic mentioned this issue Oct 12, 2017

Build Syncthing with cgo and GOOS=android syncthing/syncthing-android#873

Closed

gopherbot closed this as completed in 8f70e1f Nov 3, 2017

ethanfrey mentioned this issue Dec 8, 2017

From CGO_ENABLED=0 from make install tendermint/tendermint#942

Merged

pierrebeaucamp mentioned this issue Dec 12, 2017

Can't build Go binaries with CGO disabled NixOS/nixpkgs#32617

Closed

tbenz9 mentioned this issue Jan 4, 2018

make release-std fails NebulousLabs/Sia#2610

Closed

slackpad added a commit to hashicorp/envconsul that referenced this issue Jan 22, 2018

Removes disabling CGO for dev builds.

d2e0641

This works around golang/go#18981 until that fix makes it into an official release.

mkj28 mentioned this issue Feb 2, 2018

Install deployment dependencies when circle:deps is executed sagansystems/build-harness#70

Closed

r2d4 mentioned this issue Feb 27, 2018

make: cgo_enabled=0 on go install GoogleContainerTools/skaffold#111

Merged

wanghong230 mentioned this issue Apr 2, 2018

Build failure with "CGO_ENABLED=0" in the Makefile argoproj/argo-workflows#818

Closed

wking mentioned this issue Apr 3, 2018

Makefile: Respect GOBIN kubernetes-retired/bootkube#949

Merged

wking mentioned this issue Apr 3, 2018

Documentation/development: Bump minimum Go version to 1.10 kubernetes-retired/bootkube#955

Merged

golang locked and limited conversation to collaborators Nov 3, 2018

gopherbot added the FrozenDueToAge label Nov 3, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

cmd/go: `go install` with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

cmd/go: `go install` with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

glycerine commented Feb 7, 2017

davecheney commented Feb 7, 2017

glycerine commented Feb 7, 2017

ianlancetaylor commented Feb 7, 2017

davecheney commented Feb 7, 2017

glycerine commented Feb 7, 2017

rakyll commented Feb 7, 2017

glycerine commented Feb 7, 2017 •

edited

ianlancetaylor commented Feb 7, 2017

davecheney commented Feb 7, 2017 via email

ianlancetaylor commented Feb 7, 2017

davecheney commented Feb 7, 2017 via email

petemoore commented Mar 3, 2017

stapelberg commented Mar 18, 2017

rsc commented Jun 22, 2017

gopherbot commented Nov 3, 2017

cmd/go: go install with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

cmd/go: go install with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

Comments

glycerine commented Feb 7, 2017

What version of Go are you using (go version)?

What operating system and processor architecture are you using (go env)?

What did you do?

What did you expect to see?

What did you see instead?

davecheney commented Feb 7, 2017

glycerine commented Feb 7, 2017

ianlancetaylor commented Feb 7, 2017

davecheney commented Feb 7, 2017

glycerine commented Feb 7, 2017

rakyll commented Feb 7, 2017

glycerine commented Feb 7, 2017 • edited

ianlancetaylor commented Feb 7, 2017

davecheney commented Feb 7, 2017 via email

ianlancetaylor commented Feb 7, 2017

davecheney commented Feb 7, 2017 via email

petemoore commented Mar 3, 2017

stapelberg commented Mar 18, 2017

rsc commented Jun 22, 2017

gopherbot commented Nov 3, 2017

cmd/go: `go install` with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

cmd/go: `go install` with CGO_ENABLED=0 tries to install standard packages, which can fail #18981

What version of Go are you using (`go version`)?

What operating system and processor architecture are you using (`go env`)?

glycerine commented Feb 7, 2017 •

edited