cmd/go: "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7. #38373

dhowell66 · 2020-04-11T02:22:36Z

What version of Go are you using (`go version`)?

$ go version
go version go1.13.6 linux/amd64

Does this issue reproduce with the latest release?

Not sure, but this is the latest supported version for CentOS 7.

What operating system and processor architecture are you using (`go env`)?

CentOS 7.

go env Output

$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/users/d00u3151/.cache/go-build"
GOENV="/users/d00u3151/.config/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/users/d00u3151/go"
GOPRIVATE=""
GOPROXY="direct"
GOROOT="/usr/lib/golang"
GOSUMDB="off"
GOTMPDIR=""
GOTOOLDIR="/usr/lib/golang/pkg/tool/linux_amd64"
GCCGO="gccgo"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/users/d00u3151/tmp/go-build945266341=/tmp/go-build -gno-record-gcc-switches"
[d00u3151@pde-bsp3hq2 dan]$

What did you do?

Tried to build the latest unreleased version of reposurgeon (problem does not occur with reposurgeon release 4.5).

$ git clone https://gitlab.com/esr/reposurgeon.git
Cloning into 'reposurgeon'...
remote: Enumerating objects: 1203, done.
remote: Counting objects: 100% (1203/1203), done.
remote: Compressing objects: 100% (456/456), done.
remote: Total 33416 (delta 890), reused 1009 (delta 739), pack-reused 32213
Receiving objects: 100% (33416/33416), 550.06 MiB | 11.28 MiB/s, done.
Resolving deltas: 100% (22980/22980), done.
$ cd reposurgeon
$ git checkout -q b392d176f30825d150b828c4df3d2d8e2b3166f7 # version as of April 10, 2020
$ make
asciidoctor -a nofooter -b manpage reposurgeon.adoc
asciidoctor -a nofooter -b manpage repocutter.adoc
asciidoctor -a nofooter -b manpage repomapper.adoc
asciidoctor -a nofooter -b manpage repotool.adoc
asciidoctor -a nofooter -b manpage repobench.adoc
asciidoctor -a webfonts! reposurgeon.adoc
asciidoctor -a webfonts! repocutter.adoc
asciidoctor -a webfonts! repomapper.adoc
asciidoctor -a webfonts! repotool.adoc
asciidoctor -a webfonts! repobench.adoc
asciidoctor -a webfonts! repository-editing.adoc
go build -gcflags '-N -l' -o repocutter ./cutter
go: github.com/go-delve/delve@v1.4.0 requires
        github.com/sirupsen/logrus@v0.0.0-20180523074243-ea8897e79973: invalid version: git fetch --unshallow -f origin in /users/d00u3151/go/pkg/mod/cache/vcs/020616345f7c7f88438c217f9d0e26744bce721c80e4a28f93399a8a4cd2acf1: exit status 128:
        fatal: git fetch-pack: expected shallow list
make: *** [build] Error 1
$ make
go build -gcflags '-N -l' -o repocutter ./cutter
go: github.com/go-delve/delve@v1.4.0 requires
        golang.org/x/arch@v0.0.0-20190927153633-4e8777c89be4: invalid version: git fetch --unshallow -f https://go.googlesource.com/arch in /users/d00u3151/go/pkg/mod/cache/vcs/a260a67b53c91dca287c34ff2bdee130be447c2ea411a64bf4489a69e886411b: exit status 128:
        fatal: git fetch-pack: expected shallow list
make: *** [build] Error 1

What did you expect to see?

A successful build.

What did you see instead?

A cryptic error message.

This seems to occur when multiple versions of the same package are required. In this case, the go.mod contains golang.org/x/arch v0.0.0-20200312215426-ff8b605520f4 and github.com/go-delve/delve v1.4.0, but delve v1.4.0 has a dependency on: golang.org/x/arch@v0.0.0-20190927153633-4e8777c89be4. It seems that trying to get the earlier version of arch when the later version has already been retrieved causes this error message.

In this case I was able to work around and successfully build by removing the reference to the later version of arch from go.mod.

The text was updated successfully, but these errors were encountered:

seankhliao · 2020-04-11T02:36:51Z

this looks like the git command being too old to support shallow, solutions would be to upgrade git and/or enable the module proxy so git is no longer necessary

dhowell66 · 2020-04-11T02:53:28Z

Also, see reposurgeon bug #272: https://gitlab.com/esr/reposurgeon/-/issues/272

dhowell66 · 2020-04-11T02:59:50Z

Strange thing is if I manually create a shallow clone, git fetch --unshallow works fine. I'm not sure what is different about the shallow clones that go retrieves vs. the following:

$ git version
git version 1.8.3.1
$ git clone --depth 1 --bare https://go.googlesource.com/arch
Cloning into bare repository 'arch.git'...
remote: Counting objects: 144, done
remote: Finding sources: 100% (144/144)
remote: Total 144 (delta 11), reused 129 (delta 11)
Receiving objects: 100% (144/144), 768.76 KiB | 0 bytes/s, done.
Resolving deltas: 100% (11/11), done.
$ cd arch.git
$ git log --all --oneline
ff8b605 vendor: delete
$ git fetch --unshallow -f https://go.googlesource.com/arch
remote: Total 614 (delta 228), reused 614 (delta 228)
Receiving objects: 100% (614/614), 1.47 MiB | 0 bytes/s, done.
Resolving deltas: 100% (228/228), done.
From https://go.googlesource.com/arch
 * branch            HEAD       -> FETCH_HEAD
$ git log --all --oneline
ff8b605 vendor: delete
69f17b2 vendor: migrate from govendor to go mod vendor
368ea8f x86asm: add support for FLDZ and FLDLN2
a0d8588 arm64/arm64asm: rename NOP instruction as NOOP in go syntax
4e8777c arm64/arm64gen: get system register readable and writeable attribute
1137aed arm64/arm64gen: adds a generator sysreggen.go
[...snip...]

bcmills · 2020-04-11T03:00:01Z

See also #26746 and #29114.

bcmills · 2020-04-11T03:02:31Z

Also, old git clients have a bug for which the cmd/go workaround (#34092) has probably not been backported. You may need to upgrade to Go 1.14.1 if you are affected.

dhowell66 · 2020-04-11T06:38:19Z

FYI, previous issues mentioned problems on CentOS 5 & CentOS 6. CentOS 5 is no longer supported, and CentOS 6 is reaching end-of-life later this year, but CentOS 7 is being supported until 2024.

dolph · 2020-04-29T03:23:06Z

I just ran into this issue on CentOS 7.8 (released September 24, 2019), with golang and git both installed via yum (from CentOS repos).

go version go1.13.6 linux/ppc64le
git version 1.8.3.1

I resolved this by uninstalling go 1.13.6 via yum and installing go 1.14.2 from https://golang.org/dl/

nilfdev · 2020-05-01T19:43:44Z

Faced with the same issues go version and git version are the same,
after second run error is the next

env GO111MODULE=on go run build/ci.go install ./cmd/geth
build command-line-arguments: cannot load golang_org/x/crypto/chacha20poly1305: cannot find module providing package golang_org/x/crypto/chacha20poly1305
make: *** [geth] Error 1

dfedorov-ciena · 2020-05-27T17:35:35Z

Same issue here, same solution: remove EPEL's go 1.13 and install 1.14 directly from the vendor:

yum remove golang-bin
wget https://dl.google.com/go/go1.14.3.linux-amd64.tar.gz
etc.

siscia · 2020-07-09T10:26:59Z

Same issue!

Unfortunately old platforms (and BTW Centos7 is not THAT old) are still vital in enterprise environment where stability is required, the suggestion to update git is a valid one but it really hamper down the velocity and ergonomics of go.

jgallucci32 · 2020-10-01T04:41:45Z

We have had similar issues running Bitbucket on RHEL7 in production needing a later version of the Git client. We have always found the IUS version to be very stable for production. Go to https://repo.ius.io/ to learn more.

Here are the basic steps to get the newer version of Git on Centos7/RHEL7:

yum -y erase git
yum -y install https://repo.ius.io/ius-release-el7.rpm
yum -y install git222

After updating to Git 2.2.2 the go get commands were successful.

golang/go#38373

ghost · 2021-03-02T07:03:42Z

I ran into the same error on OEL7 (RHEL-based) with git 2.24.0 and go 1.15.2.

The error I ran into resulted from the gh cli installer. I ran sudo make install initially, which resulted in the error.

To fix it, I then ran:

make install (permission denied error)
sudo make install again (finally successful)

Looks like it's possible related to sudo as well.

…HEL 7 Our Dockerfile uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches the scan plugin script to use the default GOPROXY so that git is not required for downloading the modules. Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Sebastiaan van Stijn <github@gone.nl>

…HEL 7 Our Dockerfile uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches the scan plugin script to use a proxy so that git is not required for downloading the modules Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Sebastiaan van Stijn <github@gone.nl>

…HEL 7 Our Dockerfile uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches scan install script to set GOPROXY to https://proxy.golang.org so that git is not required for downloading modules. Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Sebastiaan van Stijn <github@gone.nl>

… CentOS/RHEL 7 Since rootlesskit removed vendor folder, building it has to rely on go mod. Dockerfile in docker-ce-packaging uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches rootlesskit install script to set GOPROXY to https://proxy.golang.org so that git is not required for downloading modules. Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Tibor Vass <tibor@docker.com>

… CentOS/RHEL 7 Since rootlesskit removed vendor folder, building it has to rely on go mod. Dockerfile in docker-ce-packaging uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches rootlesskit install script to set GOPROXY to https://proxy.golang.org so that git is not required for downloading modules. Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Tibor Vass <tibor@docker.com> (cherry picked from commit cbc6cef) Signed-off-by: Sebastiaan van Stijn <github@gone.nl>

… CentOS/RHEL 7 Since rootlesskit removed vendor folder, building it has to rely on go mod. Dockerfile in docker-ce-packaging uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches rootlesskit install script to set GOPROXY to https://proxy.golang.org so that git is not required for downloading modules. Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Tibor Vass <tibor@docker.com> Upstream-commit: cbc6cefdcbe8b7ab66571407ee0b3c39f1e7a96b Component: engine

… CentOS/RHEL 7 Since rootlesskit removed vendor folder, building it has to rely on go mod. Dockerfile in docker-ce-packaging uses GOPROXY=direct, which makes "go mod" commands use git to fetch modules. "go mod" in Go versions before 1.14.1 are incompatible with older git versions, including the version of git that ships with CentOS/RHEL 7 (which have git 1.8), see golang/go#38373 This patch switches rootlesskit install script to set GOPROXY to https://proxy.golang.org so that git is not required for downloading modules. Once all our code has upgraded to Go 1.14+, this workaround should be removed. Signed-off-by: Tibor Vass <tibor@docker.com> (cherry picked from commit cbc6cef) Signed-off-by: Sebastiaan van Stijn <github@gone.nl>

On CentOS 7, the available version of git and/or go is too old and has an issue when running `go get`: git fetch-pack: expected shallow list By setting GOPROXY, git isn't required for `go get` and solves this issue. See golang/go#38373 for more details.

.)

bcmills · 2022-02-24T16:00:38Z

Given that we still don't have a CentOS 7 builder (#29114 has been open without activity since Dec. 2018), I don't have the ability to easily test a fix for this issue. If you'd like to contribute a fix (with a regression test in cmd/go/testdata/script) I'd be happy to review it.

bcmills changed the title ~~Error "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7.~~ cmd/go: "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7. Apr 11, 2020

bcmills added this to the Unplanned milestone Apr 11, 2020

bcmills added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. modules labels Apr 11, 2020

bmeng mentioned this issue Jun 5, 2020

add --wide option to print console url to the list openshift-online/ocm-cli#77

Closed

vangent mentioned this issue Jul 6, 2020

The golang.org/x/mod package/dependency triggers Git "invalid version" error in v0.20.0 release. google/go-cloud#2833

Closed

awehrfritz mentioned this issue Aug 28, 2020

zrepl v0.3.0 build fails on CentOS 7 zrepl/zrepl#367

Closed

jharting added a commit to RedHatInsights/cyndi-operator that referenced this issue Nov 4, 2020

perhaps getting closer?

7e66a82

golang/go#38373

gtardif mentioned this issue Mar 23, 2021

Scan plugin docker/docker-ce-packaging#528

Closed

tiborvass mentioned this issue Mar 23, 2021

hack: use GOPROXY for rootlesskit to workaround issue with old git on CentOS/RHEL 7 moby/moby#42192

Merged

thaJeztah mentioned this issue Mar 24, 2021

[20.10 backport] hack: use GOPROXY for rootlesskit to workaround issue with old git on CentOS/RHEL 7 moby/moby#42194

Merged

sriramNV mentioned this issue Jul 9, 2021

fatal: git fetch-pack: expected shallow list temporalio/money-transfer-project-template-go#3

Closed

R0Z-Z mentioned this issue Aug 14, 2021

Problem with compiling. invalid pseudo-version, fatal: git fetch-pack: expected shallow list strukturag/nextcloud-spreed-signaling#145

Closed

This was referenced Sep 6, 2021

[master] add docker-compose-plugin package (deb, rpm) docker/docker-ce-packaging#553

Merged

Add workaround for CentOS 7 not working without GOPROXY docker/docker-ce-packaging#577

Merged

jonasvinther mentioned this issue Sep 16, 2021

build error after initial clone jonasvinther/medusa#57

Closed

oliver006 mentioned this issue Oct 14, 2021

Centos 7 Install Issue oliver006/redis_exporter#552

Closed

rawlinp mentioned this issue Feb 1, 2022

CIAB: set GOPROXY to use go module mirror for CentOS 7 apache/trafficcontrol#6534

Merged

4 tasks

mfeit-internet2 added a commit to perfsonar/pscheduler that referenced this issue Feb 3, 2022

Use Golang.org's proxy for fetching modules. (See golang/go/issues/38373

d8fc169

.)

dmitshur mentioned this issue Feb 18, 2022

cmd/go: git revision information stamping on CentOS 7 fails with Go 1.18rc1: error obtaining VCS status: exit status 128 #51253

Closed

ALTree mentioned this issue Mar 7, 2022

cmd/go: go mod download seems now incompatible with git version 1 #51529

Closed

bnfinet mentioned this issue Mar 17, 2022

cannot load embed while compiling vouch/vouch-proxy#465

Closed

aspirer mentioned this issue Mar 22, 2022

curveadm: build failed on CentOS7 opencurve/curveadm#86

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

cmd/go: "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7. #38373

cmd/go: "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7. #38373

dhowell66 commented Apr 11, 2020

seankhliao commented Apr 11, 2020

dhowell66 commented Apr 11, 2020

dhowell66 commented Apr 11, 2020

bcmills commented Apr 11, 2020

bcmills commented Apr 11, 2020 •

edited

dhowell66 commented Apr 11, 2020

dolph commented Apr 29, 2020 •

edited

nilfdev commented May 1, 2020

dfedorov-ciena commented May 27, 2020 •

edited

siscia commented Jul 9, 2020

jgallucci32 commented Oct 1, 2020

ghost commented Mar 2, 2021

bcmills commented Feb 24, 2022

cmd/go: "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7. #38373

cmd/go: "fatal: git fetch-pack: expected shallow list" when retrieving earlier version of already installed package on CentOS 7. #38373

Comments

dhowell66 commented Apr 11, 2020

What version of Go are you using (go version)?

Does this issue reproduce with the latest release?

What operating system and processor architecture are you using (go env)?

What did you do?

What did you expect to see?

What did you see instead?

seankhliao commented Apr 11, 2020

dhowell66 commented Apr 11, 2020

dhowell66 commented Apr 11, 2020

bcmills commented Apr 11, 2020

bcmills commented Apr 11, 2020 • edited

dhowell66 commented Apr 11, 2020

dolph commented Apr 29, 2020 • edited

nilfdev commented May 1, 2020

dfedorov-ciena commented May 27, 2020 • edited

siscia commented Jul 9, 2020

jgallucci32 commented Oct 1, 2020

ghost commented Mar 2, 2021

bcmills commented Feb 24, 2022

What version of Go are you using (`go version`)?

What operating system and processor architecture are you using (`go env`)?

bcmills commented Apr 11, 2020 •

edited

dolph commented Apr 29, 2020 •

edited

dfedorov-ciena commented May 27, 2020 •

edited