Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/tools/gopls: set a deadline on go list call in the initial workspace load #42132

Closed
matthewmueller opened this issue Oct 21, 2020 · 5 comments
Closed

x/tools/gopls: set a deadline on go list call in the initial workspace load #42132

matthewmueller opened this issue Oct 21, 2020 · 5 comments
Labels
FrozenDueToAge gopls Issues related to the Go language server, gopls. Tools This label describes issues relating to any tools in the x/tools repository.
Milestone
gopls/v0.5.3

Comments

@matthewmueller
Copy link

matthewmueller commented Oct 21, 2020 •
edited

What version of Go are you using (go version)?

$ go version
go version go1.15 darwin/amd64

$ gopls version
golang.org/x/tools/gopls v0.5.1
    golang.org/x/tools/gopls@v0.5.1 h1:AF3Uh7HF08SZpKFfgJO6zfF3bbxyDXWqdkK4kMXiQ1o=

What operating system and processor architecture are you using (go env)?

go env Output
$ go env
GO111MODULE="on"
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/m/Library/Caches/go-build"
GOENV="/Users/m/Library/Application Support/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GOMODCACHE="/Users/m/Go/pkg/mod"
GONOPROXY=""
GONOSUMDB="github.com/matthewmueller"
GOOS="darwin"
GOPATH="/Users/m/Go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/darwin_amd64"
GCCGO="gccgo"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/dev/null"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/4f/tcxcr6_55v9bp38d8g4hjlf80000gn/T/go-build388962724=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?

100% CPU utilization on go list.

CleanShot 2020-10-21 at 22 48 31@2x

Here's the command that's running:

m                11926 100.0  0.0  5084696     24   ??  R    10:58PM 790:42.08 go list -modfile=/var/folders/4f/tcxcr6_55v9bp38d8g4hjlf80000gn/T/go.81d65b897d3d2041650a7b316bfe7936e665c0667228e1aea9664629dbcc4506.974007766.mod -e -json -compiled=true -test=true -export=false -deps=true -find=false -modfile=/var/folders/4f/tcxcr6_55v9bp38d8g4hjlf80000gn/T/go.81d65b897d3d2041650a7b316bfe7936e665c0667228e1aea9664629dbcc4506.974007766.mod -- github.com/matthewmueller/mat.tm/duo/cli

It seems like go list is stuck trying to list a package that no longer exists.

Roughly the steps I took:

  1. I had a directory called command: github.com/matthewmueller/mat.tm/duo/command
  2. Renamed the directory from command to cli: github.com/matthewmueller/mat.tm/duo/cli
  3. Changes all the package names from command to cli
  4. Realized that was a dumb idea, changed all the packages back to command
  5. Renamed the directory from cli back to command.
  6. Noticed about an hour later that my CPU usage was at 100%.

Unfortunately, I don't have the gopls logs as far as I know. I closed VSCode in an effort to bring down CPU usage.
@gopherbot gopherbot added Tools This label describes issues relating to any tools in the x/tools repository. gopls Issues related to the Go language server, gopls. labels Oct 21, 2020
@gopherbot gopherbot added this to the Unreleased milestone Oct 21, 2020
@matthewmueller matthewmueller mentioned this issue Oct 21, 2020
Closed
@heschi
Copy link
Contributor

heschi commented Oct 22, 2020

stamblerre:

@heschik: I believe you had previously looked into these issues (and resolved them with the gocommand package). Do you think it's possible that go list could hang for an hour for a nonexistent package?

This is clearly a go command bug, perhaps caused by the filesystem changing during a list run. I think you're asking if it could hang hitting the network, but I don't think so, and even if it did it would not use 100% cpu to do it.

The fact that gopls hasn't killed it suggests that whatever triggered the load was running detached, e.g. the IWL. Perhaps we should set a deadline of last resort like 5 minutes?

@stamblerre
Copy link
Contributor

A deadline seems like a good idea--maybe we could add it as an experimental setting.

@matthewmueller
Copy link
Author

matthewmueller commented Oct 23, 2020 •
edited

Throwing this out there naively: could go list be used programmatically to avoid dealing with process lifecycles and cleanup?

@stamblerre
Copy link
Contributor

Unfortunately not--gopls needs to use the version of go that the user is currently using, not the version with which gopls was compiled.

@heschi heschi mentioned this issue Oct 28, 2020
Closed
@stamblerre stamblerre mentioned this issue Oct 28, 2020
Closed
@stamblerre stamblerre changed the title x/tools/gopls: go list causes 100% CPU load x/tools/gopls: set a deadline on go list call in the initial workspace load Oct 30, 2020
@stamblerre stamblerre self-assigned this Oct 30, 2020
@gopherbot
Copy link

Change https://golang.org/cl/266478 mentions this issue: internal/lsp/cache: set a 15 minute deadline on calls to packages.Load

@golang golang locked and limited conversation to collaborators Nov 2, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
FrozenDueToAge gopls Issues related to the Go language server, gopls. Tools This label describes issues relating to any tools in the x/tools repository.
Projects
None yet
Milestone
gopls/v0.5.3
Development

No branches or pull requests
4 participants
@matthewmueller @stamblerre @gopherbot @heschi