Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

expvar: BenchmarkRealworldExpvarUsage times out on specific arm64 server #47511

Closed
erifan opened this issue Aug 3, 2021 · 10 comments
Closed

expvar: BenchmarkRealworldExpvarUsage times out on specific arm64 server #47511

erifan opened this issue Aug 3, 2021 · 10 comments
Labels
arch-arm64 FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.

Comments

@erifan
Copy link

erifan commented Aug 3, 2021

This benchmark only get stuck in one type of our arm64/linux servers with n1 cpu and many cores.

What version of Go are you using (go version)?

$ go version
go version devel go1.17-8a7ee4c51e Mon Aug 2 17:18:57 2021 +0000 linux/arm64

Does this issue reproduce with the latest release?

Yes

What operating system and processor architecture are you using (go env)?

go env Output
$ go env
GO111MODULE=""
GOARCH="arm64"
GOBIN=""
GOCACHE="/home/admin/.cache/go-build"
GOENV="/home/admin/.config/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="arm64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/home/admin/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/home/admin/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/home/admin/go-master"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/home/admin/go-master/pkg/tool/linux_arm64"
GOVCS=""
GOVERSION="devel go1.17-8a7ee4c51e Mon Aug 2 17:18:57 2021 +0000"
GCCGO="gccgo"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD="/home/admin/go-master/src/go.mod"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build2046940622=/tmp/go-build -gno-record-gcc-switches"

What did you do?

go test -bench BenchmarkRealworldExpvarUsage -count 5

What did you expect to see?

Pass

What did you see instead?

The benchmark is stuck.

Linux kernel

Linux 5.4.0-42-generic #46-Ubuntu SMP Fri Jul 10 00:24:02 UTC 2020 aarch64 aarch64 aarch64 GNU/Linux

gcc version

gcc version 9.3.0 (Ubuntu 9.3.0-17ubuntu1~20.04)

Debug with delve:

(dlv) goroutines
Goroutine 1 - User: /home/admin/go-master/src/testing/benchmark.go:284 testing.(*B).doBench (0xdf89c) [chan receive 451881h53m35.653003271s]
Goroutine 2 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [force gc (idle) 451881h53m39.747847302s]
Goroutine 3 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC sweep wait]
Goroutine 4 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC scavenge wait]
Goroutine 5 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [finalizer wait 451881h53m39.747877342s]
Goroutine 52 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747886983s]
Goroutine 53 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747895183s]
Goroutine 54 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747903383s]
Goroutine 55 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747913623s]
Goroutine 56 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747925623s]
Goroutine 57 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747933983s]
Goroutine 58 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747942263s]
Goroutine 59 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747951704s]
Goroutine 60 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747961824s]
Goroutine 61 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747970264s]
Goroutine 62 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747979704s]
Goroutine 63 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747991544s]
Goroutine 64 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.747999904s]
Goroutine 65 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748008384s]
Goroutine 66 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748023545s]
Goroutine 67 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748032265s]
Goroutine 68 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748061625s]
Goroutine 69 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748070545s]
Goroutine 70 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748078385s]
Goroutine 71 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748086826s]
Goroutine 72 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748097186s]
Goroutine 73 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748106586s]
Goroutine 74 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748116626s]
Goroutine 75 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748125946s]
Goroutine 76 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748134306s]
Goroutine 77 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748144986s]
Goroutine 78 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748154827s]
Goroutine 79 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748165027s]
Goroutine 80 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748174827s]
Goroutine 81 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748184147s]
Goroutine 82 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748193947s]
Goroutine 83 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748202787s]
Goroutine 84 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748212027s]
Goroutine 85 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748221588s]
Goroutine 86 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748232188s]
Goroutine 87 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748244028s]
Goroutine 88 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748252228s]
Goroutine 89 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748260308s]
Goroutine 90 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748269828s]
Goroutine 91 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748279348s]
Goroutine 92 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748289989s]
Goroutine 93 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748300709s]
Goroutine 94 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748310549s]
Goroutine 95 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748318669s]
Goroutine 96 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748326509s]
Goroutine 97 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 98 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748345669s]
Goroutine 99 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74835567s]
Goroutine 100 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74836411s]
Goroutine 101 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74837199s]
Goroutine 102 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74838067s]
Goroutine 103 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74839023s]
Goroutine 104 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74839907s]
Goroutine 105 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74840859s]
Goroutine 106 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74841655s]
Goroutine 107 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748423871s]
Goroutine 108 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748432151s]
Goroutine 109 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748440551s]
Goroutine 110 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748449031s]
Goroutine 111 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748457191s]
Goroutine 112 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748465551s]
Goroutine 113 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748474391s]
Goroutine 114 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748485111s]
Goroutine 115 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748493592s]
Goroutine 116 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748502192s]
Goroutine 117 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748511592s]
Goroutine 118 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748520192s]
Goroutine 119 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748530632s]
Goroutine 120 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748540752s]
Goroutine 121 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748550832s]
Goroutine 122 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748560273s]
Goroutine 123 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748570913s]
Goroutine 124 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748579593s]
Goroutine 125 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748588073s]
Goroutine 126 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748597713s]
Goroutine 127 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748608273s]
Goroutine 128 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748617753s]
Goroutine 129 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748630874s]
Goroutine 130 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748640954s]
Goroutine 131 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748650394s]
Goroutine 132 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748660274s]
Goroutine 133 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748669994s]
Goroutine 134 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748680314s]
Goroutine 135 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748693915s]
Goroutine 136 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748702435s]
Goroutine 137 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748710915s]
Goroutine 138 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748720075s]
Goroutine 139 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748730115s]
Goroutine 146 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748740875s]
Goroutine 147 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748751075s]
Goroutine 148 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748760156s]
Goroutine 149 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748768356s]
Goroutine 150 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748778196s]
Goroutine 151 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748788436s]
Goroutine 152 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748798476s]
Goroutine 153 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748808636s]
Goroutine 154 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748818556s]
Goroutine 155 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748827637s]
Goroutine 156 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748838517s]
Goroutine 157 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748848757s]
Goroutine 158 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748859077s]
Goroutine 159 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748869117s]
Goroutine 160 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 161 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627432639s]
Goroutine 162 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748898598s]
Goroutine 163 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748908478s]
Goroutine 164 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748918318s]
Goroutine 165 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748927558s]
Goroutine 166 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748937438s]
Goroutine 167 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.748945398s]
Goroutine 168 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 169 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 170 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627519241s]
Goroutine 171 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 172 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 173 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 174 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 175 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 178 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74902396s]
Goroutine 179 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m39.74903464s]
Goroutine 180 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 181 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 182 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627607802s]
Goroutine 183 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 184 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627626442s]
Goroutine 185 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 186 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.600443748s]
Goroutine 187 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.600454228s]
Goroutine 188 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 189 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 190 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.600479148s]
Goroutine 191 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 194 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.600496028s]
Goroutine 195 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 196 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627716044s]
Goroutine 197 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627723444s]
Goroutine 198 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 199 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 200 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 201 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 202 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 203 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 204 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 205 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 206 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 207 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 208 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 209 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 210 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627831965s]
Goroutine 211 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 212 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 213 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.654495733s]
Goroutine 214 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 215 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 216 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627880726s]
Goroutine 217 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 226 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.627897966s]
Goroutine 227 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle) 451881h53m35.654545534s]
Goroutine 228 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 229 - User: /home/admin/go-master/src/runtime/proc.go:367 runtime.gopark (0x4b52c) [GC worker (idle)]
Goroutine 4162 - User: /home/admin/go-master/src/runtime/sema.go:56 sync.runtime_Semacquire (0x79b58) [semacquire]
Goroutine 5978 - User: /home/admin/go-master/src/runtime/netpoll.go:229 internal/poll.runtime_pollWait (0x782e4) [IO wait]
[167 goroutines]
(dlv) goroutine 5978
Switched from 0 to 5978 (thread 3744652)
(dlv) bt
0 0x000000000004b52c in runtime.gopark
at /home/admin/go-master/src/runtime/proc.go:367
1 0x0000000000043568 in runtime.netpollblock
at /home/admin/go-master/src/runtime/netpoll.go:445
2 0x00000000000782e4 in internal/poll.runtime_pollWait
at /home/admin/go-master/src/runtime/netpoll.go:229
3 0x00000000000a13f8 in internal/poll.(*pollDesc).wait
at /home/admin/go-master/src/internal/poll/fd_poll_runtime.go:84
4 0x00000000000a1cc4 in internal/poll.(*pollDesc).waitRead
at /home/admin/go-master/src/internal/poll/fd_poll_runtime.go:89
5 0x00000000000a1cc4 in internal/poll.(*FD).Read
at /home/admin/go-master/src/internal/poll/fd_unix.go:167
6 0x0000000000160014 in net.(*netFD).Read
at /home/admin/go-master/src/net/fd_posix.go:56
7 0x000000000016ad5c in net.(*conn).Read
at /home/admin/go-master/src/net/net.go:183
8 0x00000000001a2008 in expvar.BenchmarkRealworldExpvarUsage.func5
at ./expvar_test.go:588
9 0x000000000007d0c4 in runtime.goexit
at /home/admin/go-master/src/runtime/asm_arm64.s:1133
@erifan
Copy link
Author

erifan commented Aug 3, 2021

If I set GOMAXPROCS to 1, the benchmark passes.

@seankhliao seankhliao added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. Testing An issue that has been verified to require only test changes, not just a test failure. labels Aug 3, 2021
@seankhliao
Copy link
Member

cc @bradfitz

@bcmills
Copy link
Contributor

bcmills commented Aug 3, 2021 •
edited

The goroutines wedged in GC worker (idle) look a lot like #47505.

@bcmills bcmills added arch-arm64 and removed Testing An issue that has been verified to require only test changes, not just a test failure. labels Aug 3, 2021
@bcmills
Copy link
Contributor

bcmills commented Aug 3, 2021

Is this a regression in Go 1.17, or does this test also wedge on the latest Go 1.16 release?

@seankhliao

This comment has been minimized.

Sign in to view
@bcmills

This comment has been minimized.

Sign in to view
@erifan
Copy link
Author

erifan commented Aug 4, 2021

Is this a regression in Go 1.17, or does this test also wedge on the latest Go 1.16 release?

I just tried Go 1.16.6, the answer is yes.

@bcmills
Copy link
Contributor

bcmills commented Aug 4, 2021

Yes it's a regression, or yes it reproduces on 1.16.6? 😅

@erifan
Copy link
Author

erifan commented Aug 4, 2021

Yes it's a regression, or yes it reproduces on 1.16.6? 😅

Sorry for the confusion, it reproduces on 1.16.6.

@erifan
Copy link
Author

erifan commented Mar 24, 2022

After verification, this problem has disappeared, so close this issue.

@erifan erifan closed this as completed Mar 24, 2022
@golang golang locked and limited conversation to collaborators Mar 24, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
arch-arm64 FrozenDueToAge NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@bcmills @gopherbot @seankhliao @erifan