Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SIGILL: illegal instruction on CentOS7 #33407

Closed
hafeidejiangyou opened this issue Aug 1, 2019 · 5 comments
Closed

SIGILL: illegal instruction on CentOS7 #33407

hafeidejiangyou opened this issue Aug 1, 2019 · 5 comments
Labels
FrozenDueToAge WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.

Comments

@hafeidejiangyou
Copy link

hafeidejiangyou commented Aug 1, 2019

What version of Go are you using (go version)?

$ go version
go version go1.12.7 linux/amd64

Does this issue reproduce with the latest release?

Yes

What operating system and processor architecture are you using (go env)?

$ go env

GOARCH="amd64"
GOBIN=""
GOCACHE="/root/.cache/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GOPATH="/var/go"
GOPROXY=""
GORACE=""
GOROOT="/usr/local/go"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build858118075=/tmp/go-build -gno-record-gcc-switches"

cpuinfo:

processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 85 model name : Intel(R) Xeon(R) Gold 6161 CPU @ 2.20GHz stepping : 4 microcode : 0x1 cpu MHz : 2200.000 cache size : 30976 KB physical id : 0 siblings : 4 core id : 0 cpu cores : 2 apicid : 0 initial apicid : 0 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology nonstop_tsc eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 arat spec_ctrl intel_stibp bogomips : 4400.00 clflush size : 64 cache_alignment : 64 address sizes : 42 bits physical, 48 bits virtual power management: processor : 1 vendor_id : GenuineIntel cpu family : 6 model : 85 model name : Intel(R) Xeon(R) Gold 6161 CPU @ 2.20GHz stepping : 4 microcode : 0x1 cpu MHz : 2200.000 cache size : 30976 KB physical id : 0 siblings : 4 core id : 0 cpu cores : 2 apicid : 1 initial apicid : 1 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology nonstop_tsc eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 arat spec_ctrl intel_stibp bogomips : 4400.00 clflush size : 64 cache_alignment : 64 address sizes : 42 bits physical, 48 bits virtual power management: processor : 2 vendor_id : GenuineIntel cpu family : 6 model : 85 model name : Intel(R) Xeon(R) Gold 6161 CPU @ 2.20GHz stepping : 4 microcode : 0x1 cpu MHz : 2200.000 cache size : 30976 KB physical id : 0 siblings : 4 core id : 1 cpu cores : 2 apicid : 2 initial apicid : 2 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology nonstop_tsc eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 arat spec_ctrl intel_stibp bogomips : 4400.00 clflush size : 64 cache_alignment : 64 address sizes : 42 bits physical, 48 bits virtual power management: processor : 3 vendor_id : GenuineIntel cpu family : 6 model : 85 model name : Intel(R) Xeon(R) Gold 6161 CPU @ 2.20GHz stepping : 4 microcode : 0x1 cpu MHz : 2200.000 cache size : 30976 KB physical id : 0 siblings : 4 core id : 1 cpu cores : 2 apicid : 3 initial apicid : 3 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology nonstop_tsc eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 arat spec_ctrl intel_stibp bogomips : 4400.00 clflush size : 64 cache_alignment : 64 address sizes : 42 bits physical, 48 bits virtual power management:

What did you do?

I use CGO, the call path is Go -> C -> Java -> C -> Go, and every time I run the program, it will be panic while several calls or after a while,and every time the panic message is different, such as SIGILL: illegal instruction, runtime: unexpected return pc for runtime.selectgo called from 0x0, runtime: unexpected return pc for runtime.gopark called from 0x202 , runtime: unexpected return pc for runtime.chanrecv1 called from 0x37f and so on. For example:

SIGILL: illegal instruction PC=0x2347005 m=9 sigcode=2 goroutine 156 [running]: runtime: unknown pc 0x2347005 stack: frame={sp:0x7f5d1d18edf0, fp:0x0} stack=[0xc0000e6000,0xc0000e7000) runtime: unknown pc 0x2347005 stack: frame={sp:0x7f5d1d18edf0, fp:0x0} stack=[0xc0000e6000,0xc0000e7000) created by github.com/hyperchain/hyperchain/manager.(*EventHub).Start /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:203 +0x85 goroutine 1 [select, 11 minutes]: main.run(0xc00027cdc0, 0xc00011cb80) /var/go/src/github.com/hyperchain/hyperchain/main.go:190 +0xd4 main.main.func1(0xc0001b4fd0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/main.go:177 +0x2c5 github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli.(*Command).RunWith(0xc0001b3c20, 0xc00003c1d0, 0x0, 0x0, 0x197d580, 0xc000010018, 0x0, 0x0, 0x0, 0x0, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli/command.go:205 +0x262 github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli.(*Command).Run(...) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli/command.go:162 github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli.RunWithArgs(0x152e920, 0xc00011cb80, 0xc00003c1d0, 0x1, 0x1, 0x1796c80, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli/cli.go:30 +0x1a0 github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli.Run(...) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/mkideal/cli/cli.go:15 main.main() /var/go/src/github.com/hyperchain/hyperchain/main.go:122 +0x7f goroutine 41 [syscall, 11 minutes]: os/signal.signal_recv(0x48eec6) /usr/local/go/src/runtime/sigqueue.go:139 +0x9c os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x22 created by os/signal.init.0 /usr/local/go/src/os/signal/signal_unix.go:29 +0x41 goroutine 46 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0001c8e00) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x110 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newCCBalancerWrapper /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x14f goroutine 66 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000448000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:1040 +0x5a1 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).connect /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:700 +0xb6 goroutine 57 [sleep, 11 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:307 time.Sleep(0x191a5bccea00) /usr/local/go/src/runtime/time.go:105 +0x159 github.com/hyperchain/hyperchain/common.(*HyperLogger).newLogFileByInterval(0xc0000bf440, 0xc000309a70) /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:315 +0x50e created by github.com/hyperchain/hyperchain/common.(*HyperLogger).init /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:167 +0x276 goroutine 58 [select, 1 minutes]: github.com/hyperchain/hyperchain/common.(*HyperLogger).newLogFileBySize(0xc0000bf440, 0xc000309a70) /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:342 +0x21f created by github.com/hyperchain/hyperchain/common.(*HyperLogger).init /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:168 +0x2a5 goroutine 59 [chan receive]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*HyperNet).retry.func1(0xc0002dfad0, 0xc0002dfad0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/hypernet.go:366 +0x3ab created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*HyperNet).retry /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/hypernet.go:363 +0xde goroutine 60 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008fd0, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc00011d318, 0x72, 0x0, 0x0, 0x16fd31b) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Accept(0xc00011d300, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1ba net.(*netFD).accept(0xc00011d300, 0xc00790bc01, 0x0, 0x0) /usr/local/go/src/net/fd_unix.go:238 +0x42 net.(*TCPListener).accept(0xc0000109c0, 0xc0000e8ec0, 0xc0000e8ec8, 0x18) /usr/local/go/src/net/tcpsock_posix.go:139 +0x32 net.(*TCPListener).Accept(0xc0000109c0, 0x1796738, 0xc000240f00, 0x19b48e0, 0xc00790bc00) /usr/local/go/src/net/tcpsock.go:260 +0x48 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).Serve(0xc000240f00, 0x199eb20, 0xc0000109c0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:561 +0x1e9 created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Server).StartServer /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/server.go:48 +0x198 goroutine 88645 [select, 3 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc009b48480) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:935 +0x1ed created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:282 +0xfdf goroutine 98 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000316bc0, 0x1, 0x0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000401080, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0000f1500) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xeb2 goroutine 47 [select]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).produceTimeTick(0xc0001c49a0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:274 +0x10f created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).initState /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:56 +0x46e goroutine 178 [syscall, 3 minutes]: syscall.Syscall6(0xe8, 0x31, 0xc000a7bd14, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x2, 0xc00af4f920, 0x0) /usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5 github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix.EpollWait(0x31, 0xc000a7bd14, 0x7, 0x7, 0xffffffffffffffff, 0xc00af4f920, 0xc000a7bdf4, 0x19af000) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1692 +0x72 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0004f0020, 0xc000a7bd00, 0x2, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc000198230) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x18a created by github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.NewWatcher /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:61 +0x1e2 goroutine 49 [chan receive]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).working.func2(0xc0001c49a0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:100 +0x104 created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).working /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:96 +0x61 goroutine 70 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008f00, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc000464118, 0x72, 0x800, 0x800, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc000464100, 0xc00ffb2800, 0x800, 0x800, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc000464100, 0xc00ffb2800, 0x800, 0x800, 0x43a8ac, 0xc000032000, 0x1560cc0) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc000460008, 0xc00ffb2800, 0x800, 0x800, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 github.com/hyperchain/hyperchain/crypto/tls.(*block).readFromUntil(0xc00044a1b0, 0x197d1a0, 0xc000460008, 0x5, 0xc000460008, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:492 +0x86 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).readRecord(0xc000470000, 0x1797617, 0xc000470120, 0x20) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:593 +0xd8 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).Read(0xc000470000, 0xc0004b0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:1145 +0xf1 bufio.(*Reader).Read(0xc000458420, 0xc000498118, 0x9, 0x9, 0xae707c, 0xc00049a328, 0xc00044a6f0) /usr/local/go/src/bufio/bufio.go:223 +0x23e io.ReadAtLeast(0x197b440, 0xc000458420, 0xc000498118, 0x9, 0x9, 0x9, 0xaa, 0x0, 0x0) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.readFrameHeader(0xc000498118, 0x9, 0x9, 0x197b440, 0xc000458420, 0x0, 0xaa00000000, 0x100000001, 0x1000000aa) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:237 +0x88 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0004980e0, 0xc00044a660, 0xc00044a660, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00049a1c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1236 +0x168 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd15 goroutine 71 [runnable]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00043e2c0, 0x1, 0x0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0004584e0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00049a1c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xeb2 goroutine 82 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newClientStream.func5(0xc000442000, 0xc0001e27e0, 0x19a53a0, 0xc00045a090) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:320 +0xd7 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newClientStream /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:319 +0x8e2 goroutine 83 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0001985a0, 0xc000187350, 0x5, 0x5, 0x47009d, 0xc0001fa838, 0xc00033f768) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:158 +0xe5 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0001985a0, 0xc000187350, 0x5, 0x5, 0xadc310, 0xc0001a6320, 0xc00033f778) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:138 +0x127 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000224de0, 0xc000187350, 0x5, 0x5, 0x43e208, 0xc00033f7a0, 0xafa9cc) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:435 +0x55 io.ReadAtLeast(0x197ce80, 0xc000224de0, 0xc000187350, 0x5, 0x5, 0x5, 0x55b68c, 0xc00045a090, 0xc0001fa7e0) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0001a2900, 0xc000187350, 0x5, 0x5, 0x1673020, 0x7f5d40006a30, 0xc0001fa7e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:419 +0xc8 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000187340, 0x3200000, 0xa5, 0xa5, 0x0, 0x0, 0x7f5d40006a00, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.recvAndDecompress(0xc000187340, 0xc0001a2900, 0x0, 0x0, 0x3200000, 0x0, 0x0, 0x0, 0xc00bb91340, 0xa5, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.recv(0xc000187340, 0x7f5d4600d458, 0x29bf758, 0xc0001a2900, 0x0, 0x0, 0x1673020, 0xc001817f30, 0x3200000, 0x0, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:684 +0x9b github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0001fce00, 0x1673020, 0xc001817f30, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:870 +0xed github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0001fce00, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:721 +0x46 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0001e27e0, 0xc00033fc00, 0xc00033fbf0, 0xc00033fbb0, 0x10) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:573 +0x29f github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0001e27e0, 0x1673020, 0xc001817f30, 0x489770, 0xc000447da0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:720 +0x100 github.com/hyperchain/hyperchain/p2p/types.(*chatChatClient).Recv(0xc00018aac0, 0x14b5601, 0xe779e5, 0xc0098f9201) /var/go/src/github.com/hyperchain/hyperchain/p2p/types/communicate.pb.go:92 +0x62 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*clientStream).Recv(0xc000187360, 0xc00033fe30, 0x6, 0xc0098f9210) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/stream.go:82 +0x33 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*NetworkImpl).readLoop(0xc00027ceb0, 0x19a57a0, 0xc000187360, 0xc0003bad20, 0x5, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/grpc.go:164 +0x83 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).Chat.func1(0xc000402000, 0xc0001c49a0, 0xc000442000, 0xc0003c3290, 0xc000187360, 0x19a57a0, 0xc000187360, 0xc0003bad20, 0x5) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client.go:119 +0xcf created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).Chat /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client.go:114 +0x700 goroutine 84 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0001a8b80) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x110 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newCCBalancerWrapper /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x14f goroutine 85 [select]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).produceTimeTick(0xc00018efc0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:274 +0x10f created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).initState /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:56 +0x46e goroutine 87 [chan receive]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).working.func2(0xc00018efc0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:100 +0x104 created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).working /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client_stat.go:96 +0x61 goroutine 88 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0004e4000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:1040 +0x5a1 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).connect /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:700 +0xb6 goroutine 65 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008e30, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc0001a4c18, 0x72, 0x800, 0x800, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc0001a4c00, 0xc007975000, 0x800, 0x800, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc0001a4c00, 0xc007975000, 0x800, 0x800, 0x43a8ac, 0xc000032000, 0x1560cc0) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc0001941e0, 0xc007975000, 0x800, 0x800, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 github.com/hyperchain/hyperchain/crypto/tls.(*block).readFromUntil(0xc000428090, 0x197d1a0, 0xc0001941e0, 0x5, 0xc0001941e0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:492 +0x86 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).readRecord(0xc000093180, 0x1797617, 0xc0000932a0, 0xaa00000001) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:593 +0xd8 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).Read(0xc000093180, 0xc000504000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:1145 +0xf1 bufio.(*Reader).Read(0xc000400fc0, 0xc0000da818, 0x9, 0x9, 0xae707c, 0xc0000f1668, 0xc0004285a0) /usr/local/go/src/bufio/bufio.go:223 +0x23e io.ReadAtLeast(0x197b440, 0xc000400fc0, 0xc0000da818, 0x9, 0x9, 0x9, 0xaa, 0x0, 0x0) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.readFrameHeader(0xc0000da818, 0x9, 0x9, 0x197b440, 0xc000400fc0, 0x0, 0xaa00000000, 0x100000001, 0x1000000aa) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:237 +0x88 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0000da7e0, 0xc000428510, 0xc000428510, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0000f1500) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1236 +0x168 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd15 goroutine 99 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newClientStream.func5(0xc0004de000, 0xc0002126c0, 0x19a53a0, 0xc000225200) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:320 +0xd7 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newClientStream /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:319 +0x8e2 goroutine 100 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00027d680, 0xc00051c150, 0x5, 0x5, 0x47009d, 0xc000214538, 0xc0001e5768) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:158 +0xe5 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00027d680, 0xc00051c150, 0x5, 0x5, 0xadc310, 0xc0004f0580, 0xc0001e5778) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:138 +0x127 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000428780, 0xc00051c150, 0x5, 0x5, 0x43e208, 0xc0001e57a0, 0xafa9cc) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:435 +0x55 io.ReadAtLeast(0x197ce80, 0xc000428780, 0xc00051c150, 0x5, 0x5, 0x5, 0x55b68c, 0xc000225200, 0xc0002144e0) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc00011f500, 0xc00051c150, 0x5, 0x5, 0x1673020, 0x7f5d40006a30, 0xc0002144e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:419 +0xc8 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00051c140, 0x3200000, 0xa5, 0xa5, 0x0, 0x0, 0x7f5d40006a00, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.recvAndDecompress(0xc00051c140, 0xc00011f500, 0x0, 0x0, 0x3200000, 0x0, 0x0, 0x0, 0xc00ae6f550, 0xa5, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.recv(0xc00051c140, 0x7f5d4600d458, 0x29bf758, 0xc00011f500, 0x0, 0x0, 0x1673020, 0xc0039847c0, 0x3200000, 0x0, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:684 +0x9b github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0001a4a00, 0x1673020, 0xc0039847c0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:870 +0xed github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0001a4a00, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:721 +0x46 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0002126c0, 0xc0001e5c00, 0xc0001e5bf0, 0xc0001e5bb0, 0x10) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:573 +0x29f github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0002126c0, 0x1673020, 0xc0039847c0, 0x489770, 0xc000447e00) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:720 +0x100 github.com/hyperchain/hyperchain/p2p/types.(*chatChatClient).Recv(0xc0003e13f0, 0x14b5601, 0xe779e5, 0xc00ab1f201) /var/go/src/github.com/hyperchain/hyperchain/p2p/types/communicate.pb.go:92 +0x62 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*clientStream).Recv(0xc00051c160, 0xc0001e5e30, 0x6, 0xc00ab1f290) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/stream.go:82 +0x33 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*NetworkImpl).readLoop(0xc00027ceb0, 0x19a57a0, 0xc00051c160, 0xc0003badc0, 0x5, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/grpc.go:164 +0x83 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).Chat.func1(0xc000402000, 0xc00018efc0, 0xc0004de000, 0xc0003c3290, 0xc00051c160, 0x19a57a0, 0xc00051c160, 0xc0003badc0, 0x5) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client.go:119 +0xcf created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Client).Chat /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/client.go:114 +0x700 goroutine 72 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008c90, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc000464598, 0x72, 0x0, 0x0, 0x16fd31b) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Accept(0xc000464580, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1ba net.(*netFD).accept(0xc000464580, 0x1797640, 0xc0004d8e88, 0x5f8537d2) /usr/local/go/src/net/fd_unix.go:238 +0x42 net.(*TCPListener).accept(0xc000460020, 0x5d42cd7c, 0xc0004d8eb0, 0x4f10d6) /usr/local/go/src/net/tcpsock_posix.go:139 +0x32 net.(*TCPListener).Accept(0xc000460020, 0xc0004d8f00, 0x18, 0xc000532300, 0x7eff54) /usr/local/go/src/net/tcpsock.go:260 +0x48 net/http.(*Server).Serve(0xc00047a410, 0x199eb20, 0xc000460020, 0x0, 0x0) /usr/local/go/src/net/http/server.go:2859 +0x22d created by github.com/hyperchain/hyperchain/rpc.(*httpServerImpl).start /var/go/src/github.com/hyperchain/hyperchain/rpc/http.go:133 +0x703 goroutine 149 [select]: github.com/hyperchain/hyperchain/services/mq.(*MQ).listenEvent(0xc000467980) /var/go/src/github.com/hyperchain/hyperchain/services/mq/mq.go:504 +0x190 github.com/hyperchain/hyperchain/services/mq.(*MQ).Start(0xc000467980, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/services/mq/mq.go:146 +0x63 github.com/hyperchain/hyperchain/middleware.(*ServiceHandler).StartAll.func1(0x19b0f80, 0xc000467980) /var/go/src/github.com/hyperchain/hyperchain/middleware/serviceHandler.go:66 +0x31 created by github.com/hyperchain/hyperchain/middleware.(*ServiceHandler).StartAll /var/go/src/github.com/hyperchain/hyperchain/middleware/serviceHandler.go:65 +0x7e goroutine 74 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0000bc4e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x40f goroutine 108 [chan receive, 11 minutes, locked to thread]: github.com/hyperchain/hyperchain/license.CheckLicense(0xc0000a0780) /var/go/src/github.com/hyperchain/hyperchain/license/license.go:32 +0x7b created by main.(*hyperchain).start /var/go/src/github.com/hyperchain/hyperchain/main.go:82 +0x1bf goroutine 111 [sleep, 11 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:307 time.Sleep(0x191a5bccea00) /usr/local/go/src/runtime/time.go:105 +0x159 github.com/hyperchain/hyperchain/common.(*HyperLogger).newLogFileByInterval(0xc0000bf560, 0xc000630cf0) /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:315 +0x50e created by github.com/hyperchain/hyperchain/common.(*HyperLogger).init /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:167 +0x276 goroutine 110 [IO wait, 11 minutes]: internal/poll.runtime_pollWait(0x7f5d46008d60, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc000586798, 0x72, 0x0, 0x0, 0x16fd31b) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Accept(0xc000586780, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1ba net.(*netFD).accept(0xc000586780, 0xc0001ace00, 0x7f5d46064008, 0xc000532a80) /usr/local/go/src/net/fd_unix.go:238 +0x42 net.(*UnixListener).accept(0xc000429a40, 0xc000071e88, 0x43e208, 0x30) /usr/local/go/src/net/unixsock_posix.go:162 +0x32 net.(*UnixListener).Accept(0xc000429a40, 0x1621620, 0xc000429b30, 0x152f400, 0x2937820) /usr/local/go/src/net/unixsock.go:260 +0x48 net/http.(*Server).Serve(0xc0005304e0, 0x199eb60, 0xc000429a40, 0x0, 0x0) /usr/local/go/src/net/http/server.go:2859 +0x22d net/http.Serve(...) /usr/local/go/src/net/http/server.go:2456 github.com/hyperchain/hyperchain/ipc.(*IPCServer).Start.func1(0x199eb60, 0xc000429a40, 0xc0003e1cb0) /var/go/src/github.com/hyperchain/hyperchain/ipc/ipcserver.go:44 +0x54 created by github.com/hyperchain/hyperchain/ipc.(*IPCServer).Start /var/go/src/github.com/hyperchain/hyperchain/ipc/ipcserver.go:43 +0x2ee goroutine 73 [IO wait, 11 minutes]: internal/poll.runtime_pollWait(0x7f5d46008bc0, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc000464918, 0x72, 0x0, 0x0, 0x16fd31b) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Accept(0xc000464900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1ba net.(*netFD).accept(0xc000464900, 0xc000331eb0, 0xc0001aca80, 0x7f5d46065460) /usr/local/go/src/net/fd_unix.go:238 +0x42 net.(*TCPListener).accept(0xc000460038, 0xc000331eb0, 0x43e208, 0x30) /usr/local/go/src/net/tcpsock_posix.go:139 +0x32 net.(*TCPListener).Accept(0xc000460038, 0x1621620, 0xc0005fa000, 0x152f400, 0x2937820) /usr/local/go/src/net/tcpsock.go:260 +0x48 net/http.(*Server).Serve(0xc00047a820, 0x199eb20, 0xc000460038, 0x0, 0x0) /usr/local/go/src/net/http/server.go:2859 +0x22d created by github.com/hyperchain/hyperchain/rpc.(*wsServerImpl).start /var/go/src/github.com/hyperchain/hyperchain/rpc/websocket.go:76 +0x43b goroutine 112 [select, 1 minutes]: github.com/hyperchain/hyperchain/common.(*HyperLogger).newLogFileBySize(0xc0000bf560, 0xc000630cf0) /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:342 +0x21f created by github.com/hyperchain/hyperchain/common.(*HyperLogger).init /var/go/src/github.com/hyperchain/hyperchain/common/hyper_logger_impl.go:168 +0x2a5 goroutine 113 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc0000da8c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x121 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x176 goroutine 114 [select, 10 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0002e5040) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x40f goroutine 115 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0002e5040) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x431 goroutine 116 [select, 10 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0002e5040) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x23a created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x585 goroutine 117 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0002e5040) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x12e created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5a7 goroutine 118 [select]: github.com/hyperchain/hyperchain/hyperdb/hleveldb.(*LDBDatabase).meter(0xc000280480, 0xb2d05e00) /var/go/src/github.com/hyperchain/hyperchain/hyperdb/hleveldb/database.go:270 +0x38c created by github.com/hyperchain/hyperchain/hyperdb/hleveldb.NewLDBDataBase /var/go/src/github.com/hyperchain/hyperchain/hyperdb/hleveldb/database.go:61 +0x247 goroutine 119 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc0000da380) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x121 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x176 goroutine 75 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0000bc4e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x431 goroutine 76 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0000bc4e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x23a created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x585 goroutine 77 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0000bc4e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x12e created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5a7 goroutine 78 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc0000da540) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x121 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x176 goroutine 79 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0000bc680) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x40f goroutine 80 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0000bc680) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x431 goroutine 81 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0000bc680) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x23a created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x585 goroutine 130 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0000bc680) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x12e created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5a7 goroutine 132 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1(0xc0005b4000) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:299 +0x22f created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:260 +0x3f goroutine 93 [select, 3 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1.1(0xc00027d090, 0x1708652, 0xb, 0xc0005b4000) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:280 +0xdd created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1 /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:278 +0x1f6 goroutine 124 [select]: github.com/hyperchain/hyperchain/manager/filter.(*EventSystem).eventLoop(0xc000626240) /var/go/src/github.com/hyperchain/hyperchain/manager/filter/filter_system.go:113 +0x5b6 created by github.com/hyperchain/hyperchain/manager/filter.NewEventSystem /var/go/src/github.com/hyperchain/hyperchain/manager/filter/filter_system.go:94 +0x108 goroutine 125 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc0000da700) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x121 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x176 goroutine 126 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc0000bc9c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0xcd created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x40f goroutine 127 [select]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc0000bc9c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0xf6 created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:143 +0x431 goroutine 128 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc0000bc9c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:825 +0x23a created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x585 goroutine 129 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc0000bc9c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:762 +0x12e created by github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb.openDB /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x5a7 goroutine 146 [chan receive, 1 minutes]: github.com/hyperchain/hyperchain/api.(*PublicFilterAPI).timeoutLoop(0xc000316a80) /var/go/src/github.com/hyperchain/hyperchain/api/filter.go:51 +0x14b created by github.com/hyperchain/hyperchain/api.NewFilterAPI /var/go/src/github.com/hyperchain/hyperchain/api/filter.go:40 +0xf6 goroutine 147 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/namespace.(*nsManagerImpl).ListenDelNode(0xc000316d40, 0xc0004f07cd, 0x6, 0xc00061e2a0) /var/go/src/github.com/hyperchain/hyperchain/namespace/nsmgr.go:524 +0x31 created by github.com/hyperchain/hyperchain/namespace.(*nsManagerImpl).Register /var/go/src/github.com/hyperchain/hyperchain/namespace/nsmgr.go:320 +0x952 goroutine 150 [select]: github.com/hyperchain/hyperchain/middleware.(*MiddleWare).listenEvent.func1(0xc000084f00) /var/go/src/github.com/hyperchain/hyperchain/middleware/middleware.go:87 +0xcc created by github.com/hyperchain/hyperchain/middleware.(*MiddleWare).listenEvent /var/go/src/github.com/hyperchain/hyperchain/middleware/middleware.go:85 +0x3f goroutine 151 [select]: github.com/hyperchain/hyperchain/core/executor.(*SnapshotRegistry).listen(0xc0000e0b60) /var/go/src/github.com/hyperchain/hyperchain/core/executor/snapshot.go:278 +0xc7 created by github.com/hyperchain/hyperchain/core/executor.(*SnapshotRegistry).Start /var/go/src/github.com/hyperchain/hyperchain/core/executor/snapshot.go:118 +0x3f goroutine 152 [select]: github.com/hyperchain/hyperchain/core/executor.(*Executor).listenPrivateValidationEvent(0xc000467080) /var/go/src/github.com/hyperchain/hyperchain/core/executor/private.go:52 +0x1a5 created by github.com/hyperchain/hyperchain/core/executor.(*Executor).initialize /var/go/src/github.com/hyperchain/hyperchain/core/executor/executor.go:303 +0x612 goroutine 153 [select]: github.com/hyperchain/hyperchain/core/executor.(*Executor).listenCommitEvent(0xc000467080) /var/go/src/github.com/hyperchain/hyperchain/core/executor/commit.go:51 +0x1a9 created by github.com/hyperchain/hyperchain/core/executor.(*Executor).initialize /var/go/src/github.com/hyperchain/hyperchain/core/executor/executor.go:311 +0x539 goroutine 154 [select]: github.com/hyperchain/hyperchain/core/executor.(*Executor).listenValidateEvent(0xc000467080) /var/go/src/github.com/hyperchain/hyperchain/core/executor/validate.go:71 +0x1b8 created by github.com/hyperchain/hyperchain/core/executor.(*Executor).initialize /var/go/src/github.com/hyperchain/hyperchain/core/executor/executor.go:312 +0x55e goroutine 92 [syscall, 3 minutes]: syscall.Syscall6(0xe8, 0x2b, 0xc000a5bd14, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x2, 0x200c00402ee50, 0x0) /usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5 github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix.EpollWait(0x2b, 0xc000a5bd14, 0x7, 0x7, 0xffffffffffffffff, 0xc00192a6a8, 0xc000a5bdf4, 0xc0001ffc80) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1692 +0x72 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0000409e0, 0xc000a5bd00, 0x2, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc00027d090) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x18a created by github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.NewWatcher /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:61 +0x1e2 goroutine 157 [select, 11 minutes]: github.com/hyperchain/hyperchain/manager.(*EventHub).listenPeerMaintainEvent(0xc00012a3c0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:549 +0x14c created by github.com/hyperchain/hyperchain/manager.(*EventHub).Start /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:204 +0xa7 goroutine 158 [select]: github.com/hyperchain/hyperchain/manager.(*EventHub).listenExecutorEvent(0xc00012a3c0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:606 +0x13d created by github.com/hyperchain/hyperchain/manager.(*EventHub).Start /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:205 +0xc9 goroutine 159 [select]: github.com/hyperchain/hyperchain/manager.(*EventHub).listenTransactionEvent(0xc00012a3c0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:632 +0x14c created by github.com/hyperchain/hyperchain/manager.(*EventHub).Start /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:206 +0xeb goroutine 160 [select, 11 minutes]: github.com/hyperchain/hyperchain/manager.(*EventHub).listenMiscellaneousEvent(0xc00012a3c0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:700 +0x14c created by github.com/hyperchain/hyperchain/manager.(*EventHub).Start /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:207 +0x10d goroutine 161 [select, 11 minutes]: github.com/hyperchain/hyperchain/manager.(*EventHub).listenNvpStateUpdateEvent(0xc00012a3c0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:679 +0x131 created by github.com/hyperchain/hyperchain/manager.(*EventHub).Start /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:208 +0x12f goroutine 137 [syscall, 11 minutes]: syscall.Syscall6(0xe8, 0x35, 0xc000367d14, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5 github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix.EpollWait(0x35, 0xc000367d14, 0x7, 0x7, 0xffffffffffffffff, 0xc000367d10, 0x0, 0xc0004e8780) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1692 +0x72 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0001c2d80, 0x1794e00, 0xc0001c2d80, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc0004502d0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x18a created by github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.NewWatcher /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:61 +0x1e2 goroutine 163 [select, 3 minutes]: github.com/hyperchain/hyperchain/p2p.(*Server).listening(0xc0000f8370) /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1133 +0x14b created by github.com/hyperchain/hyperchain/p2p.(*Server).Start /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:141 +0x77 goroutine 164 [select]: github.com/hyperchain/hyperchain/p2p.(*Server).linking(0xc0000f8370) /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1177 +0x676 created by github.com/hyperchain/hyperchain/p2p.(*Server).Start /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:142 +0x9c goroutine 165 [select, 3 minutes]: github.com/hyperchain/hyperchain/consensus/slicepool.(*slicePoolImpl).checkLoop(0xc0000bf9e0) /var/go/src/github.com/hyperchain/hyperchain/consensus/slicepool/slice_pool.go:252 +0xc8 created by github.com/hyperchain/hyperchain/consensus/slicepool.(*slicePoolImpl).Start /var/go/src/github.com/hyperchain/hyperchain/consensus/slicepool/slice_pool.go:234 +0x3f goroutine 133 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1(0xc0005b40f0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:299 +0x22f created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:260 +0x3f goroutine 134 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1(0xc0005b41e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:299 +0x22f created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:260 +0x3f goroutine 179 [select, 3 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1.1(0xc000198230, 0xc0003c0010, 0xa, 0xc0005b40f0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:280 +0xdd created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1 /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:278 +0x1f6 goroutine 135 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1(0xc0005b42d0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:299 +0x22f created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:260 +0x3f goroutine 136 [chan receive, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1(0xc0005b43c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:299 +0x22f created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:260 +0x3f goroutine 138 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1.1(0xc0004502d0, 0xc00045cb70, 0x28, 0xc0005b43c0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:280 +0xdd created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1 /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:278 +0x1f6 goroutine 139 [syscall, 3 minutes]: syscall.Syscall6(0xe8, 0x39, 0xc002af9d14, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x2, 0xc00402eeb0, 0x0) /usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5 github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix.EpollWait(0x39, 0xc002af9d14, 0x7, 0x7, 0xffffffffffffffff, 0xc00402eeb0, 0xc002af9df4, 0x19af000) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1692 +0x72 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0001c2dc0, 0xc002af9d00, 0x2, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc000450320) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x18a created by github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.NewWatcher /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:61 +0x1e2 goroutine 140 [select, 3 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1.1(0xc000450320, 0xc0005f6be0, 0x9, 0xc0005b41e0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:280 +0xdd created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1 /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:278 +0x1f6 goroutine 141 [syscall, 11 minutes]: syscall.Syscall6(0xe8, 0x3d, 0xc002b2bd14, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5 github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix.EpollWait(0x3d, 0xc002b2bd14, 0x7, 0x7, 0xffffffffffffffff, 0xc002b2bd10, 0x0, 0xc0004f4a80) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:1692 +0x72 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0001c2de0, 0x1794e00, 0xc0001c2de0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc0004504b0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x18a created by github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify.NewWatcher /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/fsnotify/fsnotify/inotify.go:61 +0x1e2 goroutine 142 [select, 11 minutes]: github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1.1(0xc0004504b0, 0xc00045cbd0, 0x27, 0xc0005b42d0) /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:280 +0xdd created by github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper.(*Viper).WatchConfig.func1 /var/go/src/github.com/hyperchain/hyperchain/vendor/github.com/terasum/viper/viper.go:278 +0x1f6 goroutine 166 [select]: github.com/hyperchain/hyperchain/consensus/rbft.(*rbftImpl).listenEvent(0xc0000e2a00) /var/go/src/github.com/hyperchain/hyperchain/consensus/rbft/rbft_impl.go:115 +0x10b created by github.com/hyperchain/hyperchain/consensus/rbft.(*rbftImpl).Start /var/go/src/github.com/hyperchain/hyperchain/consensus/rbft/rbft.go:158 +0xed2 goroutine 167 [select]: github.com/hyperchain/hyperchain/consensus/rbft.(*TxSetImpl).listenEvent(0xc0001a03c0) /var/go/src/github.com/hyperchain/hyperchain/consensus/rbft/tx_set.go:60 +0xde created by github.com/hyperchain/hyperchain/consensus/rbft.(*TxSetImpl).Start /var/go/src/github.com/hyperchain/hyperchain/consensus/rbft/tx_set.go:47 +0x3f goroutine 169 [select, 11 minutes]: github.com/hyperchain/hyperchain/core/transaction/private.(*PrivacyManager).listenMsg(0xc0000bb900) /var/go/src/github.com/hyperchain/hyperchain/core/transaction/private/private_mgr.go:308 +0xfd created by github.com/hyperchain/hyperchain/core/transaction/private.(*PrivacyManager).Start /var/go/src/github.com/hyperchain/hyperchain/core/transaction/private/private_mgr.go:121 +0xb3 goroutine 170 [select, 11 minutes]: github.com/hyperchain/hyperchain/core/transaction/private.(*PrivacyManager).checkExpiration(0xc0000bb900) /var/go/src/github.com/hyperchain/hyperchain/core/transaction/private/private_mgr.go:411 +0x128 created by github.com/hyperchain/hyperchain/core/transaction/private.(*PrivacyManager).Start /var/go/src/github.com/hyperchain/hyperchain/core/transaction/private/private_mgr.go:122 +0xd5 goroutine 172 [select]: github.com/hyperchain/hyperchain/core/ledger/bloom.(*Filter).loop(0xc0000bb360) /var/go/src/github.com/hyperchain/hyperchain/core/ledger/bloom/bloom_filter.go:290 +0x475 created by github.com/hyperchain/hyperchain/core/ledger/bloom.(*Filter).Start /var/go/src/github.com/hyperchain/hyperchain/core/ledger/bloom/bloom_filter.go:100 +0x90 goroutine 118258 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc002bd0400) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x110 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newCCBalancerWrapper /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x14f goroutine 88644 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00bcbf480, 0x1, 0x0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00b6b0300, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc009b48480) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:276 +0xcb created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:273 +0xfba goroutine 89573 [select]: github.com/hyperchain/hyperchain/p2p.(*protoRW).ReadMsg(0xc00a4e1ad0, 0xc003f4b640, 0x3d, 0x40) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:576 +0xbf github.com/hyperchain/hyperchain/manager/node.(*Peer).ReadMsg(...) /var/go/src/github.com/hyperchain/hyperchain/manager/node/peer.go:61 github.com/hyperchain/hyperchain/manager.(*EventHub).handleMsg(0xc00012a3c0, 0xc0098ec930, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/peer_service.go:252 +0x39 github.com/hyperchain/hyperchain/manager.(*EventHub).handle(0xc00012a3c0, 0xc0098ec930, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/peer_service.go:241 +0x124 github.com/hyperchain/hyperchain/manager.New.func1(0xc00b80b9a0, 0x198e720, 0xc00a4e1ad0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:158 +0x18c github.com/hyperchain/hyperchain/p2p.(*Peer).startProtocols.func1(0xc00a4e1ad0, 0xc00b80b9a0, 0x198e720, 0xc00a4e1ad0) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:449 +0x66 created by github.com/hyperchain/hyperchain/p2p.(*Peer).startProtocols /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:448 +0x121 goroutine 118240 [chan receive]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00b085180) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:1040 +0x5a1 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).connect /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:700 +0xb6 goroutine 118259 [chan receive]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00b085400) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:1040 +0x5a1 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*addrConn).connect /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/clientconn.go:700 +0xb6 goroutine 88647 [select, 3 minutes]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Server).Chat(0xc0003e0990, 0x19b4280, 0xc00ab51a30, 0x198e760, 0xc0003e0990) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/server.go:103 +0x51b github.com/hyperchain/hyperchain/p2p/types._Chat_Chat_Handler(0x15964a0, 0xc0003e0990, 0x19aed00, 0xc00b5560c0, 0x29bf758, 0xc00acd4700) /var/go/src/github.com/hyperchain/hyperchain/p2p/types/communicate.pb.go:120 +0xad github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000240f00, 0x19b6500, 0xc009b48480, 0xc00acd4700, 0xc000405bf0, 0x293b480, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:1176 +0xacd github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000240f00, 0x19b6500, 0xc009b48480, 0xc00acd4700, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:1256 +0xd3f github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00b2d5aa0, 0xc000240f00, 0x19b6500, 0xc009b48480, 0xc00acd4700) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:691 +0x9f created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:689 +0xa1 goroutine 89571 [select]: github.com/hyperchain/hyperchain/p2p.(*Peer).pingLoop(0xc00b80b9a0) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:261 +0x156 created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:180 +0x117 goroutine 118239 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc002bd0180) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x110 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.newCCBalancerWrapper /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x14f goroutine 89572 [select, 3 minutes]: github.com/hyperchain/hyperchain/p2p.(*Peer).sendComputeRequestByInterval(0xc00b80b9a0) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:321 +0x2e4 created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:181 +0x13c goroutine 190 [select]: github.com/hyperchain/hyperchain/p2p.(*protoRW).ReadMsg(0xc0002de750, 0xc007ad2d40, 0x3d, 0x40) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:576 +0xbf github.com/hyperchain/hyperchain/manager/node.(*Peer).ReadMsg(...) /var/go/src/github.com/hyperchain/hyperchain/manager/node/peer.go:61 github.com/hyperchain/hyperchain/manager.(*EventHub).handleMsg(0xc00012a3c0, 0xc00048c810, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/peer_service.go:252 +0x39 github.com/hyperchain/hyperchain/manager.(*EventHub).handle(0xc00012a3c0, 0xc00048c810, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/peer_service.go:241 +0x124 github.com/hyperchain/hyperchain/manager.New.func1(0xc00057a000, 0x198e720, 0xc0002de750, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:158 +0x18c github.com/hyperchain/hyperchain/p2p.(*Peer).startProtocols.func1(0xc0002de750, 0xc00057a000, 0x198e720, 0xc0002de750) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:449 +0x66 created by github.com/hyperchain/hyperchain/p2p.(*Peer).startProtocols /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:448 +0x121 goroutine 355 [select]: github.com/hyperchain/hyperchain/p2p.(*protoRW).ReadMsg(0xc0001b84e0, 0xc003f4ba80, 0x3d, 0x40) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:576 +0xbf github.com/hyperchain/hyperchain/manager/node.(*Peer).ReadMsg(...) /var/go/src/github.com/hyperchain/hyperchain/manager/node/peer.go:61 github.com/hyperchain/hyperchain/manager.(*EventHub).handleMsg(0xc00012a3c0, 0xc000643da0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/peer_service.go:252 +0x39 github.com/hyperchain/hyperchain/manager.(*EventHub).handle(0xc00012a3c0, 0xc000643da0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/peer_service.go:241 +0x124 github.com/hyperchain/hyperchain/manager.New.func1(0xc000495860, 0x198e720, 0xc0001b84e0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/manager/eventhub.go:158 +0x18c github.com/hyperchain/hyperchain/p2p.(*Peer).startProtocols.func1(0xc0001b84e0, 0xc000495860, 0x198e720, 0xc0001b84e0) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:449 +0x66 created by github.com/hyperchain/hyperchain/p2p.(*Peer).startProtocols /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:448 +0x121 goroutine 189 [select, 11 minutes]: github.com/hyperchain/hyperchain/p2p.(*Peer).sendComputeRequestByInterval(0xc00057a000) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:321 +0x2e4 created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:181 +0x13c goroutine 354 [select, 11 minutes]: github.com/hyperchain/hyperchain/p2p.(*Peer).sendComputeRequestByInterval(0xc000495860) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:321 +0x2e4 created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:181 +0x13c goroutine 187 [chan receive]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*grpcTransport).ReadMsg(0xc0003e09a0, 0xc0004f07cd, 0x6, 0xc00060d338, 0x5, 0xc001817e70, 0xc00060d300, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/grpc.go:308 +0x93 github.com/hyperchain/hyperchain/p2p.(*Peer).readLoop(0xc00057a000, 0xc000089c80) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:283 +0xae created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:179 +0xf2 goroutine 88648 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00b2f2190, 0xc007d7ef90, 0x5, 0x5, 0xc00b7518a0, 0xafbcec, 0xc00b751928) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:146 +0xe5 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00b2f2190, 0xc007d7ef90, 0x5, 0x5, 0xadc310, 0xc00b17ea60, 0xc00b751938) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:140 +0x1a6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00b5592c0, 0xc007d7ef90, 0x5, 0x5, 0x43e208, 0xc00b751960, 0xafbc9c) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:435 +0x55 io.ReadAtLeast(0x197ce80, 0xc00b5592c0, 0xc007d7ef90, 0x5, 0x5, 0x5, 0xa5, 0x0, 0x0) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc00acd4700, 0xc007d7ef90, 0x5, 0x5, 0x1673020, 0x7f5d40006a30, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/transport.go:419 +0xc8 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc007d7ef80, 0x3200000, 0xa5, 0xa5, 0x0, 0x0, 0x7f5d40006a00, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.recvAndDecompress(0xc007d7ef80, 0xc00acd4700, 0x0, 0x0, 0x3200000, 0x0, 0x0, 0x0, 0xc00bb90b00, 0xc00b751ba0, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.recv(0xc007d7ef80, 0x7f5d4600d458, 0x29bf758, 0xc00acd4700, 0x0, 0x0, 0x1673020, 0xc001817b90, 0x3200000, 0x0, ...) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/rpc_util.go:684 +0x9b github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc00b5560c0, 0x1673020, 0xc001817b90, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/stream.go:1464 +0x14e github.com/hyperchain/hyperchain/p2p/types.(*chatChatServer).Recv(0xc00ab51a30, 0x14b5601, 0xe779e5, 0xc0098f8f01) /var/go/src/github.com/hyperchain/hyperchain/p2p/types/communicate.pb.go:139 +0x62 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*serverStream).Recv(0xc007d7efa0, 0xc00b751e80, 0x6, 0xc0098f8fc6) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/stream.go:108 +0x33 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*NetworkImpl).readLoop(0xc00027ceb0, 0x19a57e0, 0xc007d7efa0, 0xc00b2d5b10, 0x5, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/grpc.go:164 +0x83 github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Server).Chat.func1(0xc0003e0990, 0xc00b2d5b10, 0x5, 0xc007d7efa0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/server.go:89 +0xc9 created by github.com/hyperchain/hyperchain/p2p/transport/grpc.(*Server).Chat /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/server.go:87 +0x46d goroutine 118264 [IO wait]: internal/poll.runtime_pollWait(0x7f5d460087b0, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc00ad7a418, 0x72, 0x400, 0x400, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc00ad7a400, 0xc00a521400, 0x400, 0x400, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc00ad7a400, 0xc00a521400, 0x400, 0x400, 0x43a8ac, 0xc000032000, 0x1560cc0) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc00ad833e8, 0xc00a521400, 0x400, 0x400, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 github.com/hyperchain/hyperchain/crypto/tls.(*block).readFromUntil(0xc00a8b9e00, 0x197d1a0, 0xc00ad833e8, 0x5, 0xc00ad833e8, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:492 +0x86 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).readRecord(0xc00ad53500, 0x1797617, 0xc00ad53620, 0x800010601) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:593 +0xd8 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).Read(0xc00ad53500, 0xc00b112000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:1145 +0xf1 bufio.(*Reader).Read(0xc001d3bb00, 0xc00b412b98, 0x9, 0x9, 0xc000470380, 0x7f5d460646d0, 0x0) /usr/local/go/src/bufio/bufio.go:223 +0x23e io.ReadAtLeast(0x197b440, 0xc001d3bb00, 0xc00b412b98, 0x9, 0x9, 0x9, 0xab72b5, 0xc003b5d02c, 0xc000130e38) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.readFrameHeader(0xc00b412b98, 0x9, 0x9, 0x197b440, 0xc001d3bb00, 0x0, 0xc000000000, 0xa06f8b2994, 0x299bba0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:237 +0x88 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00b412b60, 0xc003b5d020, 0xc003b5d020, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00ae72380) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1236 +0x168 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd15 goroutine 188 [select]: github.com/hyperchain/hyperchain/p2p.(*Peer).pingLoop(0xc00057a000) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:261 +0x156 created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:180 +0x117 goroutine 273 [select]: github.com/hyperchain/hyperchain/p2p.(*Peer).pingLoop(0xc000495860) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:261 +0x156 created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:180 +0x117 goroutine 272 [chan receive]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*grpcTransport).ReadMsg(0xc0003e09a0, 0xc0004f07cd, 0x6, 0xc00060d2a8, 0x5, 0xc001817c50, 0xc00060d200, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/grpc.go:308 +0x93 github.com/hyperchain/hyperchain/p2p.(*Peer).readLoop(0xc000495860, 0xc0004011a0) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:283 +0xae created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:179 +0xf2 goroutine 339 [select]: github.com/hyperchain/hyperchain/p2p.(*Peer).run(0xc000495860, 0x3, 0xc0006230f0) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:191 +0x2a3 github.com/hyperchain/hyperchain/p2p.(*Server).linking.func1(0xc0000f8370, 0xc0004f07cd, 0x6, 0xc00060d2a8, 0x5, 0xc0005fe300, 0xc00062c900, 0xc0004f07cd, 0x6, 0xc00060d2a8, ...) /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1219 +0x8ee created by github.com/hyperchain/hyperchain/p2p.(*Server).linking /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1194 +0x381 goroutine 338 [select]: github.com/hyperchain/hyperchain/p2p.(*Peer).run(0xc00057a000, 0x3, 0xc00019d980) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:191 +0x2a3 github.com/hyperchain/hyperchain/p2p.(*Server).linking.func1(0xc0000f8370, 0xc0004f07cd, 0x6, 0xc00060d338, 0x5, 0xc0005fe300, 0xc00062c800, 0xc0004f07cd, 0x6, 0xc00060d338, ...) /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1219 +0x8ee created by github.com/hyperchain/hyperchain/p2p.(*Server).linking /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1194 +0x381 goroutine 88646 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008950, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc00b55a618, 0x72, 0x800, 0x800, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc00b55a600, 0xc007a83000, 0x800, 0x800, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc00b55a600, 0xc007a83000, 0x800, 0x800, 0x43a8ac, 0xc000032000, 0x1560cc0) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc00bbc37e0, 0xc007a83000, 0x800, 0x800, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 github.com/hyperchain/hyperchain/crypto/tls.(*block).readFromUntil(0xc00b558db0, 0x197d1a0, 0xc00bbc37e0, 0x5, 0xc00bbc37e0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:492 +0x86 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).readRecord(0xc007acee00, 0x1797617, 0xc007acef20, 0x8) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:593 +0xd8 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).Read(0xc007acee00, 0xc007d8a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:1145 +0xf1 bufio.(*Reader).Read(0xc00b6b02a0, 0xc00ac60658, 0x9, 0x9, 0x18, 0x18, 0xc009c4cd20) /usr/local/go/src/bufio/bufio.go:223 +0x23e io.ReadAtLeast(0x197b440, 0xc00b6b02a0, 0xc00ac60658, 0x9, 0x9, 0x9, 0x20, 0x15b32a0, 0x47e9c8) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.readFrameHeader(0xc00ac60658, 0x9, 0x9, 0x197b440, 0xc00b6b02a0, 0x0, 0x0, 0xbf48d14558bdebcb, 0xa179556270) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:237 +0x88 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00ac60620, 0xc003cdc040, 0xc003cdc040, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc009b48480, 0xc00b558ff0, 0x1796798) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:431 +0x7c github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000240f00, 0x19b6500, 0xc009b48480) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:687 +0xdd github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000240f00, 0x19b6500, 0xc009b48480) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:649 +0x43 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).handleRawConn /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:648 +0x580 goroutine 118262 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008a20, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc00ad7a118, 0x72, 0x400, 0x400, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc00ad7a100, 0xc00bf5ec00, 0x400, 0x400, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc00ad7a100, 0xc00bf5ec00, 0x400, 0x400, 0x43a8ac, 0xc000032000, 0x1560cc0) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc00bbc3940, 0xc00bf5ec00, 0x400, 0x400, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 github.com/hyperchain/hyperchain/crypto/tls.(*block).readFromUntil(0xc00b66c780, 0x197d1a0, 0xc00bbc3940, 0x5, 0xc00bbc3940, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:492 +0x86 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).readRecord(0xc0018c8380, 0x1797617, 0xc0018c84a0, 0x800010601) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:593 +0xd8 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).Read(0xc0018c8380, 0xc00af3e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:1145 +0xf1 bufio.(*Reader).Read(0xc001d3b560, 0xc00b4129d8, 0x9, 0x9, 0xc000470380, 0x7f5d46065460, 0x0) /usr/local/go/src/bufio/bufio.go:223 +0x23e io.ReadAtLeast(0x197b440, 0xc001d3b560, 0xc00b4129d8, 0x9, 0x9, 0x9, 0xab72b5, 0xc00a891b4c, 0xc000399e38) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.readFrameHeader(0xc00b4129d8, 0x9, 0x9, 0x197b440, 0xc001d3b560, 0x0, 0xc000000000, 0xa06f3e3a33, 0x299bba0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:237 +0x88 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00b4129a0, 0xc00a891b40, 0xc00a891b40, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00ae72000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1236 +0x168 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:286 +0xd15 goroutine 118265 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002bd0740, 0x1, 0x0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001d3bbc0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00ae72380) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xeb2 goroutine 116647 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc003b9e000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:935 +0x1ed created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:282 +0xfdf goroutine 89134 [select]: github.com/hyperchain/hyperchain/p2p.(*Peer).run(0xc00b80b9a0, 0x3, 0xc00b052190) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:191 +0x2a3 github.com/hyperchain/hyperchain/p2p.(*Server).linking.func1(0xc0000f8370, 0xc00402f2d0, 0x6, 0xc00402f2d6, 0x5, 0xc0005fe300, 0xc00ad97540, 0xc00402f2d0, 0x6, 0xc00402f2d6, ...) /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1219 +0x8ee created by github.com/hyperchain/hyperchain/p2p.(*Server).linking /var/go/src/github.com/hyperchain/hyperchain/p2p/server.go:1194 +0x381 goroutine 113620 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008af0, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc00b55ac98, 0x72, 0x1000, 0x1000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc00b55ac80, 0xc003b2a000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc00b55ac80, 0xc003b2a000, 0x1000, 0x1000, 0xc000050a00, 0xc0003afc40, 0x7e56ba) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc000194280, 0xc003b2a000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 net/http.(*connReader).Read(0xc00aa3d170, 0xc003b2a000, 0x1000, 0x1000, 0xa21e95f516, 0x299bba0, 0x72) /usr/local/go/src/net/http/server.go:787 +0x107 bufio.(*Reader).fill(0xc00a4d4f60) /usr/local/go/src/bufio/bufio.go:100 +0x10f bufio.(*Reader).Peek(0xc00a4d4f60, 0x4, 0xa21e95f516, 0x299bba0, 0x0, 0x0, 0x299bba0) /usr/local/go/src/bufio/bufio.go:138 +0x4f net/http.(*conn).serve(0xc007e90140, 0x19a52e0, 0xc00bf04900) /usr/local/go/src/net/http/server.go:1903 +0x9bf created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2884 +0x2f4 goroutine 116646 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00b023b40, 0x1, 0x0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00bb8e9c0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc003b9e000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:276 +0xcb created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:273 +0xfba goroutine 118263 [select]: github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002bd0500, 0x1, 0x0, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:317 +0x104 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001d3b620, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:435 +0x1b6 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00ae72000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:330 +0x7b created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_client.go:328 +0xeb2 goroutine 116648 [IO wait]: internal/poll.runtime_pollWait(0x7f5d46008610, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:182 +0x56 internal/poll.(*pollDesc).wait(0xc00bb56018, 0x72, 0x400, 0x400, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x9b internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(*FD).Read(0xc00bb56000, 0xc00ffe9800, 0x400, 0x400, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x19b net.(*netFD).Read(0xc00bb56000, 0xc00ffe9800, 0x400, 0x400, 0x43a8ac, 0xc000032000, 0x1560cc0) /usr/local/go/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc000195f90, 0xc00ffe9800, 0x400, 0x400, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:177 +0x69 github.com/hyperchain/hyperchain/crypto/tls.(*block).readFromUntil(0xc001e41230, 0x197d1a0, 0xc000195f90, 0x5, 0xc000195f90, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:492 +0x86 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).readRecord(0xc001979c00, 0x1797617, 0xc001979d20, 0x8) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:593 +0xd8 github.com/hyperchain/hyperchain/crypto/tls.(*Conn).Read(0xc001979c00, 0xc009f4a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/crypto/tls/conn.go:1145 +0xf1 bufio.(*Reader).Read(0xc00aad5ce0, 0xc0005ed6f8, 0x9, 0x9, 0x18, 0x18, 0xc00a1046a0) /usr/local/go/src/bufio/bufio.go:223 +0x23e io.ReadAtLeast(0x197b440, 0xc00aad5ce0, 0xc0005ed6f8, 0x9, 0x9, 0x9, 0x20, 0x15b32a0, 0x47e9c8) /usr/local/go/src/io/io.go:310 +0x88 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.readFrameHeader(0xc0005ed6f8, 0x9, 0x9, 0x197b440, 0xc00aad5ce0, 0x0, 0x0, 0xbf48d14286733dc7, 0x9ed7640674) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:237 +0x88 github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0005ed6c0, 0xc00b20a1c0, 0xc00b20a1c0, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc003b9e000, 0xc001e41620, 0x1796798) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/internal/transport/http2_server.go:431 +0x7c github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000240f00, 0x19b6500, 0xc003b9e000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:687 +0xdd github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000240f00, 0x19b6500, 0xc003b9e000) /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:649 +0x43 created by github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc.(*Server).handleRawConn /var/go/src/github.com/hyperchain/hyperchain/vendor/google.golang.org/grpc/server.go:648 +0x580 goroutine 89570 [chan receive]: github.com/hyperchain/hyperchain/p2p/transport/grpc.(*grpcTransport).ReadMsg(0xc0003e09a0, 0xc00402f2d0, 0x6, 0xc00402f2d6, 0x5, 0xc001817a80, 0xc00402f200, 0x0, 0x0) /var/go/src/github.com/hyperchain/hyperchain/p2p/transport/grpc/grpc.go:308 +0x93 github.com/hyperchain/hyperchain/p2p.(*Peer).readLoop(0xc00b80b9a0, 0xc00bf83f20) /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:283 +0xae created by github.com/hyperchain/hyperchain/p2p.(*Peer).run /var/go/src/github.com/hyperchain/hyperchain/p2p/peer.go:179 +0xf2 rax 0x5020dfe rbx 0xc00178e998 rcx 0x7f5d44eb94b0 rdx 0x131c375 rdi 0x29bb620 rsi 0x1 rbp 0x0 rsp 0x7f5d1d18edf0 r8 0x7f5d1d18ecf0 r9 0x7f5d1d18ede0 r10 0x8 r11 0x246 r12 0xffffffffffffffff r13 0x26 r14 0x25 r15 0x200 rip 0x2347005 rflags 0x10203 cs 0x33 fs 0x0 gs 0x0
@beoran
Copy link

beoran commented Aug 1, 2019

Could you perhaps give us a small example of Go and C (and maybe Java) code that has the same problem? CGO is delicate, and may require the use of runtime.LockOSThread() or other precautions.

@ALTree
Copy link
Member

ALTree commented Aug 1, 2019

Hi, and thanks for reporting this.

The variety and nondeterminism of the crash errors suggests that the root cause is likely to be memory corruption caused by an issue in the C or cgo parts of your codebase.

Unless you have convincing evidence that your program is 100% correct, and that the issue is actually caused by a bug in the Go compiler or runtime, a report like this is essentially non-actionable.

@ALTree ALTree added the WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. label Aug 1, 2019
@hafeidejiangyou
Copy link
Author

We remove a malloc code in C binding code, which used frequently, and the panic is gone. Now we test it for days and it looks good.

@hafeidejiangyou
Copy link
Author

Every malloc have free(), so it may be the CGO gc problem?But the program is too large and the demo can not recurring problem, so i can not provide it. I will close the issue, thanks.

@ianlancetaylor
Copy link
Member

Thanks for following up.

@golang golang locked and limited conversation to collaborators Aug 6, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
FrozenDueToAge WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.
Projects
None yet
Development

No branches or pull requests

5 participants