Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

runtime: crash with traceback stuck #66398

Closed
XuHuaiyu opened this issue Mar 19, 2024 · 3 comments
Closed

runtime: crash with traceback stuck #66398

XuHuaiyu opened this issue Mar 19, 2024 · 3 comments
Labels
compiler/runtime Issues related to the Go compiler and/or runtime. WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.

Comments

@XuHuaiyu
Copy link

Go version

go1.19.12

Output of go env in your module/workspace:

$ go env

What did you do?

There has been one crash occurrence currently, with no clear reproducible method identified. The node has consistently been running daily business workloads, with no other changes in operations.

What did you see happen?

In our customer's production environment cluster, a database node crash occurred, and the error stack is as follows:

runtime: traceback stuck. pc=0x3973c50 sp=0x40024d7fb0
stack: frame={sp:0x40024d7fb0, fp:0x40024d7fb0} stack=[0x40024d4000,0x40024d8000)
0x00000040024d7eb0:  0x0001000000010000  0x000000410220f500 
0x00000040024d7ec0:  0x000000417b54c000  0x0000000004c76ee0 
0x00000040024d7ed0:  0x000000410220f500  0x000000417b4e5f08 
0x00000040024d7ee0:  0x0000000001d1d0f0 <google.golang.org/grpc/internal/transport.(*loopyWriter).run+0x0000000000000060>  0x000000417b338360 
0x00000040024d7ef0:  0x0000000000000000  0x000000417b338480 
0x00000040024d7f00:  0x0000000000000000  0x0000000000000000 
0x00000040024d7f10:  0x0000000001d321a8 <google.golang.org/grpc/internal/transport.NewServerTransport.func2+0x00000000000000d8>  0x000000410220f4f0 
0x00000040024d7f20:  0x0000000003f7cd01  0x00000040cfcf3c90 
0x00000040024d7f30:  0x0000000003973c1c <github.com/pingcap/tidb/executor.(*IndexLookUpExecutor).startTableWorker.func1+0x00000000000000bc>  0x01000040024ecf68 
0x00000040024d7f40:  0x0000000000000000  0x0000000000000000 
0x00000040024d7f50:  0x0000000001d1d330 <google.golang.org/grpc/internal/transport.(*loopyWriter).run.func1+0x0000000000000000>  0x00000040024d7f40 
0x00000040024d7f60:  0x00000040024d7f50  0x0000000000000000 
0x00000040024d7f70:  0x000000000187de34 <runtime.goexit+0x0000000000000004>  0x000000417b391b60 
0x00000040024d7f80:  0x000000417b319850  0x000000410220f4f0 
0x00000040024d7f90:  0x0000000000000000  0x0000004173a86500 
0x00000040024d7fa0:  0x000000417ac4d000  0x000000417a51d040 
0x00000040024d7fb0: >0x0000000003973c50 <github.com/pingcap/tidb/executor.(*IndexLookUpExecutor).startTableWorker.func1.1+0x0000000000000000>  0x000000417b348000 
0x00000040024d7fc0:  0x00000040024ecfb0  0x0000000000000000 
0x00000040024d7fd0:  0x0000000000000000  0x0000000000000000 
0x00000040024d7fe0:  0x0000000000000000  0x0000000000000000 
0x00000040024d7ff0:  0x0000000000000000  0x0000000000000000 
fatal error: traceback stuck

What did you expect to see?

No crash
@gopherbot gopherbot added the compiler/runtime Issues related to the Go compiler and/or runtime. label Mar 19, 2024
@XuHuaiyu XuHuaiyu changed the title runtime: crash with runtime: crash with traceback stuck Mar 19, 2024
@dr2chase
Copy link
Contributor

Is this a one-time failure, or does it happen more often?

Upgrading to the current version of Go (1.22) might help, and also has a better chance of a fix because we are no longer fixing bugs in 1.19.

@dr2chase dr2chase added the WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. label Mar 19, 2024
@XuHuaiyu
Copy link
Author

@dr2chase
Thank you for your reply. This is a one-time bug. However, we are unable to recompile and upgrade the services in the user's environment. Are there any known bugs in the version we are using that could potentially cause this issue? I tried searching for the error message keyword but couldn't find any relevant issues.

@seankhliao seankhliao added WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. and removed WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided. labels Mar 22, 2024
@gopherbot
Copy link

Timed out in state WaitingForInfo. Closing.

(I am just a bot, though. Please speak up if this is a mistake or you have the requested information.)

@gopherbot gopherbot closed this as not planned Won't fix, can't repro, duplicate, stale Apr 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
compiler/runtime Issues related to the Go compiler and/or runtime. WaitingForInfo Issue is not actionable because of missing required information, which needs to be provided.
Projects
Go Compiler / Runtime
Status: Done
Milestone
No milestone
Development

No branches or pull requests
4 participants
@dr2chase @gopherbot @XuHuaiyu @seankhliao