Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

runtime: "fatal error: s.allocCount != s.nelems && freeIndex == s.nelems" during newobject on windows-amd64 #45775

Closed
bcmills opened this issue Apr 26, 2021 · 20 comments
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Windows release-blocker
Milestone

Comments

@bcmills
Copy link
Contributor

bcmills commented Apr 26, 2021

2021-04-23T21:42:59-41e5ae4/windows-amd64-2012

runtime: s.allocCount= 63 s.nelems= 64
            fatal error: s.allocCount != s.nelems && freeIndex == s.nelems
            
            goroutine 1 [running]:
            runtime.throw({0xd5860d, 0x0})
            	C:/workdir/go/src/runtime/panic.go:1198 +0x76 fp=0xc0000898a0 sp=0xc000089870 pc=0x438f76
            runtime.(*mcache).nextFree(0x330598, 0x14)
            	C:/workdir/go/src/runtime/malloc.go:877 +0x1e5 fp=0xc0000898e8 sp=0xc0000898a0 pc=0x40d145
            runtime.mallocgc(0xc000089990, 0xd042a0, 0x1)
            	C:/workdir/go/src/runtime/malloc.go:1066 +0x4e5 fp=0xc000089978 sp=0xc0000898e8 pc=0x40d665
            runtime.newobject(0x8)
            	C:/workdir/go/src/runtime/malloc.go:1174 +0x27 fp=0xc0000899a0 sp=0xc000089978 pc=0x40dac7
            cmd/internal/obj.(*Link).LookupABIInit(0xc0000de400, {0xc00051a0a0, 0xd32209}, 0x7, 0xc000089a28)
            	C:/workdir/go/src/cmd/internal/obj/sym.go:104 +0xbd fp=0xc000089a00 sp=0xc0000899a0 pc=0x542b1d
            cmd/compile/internal/base.linksym({0xd32209, 0xd32209}, {0xc00051a0a0, 0xe7ad08}, 0x7)
            	C:/workdir/go/src/cmd/compile/internal/base/link.go:35 +0x5c fp=0xc000089a50 sp=0xc000089a00 pc=0x550b3c
            cmd/compile/internal/base.PkgLinksym({0xd32209, 0xc0000addc0}, {0xd3399d, 0xc0000adea0}, 0x10)
            	C:/workdir/go/src/cmd/compile/internal/base/link.go:23 +0x92 fp=0xc000089ab0 sp=0xc000089a50 pc=0x550a92
            cmd/compile/internal/typecheck.LookupRuntimeABI(...)
            	C:/workdir/go/src/cmd/compile/internal/typecheck/syms.go:102
            cmd/compile/internal/typecheck.LookupRuntimeVar(...)
            	C:/workdir/go/src/cmd/compile/internal/typecheck/syms.go:97
            cmd/compile/internal/ssagen.InitConfig()
            	C:/workdir/go/src/cmd/compile/internal/ssagen/ssa.go:208 +0x1cd7 fp=0xc000089c98 sp=0xc000089ab0 pc=0xa67a97
            cmd/compile/internal/gc.Main(0xd64c20)
            	C:/workdir/go/src/cmd/compile/internal/gc/main.go:267 +0xd2a fp=0xc000089f20 sp=0xc000089c98 pc=0xc18f6a
            main.main()
            	C:/workdir/go/src/cmd/compile/main.go:55 +0xdd fp=0xc000089f80 sp=0xc000089f20 pc=0xc3b79d
            runtime.main()
            	C:/workdir/go/src/runtime/proc.go:255 +0x217 fp=0xc000089fe0 sp=0xc000089f80 pc=0x43b537
            runtime.goexit()
            	C:/workdir/go/src/runtime/asm_amd64.s:1581 +0x1 fp=0xc000089fe8 sp=0xc000089fe0 pc=0x4691c1

CC @mknyszek

@bcmills bcmills added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Windows labels Apr 26, 2021
@bcmills bcmills added this to the Go1.17 milestone Apr 26, 2021
@bcmills
Copy link
Contributor Author

bcmills commented Apr 26, 2021

Tentatively marking as release-blocker for 1.17 until we can determine whether this is a regression. (The only other occurrence of this error I could find in the logs was in 2019 on plan9, which seems likely to be unrelated.)

@toothrot
Copy link
Contributor

/cc @bufflig

@heschi
Copy link
Contributor

heschi commented May 13, 2021

Weekly check-in: this needs to be investigated before beta 1.

@mknyszek @aclements @prattmic

@mknyszek
Copy link
Contributor

Here's what the situation looks like: nextFreeFast (the allocator fast path) was called for this span that was already in the mcache, and it failed. Then, nextFree was called to either replenish the span's allocCache, or go get a new span. In this case, the span appears full, so it tries to go get a new span, but before it does that, the allocator notices that allocCount doesn't line up with nelems and throws an error.

What's interesting here is that this means the program was already allocating out of this mcache in the current GC cycle, at least once, anyway. And somehow the allocator missed a free slot in the process. In general, this is very unlikely; these code paths are exercised extremely heavily. The allocator did not change in 1.17, so if there's a bug in that logic, it's not new. I've walked over this code a bunch of times now and I can't find a fault in the algorithm.

I thought maybe I saw something in a corner case, like a span that was just swept (there is some super weird stuff we do that I think we should clean up, like relying on certain pieces of span state to change then fixing them up...) but it all seems to check out.

Now, on the other hand, if we consider memory corruption a (scary but) viable alternative, then an errant zero value on the span's allocCache value would manifest as this error in many cases.

@RLH
Copy link
Contributor

RLH commented May 19, 2021 via email

@mknyszek
Copy link
Contributor

Thanks Rick. I'm trying to wrap my head around why a revived object would be caught here, though, instead of when sweeping. Since only swept spans may be cached, we check for revived objects during sweeping, and marking never touches the allocation bits, I'm not sure how the allocation path could surface an error for a revived object, at least the way the code is currently written.

Perhaps there's something I'm missing, though.

@dmitshur dmitshur added the okay-after-beta1 Used by release team to mark a release-blocker issue as okay to resolve either before or after beta1 label May 27, 2021
@heschi heschi removed the okay-after-beta1 Used by release team to mark a release-blocker issue as okay to resolve either before or after beta1 label Jun 10, 2021
@heschi
Copy link
Contributor

heschi commented Jun 10, 2021

I think this needs to be addressed before final release and ideally before RC, so ping.

@toothrot
Copy link
Contributor

Checking in as the RC1 date is approaching.

@mknyszek
Copy link
Contributor

mknyszek commented Jun 17, 2021

Just walked back all the windows/amd64 failures I could find in the logs up to this failure. I couldn't find anything else like it. EDIT: Or anything else untriaged or unresolved, for that matter.

I'm really not sure what to do here. My analysis above lead nowhere.

@ianlancetaylor
Copy link
Contributor

As far as I can tell this has happened exactly once. "Once is happenstance." If we don't see any way that this could happen, I think we should close the issue until it recurs.

@mknyszek
Copy link
Contributor

If it happens again, I'm happy to throw more resources at it to find the root cause, but I really don't see how this could happen, and I don't feel particularly optimistic about reproducing it given how well reproducing FreeBSD memory corruption is going (though, that has certainly happened more than once!).

@bcmills
Copy link
Contributor Author

bcmills commented Jun 17, 2021

I'd be ok with closing it as non-reproducible for now, given that we also can't identify any changes that might have caused it.

@ianlancetaylor
Copy link
Contributor

Closing.

@davepacheco
Copy link

I just saw this same issue in Go 1.16.10 on illumos. (See oxidecomputer/omicron#1146.) I see that someone else saw this on Linux on ARM years ago. Should this issue be reopened?

@jmpesp
Copy link

jmpesp commented Jun 7, 2022

I've been able to reproduce this and what look like other GC related errors on OmniOS (an illumos based OS) running on physical hardware and under QEMU. Here's the steps that have worked for me:

On Ubuntu, install the ovmf and qemu packages.

Create an OmniOS disk:

$ qemu-img create -f qcow2 omnios.qcow2 16G

Download the OmniOS installer:

$ wget --quiet https://downloads.omnios.org/media/stable/omnios-r151042.usb-dd
$ curl -sq https://downloads.omnios.org/media/stable/omnios-r151042.usb-dd.sha256
1d71502c1c5518d911fbca64954bf094f40de10897bf802ffffaf0e1452d0665
$ sha256sum omnios-r151042.usb-dd
1d71502c1c5518d911fbca64954bf094f40de10897bf802ffffaf0e1452d0665  omnios-r151042.usb-dd

Boot qemu, and install OmniOS:

qemu-system-x86_64 \
    -m 12g \
    -enable-kvm \
    -cpu host \
    -smp $(nproc) \
    -drive file=omnios.qcow2,if=virtio,format=qcow2 \
    -bios /usr/share/OVMF/OVMF_CODE.fd \
    -drive if=none,id=stick,format=raw,file=${PWD}/omnios-r151042.usb-dd \
    -device ich9-usb-ehci1,id=ehci,addr=0x4 \
    -device usb-storage,bus=ehci.0,drive=stick

Note that $(nproc) on my system returns 24.

During the install process:

  • Select keyboard layout (US-English is the default)
  • Select "Find disks, create rpool, and install OmniOS"
  • Press space to select the Virtio Block Device, then OK.
  • Up until "Installing ZFS image", I selected all defaults.
  • After the image is installed, select "Configure the installed OmniOS system"
    -- Configure Networking -> Configuration Mode -> DHCP
    -- SSH Server -> Enabled
    -- Serial Console -> ttya, 115200, 8, none, 1

Then pick Halt. Boot the freshly installed OmniOS image without the USB stick and forwarding SSH:

qemu-system-x86_64 \
    -m 12g \
    -enable-kvm \
    -cpu host \
    -smp $(nproc) \
    -drive file=omnios.qcow2,if=virtio,format=qcow2 \
    -bios /usr/share/OVMF/OVMF_CODE.fd \
    -device e1000,netdev=net0,addr=0x5 \
    -netdev user,id=net0,hostfwd=tcp::5555-:22

There's some post-install setup required. Switch over to serial0 in qemu and log in as root (with no password).

  • if you run ipadm, it should show 10.0.2.15/24 that was grabbed from qemu through dhcp. if it does not, then run ipadm create-addr -T dhcp e1000g0/v4
  • to ssh in as root, run sed -i -e 's/PermitRootLogin no/PermitRootLogin yes/g' /etc/ssh/sshd_config, then svcadm restart ssh

after that, ssh -p 5555 root@127.0.0.1 should work from the host:

$ ssh -p 5555 root@127.0.0.1
Password:
OmniOS r151042  omnios-r151042-2a01bcc289       May 2022
root@omnios:~#

Inside the VM, install the prereq packages:

# pkg update
...
# pkg install git build-essential

Disable tmpfs by editing /etc/vfstab and commenting out:

#swap           -               /tmp            tmpfs   -       yes     -

Reboot (with reboot), then copy in the following reproduction script (note that it assumes it's running from the current user's $HOME):

#!/bin/bash
set -e

unset GOBIN
unset GOPATH

# assuming a fresh system, bootstrap go 1.4 from C toolchain
if [[ ! -e bootstrap/ ]];
then
    git clone \
        --recurse-submodules \
        -b release-branch.go1.4 \
        --depth=1 \
        https://go.googlesource.com/go bootstrap

    (
     cd bootstrap/src/
     export CGO_ENABLED=0
     bash ./make.bash
    )
fi

#VERSION="go1.16.10"
#VERSION="go1.16.11"
#VERSION="go1.16.15"
#VERSION="release-branch.go1.17"
VERSION="release-branch.go1.18"

# build $VERSION using go 1.4
rm -rf bootstrap2/

if [[ ! -e bootstrap2 ]];
then
    export GOROOT_BOOTSTRAP=${HOME}/bootstrap/
    $GOROOT_BOOTSTRAP/bin/go version

    git clone \
        --recurse-submodules \
        -b $VERSION \
        --depth=1 \
        https://go.googlesource.com/go bootstrap2

    ( cd bootstrap2/src && bash ./make.bash )

    unset GOROOT_BOOTSTRAP
fi

export PATH="${HOME}/bootstrap2/bin:$PATH"

# build $VERSION in a loop
while :;
do
        rm -rf goroot/
        rm -rf /tmp/go-* /tmp/cgo*

        git clone \
                --recurse-submodules \
                -b $VERSION \
                --depth=1 \
                https://go.googlesource.com/go goroot

        # core files, please
        sed -i -e '/ulimit -c 0/d' goroot/src/run.bash

        ( cd goroot/src && bash ./all.bash )
done;

Then, run ./repro.sh until it breaks (it took my VM about 11 minutes on release-branch.go1.18).

With this, we've seen

fatal error: s.allocCount != s.nelems && freeIndex == s.nelems

on some physical machines, we've seen:

2022/06/07 16:51:53 loading imports: exit status 2
runtime: marked free object in span 0xfffffc7fecc2d158, elemsize=4096 freeindex=1 (bad use of unsafe.Pointer? try -d=checkptr)
0xc0002fa000 alloc unmarked
0xc0002fb000 free  unmarked
fatal error: found pointer to free object

and

##### ../misc/cgo/testso
--- FAIL: TestSO (0.37s)
    so_test.go:100: gcc -fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build3726058972=/tmp/go-build -gno-record-gcc-switches -shared -o libcgosotest.so cgoso_c.c:
    so_test.go:117: go build -o main.exe main.go: exit status 2
        runtime: marked free object in span 0xfffffc7fef178a78, elemsize=144 freeindex=1 (bad use of unsafe.Pointer? try -d=checkptr)

@prattmic
Copy link
Member

prattmic commented Jun 7, 2022

Thanks for the report. Given that this issue has been closed for a year and we hadn't seen crashes on illumos previously, could you move this to a new issue?

@sixhj
Copy link

sixhj commented Nov 15, 2022

@mknyszek
I have this problem often, several times a day

Platform is ARM, Yogurt (Phytec Example Distribution) BSP-Yocto-i.MX6-PD18.1.2

use go1.17.13.linux-armv6l.tar.gz.

This is the log:

runtime: s.allocCount= 511 s.nelems= 512
fatal error: s.allocCount != s.nelems && freeIndex == s.nelems

goroutine 69009 [running]:
runtime.throw({0xc1c477, 0x31})
/mnt/go/src/runtime/panic.go:1198 +0x5c fp=0x322fc44 sp=0x322fc30 pc=0x396728
runtime.(*mcache).nextFree(0xb60da088, 0x5)
/mnt/go/src/runtime/malloc.go:884 +0x204 fp=0x322fc68 sp=0x322fc44 pc=0x36785c
runtime.mallocgc(0x10, 0xb14138, 0x1)
/mnt/go/src/runtime/malloc.go:1077 +0x60c fp=0x322fcac sp=0x322fc68 pc=0x367e9c
runtime.makeslice(0xb14138, 0x10, 0x10)
/mnt/go/src/runtime/slice.go:98 +0xac fp=0x322fcc0 sp=0x322fcac pc=0x3b16d4
zzmj.automation.depends/common/pdp.(*PDP).Marshal(0x314e3c0)
/mnt/mx/Scu_release/zzmj.automation.depends/common/pdp/pdp.go:37 +0x28 fp=0x322fcd4 sp=0x322fcc0 pc=0x69c05c
zzmj%2eautomation%2edevice%2emainboard.(*Mainboard).Post(0x2826370, 0x1, 0x314e3c0)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.device.mainboard/mainboard.go:279 +0x2c fp=0x322fcf0 sp=0x322fcd4 pc=0x9dc2c0
zzmj.automation.service.gateway/scu.(*ScuGateWay).PostPDP(0x2a20268, {0xd2a9f4, 0x35bd710}, 0x314e3a0)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.service.gateway/scu/remote_scu.go:75 +0x1e4 fp=0x322fd38 sp=0x322fcf0 pc=0xa83c64
zzmj.automation.depends/common/protos._RemoteBoot_PostPDP_Handler({0xb8a178, 0x2a20268}, {0xd2a9f4, 0x35bd710}, 0x358ebc0, 0x0)
/mnt/mx/Scu_release/zzmj.automation.depends/common/protos/remote_boot_grpc.pb.go:89 +0x190 fp=0x322fd6c sp=0x322fd38 pc=0x8987a8
google.golang.org/grpc.(*Server).processUnaryRPC(0x297e5a0, {0xd32264, 0x2bf8360}, 0x35ba140, 0x29b51a0, 0x11a0c98, 0x0)
/mnt/gomod/google.golang.org/grpc@v1.50.1/server.go:1340 +0xd54 fp=0x322ff20 sp=0x322fd6c pc=0x863da4
google.golang.org/grpc.(*Server).handleStream(0x297e5a0, {0xd32264, 0x2bf8360}, 0x35ba140, 0x0)
/mnt/gomod/google.golang.org/grpc@v1.50.1/server.go:1713 +0xa70 fp=0x322ffb0 sp=0x322ff20 pc=0x868384
google.golang.org/grpc.(*Server).serveStreams.func1.2(0x311b120, 0x297e5a0, {0xd32264, 0x2bf8360}, 0x35ba140)
/mnt/gomod/google.golang.org/grpc@v1.50.1/server.go:965 +0x8c fp=0x322ffd4 sp=0x322ffb0 pc=0x8619c8
runtime.goexit()
/mnt/go/src/runtime/asm_arm.s:838 +0x4 fp=0x322ffd4 sp=0x322ffd4 pc=0x3cdf70
created by google.golang.org/grpc.(*Server).serveStreams.func1
/mnt/gomod/google.golang.org/grpc@v1.50.1/server.go:963 +0x1b8


runtime: s.allocCount= 340 s.nelems= 341
fatal error: s.allocCount != s.nelems && freeIndex == s.nelems

goroutine 17 [running, locked to thread]:
runtime.throw({0xc1c477, 0x31})
/mnt/go/src/runtime/panic.go:1198 +0x5c fp=0x36fdd2c sp=0x36fdd18 pc=0x396728
runtime.(*mcache).nextFree(0xb60c5088, 0x6)
/mnt/go/src/runtime/malloc.go:884 +0x204 fp=0x36fdd50 sp=0x36fdd2c pc=0x36785c
runtime.mallocgc(0x18, 0xb91a78, 0x1)
/mnt/go/src/runtime/malloc.go:1077 +0x60c fp=0x36fdd94 sp=0x36fdd50 pc=0x367e9c
runtime.newobject(0xb91a78)
/mnt/go/src/runtime/malloc.go:1234 +0x2c fp=0x36fdda8 sp=0x36fdd94 pc=0x36845c
zzmj%2eautomation%2eauto%2edeviceboard.(*Deviceboard).PostEventAll(0x30be6c0, 0x36fdeac)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.auto.deviceboard/deviceboard_data_notify_all.go:54 +0x5ec fp=0x36fde6c sp=0x36fdda8 pc=0x931144
zzmj%2eautomation%2eauto%2edeviceboard.(*Deviceboard).OnDataNotifyAll(0x30be6c0, 0x0, 0x9e8efd64)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.auto.deviceboard/deviceboard_data_notify_all.go:33 +0x140 fp=0x377febc sp=0x36fde6c pc=0x930aec
zzmj%2eautomation%2eauto%2edeviceboard.(*Deviceboard).OnServiceHandle(0x30be6c0, 0x4, 0x22, 0x0, 0x9e8efd64)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.auto.deviceboard/deviceboard.go:238 +0x70 fp=0x377fed0 sp=0x377febc pc=0x92dfe8
zzmj%2eautomation%2ecomm%2eerpc.(*ERpc).OnServiceHandle(0x300f300, 0x4, 0x22, 0x0, 0x9e8efd64)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.comm.erpc/erpc.go:52 +0xa4 fp=0x377ff38 sp=0x377fed0 pc=0x952b30
zzmj%2eautomation%2ecomm%2eerpc.ErpcServiceProcess(...)
/mnt/mx/Scu_release/zzmj.automation.daemon/zzmj.automation.comm.erpc/erpc.cgo.go:24
_cgoexp_1e31720ecc5d_ErpcServiceProcess(0x9e8efd2c)
_cgo_gotypes.go:162 +0x54 fp=0x377ff54 sp=0x377ff38 pc=0x953c80
runtime.cgocallbackg1(0x953c2c, 0x9e8efd2c, 0x0)
/mnt/go/src/runtime/cgocall.go:306 +0x1a8 fp=0x377ffa8 sp=0x377ff54 pc=0x35ea94
runtime.cgocallbackg(0x953c2c, 0x9e8efd2c, 0x0)
/mnt/go/src/runtime/cgocall.go:232 +0xcc fp=0x377ffe0 sp=0x377ffa8 pc=0x35e878
runtime.cgocallback(0x0, 0x0, 0x0)
/mnt/go/src/runtime/asm_arm.s:716 +0x84 fp=0x377fff0 sp=0x377ffe0 pc=0x3cde34
runtime.goexit()
/mnt/go/src/runtime/asm_arm.s:838 +0x4 fp=0x377fff0 sp=0x377fff0 pc=0x3cdf70


can you help me ?

thanks

@ajstarks
Copy link
Contributor

ajstarks commented Aug 2, 2023

This also occurred for me on this machine: go1.20.6, AMD Ryzen 9 6900HX , 32Gb RAM, Fedora Linux 38 (6.4.6-200.fc38.x86_64)
when running a standard script that rebuilds and runs giocanvas clients (https://github.com/ajstarks/giocanvas/blob/master/update) . Running the same script on an Intel i5, 8Gb RAM shows no errors.

$ ./update
go: downloading gioui.org v0.1.1-0.20230801070910-edbf872b44af
go: upgraded gioui.org v0.1.1-0.20230731100737-c7c49c3258f8 => v0.1.1-0.20230801070910-edbf872b44af
alpha arc apisheet cchue concentric compchart confetti dots elections eclipse flowers gcdeck grid hello images lego lines mondrian pie polar rgb scim shapesketch showimage spiral sunearth tile transform twrap play 
alpha arc apisheet cchue concentric compchart confetti dots elections eclipse flowers gcdeck grid hello images lego lines mondrian pie polar rgb scim shapesketch showimage spiral sunearth tile transform twrap play 
$ runtime: s.allocCount= 93 s.nelems= 102
fatal error: s.allocCount != s.nelems && freeIndex == s.nelems

goroutine 6 [running]:
runtime.throw({0x7e13c7?, 0xc000fc9728?})
	/home/ajstarks/go/src/runtime/panic.go:1047 +0x5d fp=0xc000fc9300 sp=0xc000fc92d0 pc=0x441b1d
runtime.(*mcache).nextFree(0x7fc5102d55b8, 0xe)
	/home/ajstarks/go/src/runtime/malloc.go:853 +0x1e5 fp=0xc000fc9348 sp=0xc000fc9300 pc=0x41a405
runtime.mallocgc(0x48, 0x79f660, 0x1)
	/home/ajstarks/go/src/runtime/malloc.go:1042 +0x455 fp=0xc000fc93b0 sp=0xc000fc9348 pc=0x41a895
runtime.convT(0x79f660, 0xc000fc9458?)
	/home/ajstarks/go/src/runtime/iface.go:331 +0x34 fp=0xc000fc93e8 sp=0xc000fc93b0 pc=0x418434
github.com/go-text/typesetting/fontscan.fontSet.selectByFamily({0xc000cf02a0, 0x1, 0x1}, {0xc000165248?, 0x748a60?}, 0x0, 0xc000218340, 0xc000cf2e70)
	/home/ajstarks/gowork/pkg/mod/github.com/go-text/typesetting@v0.0.0-20230720191532-efc36025df80/fontscan/match.go:142 +0x42d fp=0xc000fc95d0 sp=0xc000fc93e8 pc=0x6596cd
github.com/go-text/typesetting/fontscan.(*FontMap).buildCandidates.func1(0x0)
	/home/ajstarks/gowork/pkg/mod/github.com/go-text/typesetting@v0.0.0-20230720191532-efc36025df80/fontscan/fontmap.go:364 +0xaa fp=0xc000fc9668 sp=0xc000fc95d0 pc=0x65672a
github.com/go-text/typesetting/fontscan.(*FontMap).buildCandidates(0xc000218280)
	/home/ajstarks/gowork/pkg/mod/github.com/go-text/typesetting@v0.0.0-20230720191532-efc36025df80/fontscan/fontmap.go:390 +0x1ca fp=0xc000fc9758 sp=0xc000fc9668 pc=0x65648a
github.com/go-text/typesetting/fontscan.(*FontMap).ResolveFace(0xc000218280, 0x73)
	/home/ajstarks/gowork/pkg/mod/github.com/go-text/typesetting@v0.0.0-20230720191532-efc36025df80/fontscan/fontmap.go:440 +0x237 fp=0xc000fc99b0 sp=0xc000fc9758 pc=0x656d97
gioui.org/text.(*shaperImpl).ResolveFace(0xc000b60c28, 0xfc9c88?)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/gotext.go:327 +0x39 fp=0xc000fc9a68 sp=0xc000fc99b0 pc=0x6720f9
github.com/go-text/typesetting/shaping.SplitByFace({{0xc000020948, 0x5, 0x6}, 0x0, 0x5, 0x0, 0x0, {0x0, 0x0, 0x0}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/github.com/go-text/typesetting@v0.0.0-20230720191532-efc36025df80/shaping/input.go:116 +0x126 fp=0xc000fc9b68 sp=0xc000fc9a68 pc=0x663ce6
gioui.org/text.(*shaperImpl).splitByFaces(0xc000020948?, {0xc000cf0380?, 0x1, 0x5?}, {0x0?, 0x0?, 0x0?})
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/gotext.go:350 +0x1b1 fp=0xc000fc9c98 sp=0xc000fc9b68 pc=0x672631
gioui.org/text.(*shaperImpl).shapeText(0xc000b60c28, 0x600, {{0x0?, 0x5e85cd?}, 0x10?}, {0xc000020948, 0x5, 0x6})
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/gotext.go:372 +0x385 fp=0xc000fc9fc0 sp=0xc000fc9c98 pc=0x672aa5
gioui.org/text.(*shaperImpl).shapeAndWrapText(0xc000b60c28, {{{0x0, 0x0}, 0x0, 0x0}, 0x2, 0x600, 0x0, {0x0, 0x0}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/gotext.go:466 +0x5ae fp=0xc000fca150 sp=0xc000fc9fc0 pc=0x6736ae
gioui.org/text.(*shaperImpl).LayoutRunes(0xc000b60c28, {{{0x0, 0x0}, 0x0, 0x0}, 0x2, 0x600, 0x0, {0x0, 0x0}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/gotext.go:535 +0x17e fp=0xc000fca378 sp=0xc000fca150 pc=0x67397e
gioui.org/text.(*Shaper).layoutParagraph(0xc000b60c00, {{{0x0, 0x0}, 0x0, 0x0}, 0x2, 0x600, 0x0, {0x0, 0x0}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/shaper.go:395 +0x458 fp=0xc000fca608 sp=0xc000fca378 pc=0x677cf8
gioui.org/text.(*Shaper).layoutText(0xc000b60c00, {{{0x0, 0x0}, 0x0, 0x0}, 0x2, 0x600, 0x0, {0x0, 0x0}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/shaper.go:332 +0x4d4 fp=0xc000fca808 sp=0xc000fca608 pc=0x677434
gioui.org/text.(*Shaper).LayoutString(0x34f0000012a?, {{{0x0, 0x0}, 0x0, 0x0}, 0x2, 0x600, 0x0, {0x0, 0x0}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/text/shaper.go:278 +0x94 fp=0xc000fca8c8 sp=0xc000fca808 pc=0x676ef4
gioui.org/widget.Label.LayoutDetailed({0x2, 0x0, {0x0, 0x0}, 0x0, 0x0, 0x0}, {{{0x640, 0x3e8}, {0x640, ...}}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/widget/label.go:59 +0x2b0 fp=0xc000fcb738 sp=0xc000fca8c8 pc=0x685dd0
gioui.org/widget.Label.Layout(...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/widget/label.go:43
gioui.org/widget/material.LabelStyle.Layout({{{0x0, 0x0}, 0x0, 0x0}, {0x0, 0x0, 0x0, 0xff}, {0x3f, 0x51, ...}, ...}, ...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/widget/material/label.go:153 +0x8b6 fp=0xc000fcbab8 sp=0xc000fcb738 pc=0x692b96
github.com/ajstarks/giocanvas.(*Canvas).textops(0xc000030100, 0x6cba45?, 0x0?, 0x41c00000, 0x2, {0x7ce476, 0x5}, {0x9a?, 0x99?, 0x99?, ...})
	/home/ajstarks/gocode/giocanvas/abs.go:39 +0x4bb fp=0xc000fcbe00 sp=0xc000fcbab8 pc=0x6c5b7b
github.com/ajstarks/giocanvas.(*Canvas).TextMid(0x447a000096b48246?, 0x30100?, 0xc0?, 0xfcbee4?, {0x7ce476?, 0x0?}, {0xd8?, 0xbe?, 0xfc?, 0x0?})
	/home/ajstarks/gocode/giocanvas/pct.go:167 +0x69 fp=0xc000fcbe40 sp=0xc000fcbe00 pc=0x6cb649
main.ref(0xc000118600, 0x2?, 0x0?, 0x0)
	/home/ajstarks/gocode/giocanvas/apisheet/main.go:153 +0x119a fp=0xc000fcbf90 sp=0xc000fcbe40 pc=0x6cd25a
main.main.func1()
	/home/ajstarks/gocode/giocanvas/apisheet/main.go:208 +0xeb fp=0xc000fcbfe0 sp=0xc000fcbf90 pc=0x6cdb0b
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000fcbfe8 sp=0xc000fcbfe0 pc=0x4725e1
created by main.main
	/home/ajstarks/gocode/giocanvas/apisheet/main.go:206 +0x1b0

goroutine 1 [select (no cases)]:
runtime.gopark(0x44ce20?, 0xc0000121e0?, 0xa0?, 0x61?, 0x6cd9f0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000071ee0 sp=0xc000071ec0 pc=0x444876
runtime.block()
	/home/ajstarks/go/src/runtime/select.go:103 +0x2c fp=0xc000071f10 sp=0xc000071ee0 pc=0x453d4c
gioui.org/app.osMain(...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/os_unix.go:43
gioui.org/app.Main(...)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/app.go:64
main.main()
	/home/ajstarks/gocode/giocanvas/apisheet/main.go:214 +0x1b7 fp=0xc000071f80 sp=0xc000071f10 pc=0x6cd9f7
runtime.main()
	/home/ajstarks/go/src/runtime/proc.go:250 +0x207 fp=0xc000071fe0 sp=0xc000071f80 pc=0x444447
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000071fe8 sp=0xc000071fe0 pc=0x4725e1

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060fb0 sp=0xc000060f90 pc=0x444876
runtime.goparkunlock(...)
	/home/ajstarks/go/src/runtime/proc.go:387
runtime.forcegchelper()
	/home/ajstarks/go/src/runtime/proc.go:305 +0xb0 fp=0xc000060fe0 sp=0xc000060fb0 pc=0x4446b0
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000060fe8 sp=0xc000060fe0 pc=0x4725e1
created by runtime.init.6
	/home/ajstarks/go/src/runtime/proc.go:293 +0x25

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061780 sp=0xc000061760 pc=0x444876
runtime.goparkunlock(...)
	/home/ajstarks/go/src/runtime/proc.go:387
runtime.bgsweep(0x0?)
	/home/ajstarks/go/src/runtime/mgcsweep.go:319 +0xde fp=0xc0000617c8 sp=0xc000061780 pc=0x43117e
runtime.gcenable.func1()
	/home/ajstarks/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000617e0 sp=0xc0000617c8 pc=0x4265e6
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000617e8 sp=0xc0000617e0 pc=0x4725e1
created by runtime.gcenable
	/home/ajstarks/go/src/runtime/mgc.go:178 +0x6b

goroutine 4 [GC scavenge wait]:
runtime.gopark(0xe2dd12dd7867?, 0xd3e84?, 0x0?, 0x0?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000061f70 sp=0xc000061f50 pc=0x444876
runtime.goparkunlock(...)
	/home/ajstarks/go/src/runtime/proc.go:387
runtime.(*scavengerState).park(0xaae8a0)
	/home/ajstarks/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc000061fa0 sp=0xc000061f70 pc=0x42f053
runtime.bgscavenge(0x0?)
	/home/ajstarks/go/src/runtime/mgcscavenge.go:633 +0x65 fp=0xc000061fc8 sp=0xc000061fa0 pc=0x42f645
runtime.gcenable.func2()
	/home/ajstarks/go/src/runtime/mgc.go:179 +0x26 fp=0xc000061fe0 sp=0xc000061fc8 pc=0x426586
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000061fe8 sp=0xc000061fe0 pc=0x4725e1
created by runtime.gcenable
	/home/ajstarks/go/src/runtime/mgc.go:179 +0xaa

goroutine 5 [finalizer wait]:
runtime.gopark(0x0?, 0x812b98?, 0x0?, 0xa0?, 0x2000000020?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000060628 sp=0xc000060608 pc=0x444876
runtime.runfinq()
	/home/ajstarks/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000607e0 sp=0xc000060628 pc=0x425627
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000607e8 sp=0xc0000607e0 pc=0x4725e1
created by runtime.createfing
	/home/ajstarks/go/src/runtime/mfinal.go:163 +0x45

goroutine 7 [select]:
runtime.gopark(0xc00006cf50?, 0x5?, 0x1?, 0x0?, 0xc00006ceee?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc00006cd60 sp=0xc00006cd40 pc=0x444876
runtime.selectgo(0xc00006cf50, 0xc00006cee4, 0x6?, 0x0, 0x0?, 0x1)
	/home/ajstarks/go/src/runtime/select.go:327 +0x7be fp=0xc00006cea0 sp=0xc00006cd60 pc=0x45451e
gioui.org/app.(*Window).run(0xc000118600, {0xc0000883c0?, 0xc0000121f8?, 0xc000105528?})
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/window.go:961 +0x1d9 fp=0xc00006cfb0 sp=0xc00006cea0 pc=0x6a3519
gioui.org/app.NewWindow.func6()
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/window.go:188 +0x32 fp=0xc00006cfe0 sp=0xc00006cfb0 pc=0x69f592
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x4725e1
created by gioui.org/app.NewWindow
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/window.go:188 +0x834

goroutine 18 [select, locked to thread]:
runtime.gopark(0xc0005db8c8?, 0x4?, 0xc0?, 0x10?, 0xc0005db8a0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0005db728 sp=0xc0005db708 pc=0x444876
runtime.selectgo(0xc0005db8c8, 0xc0005db898, 0xc0005db8c8?, 0x1, 0x58?, 0x1)
	/home/ajstarks/go/src/runtime/select.go:327 +0x7be fp=0xc0005db868 sp=0xc0005db728 pc=0x45451e
gioui.org/app.(*Window).waitFrame(0xc000118600, {0x862c68, 0xc000218000})
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/window.go:744 +0xea fp=0xc0005db918 sp=0xc0005db868 pc=0x6a1b6a
gioui.org/app.(*Window).processEvent(0xc000118600, {0x862c68, 0xc000218000}, {0x85f028, 0xc001efc840})
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/window.go:872 +0x8e7 fp=0xc0005dbcf0 sp=0xc0005db918 pc=0x6a2707
gioui.org/app.(*callbacks).Event(0xc000118ad0, {0x85f028?, 0xc001efc840?})
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/window.go:476 +0x145 fp=0xc0005dbdb0 sp=0xc0005dbcf0 pc=0x6a0ac5
gioui.org/app.(*x11Window).loop(0xc000218000)
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/os_x11.go:460 +0x3b9 fp=0xc0005dbf50 sp=0xc0005dbdb0 pc=0x6bbc19
gioui.org/app.newX11Window.func12()
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/os_x11.go:834 +0x1a5 fp=0xc0005dbfe0 sp=0xc0005dbf50 pc=0x6bdf25
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0005dbfe8 sp=0xc0005dbfe0 pc=0x4725e1
created by gioui.org/app.newX11Window
	/home/ajstarks/gowork/pkg/mod/gioui.org@v0.1.1-0.20230801070910-edbf872b44af/app/os_x11.go:826 +0x8f5

goroutine 19 [GC worker (idle)]:
runtime.gopark(0xc000218000?, 0xc0000883c0?, 0x6?, 0x0?, 0x10?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000062750 sp=0xc000062730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000627e0 sp=0xc000062750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 20 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc00005c750 sp=0xc00005c730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc00005c7e0 sp=0xc00005c750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00005c7e8 sp=0xc00005c7e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 8 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000062f50 sp=0xc000062f30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000062fe0 sp=0xc000062f50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000062fe8 sp=0xc000062fe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 9 [GC worker (idle)]:
runtime.gopark(0xe2deb0b8a74d?, 0x3?, 0x1d?, 0x2?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000063750 sp=0xc000063730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000637e0 sp=0xc000063750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000637e8 sp=0xc0000637e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 10 [GC worker (idle)]:
runtime.gopark(0xe2deacb56050?, 0x3?, 0x2d?, 0x15?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc000063f50 sp=0xc000063f30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000063fe0 sp=0xc000063f50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 11 [GC worker (idle)]:
runtime.gopark(0xe2deb0b8b3bf?, 0x1?, 0x86?, 0x48?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001ec750 sp=0xc0001ec730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001ec7e0 sp=0xc0001ec750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001ec7e8 sp=0xc0001ec7e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 12 [GC worker (idle)]:
runtime.gopark(0xe2deb0b8b49b?, 0x1?, 0x56?, 0x1c?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001ecf50 sp=0xc0001ecf30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001ecfe0 sp=0xc0001ecf50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001ecfe8 sp=0xc0001ecfe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 13 [GC worker (idle)]:
runtime.gopark(0xe2deb0b8bd6a?, 0x1?, 0x23?, 0xe4?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001ed750 sp=0xc0001ed730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001ed7e0 sp=0xc0001ed750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001ed7e8 sp=0xc0001ed7e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 14 [GC worker (idle)]:
runtime.gopark(0xaddd20?, 0x3?, 0xcc?, 0xc?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001edf50 sp=0xc0001edf30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001edfe0 sp=0xc0001edf50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001edfe8 sp=0xc0001edfe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 34 [GC worker (idle)]:
runtime.gopark(0xe2deae1640a8?, 0x3?, 0xdd?, 0x3a?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001e8750 sp=0xc0001e8730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001e87e0 sp=0xc0001e8750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001e87e8 sp=0xc0001e87e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 15 [GC worker (idle)]:
runtime.gopark(0xe2deb0b8c5de?, 0x1?, 0x51?, 0x43?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001ee750 sp=0xc0001ee730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001ee7e0 sp=0xc0001ee750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001ee7e8 sp=0xc0001ee7e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 16 [GC worker (idle)]:
runtime.gopark(0xe2deacb561cd?, 0x1?, 0xba?, 0x30?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001eef50 sp=0xc0001eef30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001eefe0 sp=0xc0001eef50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001eefe8 sp=0xc0001eefe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 50 [GC worker (idle)]:
runtime.gopark(0xe2deb0b8b640?, 0x3?, 0xa6?, 0x30?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001ef750 sp=0xc0001ef730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001ef7e0 sp=0xc0001ef750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001ef7e8 sp=0xc0001ef7e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 51 [GC worker (idle)]:
runtime.gopark(0xe2deacb55fc4?, 0x1?, 0xde?, 0x1b?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001eff50 sp=0xc0001eff30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001effe0 sp=0xc0001eff50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001effe8 sp=0xc0001effe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 52 [GC worker (idle)]:
runtime.gopark(0xaddd20?, 0x3?, 0x36?, 0x5c?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001f4750 sp=0xc0001f4730 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001f47e0 sp=0xc0001f4750 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001f47e8 sp=0xc0001f47e0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

goroutine 53 [GC worker (idle)]:
runtime.gopark(0xe2de66a0c88e?, 0x3?, 0xb3?, 0x47?, 0x0?)
	/home/ajstarks/go/src/runtime/proc.go:381 +0xd6 fp=0xc0001f4f50 sp=0xc0001f4f30 pc=0x444876
runtime.gcBgMarkWorker()
	/home/ajstarks/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0001f4fe0 sp=0xc0001f4f50 pc=0x428151
runtime.goexit()
	/home/ajstarks/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001f4fe8 sp=0xc0001f4fe0 pc=0x4725e1
created by runtime.gcBgMarkStartWorkers
	/home/ajstarks/go/src/runtime/mgc.go:1199 +0x25

@mknyszek
Copy link
Contributor

mknyszek commented Aug 2, 2023

@ajstarks Can you please file a new issue? Also, is this reproducible? Thanks.

@ajstarks
Copy link
Contributor

ajstarks commented Aug 2, 2023

@mknyszek will do, and no I have not been able to reproduce this after several attempts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Windows release-blocker
Projects
None yet
Development

No branches or pull requests