Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

archive/tar: TEST FAIL on openbsd #2240

Closed
tjyang opened this issue Sep 8, 2011 · 13 comments
Closed

archive/tar: TEST FAIL on openbsd #2240

tjyang opened this issue Sep 8, 2011 · 13 comments

Comments

@tjyang
Copy link

tjyang commented Sep 8, 2011

Understand openbsd is not fully supported yet, but following is an error in test stage.

What do you see instead?
<snipped>
--- cd pkg
test archive/tar
TEST FAIL archive/tar
gmake[1]: Entering directory `/home/tjyang/gotip/src/pkg/archive/tar'
gotest -test.short -test.timeout=120
gmake[1]: *** [testshort] Segmentation fault
gmake[1]: Leaving directory `/home/tjyang/gotip/src/pkg/archive/tar'
gmake: *** [archive/tar.testshort] Error 1
$
@4a6f656c
Copy link
Contributor

Comment 1:

From my perspective openbsd support is now fairly stable - I've been doing full builds
with all tests successfully completing for several weeks now.
Unfortunately, I'm going to need more information than has been provided - to start with:
1) What OpenBSD version and architecture are you running on (output from 'sysctl
kern.version' would be useful). You'll probably want to run -current or at least a 5.0
beta.
2) What's the status of your go repository (output from 'hg summary' for
/home/tjyang/gotip). I presume you are tracking the default branch?

@tjyang
Copy link
Author

tjyang commented Sep 10, 2011

Comment 2:

I created a "tip" user for building tip version of code. Same error message when doing
test.
-bash-4.1$ sysctl kern.version
kern.version=OpenBSD 4.9 (GENERIC.MP) #794: Wed Mar  2 07:19:02 MST 2011
    deraadt@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP
-bash-4.1$
-bash-4.1$ hg summary
parent: 9706:546f21eebee8 tip
 image/png: don't use a goroutine to decode. This was preventing
branch: default
commit: (clean)
update: (current)
-bash-4.1$
-bash-4.1$ hg id
546f21eebee8 tip
-bash-4.1$
%%%% making pkg %%%%
gmake: Entering directory `/home/tip/go/src/pkg'
install runtime
install sync/atomic
install unicode
install math
install container/list
install container/ring
install container/vector
install crypto/subtle
install utf16
install utf8
install sort
install cmath
install container/heap
install sync
install syscall
install rand
install os
install io
install strings
install crypto/cast5
install os/signal
install path
install bytes
install hash
install crypto/cipher
install exp/norm
install hash/crc64
install hash/crc32
install hash/adler32
install crypto
install regexp
install tabwriter
install path/filepath
install strconv
install crypto/md5
install crypto/sha1
install crypto/sha256
install crypto/md4
install crypto/ripemd160
install crypto/sha512
install index/suffixarray
install io/ioutil
install bufio
install reflect
install crypto/aes
install crypto/blowfish
install crypto/hmac
install encoding/base64
install crypto/openpgp/error
install crypto/rc4
install exec
install url
install crypto/twofish
install crypto/xtea
install encoding/ascii85
install encoding/base32
install encoding/git85
install encoding/hex
install image
install exp/regexp/syntax
install html
install json
install archive/tar
install compress/flate
install encoding/binary
install time
install fmt
install compress/bzip2
install encoding/pem
install crypto/openpgp/armor
install crypto/openpgp/s2k
install debug/dwarf
install flag
install go/token
install template/parse
install csv
install debug/gosym
install image/ycbcr
install log
install exp/regexp
install mime
install runtime/debug
install scanner
install gob
install hash/fnv
install runtime/pprof
install image/bmp
install image/jpeg
install old/template
install testing
install testing/iotest
install testing/quick
install testing/script
install try
install xml
install ../cmd/goyacc
install archive/zip
install big
install compress/gzip
install compress/lzw
install compress/zlib
install crypto/des
install crypto/dsa
install crypto/elliptic
install crypto/rand
install debug/elf
install debug/macho
install debug/pe
install go/scanner
install template
install image/draw
install image/gif
install image/png
install image/tiff
install patch
install asn1
install crypto/ecdsa
install crypto/rsa
install crypto/openpgp/elgamal
install go/ast
install ebnf
install exp/datafmt
install exp/gui
install exp/template/html
install ../cmd/hgpatch
install crypto/x509/pkix
install crypto/openpgp/packet
install go/doc
install go/parser
install go/printer
install go/typechecker
install go/types
install ../cmd/ebnflint
install ../cmd/govet
install crypto/x509
install crypto/openpgp
install ../cmd/cgo
install go/build
install ../cmd/gofix
install ../cmd/gofmt
install ../cmd/gotype
install crypto/ocsp
install ../cmd/gotest
install runtime/cgo
install net
install os/user
install crypto/tls
install exp/gui/x11
install net/textproto
install netchan
install syslog
install mime/multipart
install mail
install net/dict
install http
install smtp
install expvar
install http/cgi
install http/pprof
install http/httptest
install http/spdy
install rpc
install websocket
install ../cmd/godoc
install ../cmd/goinstall
install http/fcgi
install rpc/jsonrpc
gmake: Leaving directory `/home/tip/go/src/pkg'
---
Installed Go for openbsd/386 in /home/tip/go.
Installed commands in /home/tip/go/bin.
*** You need to add /home/tip/go/bin to your $PATH. ***
The compiler is 8g.
--- cd pkg
test archive/tar
TEST FAIL archive/tar
gmake[1]: Entering directory `/home/tip/go/src/pkg/archive/tar'
gotest -test.short -test.timeout=120
gmake[1]: *** [testshort] Segmentation fault
gmake[1]: Leaving directory `/home/tip/go/src/pkg/archive/tar'
gmake: *** [archive/tar.testshort] Error 1
-bash-4.1$ 
-bash-4.1$ ../go/bin/8g -V
8g version weekly.2011-09-07 9706
-bash-4.1$ pwd
/home/tip/go
-bash-4.1$

@tjyang
Copy link
Author

tjyang commented Sep 10, 2011

Comment 3:

BTW, this is a vmware session.

@4a6f656c
Copy link
Contributor

Comment 4:

OpenBSD 4.9 is too old - it does not support I386_SET_GSBASE via sysarch(), which is why
attempting to run a binary is resulting in a segfault (most likely from the runtime
notok function). If you want to use Go on OpenBSD, please update to a current snapshot.
OpenBSD 5.0 will be released on the 1st of November and it will be the first version
that Go will work fully on.

@tjyang
Copy link
Author

tjyang commented Sep 14, 2011

Comment 5:

I created another vm session to run openbsd 5.0(snapshot).  Still failed at tar test.
please see following info.
<snipped>
install http/spdy
install rpc
install websocket
install ../cmd/goinstall
install http/fcgi
install ../cmd/godoc
install rpc/jsonrpc
gmake: Leaving directory `/home/tip/go/src/pkg'
---
Installed Go for openbsd/386 in /home/tip/go.
Installed commands in /home/tip/go/bin.
The compiler is 8g.
--- cd pkg
test archive/tar
TEST FAIL archive/tar
gmake[1]: Entering directory `/home/tip/go/src/pkg/archive/tar'
gotest -test.short -test.timeout=120
throw: runtime: cannot reserve arena virtual address space
gmake[1]: *** [testshort] Error 2
gmake[1]: Leaving directory `/home/tip/go/src/pkg/archive/tar'
gmake: *** [archive/tar.testshort] Error 1
-bash-4.2$ hg summary
parent: 9740:5729b8d311d4 tip
 go/printer: use panic/defer instead of goroutine
branch: default
commit: (clean)
update: (current)
-bash-4.2$ hg id
5729b8d311d4 tip
-bash-4.2$ 8g -V
8g version weekly.2011-09-07 9740
-bash-4.2$ sysctl kern.version
kern.version=OpenBSD 5.0-current (GENERIC.MP) #66: Mon Sep 12 02:15:23 MDT 2011
    deraadt@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP
-bash-4.2$ tail ~/.bashrc
# Source global definitions
if [ -f /etc/bashrc ]; then
        . /etc/bashrc
fi
# User specific aliases and functions
PATH=${PATH}:~/go/bin
export GOROOT=~/go GOARCH=386 GOOS=openbsd GOBIN=~/go/bin
-bash-4.2$

@davecheney
Copy link
Contributor

Comment 6:

What hypervisor are you using. I found that archive/tar would fail when running FreeBSD
8/9 inside Vmware Fusion on the Mac. Are you able to test on real hardware ?

@tjyang
Copy link
Author

tjyang commented Sep 18, 2011

Comment 7:

0. I was using vmware wks 7.0 on Asus ROG with i7 cpu.
1. Another test on IBM T30 laptop.
-bash-4.2$ sysctl kern.version
kern.version=OpenBSD 5.0-current (GENERIC) #52: Tue Sep 13 22:04:50 MDT 2011
    deraadt@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC
-bash-4.2$ uname -a
OpenBSD t30.test.net 5.0 GENERIC#52 i386
-bash-4.2$ date
Sun Sep 18 08:18:11 CDT 2011
-bash-4.2$
2. still failed on tar test.
<snipped>
install http/spdy
install rpc
install websocket
install ../cmd/godoc
install ../cmd/goinstall
install http/fcgi
install rpc/jsonrpc
gmake: Leaving directory `/home/tip/go/src/pkg'
---
Installed Go for openbsd/386 in /home/tip/go.
Installed commands in /home/tip/go/bin.
The compiler is 8g.
--- cd pkg
test archive/tar
TEST FAIL archive/tar
gmake[1]: Entering directory `/home/tip/go/src/pkg/archive/tar'
gotest -test.short -test.timeout=120
throw: runtime: cannot reserve arena virtual address space
gmake[1]: *** [testshort] Error 2
gmake[1]: Leaving directory `/home/tip/go/src/pkg/archive/tar'
gmake: *** [archive/tar.testshort] Error 1
-bash-4.2$
4. I have OpenBSD/sparc64 stood up on a Sun blade 100 also..

@tjyang
Copy link
Author

tjyang commented Sep 18, 2011

Comment 8:

0. I was using vmware wks 7.0 on Asus ROG with i7 cpu.
1. Another test on IBM T30 laptop.
-bash-4.2$ sysctl kern.version
kern.version=OpenBSD 5.0-current (GENERIC) #52: Tue Sep 13 22:04:50 MDT 2011
    deraadt@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC
-bash-4.2$ uname -a
OpenBSD t30.test.net 5.0 GENERIC#52 i386
-bash-4.2$ date
Sun Sep 18 08:18:11 CDT 2011
-bash-4.2$
2. still failed on tar test.
<snipped>
install http/spdy
install rpc
install websocket
install ../cmd/godoc
install ../cmd/goinstall
install http/fcgi
install rpc/jsonrpc
gmake: Leaving directory `/home/tip/go/src/pkg'
---
Installed Go for openbsd/386 in /home/tip/go.
Installed commands in /home/tip/go/bin.
The compiler is 8g.
--- cd pkg
test archive/tar
TEST FAIL archive/tar
gmake[1]: Entering directory `/home/tip/go/src/pkg/archive/tar'
gotest -test.short -test.timeout=120
throw: runtime: cannot reserve arena virtual address space
gmake[1]: *** [testshort] Error 2
gmake[1]: Leaving directory `/home/tip/go/src/pkg/archive/tar'
gmake: *** [archive/tar.testshort] Error 1
-bash-4.2$
4. I have OpenBSD/sparc64 stood up on a Sun blade 100 also..

@tjyang
Copy link
Author

tjyang commented Sep 18, 2011

Comment 9:

Similar issue like https://golang.org/issue/2015
-bash-4.2$ 8g hello.go
-bash-4.2$ 8l -o hello hello.8
-bash-4.2$ ./hello
throw: runtime: cannot reserve arena virtual address space
-bash-4.2$ cat hello.
hello.8   hello.go
-bash-4.2$ cat hello.go
package main
import "fmt"
func main() {
    fmt.Println("hello world")
}
-bash-4.2$

@tjyang
Copy link
Author

tjyang commented Sep 18, 2011

Comment 10:

Looks like it is resource limitation issue. Running hello world with "2097152" is ok
with running a "tip" user with "524288" limit will cause the issue.
# ulimit -a
time(cpu-seconds)    unlimited
file(blocks)         unlimited
coredump(blocks)     unlimited
data(kbytes)         2097152
stack(kbytes)        8192
lockedmem(kbytes)    339837
memory(kbytes)       1017760
nofiles(descriptors) 128
processes            1310
# pwd
/usr/ports
# cd ~tip
# ls
.Xdefaults      .cshrc          .profile        hello
.bash_history   .login          .ssh            hello.8
.bashrc         .mailrc         go              hello.go
# ./hello
hello world
# id
uid=0(root) gid=0(wheel) groups=0(wheel), 2(kmem), 3(sys), 4(tty), 5(operator),
20(staff), 31(guest)
# uname -a
OpenBSD t30.test.net 5.0 GENERIC#52 i386
#

@tjyang
Copy link
Author

tjyang commented Sep 18, 2011

Comment 11:

This a "ulimit -a" setting output from a fedora 15 amd64 as a regular unix user
"release".
[release@t-fedora15-64 ~]$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 29370
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 1024
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
[release@t-fedora15-64 ~]$

@4a6f656c
Copy link
Contributor

Comment 12:

As you have already identified, you are running into resource limits. The Go runtime
reserves a fairly large amount of virtual address space and this will fail if your data
size is too low. You will also likely need to increase the file descriptor limit or a
later test will also fail. Under OpenBSD/i386 all tests should pass with:
ulimit -d 2097152
ulimit -n 512

@adg
Copy link
Contributor

adg commented Sep 19, 2011

Comment 13:

Status changed to Retracted.

@mikioh mikioh changed the title openbsd: TEST FAIL archive/tar archive/tar: TEST FAIL on openbsd Jul 30, 2015
@golang golang locked and limited conversation to collaborators Jul 1, 2016
This issue was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

5 participants