Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

compress/gzip: It would be nice if Go had a parallel gzip compressor and decompressor #8247

Closed
gopherbot opened this issue Jun 20, 2014 · 5 comments

Comments

@gopherbot
Copy link

by camilo.aguilar:

I apologize since this is not exactly a defect report but a feature request.
@griesemer
Copy link
Contributor

Comment 1:

Labels changed: added release-none, repo-main.

@bradfitz bradfitz removed the new label Dec 18, 2014
@rsc rsc added this to the Unplanned milestone Apr 10, 2015
@klauspost
Copy link
Contributor

Meanwhile, may I humbly suggest pgzip.

@bradfitz
Copy link
Contributor

There's also http://godoc.org/golang.org/x/build/pargzip which we wrote for Go's build system.

@klauspost
Copy link
Contributor

@bradfitz - Very nice. I see you concatenate complete gzip archives. I use the flate.NewWriterDict in the builtin library to avoid the compression loss. While we are at it, there is also bgzf, which makes seeking inside a compressed file possible via a small addition to the gzip format.

Either way, I don't see any reason for this feature to be in the standard library. For the most common use-case (webservers), you get non benefit from parallel compression.

@ALTree
Copy link
Member

ALTree commented May 13, 2019

Either way, I don't see any reason for this feature to be in the standard library.

I agree. At this point this seems unlikely to be added in the standard library, so I think it's okay to close this issue.

@ALTree ALTree closed this as completed May 13, 2019
@golang golang locked and limited conversation to collaborators May 12, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

6 participants