net/http: Client support for Expect: 100-continue #3665

bradfitz · 2012-05-23T15:48:37Z

The http Client should probably support Expect: 100-continue.  The server does.

It does introduce a new round-trip, though, so we should probably only send it when the
data size exceeds some threshold.  Probably the same threshold we use for consuming
request bodies when a handler doesn't (maxPostHandlerReadBytes).

I think we could see if we know the size of the request body (just as NewRequest does,
checking for a few known types), but if the Body is non-nil and the ContentLength is
<=0 (unknown), we instead slurp up the Body into a bytes.Buffer to see if it's >=
someThreshold.  If so, we replace the Body with a io.MultiReader(slurped, rest) and
proceed to do a 100-continue.  If not, we blast it away HTTP/1.0-style.

bradfitz · 2012-08-07T04:12:08Z

Comment 1:

See also issue #2184, different but related.

rsc · 2012-09-12T21:39:25Z

Comment 2:

Labels changed: added priority-later, removed priority-triage.

rsc · 2012-09-12T21:41:16Z

Comment 3:

Labels changed: added go1.1.

rsc · 2012-12-09T18:26:47Z

Comment 4:

Labels changed: added go1.1maybe, removed go1.1.

bradfitz · 2012-12-14T17:19:36Z

Comment 5:

Adding the "Suggested" label, if somebody wants to take this on.  I expect it to be
somewhat involved, though.
It should probably be opt-in:  users will need to add "Expect": "100-continue" to their
request before sending it.
And then in transport.go, when we're going to write the request, write and flush the
headers, create a channel, and then wait on the channel response and a 1 second timer
(like curl).  If after 1 second no response, send the body anyway.  If the channel gives
you a non-100 HTTP response, use that.  If the channel gives a 100, start writing the
body.

Labels changed: added suggested, size-l.

bradfitz · 2013-02-20T17:53:47Z

Comment 6:

Owner changed to ---.

rsc · 2013-03-12T20:19:30Z

Comment 7:

[The time for maybe has passed.]

Labels changed: removed go1.1maybe.

bradfitz · 2013-03-30T00:05:13Z

Comment 8:

Sent out https://golang.org/cl/8166045

bradfitz · 2013-03-30T03:25:23Z

Comment 9:

This issue was updated by revision a79df7b.

R=golang-dev, dsymonds, dave, jgrahamc
CC=golang-dev
https://golang.org/cl/8166045

andybalholm · 2013-03-30T23:46:56Z

Comment 10:

I think this fixes issue #2184.

rsc · 2013-07-30T15:52:23Z

Comment 11:

Labels changed: added go1.2maybe.

rsc · 2013-07-30T22:41:01Z

Comment 12:

Labels changed: added feature.

robpike · 2013-08-29T01:27:55Z

Comment 13:

Won't happen for 1.2.

Labels changed: removed go1.2maybe.

mattetti · 2013-10-13T00:18:45Z

Comment 14:

Just a quick note to let you know that node. Is only send a 100 if the request sends an
expect 100. That seems like a good idea.
Also, does the http client supports expect 100 with timeout

rsc · 2013-11-27T18:49:27Z

Comment 15:

Labels changed: added go1.3maybe.

rsc · 2013-11-27T20:29:33Z

Comment 16:

Labels changed: removed feature.

rsc · 2013-12-04T01:31:30Z

Comment 17:

Labels changed: added release-none, removed go1.3maybe.

rsc · 2013-12-04T01:51:54Z

Comment 18:

Labels changed: added repo-main.

jbardin · 2014-03-31T14:35:09Z

Comment 19:

I was going create a patch for this, but noticed that the concurrent read/write loops
handle this surprisingly well as is. A very easy improvement would be to flush headers
immediately if expectsContinue during the initial write.
One question regarding brafitz's earlier comment, do we actually *need* to block sending
the body (seems ambiguous in the spec). I'd actually prefer the current behavior with
the added flush, as it would get a head start on sending data, and it looks like the
client still shuts down immediately upon a non 100-continue response.

anacrolix · 2015-05-10T13:30:11Z

I believe this is the cause for issues I'm having PUT-ing to a server that redirects me. The body in the initial PUT request is prematurely consumed, despite my having set Expect: 100-continue. If there is Expect: 100-continue in the request, the body needs to be withheld from the request until a 100 Continue is received from the server.

matope · 2015-05-14T17:03:00Z

Although I'm not sure if it were a right implementation, I've sent my small patch for this issue.
https://go-review.googlesource.com/#/c/10091/

I hit this premature consuming issue on my project. So I would appreciate if someone review this CL.

gopherbot · 2015-05-14T18:00:26Z

CL https://golang.org/cl/10091 mentions this issue.

mattn · 2015-05-29T12:58:48Z

@bradfitz ping

bradfitz · 2015-05-29T15:12:02Z

The Go tree is currently in freeze for the Go 1.5 release. The freeze started on May 1st, and this was sent after May 1st, and this was not tagged as a Go 1.5-blocking issue.

As such, this has to wait until Go 1.6.

I've marked that CL with R=close so it doesn't show up on our dashboard, but pinging this thread at any time will make it reappear. Please reply to this bug after August 1st and we can begin the code review.

Thanks for working on this, though!

matope · 2015-05-29T16:26:00Z

@bradfiz OK, I catch on your timeline. I'll ping you again this August!

@mattn Thanks for your pinging!

rhinoman · 2015-07-31T18:28:00Z

I've been having issues with this as welI (using Go with CouchDB: http://stackoverflow.com/questions/30541591/large-put-requests-from-go-to-couchdb ) and I really hope this gets in sometime so I can remove the ugly hack-around in my code 👍

drnic · 2015-08-24T18:20:36Z

For golang-backed servers, is there a way to increase the max size before it starts the 100-continue protocol?

drnic · 2015-08-24T18:24:06Z

My body seems to be only 2000+ characters of JSON, so am not sure what triggers to 100-continue sequence (and causes my golang client to hang until timeout)

anacrolix · 2015-08-25T01:18:03Z

@bradfitz can we get this in now?
On 25/08/2015 4:24 AM, "Dr Nic Williams" notifications@github.com wrote:

My body seems to be only 2000+ characters of JSON, so am not sure what
triggers to 100-continue sequence (and causes my golang client to hang
until timeout)

—
Reply to this email directly or view it on GitHub
#3665 (comment).

bradfitz · 2015-08-25T16:34:53Z

I replied with some initial review feedback.

matope · 2015-09-24T08:18:11Z

@bradfitz Thank you for your feedback! I revised my patch a few weeks ago.
I think my patch got better but I'm not sure if it is enough.
If you are free, could you please look through that?

bradfitz · 2015-09-24T18:26:16Z

Replied on Gerrit.

matope · 2015-10-03T09:00:17Z

@bradfitz Thank you for your review comments.

I've just updated my CL on Gerrit.
I fixed a issue that my previous code couldn't flush request header before waiting response.
I added some explicit codes for canceling sending body when the response status was not 100.

bradfitz added priority-later Suggested Issues that may be good for new contributors looking for work to do. labels Mar 31, 2014

rsc added this to the Unplanned milestone Apr 10, 2015

rsc removed the priority-later label Apr 10, 2015

rsc mentioned this issue Apr 10, 2015

net/http: something about 100-continue #9735

Closed

rsc removed release-none labels Apr 14, 2015

anacrolix mentioned this issue May 10, 2015

net/http: Redirect conditions are incorrect, support 307/308 #10767

Closed

bradfitz modified the milestones: Go1.6, Unplanned May 29, 2015

harshavardhana mentioned this issue Jun 24, 2015

http: Verify if we need to get http client support for 100 Continue minio/minio-go#101

Closed

emicklei mentioned this issue Sep 20, 2015

remove curl emicklei/artreyu#2

Closed

bradfitz closed this as completed in dab143c Oct 17, 2015

sielaq mentioned this issue Feb 16, 2016

The 100-Continue mechanism doesn't work correctly fabiolb/fabio#54

Open

golang locked and limited conversation to collaborators Oct 17, 2016

gopherbot added the FrozenDueToAge label Oct 17, 2016

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

net/http: Client support for Expect: 100-continue #3665

net/http: Client support for Expect: 100-continue #3665

bradfitz commented May 23, 2012

bradfitz commented Aug 7, 2012

rsc commented Sep 12, 2012

rsc commented Sep 12, 2012

rsc commented Dec 9, 2012

bradfitz commented Dec 14, 2012

bradfitz commented Feb 20, 2013

rsc commented Mar 12, 2013

bradfitz commented Mar 30, 2013

bradfitz commented Mar 30, 2013

andybalholm commented Mar 30, 2013

rsc commented Jul 30, 2013

rsc commented Jul 30, 2013

robpike commented Aug 29, 2013

mattetti commented Oct 13, 2013

rsc commented Nov 27, 2013

rsc commented Nov 27, 2013

rsc commented Dec 4, 2013

rsc commented Dec 4, 2013

jbardin commented Mar 31, 2014

anacrolix commented May 10, 2015

matope commented May 14, 2015

gopherbot commented May 14, 2015

mattn commented May 29, 2015

bradfitz commented May 29, 2015

matope commented May 29, 2015

rhinoman commented Jul 31, 2015

drnic commented Aug 24, 2015

drnic commented Aug 24, 2015

anacrolix commented Aug 25, 2015

bradfitz commented Aug 25, 2015

matope commented Sep 24, 2015

bradfitz commented Sep 24, 2015

matope commented Oct 3, 2015

net/http: Client support for Expect: 100-continue #3665

net/http: Client support for Expect: 100-continue #3665

Comments

bradfitz commented May 23, 2012

bradfitz commented Aug 7, 2012

rsc commented Sep 12, 2012

rsc commented Sep 12, 2012

rsc commented Dec 9, 2012

bradfitz commented Dec 14, 2012

bradfitz commented Feb 20, 2013

rsc commented Mar 12, 2013

bradfitz commented Mar 30, 2013

bradfitz commented Mar 30, 2013

andybalholm commented Mar 30, 2013

rsc commented Jul 30, 2013

rsc commented Jul 30, 2013

robpike commented Aug 29, 2013

mattetti commented Oct 13, 2013

rsc commented Nov 27, 2013

rsc commented Nov 27, 2013

rsc commented Dec 4, 2013

rsc commented Dec 4, 2013

jbardin commented Mar 31, 2014

anacrolix commented May 10, 2015

matope commented May 14, 2015

gopherbot commented May 14, 2015

mattn commented May 29, 2015

bradfitz commented May 29, 2015

matope commented May 29, 2015

rhinoman commented Jul 31, 2015

drnic commented Aug 24, 2015

drnic commented Aug 24, 2015

anacrolix commented Aug 25, 2015

bradfitz commented Aug 25, 2015

matope commented Sep 24, 2015

bradfitz commented Sep 24, 2015

matope commented Oct 3, 2015