Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

net/http: failures with timeout waiting for SETTINGS frames #60359

Open
gopherbot opened this issue May 23, 2023 · 16 comments
Open

net/http: failures with timeout waiting for SETTINGS frames #60359

gopherbot opened this issue May 23, 2023 · 16 comments
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Milestone

Comments

@gopherbot
Copy link

gopherbot commented May 23, 2023

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`

Issue created automatically to collect these failures.

Example (log):

1 second passes in backend, proxygone= false
--- FAIL: TestClientRedirect308NoGetBody (0.00s)
    --- FAIL: TestClientRedirect308NoGetBody/h2 (2.74s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:60218
        client_test.go:565: Post "https://127.0.0.1:60217": unexpected EOF

watchflakes

@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label May 23, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && test == "TestClientRedirect308NoGetBody"
2023-05-23 04:38 freebsd-riscv64-unmatched go@e4e8f9b8 net/http.TestClientRedirect308NoGetBody (log)
1 second passes in backend, proxygone= false
--- FAIL: TestClientRedirect308NoGetBody (0.00s)
    --- FAIL: TestClientRedirect308NoGetBody/h2 (2.74s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:60218
        client_test.go:565: Post "https://127.0.0.1:60217": unexpected EOF

watchflakes

@bcmills
Copy link
Contributor

bcmills commented May 23, 2023

This looks like maybe just a slow builder + too-short arbitrary timeout?
(https://cs.opensource.google/go/go/+/refs/heads/master:src/net/http/h2_bundle.go;l=3868;drc=5abfdc8c75b13edbe3ccc918df47dd2da85454d8)

(attn @neild @golang/riscv64)

@bcmills bcmills changed the title net/http: TestClientRedirect308NoGetBody failures net/http: failures with timeout waiting for SETTINGS frames Jun 13, 2023
@bcmills bcmills added this to the Backlog milestone Jun 13, 2023
@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-06-05 03:11 freebsd-arm-paulzhol go@96d16803 net/http.TestServeFileNotModified (log)
1 second passes in backend, proxygone= false
1 second passes in backend, proxygone= false
1 second passes in backend, proxygone= false
--- FAIL: TestServeFileNotModified (0.00s)
    --- FAIL: TestServeFileNotModified/h2 (4.29s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:57105
        fs_test.go:625: Get "https://127.0.0.1:57104": unexpected EOF
1 second passes in backend, proxygone= false

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-06-13 18:07 netbsd-arm-bsiegert go@8faa79e9 net/http.TestFileServerSortsNames (log)
--- FAIL: TestFileServerSortsNames (0.00s)
    --- FAIL: TestFileServerSortsNames/h1 (2.85s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:65324
        fs_test.go:398: Get: Get "https://127.0.0.1:65326": unexpected EOF
1 second passes in backend, proxygone= false

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-06-26 21:06 freebsd-arm-paulzhol go@1dbbafc7 net/http.TestClientHeadContentLength (log)
--- FAIL: TestClientHeadContentLength (0.00s)
    --- FAIL: TestClientHeadContentLength/h1 (5.60s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:54784
        client_test.go:1017: Head "https://127.0.0.1:54783/?cl=1234": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-06-13 03:06 linux-s390x-ibm-race go@b0e1707f net/http.TestTransportGCRequest (log)
--- FAIL: TestTransportGCRequest (0.00s)
    --- FAIL: TestTransportGCRequest/h1 (11.44s)
        --- FAIL: TestTransportGCRequest/h1/NoBody (5.86s)
            clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:53882
            clientserver_test.go:1166: Post "https://127.0.0.1:42741": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-07-19 11:55 linux-s390x-ibm-race go@5fe3f0a2 net/http.TestTransportClosesBodyOnError (log)
--- FAIL: TestTransportClosesBodyOnError (0.00s)
    --- FAIL: TestTransportClosesBodyOnError/h2 (2.67s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:37950
        transport_test.go:3702: Do error = Post "https://127.0.0.1:37663": read tcp 127.0.0.1:37950->127.0.0.1:37663: read: connection reset by peer; want something containing "fake error"

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-07-28 02:46 freebsd-arm-paulzhol go@84883091 net/http.TestTransportMaxConnsPerHost (log)
--- FAIL: TestTransportMaxConnsPerHost (0.00s)
    --- FAIL: TestTransportMaxConnsPerHost/https1 (5.53s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:24796
        transport_test.go:678: request failed: Get "https://127.0.0.1:24795": unexpected EOF
        transport_test.go:678: request failed: Get "https://127.0.0.1:24795": unexpected EOF
        transport_test.go:699: round 1: too many dials: 2 != 1
        transport_test.go:702: round 1: too many get connections: 2 != 1
        transport_test.go:705: round 1: too many tls handshakes: 2 != 1

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-08-14 21:10 linux-s390x-ibm go@d788b27c net/http.TestServeFileNotModified (log)
--- FAIL: TestServeFileNotModified (0.00s)
    --- FAIL: TestServeFileNotModified/h2 (2.04s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:37186
        fs_test.go:626: Get "https://127.0.0.1:37801": read tcp 127.0.0.1:37186->127.0.0.1:37801: read: connection reset by peer
2023-08-14 21:10 linux-s390x-ibm go@d788b27c net/http.TestTransportRequestWriteRoundTrip (log)
--- FAIL: TestTransportRequestWriteRoundTrip (0.00s)
    --- FAIL: TestTransportRequestWriteRoundTrip/h2 (3.63s)
        --- FAIL: TestTransportRequestWriteRoundTrip/h2/file,_length (2.04s)
            clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:51070
            transport_test.go:6037: Put "https://127.0.0.1:41529": read tcp 127.0.0.1:51070->127.0.0.1:41529: read: connection reset by peer
2023-08-16 14:41 freebsd-arm-paulzhol go@3fd67620 net/http.TestHeadBody (log)
--- FAIL: TestHeadBody (0.00s)
    --- FAIL: TestHeadBody/h2 (5.70s)
        --- FAIL: TestHeadBody/h2/chunked (5.45s)
            clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:31521
            serve_test.go:6820: Head "https://127.0.0.1:31519": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-09-02 02:18 linux-s390x-ibm-race go@83fe0e09 net/http.TestIssue3644 (log)
1 second passes in backend, proxygone= false
--- FAIL: TestIssue3644 (0.00s)
    --- FAIL: TestIssue3644/h2 (2.43s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:49744
        transport_test.go:2088: Get "https://127.0.0.1:36605": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-09-19 22:53 linux-s390x-ibm-race go@3857a89e net/http.TestServerIssue5953 (log)
--- FAIL: TestServerIssue5953 (0.00s)
    --- FAIL: TestServerIssue5953/h2 (8.29s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:33636
        sniff_test.go:142: Get "https://127.0.0.1:43115": unexpected EOF
2023-09-21 21:40 linux-s390x-ibm-race go@795414d1 net/http.TestSniffWriteSize (log)
--- FAIL: TestSniffWriteSize (0.00s)
    --- FAIL: TestSniffWriteSize/h2 (2.73s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:38088
        sniff_test.go:273: size 0: Get "https://127.0.0.1:37349/?size=0": unexpected EOF
2023/09/21 18:32:52 httptest.Server blocked in Close after 5 seconds, waiting for connections:
2023-09-21 22:21 freebsd-arm-paulzhol go@9bec49cf net/http.TestTransportGCRequest (log)
1 second passes in backend, proxygone= false
--- FAIL: TestTransportGCRequest (0.00s)
    --- FAIL: TestTransportGCRequest/h2 (6.34s)
        --- FAIL: TestTransportGCRequest/h2/Body (5.56s)
            clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:13827
            clientserver_test.go:1166: Post "https://127.0.0.1:13826": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-10-10 22:48 linux-s390x-ibm-race go@dacf1f1e net/http.TestH12_AutoGzipWithDumpResponse (log)
--- FAIL: TestH12_AutoGzipWithDumpResponse (3.98s)
    clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:53288
    clientserver_test.go:318: HTTP/2 request: Get "https://127.0.0.1:45413": unexpected EOF
2023-10-19 12:02 linux-s390x-ibm-race go@9299547e net/http.TestHeadBody (log)
--- FAIL: TestHeadBody (0.00s)
    --- FAIL: TestHeadBody/h2 (4.71s)
        --- FAIL: TestHeadBody/h2/chunked (4.65s)
            clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:56154
            serve_test.go:6931: Head "https://127.0.0.1:35579": read tcp 127.0.0.1:56154->127.0.0.1:35579: read: connection reset by peer

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-11-07 22:00 linux-s390x-ibm-race go@995ec5c8 net/http.TestTransportDecrementConnWhenIdleConnRemoved (log)
--- FAIL: TestTransportDecrementConnWhenIdleConnRemoved (0.00s)
    --- FAIL: TestTransportDecrementConnWhenIdleConnRemoved/h2 (6.48s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:57698
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
...
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF
        transport_test.go:6541: error occurred: request failed: Get "https://127.0.0.1:35215": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2023-11-13 22:12 linux-s390x-ibm-race go@773039ed net/http.TestHeadBody (log)
--- FAIL: TestHeadBody (0.00s)
    --- FAIL: TestHeadBody/h2 (5.51s)
        --- FAIL: TestHeadBody/h2/chunked (4.63s)
            clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:43276
            serve_test.go:6932: Head "https://127.0.0.1:42735": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2024-03-26 06:06 freebsd-arm-paulzhol go@aab837dd net/http.TestServeFileRejectsInvalidSuffixLengths (log)
--- FAIL: TestServeFileRejectsInvalidSuffixLengths (0.00s)
    --- FAIL: TestServeFileRejectsInvalidSuffixLengths/h2 (3.00s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:57976
        --- FAIL: TestServeFileRejectsInvalidSuffixLengths/h2/bytes=--6 (2.67s)
            fs_test.go:1501: Get "https://127.0.0.1:57975/index.html": unexpected EOF

watchflakes

@gopherbot
Copy link
Author

Found new dashboard test flakes for:

#!watchflakes
post <- pkg == "net/http" && `timeout waiting for SETTINGS frames`
2024-04-16 22:41 freebsd-arm-paulzhol go@c51f6c62 net/http.TestTransportClosesBodyOnError (log)
--- FAIL: TestTransportClosesBodyOnError (0.00s)
    --- FAIL: TestTransportClosesBodyOnError/h2 (4.17s)
        clientserver_test.go:210: server log: timeout waiting for SETTINGS frames from 127.0.0.1:51082
        transport_test.go:3878: Do error = Post "https://127.0.0.1:51081": unexpected EOF; want something containing "fake error"

watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one.
Projects
Status: No status
Development

No branches or pull requests

2 participants