Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

proposal: encoding/xml: allow caller to specify preferred namespace prefix #48821

Open
ydnar opened this issue Oct 6, 2021 · 4 comments
Open

proposal: encoding/xml: allow caller to specify preferred namespace prefix #48821

ydnar opened this issue Oct 6, 2021 · 4 comments
Labels
Proposal
Projects
Proposals (old)
Milestone
Proposal

Comments

@ydnar
Copy link

ydnar commented Oct 6, 2021 •
edited

What version of Go are you using (go version)?

$ go version
go version go1.17.1 darwin/amd64

Does this issue reproduce with the latest release?

Yes.

What operating system and processor architecture are you using (go env)?

go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/ydnar/Library/Caches/go-build"
GOENV="/Users/ydnar/Library/Application Support/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GOMODCACHE="/Users/ydnar/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="darwin"
GOPATH="/Users/ydnar/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/Cellar/go/1.17.1/libexec"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/Cellar/go/1.17.1/libexec/pkg/tool/darwin_amd64"
GOVCS=""
GOVERSION="go1.17.1"
GCCGO="gccgo"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/Users/ydnar/development/ydnar/go/src/go.mod"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -arch x86_64 -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/6g/1gng3zts0t39s_qbtt7p0wsc0000gn/T/go-build2847614851=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?

Use xml.Marshal to marshal namespaced XML, and xml.Unmarshal to decode that XML.

Example: https://play.golang.org/p/-6Ee8tcLl2L

What did you expect to see?

Namespace prefixes preserved round-trip.

What did you see instead?

Namespace prefixes written, but not recognized as the relevant tag when decoding.

Proposal

Change the encoding/xml package to allow callers to specify a preferred namespace prefix, and allow decoding of prefixed tags.

The preferred prefix can be specified by prefixing the XML tag name in a struct tag or (xml.Name).Local.

This should be backwards-compatible with existing Go 1 encoding/xml clients.

Example

type EPP struct {
	XMLName struct{} `xml:"urn:ietf:params:xml:ns:epp-1.0 epp"`
	Command *Command `xml:"command,omitempty"`
}

type Command struct {
	Check *Check `xml:"urn:ietf:params:xml:ns:epp-1.0 check,omitempty"`
}

type Check struct {
	DomainCheck *DomainCheck `xml:"urn:ietf:params:xml:ns:domain-1.0 domain:check,omitempty"`
}

type DomainCheck struct {
	DomainNames []string `xml:"urn:ietf:params:xml:ns:domain-1.0 domain:name,omitempty"`
}

This change would allow a structure defined above to correctly round-trip encode and decode with namespace prefixes:

var v = &EPP{Command: &Command{Check: &Check{DomainCheck: &DomainCheck{DomainNames: []string{"golang.org", "go.dev"}}}}}

Would encode to (and decode from):

<epp xmlns="urn:ietf:params:xml:ns:epp-1.0"><command><check><domain:check xmlns:domain="urn:ietf:params:xml:ns:domain-1.0"><domain:name>golang.org</domain:name><domain:name>go.dev</domain:name></domain:check></check></command></epp>

Implementation

A working implementation can be found at #48641, built on earlier work by @rogpeppe and others.

Related Issues

This would fix #43168 and update #11431 and #8068.
@ydnar ydnar mentioned this issue Oct 6, 2021
Open
@ydnar ydnar changed the title encoding/xml: allow caller to specify preferred namespace prefix proposal: encoding/xml: allow caller to specify preferred namespace prefix Oct 6, 2021
@gopherbot gopherbot added this to the Proposal milestone Oct 6, 2021
@ianlancetaylor ianlancetaylor added this to Incoming in Proposals (old) Oct 6, 2021
@tobbee
Copy link

tobbee commented Feb 8, 2023

@rsc

I think it is really important that the standard library gets proper handling of XML namespaces and namespace prefixes. The current implementation is definitely broken as has been raised in multiple issues. I can elaborate on the problems and short comings if needed,

In my view, this PR provides a good solution, or at least a good basis for a solution. I found myself forced to clone the standard xml package together with this patch in my new repo https://github.com/Eyevinn/dash-mpd that handles DASH MPD XMLs and need proper namespaces and prefixes.

In the discussion about previous ticket, Dave Cheney argued that one cannot change the behavior of such an established stdlib package as XML due to the risk of breaking someones code. I think there is some truth in that argument, so I'd like to suggest that we start working on a variant of the xml package that supports namespaces and namespace prefixes. It could be called encoding/xml2, and this PR could make a good start. It would be nice if it could be done in the 1.21 time frame.

@ydnar
Copy link
Author

ydnar commented May 1, 2023

I’ve rebased #48641 on top of current master: https://go-review.googlesource.com/c/go/+/355353

@ydnar
Copy link
Author

ydnar commented May 15, 2023

Hi there, anything I can do to nudge this along? Thanks!

@ydnar
Copy link
Author

ydnar commented Nov 23, 2023

Would putting this behind GOEXPERIMENT=xmlns make it more palatable?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Proposal
Projects
Proposals
Status: Incoming
Proposals (old)
Incoming
Milestone
Proposal
Development

No branches or pull requests
3 participants
@ydnar @tobbee @gopherbot