Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

unicode/utf8: document specification #31590

Closed
dsnet opened this issue Apr 20, 2019 · 2 comments
Closed

unicode/utf8: document specification #31590

dsnet opened this issue Apr 20, 2019 · 2 comments
Labels
Documentation FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Milestone
Go1.14

Comments

@dsnet
Copy link
Member

dsnet commented Apr 20, 2019

The utf8 package merely documents that it "supports text encoded in UTF-8", but doesn't point to any external sources for what "UTF-8" exactly is. I'm not an expert in this area, but my understanding is that UTF-8 is formally defined in RFC 3629. Is that true?

Furthermore, does the Valid function implement validation for merely the syntax of UTF-8 encoding (section 4) or a validation of the "definition" of UTF-8 (section 3)? The code seems to suggest that it is the later. The godoc does not make this clear to me and probably should be documented.
@ALTree ALTree added the NeedsDecision Feedback is required from experts, contributors, and/or the community before a change can be made. label Apr 21, 2019
@ALTree ALTree added this to the Go1.13 milestone Apr 21, 2019
@rsc
Copy link
Contributor

rsc commented May 1, 2019

I'm sure we can find the right chapter of the Unicode spec and link to that (unicode.org).
https://www.unicode.org/versions/Unicode12.0.0/UnicodeStandard-12.0.pdf#page=65

@rsc rsc added the NeedsFix The path to resolution is known, but the work has not been done. label May 1, 2019
@gopherbot gopherbot removed the NeedsDecision Feedback is required from experts, contributors, and/or the community before a change can be made. label May 1, 2019
@andybons andybons modified the milestones: Go1.13, Go1.14 Jul 8, 2019
@gopherbot
Copy link

Change https://golang.org/cl/199141 mentions this issue: utf8: give detailed formal description of utf-8 via external source.

@golang golang locked and limited conversation to collaborators Oct 5, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Documentation FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
None yet
Milestone
Go1.14
Development

No branches or pull requests
5 participants
@rsc @andybons @ALTree @dsnet @gopherbot