Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

proposal: log/slog: add slog.DiscardHandler #62005

Open
flowchartsman opened this issue Aug 14, 2023 · 16 comments
Open

proposal: log/slog: add slog.DiscardHandler #62005

flowchartsman opened this issue Aug 14, 2023 · 16 comments
Labels
Milestone

Comments

@flowchartsman
Copy link

flowchartsman commented Aug 14, 2023

Proposal

Add a package-level variable slog.DiscardHandler (type slog.Handler) that will discard all log output.

link to comment

Rationale

I have been happily busying myself integrating log/slog into old packages and replacing the exp import in new ones, however I've found myself implementing the same "nop handler" again and again in packages with optional logging APIs.

A common pattern in logging injection is to consume an interface or a pointer to a logging type to allow the dependency to use a derived logger with some field marking the messages as originating from that component, enabling both a standard format as well as per-component level thresholds to keep the output sane. For packages that support slog, this will likely often end up being a *slog.Logger or a slog.Handler, however I've also had to develop a series of log adapters for common dependencies which use their own concrete types, interfaces and callbacks.

In both of these cases, it is helpful to have a default fallback which logs nothing, so that the packages can be tested or used on their own without needing boilerplate guard clauses on every logging method to check for nil values. It's also helpful for less well-behaved dependencies which create their own loggers if one is not provided, some of whom are exceptionally chatty for no good reason. Packages like this are sadly far too common, and we're likely to continue seeing them, so a way to bring some sanity to the process would be very useful.

While it's true that checks for the presence of logging can be reduced by funneling all handler interaction through a single point, this introduces another sort of boilerplate for slog where Records need to be created manually, adjusting their PC to account for the extra frame as seen in the wrapping example. This is a low-level and overly-manual process just to enable conditional logging.

Currently, there doesn't seem to be a great answer for this in slog:

  • there are no guards for a nil receiver on *Logger methods
  • the zero value of Logger is not usable and will panic
  • Loggers initialized with a nil handler will panic
  • there is no way to modify a logger to change its handler or logging level once it's created, making slog.Default() unworkable as a fallback
  • defaultHandler is unexported, so it cannot act as a fallback, and handlers do not provide a WithLevel or WithLeveler method, so it wouldn't work as a fallback even if it were exported.
  • HandlerOptions, which allows specifying a minimum level, only applies to the built-in handlers, and there is no WithHandlerOptions that would allow derived handlers to adjust their logging level using this type.

Leaving aside the arguments on the merits of logging in packages, this pattern is nonetheless common enough that it would probably be useful to have a type DisabledHandler struct{} or even a func DisabledLogger()*Logger convenience method that could act as a default. when the zero values are nil.

@gopherbot gopherbot added this to the Proposal milestone Aug 14, 2023
@earthboundkid
Copy link
Contributor

log.Logger has an optimization where it detects when the writer is io.Discard and does no allocations. Maybe slog should do the same thing.

@bcmills
Copy link
Contributor

bcmills commented Aug 14, 2023

(CC @jba)

@flowchartsman
Copy link
Author

flowchartsman commented Aug 14, 2023

log.Logger has an optimization where it detects when the writer is io.Discard and does no allocations. Maybe slog should do the same thing.

I'm not sure this would work in this case, since this would be an implementation at the handler level, which would mean it would only apply to the standard lib JSON and KV handlers. It would require the user to take an slog.Handler and write something like:

if config.LoggingHandler == nil {
     //default: this JSONHandler does nothing
    config.LoggingHandler = slog.NewJSONHandler(io.Discard, nil)
}

// need the handler since slog.New(nil) will panic
logger := slog.New(config.LoggingHandler)

Which still feels pretty awkward.

@seankhliao seankhliao changed the title proposal: log/slog needs a sensible placeholder proposal: log/slog: nop logger Aug 14, 2023
@jba
Copy link
Contributor

jba commented Aug 18, 2023

I wouldn't want to make a nil *Logger meaningful. I think it would lead to hard-to-find errors where forgetting to set a logger resulted in no log output, and that is only detected when you need the log output (like during a production outage).

I think a slog.DiscardHandler variable would make sense, just as we have io.Discard. Or maybe NopHandler is a better name. Does that work for you?

@flowchartsman
Copy link
Author

flowchartsman commented Aug 21, 2023

I wouldn't want to make a nil *Logger meaningful. I think it would lead to hard-to-find errors where forgetting to set a logger resulted in no log output, and that is only detected when you need the log output (like during a production outage).

Concur. Either handler name works for me and, while I like NopHandler, I think it probably serves as more of a mnemonic to call it DiscardHandler in keeping with the convention elsewhere.

This would make the fallback story for logging injection something like:

type ClientConfig struct {
    Logger: *slog.Logger
}

func NewClient(config ClientConfig) (*Client, error) {
    if config.Logger == nil {
        config.Logger = slog.New(slog.DiscardHandler)
    }
    //...
    return &Client{
        logger: config.Logger,
    }, nil
}

Which isn't too bad, and makes a DiscardLogger() *Logger redundant, unless you really care about those 9 characters ;)

@flowchartsman
Copy link
Author

flowchartsman commented Aug 21, 2023

The only reason to prefer DiscardLogger() *Logger might be that it could be created fresh on invocation, which would prevent dependencies from mucking about with slog.DiscardHandler, though the flip side is that they can already call slog.SetDefault(), and it could be useful for debugging to explicitly set slog.DiscardHandler in main(). I guess it depends on your attitude towards package-level variables.

@jba
Copy link
Contributor

jba commented Aug 29, 2023

The proposal here is to add slog.DiscardHandler as a global variable, like io.Discard, or possibly a function.

It's ready for the proposal committee.

/cc @rsc

@jsumners
Copy link

jsumners commented Oct 4, 2023

I want to cast a vote for this being added. I found myself writing the following today in a test suite because the portion of my application I was testing relies on having a logger instance, but I don't care about logs during the tests:

package main

import "log/slog"

type NullWriter struct{}

func (NullWriter) Write([]byte) (int, error) { return 0, nil }

func main() {
	logger := NullLogger()
	logger.Info("foo")
}

func NullLogger() *slog.Logger {
	return slog.New(slog.NewTextHandler(NullWriter{}, nil))
}

Reading through this thread I learned about io.Discard (I had searched for combination of "null" and "writer" but never would have guessed "Discard"). So that'll remove some code for me. But it would be really nice if we could invoke slog.NewNullLogger() or some such to avoid this sort of boilerplate.

@jba
Copy link
Contributor

jba commented Oct 5, 2023

@flowchartsman, can you edit your top post to refer to the actual proposal (#62005 (comment))?

@jba
Copy link
Contributor

jba commented Oct 5, 2023

@flowchartsman ... or just edit it to be the proposal.

@flowchartsman flowchartsman changed the title proposal: log/slog: nop logger proposal: log/slog: add slog.DiscardHandler Oct 7, 2023
@flowchartsman
Copy link
Author

Done!

@betamos
Copy link

betamos commented Nov 28, 2023

Seeing this is not on track for 1.22, what should package authors do in the meantime, in case they want to provide structured logging as an optional feature?

  • Implement their own no-op loggers, or
  • Require users to pass a *slog.Logger (which isn't harmful per-se but can add undesirable friction)

I'd assume that a gradual ecosystem-wide migration to slog starts with package authors adding support first, enabling downstream projects to flip the switch at some point in the future.

@kevinburkesegment
Copy link

Added https://go-review.googlesource.com/c/go/+/548335 which uses @bcmills example to demonstrate how users can solve this, for now.

@gopherbot
Copy link

Change https://go.dev/cl/548335 mentions this issue: log/slog: add example showing how to discard logs

@gopherbot
Copy link

Change https://go.dev/cl/547956 mentions this issue: log/slog: implement slog.Discard with example

@flowchartsman
Copy link
Author

flowchartsman commented Dec 11, 2023

I've gone ahead and submitted change 547956, just to get the ball rolling. It required I rename the internal discardHandler, (which is similar, but also allows for initialization to test allocs) to nopHandler, which is a fitting use for the discarded name, IMO, and I've gone with slog.Discard for brevity and symmetry with io.Discard, but am happy to amend.

It seemed appropriate to make a whole file example demonstrating its usage in type initialization, since the initial purpose of the proposal was to have a sensible fallback handler that types which consume a *slog.Logger could use when none is provided. Hopefully this also helps illustrate that types should accept loggers, rather than generate them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Incoming
Development

No branches or pull requests

8 participants