blob: 96fd4283e2a171b96f2f33c72218be1ba254f649 [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001:mod:`logging` --- Logging facility for Python
2==============================================
3
4.. module:: logging
5 :synopsis: Flexible error logging system for applications.
6
7
8.. moduleauthor:: Vinay Sajip <vinay_sajip@red-dove.com>
9.. sectionauthor:: Vinay Sajip <vinay_sajip@red-dove.com>
10
11
Georg Brandl8ec7f652007-08-15 14:28:01 +000012.. index:: pair: Errors; logging
13
14.. versionadded:: 2.3
15
16This module defines functions and classes which implement a flexible error
17logging system for applications.
18
19Logging is performed by calling methods on instances of the :class:`Logger`
20class (hereafter called :dfn:`loggers`). Each instance has a name, and they are
Georg Brandla7395032007-10-21 12:15:05 +000021conceptually arranged in a namespace hierarchy using dots (periods) as
Georg Brandl8ec7f652007-08-15 14:28:01 +000022separators. For example, a logger named "scan" is the parent of loggers
23"scan.text", "scan.html" and "scan.pdf". Logger names can be anything you want,
24and indicate the area of an application in which a logged message originates.
25
26Logged messages also have levels of importance associated with them. The default
27levels provided are :const:`DEBUG`, :const:`INFO`, :const:`WARNING`,
28:const:`ERROR` and :const:`CRITICAL`. As a convenience, you indicate the
29importance of a logged message by calling an appropriate method of
30:class:`Logger`. The methods are :meth:`debug`, :meth:`info`, :meth:`warning`,
31:meth:`error` and :meth:`critical`, which mirror the default levels. You are not
32constrained to use these levels: you can specify your own and use a more general
33:class:`Logger` method, :meth:`log`, which takes an explicit level argument.
34
Georg Brandlc37f2882007-12-04 17:46:27 +000035
36Logging tutorial
37----------------
38
39The key benefit of having the logging API provided by a standard library module
40is that all Python modules can participate in logging, so your application log
41can include messages from third-party modules.
42
43It is, of course, possible to log messages with different verbosity levels or to
44different destinations. Support for writing log messages to files, HTTP
45GET/POST locations, email via SMTP, generic sockets, or OS-specific logging
Georg Brandl907a7202008-02-22 12:31:45 +000046mechanisms are all supported by the standard module. You can also create your
Georg Brandlc37f2882007-12-04 17:46:27 +000047own log destination class if you have special requirements not met by any of the
48built-in classes.
49
50Simple examples
51^^^^^^^^^^^^^^^
52
53.. sectionauthor:: Doug Hellmann
54.. (see <http://blog.doughellmann.com/2007/05/pymotw-logging.html>)
55
56Most applications are probably going to want to log to a file, so let's start
57with that case. Using the :func:`basicConfig` function, we can set up the
58default handler so that debug messages are written to a file::
59
60 import logging
61 LOG_FILENAME = '/tmp/logging_example.out'
Vinay Sajipf778bec2009-09-22 17:23:41 +000062 logging.basicConfig(filename=LOG_FILENAME,level=logging.DEBUG)
Georg Brandlc37f2882007-12-04 17:46:27 +000063
64 logging.debug('This message should go to the log file')
65
66And now if we open the file and look at what we have, we should find the log
67message::
68
69 DEBUG:root:This message should go to the log file
70
71If you run the script repeatedly, the additional log messages are appended to
Eric Smithe7dbebb2009-06-04 17:58:15 +000072the file. To create a new file each time, you can pass a *filemode* argument to
Georg Brandlc37f2882007-12-04 17:46:27 +000073:func:`basicConfig` with a value of ``'w'``. Rather than managing the file size
74yourself, though, it is simpler to use a :class:`RotatingFileHandler`::
75
76 import glob
77 import logging
78 import logging.handlers
79
80 LOG_FILENAME = '/tmp/logging_rotatingfile_example.out'
81
82 # Set up a specific logger with our desired output level
83 my_logger = logging.getLogger('MyLogger')
84 my_logger.setLevel(logging.DEBUG)
85
86 # Add the log message handler to the logger
87 handler = logging.handlers.RotatingFileHandler(
88 LOG_FILENAME, maxBytes=20, backupCount=5)
89
90 my_logger.addHandler(handler)
91
92 # Log some messages
93 for i in range(20):
94 my_logger.debug('i = %d' % i)
95
96 # See what files are created
97 logfiles = glob.glob('%s*' % LOG_FILENAME)
98
99 for filename in logfiles:
100 print filename
101
102The result should be 6 separate files, each with part of the log history for the
103application::
104
105 /tmp/logging_rotatingfile_example.out
106 /tmp/logging_rotatingfile_example.out.1
107 /tmp/logging_rotatingfile_example.out.2
108 /tmp/logging_rotatingfile_example.out.3
109 /tmp/logging_rotatingfile_example.out.4
110 /tmp/logging_rotatingfile_example.out.5
111
112The most current file is always :file:`/tmp/logging_rotatingfile_example.out`,
113and each time it reaches the size limit it is renamed with the suffix
114``.1``. Each of the existing backup files is renamed to increment the suffix
Eric Smithe7dbebb2009-06-04 17:58:15 +0000115(``.1`` becomes ``.2``, etc.) and the ``.6`` file is erased.
Georg Brandlc37f2882007-12-04 17:46:27 +0000116
117Obviously this example sets the log length much much too small as an extreme
118example. You would want to set *maxBytes* to an appropriate value.
119
120Another useful feature of the logging API is the ability to produce different
121messages at different log levels. This allows you to instrument your code with
122debug messages, for example, but turning the log level down so that those debug
123messages are not written for your production system. The default levels are
Vinay Sajipa7d44002009-10-28 23:28:16 +0000124``NOTSET``, ``DEBUG``, ``INFO``, ``WARNING``, ``ERROR`` and ``CRITICAL``.
Georg Brandlc37f2882007-12-04 17:46:27 +0000125
126The logger, handler, and log message call each specify a level. The log message
127is only emitted if the handler and logger are configured to emit messages of
128that level or lower. For example, if a message is ``CRITICAL``, and the logger
129is set to ``ERROR``, the message is emitted. If a message is a ``WARNING``, and
130the logger is set to produce only ``ERROR``\s, the message is not emitted::
131
132 import logging
133 import sys
134
135 LEVELS = {'debug': logging.DEBUG,
136 'info': logging.INFO,
137 'warning': logging.WARNING,
138 'error': logging.ERROR,
139 'critical': logging.CRITICAL}
140
141 if len(sys.argv) > 1:
142 level_name = sys.argv[1]
143 level = LEVELS.get(level_name, logging.NOTSET)
144 logging.basicConfig(level=level)
145
146 logging.debug('This is a debug message')
147 logging.info('This is an info message')
148 logging.warning('This is a warning message')
149 logging.error('This is an error message')
150 logging.critical('This is a critical error message')
151
152Run the script with an argument like 'debug' or 'warning' to see which messages
153show up at different levels::
154
155 $ python logging_level_example.py debug
156 DEBUG:root:This is a debug message
157 INFO:root:This is an info message
158 WARNING:root:This is a warning message
159 ERROR:root:This is an error message
160 CRITICAL:root:This is a critical error message
161
162 $ python logging_level_example.py info
163 INFO:root:This is an info message
164 WARNING:root:This is a warning message
165 ERROR:root:This is an error message
166 CRITICAL:root:This is a critical error message
167
168You will notice that these log messages all have ``root`` embedded in them. The
169logging module supports a hierarchy of loggers with different names. An easy
170way to tell where a specific log message comes from is to use a separate logger
171object for each of your modules. Each new logger "inherits" the configuration
172of its parent, and log messages sent to a logger include the name of that
173logger. Optionally, each logger can be configured differently, so that messages
174from different modules are handled in different ways. Let's look at a simple
175example of how to log from different modules so it is easy to trace the source
176of the message::
177
178 import logging
179
180 logging.basicConfig(level=logging.WARNING)
181
182 logger1 = logging.getLogger('package1.module1')
183 logger2 = logging.getLogger('package2.module2')
184
185 logger1.warning('This message comes from one module')
186 logger2.warning('And this message comes from another module')
187
188And the output::
189
190 $ python logging_modules_example.py
191 WARNING:package1.module1:This message comes from one module
192 WARNING:package2.module2:And this message comes from another module
193
194There are many more options for configuring logging, including different log
195message formatting options, having messages delivered to multiple destinations,
196and changing the configuration of a long-running application on the fly using a
197socket interface. All of these options are covered in depth in the library
198module documentation.
199
200Loggers
201^^^^^^^
202
203The logging library takes a modular approach and offers the several categories
204of components: loggers, handlers, filters, and formatters. Loggers expose the
205interface that application code directly uses. Handlers send the log records to
206the appropriate destination. Filters provide a finer grained facility for
207determining which log records to send on to a handler. Formatters specify the
208layout of the resultant log record.
209
210:class:`Logger` objects have a threefold job. First, they expose several
211methods to application code so that applications can log messages at runtime.
212Second, logger objects determine which log messages to act upon based upon
213severity (the default filtering facility) or filter objects. Third, logger
214objects pass along relevant log messages to all interested log handlers.
215
216The most widely used methods on logger objects fall into two categories:
217configuration and message sending.
218
219* :meth:`Logger.setLevel` specifies the lowest-severity log message a logger
220 will handle, where debug is the lowest built-in severity level and critical is
221 the highest built-in severity. For example, if the severity level is info,
222 the logger will handle only info, warning, error, and critical messages and
223 will ignore debug messages.
224
225* :meth:`Logger.addFilter` and :meth:`Logger.removeFilter` add and remove filter
226 objects from the logger object. This tutorial does not address filters.
227
228With the logger object configured, the following methods create log messages:
229
230* :meth:`Logger.debug`, :meth:`Logger.info`, :meth:`Logger.warning`,
231 :meth:`Logger.error`, and :meth:`Logger.critical` all create log records with
232 a message and a level that corresponds to their respective method names. The
233 message is actually a format string, which may contain the standard string
234 substitution syntax of :const:`%s`, :const:`%d`, :const:`%f`, and so on. The
235 rest of their arguments is a list of objects that correspond with the
236 substitution fields in the message. With regard to :const:`**kwargs`, the
237 logging methods care only about a keyword of :const:`exc_info` and use it to
238 determine whether to log exception information.
239
240* :meth:`Logger.exception` creates a log message similar to
241 :meth:`Logger.error`. The difference is that :meth:`Logger.exception` dumps a
242 stack trace along with it. Call this method only from an exception handler.
243
244* :meth:`Logger.log` takes a log level as an explicit argument. This is a
245 little more verbose for logging messages than using the log level convenience
246 methods listed above, but this is how to log at custom log levels.
247
Brett Cannon499969a2008-02-25 05:33:07 +0000248:func:`getLogger` returns a reference to a logger instance with the specified
249if it it is provided, or ``root`` if not. The names are period-separated
Georg Brandlc37f2882007-12-04 17:46:27 +0000250hierarchical structures. Multiple calls to :func:`getLogger` with the same name
251will return a reference to the same logger object. Loggers that are further
252down in the hierarchical list are children of loggers higher up in the list.
253For example, given a logger with a name of ``foo``, loggers with names of
254``foo.bar``, ``foo.bar.baz``, and ``foo.bam`` are all children of ``foo``.
255Child loggers propagate messages up to their parent loggers. Because of this,
256it is unnecessary to define and configure all the loggers an application uses.
257It is sufficient to configure a top-level logger and create child loggers as
258needed.
259
260
261Handlers
262^^^^^^^^
263
264:class:`Handler` objects are responsible for dispatching the appropriate log
265messages (based on the log messages' severity) to the handler's specified
266destination. Logger objects can add zero or more handler objects to themselves
267with an :func:`addHandler` method. As an example scenario, an application may
268want to send all log messages to a log file, all log messages of error or higher
269to stdout, and all messages of critical to an email address. This scenario
Georg Brandl907a7202008-02-22 12:31:45 +0000270requires three individual handlers where each handler is responsible for sending
Georg Brandlc37f2882007-12-04 17:46:27 +0000271messages of a specific severity to a specific location.
272
273The standard library includes quite a few handler types; this tutorial uses only
274:class:`StreamHandler` and :class:`FileHandler` in its examples.
275
276There are very few methods in a handler for application developers to concern
277themselves with. The only handler methods that seem relevant for application
278developers who are using the built-in handler objects (that is, not creating
279custom handlers) are the following configuration methods:
280
281* The :meth:`Handler.setLevel` method, just as in logger objects, specifies the
282 lowest severity that will be dispatched to the appropriate destination. Why
283 are there two :func:`setLevel` methods? The level set in the logger
284 determines which severity of messages it will pass to its handlers. The level
285 set in each handler determines which messages that handler will send on.
286 :func:`setFormatter` selects a Formatter object for this handler to use.
287
288* :func:`addFilter` and :func:`removeFilter` respectively configure and
289 deconfigure filter objects on handlers.
290
291Application code should not directly instantiate and use handlers. Instead, the
292:class:`Handler` class is a base class that defines the interface that all
293Handlers should have and establishes some default behavior that child classes
294can use (or override).
295
296
297Formatters
298^^^^^^^^^^
299
300Formatter objects configure the final order, structure, and contents of the log
Brett Cannon499969a2008-02-25 05:33:07 +0000301message. Unlike the base :class:`logging.Handler` class, application code may
Georg Brandlc37f2882007-12-04 17:46:27 +0000302instantiate formatter classes, although you could likely subclass the formatter
303if your application needs special behavior. The constructor takes two optional
304arguments: a message format string and a date format string. If there is no
305message format string, the default is to use the raw message. If there is no
306date format string, the default date format is::
307
308 %Y-%m-%d %H:%M:%S
309
310with the milliseconds tacked on at the end.
311
312The message format string uses ``%(<dictionary key>)s`` styled string
Vinay Sajip4b782332009-01-19 06:49:19 +0000313substitution; the possible keys are documented in :ref:`formatter`.
Georg Brandlc37f2882007-12-04 17:46:27 +0000314
315The following message format string will log the time in a human-readable
316format, the severity of the message, and the contents of the message, in that
317order::
318
319 "%(asctime)s - %(levelname)s - %(message)s"
320
321
322Configuring Logging
323^^^^^^^^^^^^^^^^^^^
324
325Programmers can configure logging either by creating loggers, handlers, and
326formatters explicitly in a main module with the configuration methods listed
327above (using Python code), or by creating a logging config file. The following
328code is an example of configuring a very simple logger, a console handler, and a
329simple formatter in a Python module::
330
331 import logging
332
333 # create logger
334 logger = logging.getLogger("simple_example")
335 logger.setLevel(logging.DEBUG)
336 # create console handler and set level to debug
337 ch = logging.StreamHandler()
338 ch.setLevel(logging.DEBUG)
339 # create formatter
340 formatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s")
341 # add formatter to ch
342 ch.setFormatter(formatter)
343 # add ch to logger
344 logger.addHandler(ch)
345
346 # "application" code
347 logger.debug("debug message")
348 logger.info("info message")
349 logger.warn("warn message")
350 logger.error("error message")
351 logger.critical("critical message")
352
353Running this module from the command line produces the following output::
354
355 $ python simple_logging_module.py
356 2005-03-19 15:10:26,618 - simple_example - DEBUG - debug message
357 2005-03-19 15:10:26,620 - simple_example - INFO - info message
358 2005-03-19 15:10:26,695 - simple_example - WARNING - warn message
359 2005-03-19 15:10:26,697 - simple_example - ERROR - error message
360 2005-03-19 15:10:26,773 - simple_example - CRITICAL - critical message
361
362The following Python module creates a logger, handler, and formatter nearly
363identical to those in the example listed above, with the only difference being
364the names of the objects::
365
366 import logging
367 import logging.config
368
369 logging.config.fileConfig("logging.conf")
370
371 # create logger
372 logger = logging.getLogger("simpleExample")
373
374 # "application" code
375 logger.debug("debug message")
376 logger.info("info message")
377 logger.warn("warn message")
378 logger.error("error message")
379 logger.critical("critical message")
380
381Here is the logging.conf file::
382
383 [loggers]
384 keys=root,simpleExample
385
386 [handlers]
387 keys=consoleHandler
388
389 [formatters]
390 keys=simpleFormatter
391
392 [logger_root]
393 level=DEBUG
394 handlers=consoleHandler
395
396 [logger_simpleExample]
397 level=DEBUG
398 handlers=consoleHandler
399 qualname=simpleExample
400 propagate=0
401
402 [handler_consoleHandler]
403 class=StreamHandler
404 level=DEBUG
405 formatter=simpleFormatter
406 args=(sys.stdout,)
407
408 [formatter_simpleFormatter]
409 format=%(asctime)s - %(name)s - %(levelname)s - %(message)s
410 datefmt=
411
412The output is nearly identical to that of the non-config-file-based example::
413
414 $ python simple_logging_config.py
415 2005-03-19 15:38:55,977 - simpleExample - DEBUG - debug message
416 2005-03-19 15:38:55,979 - simpleExample - INFO - info message
417 2005-03-19 15:38:56,054 - simpleExample - WARNING - warn message
418 2005-03-19 15:38:56,055 - simpleExample - ERROR - error message
419 2005-03-19 15:38:56,130 - simpleExample - CRITICAL - critical message
420
421You can see that the config file approach has a few advantages over the Python
422code approach, mainly separation of configuration and code and the ability of
423noncoders to easily modify the logging properties.
424
Vinay Sajip0e6e97d2010-02-04 20:23:45 +0000425Note that the class names referenced in config files need to be either relative
426to the logging module, or absolute values which can be resolved using normal
Georg Brandlf6d367452010-03-12 10:02:03 +0000427import mechanisms. Thus, you could use either :class:`handlers.WatchedFileHandler`
428(relative to the logging module) or :class:`mypackage.mymodule.MyHandler` (for a
429class defined in package :mod:`mypackage` and module :mod:`mymodule`, where
430:mod:`mypackage` is available on the Python import path).
Vinay Sajip0e6e97d2010-02-04 20:23:45 +0000431
Vinay Sajip99505c82009-01-10 13:38:04 +0000432.. _library-config:
433
Vinay Sajip34bfda52008-09-01 15:08:07 +0000434Configuring Logging for a Library
435^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
436
437When developing a library which uses logging, some consideration needs to be
438given to its configuration. If the using application does not use logging, and
439library code makes logging calls, then a one-off message "No handlers could be
440found for logger X.Y.Z" is printed to the console. This message is intended
441to catch mistakes in logging configuration, but will confuse an application
442developer who is not aware of logging by the library.
443
444In addition to documenting how a library uses logging, a good way to configure
445library logging so that it does not cause a spurious message is to add a
446handler which does nothing. This avoids the message being printed, since a
447handler will be found: it just doesn't produce any output. If the library user
448configures logging for application use, presumably that configuration will add
449some handlers, and if levels are suitably configured then logging calls made
450in library code will send output to those handlers, as normal.
451
452A do-nothing handler can be simply defined as follows::
453
454 import logging
455
456 class NullHandler(logging.Handler):
457 def emit(self, record):
458 pass
459
460An instance of this handler should be added to the top-level logger of the
461logging namespace used by the library. If all logging by a library *foo* is
462done using loggers with names matching "foo.x.y", then the code::
463
464 import logging
465
466 h = NullHandler()
467 logging.getLogger("foo").addHandler(h)
468
469should have the desired effect. If an organisation produces a number of
470libraries, then the logger name specified can be "orgname.foo" rather than
471just "foo".
472
Vinay Sajip213faca2008-12-03 23:22:58 +0000473.. versionadded:: 2.7
474
475The :class:`NullHandler` class was not present in previous versions, but is now
476included, so that it need not be defined in library code.
477
478
Georg Brandlc37f2882007-12-04 17:46:27 +0000479
480Logging Levels
481--------------
482
Georg Brandl8ec7f652007-08-15 14:28:01 +0000483The numeric values of logging levels are given in the following table. These are
484primarily of interest if you want to define your own levels, and need them to
485have specific values relative to the predefined levels. If you define a level
486with the same numeric value, it overwrites the predefined value; the predefined
487name is lost.
488
489+--------------+---------------+
490| Level | Numeric value |
491+==============+===============+
492| ``CRITICAL`` | 50 |
493+--------------+---------------+
494| ``ERROR`` | 40 |
495+--------------+---------------+
496| ``WARNING`` | 30 |
497+--------------+---------------+
498| ``INFO`` | 20 |
499+--------------+---------------+
500| ``DEBUG`` | 10 |
501+--------------+---------------+
502| ``NOTSET`` | 0 |
503+--------------+---------------+
504
505Levels can also be associated with loggers, being set either by the developer or
506through loading a saved logging configuration. When a logging method is called
507on a logger, the logger compares its own level with the level associated with
508the method call. If the logger's level is higher than the method call's, no
509logging message is actually generated. This is the basic mechanism controlling
510the verbosity of logging output.
511
512Logging messages are encoded as instances of the :class:`LogRecord` class. When
513a logger decides to actually log an event, a :class:`LogRecord` instance is
514created from the logging message.
515
516Logging messages are subjected to a dispatch mechanism through the use of
517:dfn:`handlers`, which are instances of subclasses of the :class:`Handler`
518class. Handlers are responsible for ensuring that a logged message (in the form
519of a :class:`LogRecord`) ends up in a particular location (or set of locations)
520which is useful for the target audience for that message (such as end users,
521support desk staff, system administrators, developers). Handlers are passed
522:class:`LogRecord` instances intended for particular destinations. Each logger
523can have zero, one or more handlers associated with it (via the
524:meth:`addHandler` method of :class:`Logger`). In addition to any handlers
525directly associated with a logger, *all handlers associated with all ancestors
526of the logger* are called to dispatch the message.
527
528Just as for loggers, handlers can have levels associated with them. A handler's
529level acts as a filter in the same way as a logger's level does. If a handler
530decides to actually dispatch an event, the :meth:`emit` method is used to send
531the message to its destination. Most user-defined subclasses of :class:`Handler`
532will need to override this :meth:`emit`.
533
Vinay Sajipb5902e62009-01-15 22:48:13 +0000534Useful Handlers
535---------------
536
Georg Brandl8ec7f652007-08-15 14:28:01 +0000537In addition to the base :class:`Handler` class, many useful subclasses are
538provided:
539
Vinay Sajip4b782332009-01-19 06:49:19 +0000540#. :ref:`stream-handler` instances send error messages to streams (file-like
Georg Brandl8ec7f652007-08-15 14:28:01 +0000541 objects).
542
Vinay Sajip4b782332009-01-19 06:49:19 +0000543#. :ref:`file-handler` instances send error messages to disk files.
Vinay Sajipb1a15e42009-01-15 23:04:47 +0000544
Vinay Sajipb5902e62009-01-15 22:48:13 +0000545#. :class:`BaseRotatingHandler` is the base class for handlers that
Vinay Sajip99234c52009-01-12 20:36:18 +0000546 rotate log files at a certain point. It is not meant to be instantiated
Vinay Sajip4b782332009-01-19 06:49:19 +0000547 directly. Instead, use :ref:`rotating-file-handler` or
548 :ref:`timed-rotating-file-handler`.
Vinay Sajipc2211ad2009-01-10 19:22:57 +0000549
Vinay Sajip4b782332009-01-19 06:49:19 +0000550#. :ref:`rotating-file-handler` instances send error messages to disk
Vinay Sajipb5902e62009-01-15 22:48:13 +0000551 files, with support for maximum log file sizes and log file rotation.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000552
Vinay Sajip4b782332009-01-19 06:49:19 +0000553#. :ref:`timed-rotating-file-handler` instances send error messages to
Vinay Sajipb5902e62009-01-15 22:48:13 +0000554 disk files, rotating the log file at certain timed intervals.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000555
Vinay Sajip4b782332009-01-19 06:49:19 +0000556#. :ref:`socket-handler` instances send error messages to TCP/IP
Vinay Sajipb5902e62009-01-15 22:48:13 +0000557 sockets.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000558
Vinay Sajip4b782332009-01-19 06:49:19 +0000559#. :ref:`datagram-handler` instances send error messages to UDP
Vinay Sajipb5902e62009-01-15 22:48:13 +0000560 sockets.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000561
Vinay Sajip4b782332009-01-19 06:49:19 +0000562#. :ref:`smtp-handler` instances send error messages to a designated
Vinay Sajipb5902e62009-01-15 22:48:13 +0000563 email address.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000564
Vinay Sajip4b782332009-01-19 06:49:19 +0000565#. :ref:`syslog-handler` instances send error messages to a Unix
Vinay Sajipb5902e62009-01-15 22:48:13 +0000566 syslog daemon, possibly on a remote machine.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000567
Vinay Sajip4b782332009-01-19 06:49:19 +0000568#. :ref:`nt-eventlog-handler` instances send error messages to a
Vinay Sajipb5902e62009-01-15 22:48:13 +0000569 Windows NT/2000/XP event log.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000570
Vinay Sajip4b782332009-01-19 06:49:19 +0000571#. :ref:`memory-handler` instances send error messages to a buffer
Vinay Sajipb5902e62009-01-15 22:48:13 +0000572 in memory, which is flushed whenever specific criteria are met.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000573
Vinay Sajip4b782332009-01-19 06:49:19 +0000574#. :ref:`http-handler` instances send error messages to an HTTP
Vinay Sajipb5902e62009-01-15 22:48:13 +0000575 server using either ``GET`` or ``POST`` semantics.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000576
Vinay Sajip4b782332009-01-19 06:49:19 +0000577#. :ref:`watched-file-handler` instances watch the file they are
Vinay Sajipb5902e62009-01-15 22:48:13 +0000578 logging to. If the file changes, it is closed and reopened using the file
579 name. This handler is only useful on Unix-like systems; Windows does not
580 support the underlying mechanism used.
Vinay Sajipc2211ad2009-01-10 19:22:57 +0000581
Vinay Sajip4b782332009-01-19 06:49:19 +0000582#. :ref:`null-handler` instances do nothing with error messages. They are used
Vinay Sajip213faca2008-12-03 23:22:58 +0000583 by library developers who want to use logging, but want to avoid the "No
584 handlers could be found for logger XXX" message which can be displayed if
Vinay Sajip99505c82009-01-10 13:38:04 +0000585 the library user has not configured logging. See :ref:`library-config` for
586 more information.
Vinay Sajip213faca2008-12-03 23:22:58 +0000587
588.. versionadded:: 2.7
589
590The :class:`NullHandler` class was not present in previous versions.
591
Vinay Sajip7cc97552008-12-30 07:01:25 +0000592The :class:`NullHandler`, :class:`StreamHandler` and :class:`FileHandler`
593classes are defined in the core logging package. The other handlers are
594defined in a sub- module, :mod:`logging.handlers`. (There is also another
595sub-module, :mod:`logging.config`, for configuration functionality.)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000596
597Logged messages are formatted for presentation through instances of the
598:class:`Formatter` class. They are initialized with a format string suitable for
599use with the % operator and a dictionary.
600
601For formatting multiple messages in a batch, instances of
602:class:`BufferingFormatter` can be used. In addition to the format string (which
603is applied to each message in the batch), there is provision for header and
604trailer format strings.
605
606When filtering based on logger level and/or handler level is not enough,
607instances of :class:`Filter` can be added to both :class:`Logger` and
608:class:`Handler` instances (through their :meth:`addFilter` method). Before
609deciding to process a message further, both loggers and handlers consult all
610their filters for permission. If any filter returns a false value, the message
611is not processed further.
612
613The basic :class:`Filter` functionality allows filtering by specific logger
614name. If this feature is used, messages sent to the named logger and its
615children are allowed through the filter, and all others dropped.
616
Vinay Sajipb5902e62009-01-15 22:48:13 +0000617Module-Level Functions
618----------------------
619
Georg Brandl8ec7f652007-08-15 14:28:01 +0000620In addition to the classes described above, there are a number of module- level
621functions.
622
623
624.. function:: getLogger([name])
625
626 Return a logger with the specified name or, if no name is specified, return a
627 logger which is the root logger of the hierarchy. If specified, the name is
628 typically a dot-separated hierarchical name like *"a"*, *"a.b"* or *"a.b.c.d"*.
629 Choice of these names is entirely up to the developer who is using logging.
630
631 All calls to this function with a given name return the same logger instance.
632 This means that logger instances never need to be passed between different parts
633 of an application.
634
635
636.. function:: getLoggerClass()
637
638 Return either the standard :class:`Logger` class, or the last class passed to
639 :func:`setLoggerClass`. This function may be called from within a new class
640 definition, to ensure that installing a customised :class:`Logger` class will
641 not undo customisations already applied by other code. For example::
642
643 class MyLogger(logging.getLoggerClass()):
644 # ... override behaviour here
645
646
647.. function:: debug(msg[, *args[, **kwargs]])
648
649 Logs a message with level :const:`DEBUG` on the root logger. The *msg* is the
650 message format string, and the *args* are the arguments which are merged into
651 *msg* using the string formatting operator. (Note that this means that you can
652 use keywords in the format string, together with a single dictionary argument.)
653
654 There are two keyword arguments in *kwargs* which are inspected: *exc_info*
655 which, if it does not evaluate as false, causes exception information to be
656 added to the logging message. If an exception tuple (in the format returned by
657 :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info`
658 is called to get the exception information.
659
660 The other optional keyword argument is *extra* which can be used to pass a
661 dictionary which is used to populate the __dict__ of the LogRecord created for
662 the logging event with user-defined attributes. These custom attributes can then
663 be used as you like. For example, they could be incorporated into logged
664 messages. For example::
665
666 FORMAT = "%(asctime)-15s %(clientip)s %(user)-8s %(message)s"
667 logging.basicConfig(format=FORMAT)
668 d = {'clientip': '192.168.0.1', 'user': 'fbloggs'}
669 logging.warning("Protocol problem: %s", "connection reset", extra=d)
670
671 would print something like ::
672
673 2006-02-08 22:20:02,165 192.168.0.1 fbloggs Protocol problem: connection reset
674
675 The keys in the dictionary passed in *extra* should not clash with the keys used
676 by the logging system. (See the :class:`Formatter` documentation for more
677 information on which keys are used by the logging system.)
678
679 If you choose to use these attributes in logged messages, you need to exercise
680 some care. In the above example, for instance, the :class:`Formatter` has been
681 set up with a format string which expects 'clientip' and 'user' in the attribute
682 dictionary of the LogRecord. If these are missing, the message will not be
683 logged because a string formatting exception will occur. So in this case, you
684 always need to pass the *extra* dictionary with these keys.
685
686 While this might be annoying, this feature is intended for use in specialized
687 circumstances, such as multi-threaded servers where the same code executes in
688 many contexts, and interesting conditions which arise are dependent on this
689 context (such as remote client IP address and authenticated user name, in the
690 above example). In such circumstances, it is likely that specialized
691 :class:`Formatter`\ s would be used with particular :class:`Handler`\ s.
692
693 .. versionchanged:: 2.5
694 *extra* was added.
695
696
697.. function:: info(msg[, *args[, **kwargs]])
698
699 Logs a message with level :const:`INFO` on the root logger. The arguments are
700 interpreted as for :func:`debug`.
701
702
703.. function:: warning(msg[, *args[, **kwargs]])
704
705 Logs a message with level :const:`WARNING` on the root logger. The arguments are
706 interpreted as for :func:`debug`.
707
708
709.. function:: error(msg[, *args[, **kwargs]])
710
711 Logs a message with level :const:`ERROR` on the root logger. The arguments are
712 interpreted as for :func:`debug`.
713
714
715.. function:: critical(msg[, *args[, **kwargs]])
716
717 Logs a message with level :const:`CRITICAL` on the root logger. The arguments
718 are interpreted as for :func:`debug`.
719
720
721.. function:: exception(msg[, *args])
722
723 Logs a message with level :const:`ERROR` on the root logger. The arguments are
724 interpreted as for :func:`debug`. Exception info is added to the logging
725 message. This function should only be called from an exception handler.
726
727
728.. function:: log(level, msg[, *args[, **kwargs]])
729
730 Logs a message with level *level* on the root logger. The other arguments are
731 interpreted as for :func:`debug`.
732
733
734.. function:: disable(lvl)
735
736 Provides an overriding level *lvl* for all loggers which takes precedence over
737 the logger's own level. When the need arises to temporarily throttle logging
Vinay Sajip2060e422010-03-17 15:05:57 +0000738 output down across the whole application, this function can be useful. Its
739 effect is to disable all logging calls of severity *lvl* and below, so that
740 if you call it with a value of INFO, then all INFO and DEBUG events would be
741 discarded, whereas those of severity WARNING and above would be processed
742 according to the logger's effective level.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000743
744
745.. function:: addLevelName(lvl, levelName)
746
747 Associates level *lvl* with text *levelName* in an internal dictionary, which is
748 used to map numeric levels to a textual representation, for example when a
749 :class:`Formatter` formats a message. This function can also be used to define
750 your own levels. The only constraints are that all levels used must be
751 registered using this function, levels should be positive integers and they
752 should increase in increasing order of severity.
753
754
755.. function:: getLevelName(lvl)
756
757 Returns the textual representation of logging level *lvl*. If the level is one
758 of the predefined levels :const:`CRITICAL`, :const:`ERROR`, :const:`WARNING`,
759 :const:`INFO` or :const:`DEBUG` then you get the corresponding string. If you
760 have associated levels with names using :func:`addLevelName` then the name you
761 have associated with *lvl* is returned. If a numeric value corresponding to one
762 of the defined levels is passed in, the corresponding string representation is
763 returned. Otherwise, the string "Level %s" % lvl is returned.
764
765
766.. function:: makeLogRecord(attrdict)
767
768 Creates and returns a new :class:`LogRecord` instance whose attributes are
769 defined by *attrdict*. This function is useful for taking a pickled
770 :class:`LogRecord` attribute dictionary, sent over a socket, and reconstituting
771 it as a :class:`LogRecord` instance at the receiving end.
772
773
774.. function:: basicConfig([**kwargs])
775
776 Does basic configuration for the logging system by creating a
777 :class:`StreamHandler` with a default :class:`Formatter` and adding it to the
Vinay Sajip1c77b7f2009-10-10 20:32:36 +0000778 root logger. The functions :func:`debug`, :func:`info`, :func:`warning`,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000779 :func:`error` and :func:`critical` will call :func:`basicConfig` automatically
780 if no handlers are defined for the root logger.
781
Vinay Sajip1c77b7f2009-10-10 20:32:36 +0000782 This function does nothing if the root logger already has handlers
783 configured for it.
Georg Brandldfb5bbd2008-05-09 06:18:27 +0000784
Georg Brandl8ec7f652007-08-15 14:28:01 +0000785 .. versionchanged:: 2.4
786 Formerly, :func:`basicConfig` did not take any keyword arguments.
787
788 The following keyword arguments are supported.
789
790 +--------------+---------------------------------------------+
791 | Format | Description |
792 +==============+=============================================+
793 | ``filename`` | Specifies that a FileHandler be created, |
794 | | using the specified filename, rather than a |
795 | | StreamHandler. |
796 +--------------+---------------------------------------------+
797 | ``filemode`` | Specifies the mode to open the file, if |
798 | | filename is specified (if filemode is |
799 | | unspecified, it defaults to 'a'). |
800 +--------------+---------------------------------------------+
801 | ``format`` | Use the specified format string for the |
802 | | handler. |
803 +--------------+---------------------------------------------+
804 | ``datefmt`` | Use the specified date/time format. |
805 +--------------+---------------------------------------------+
806 | ``level`` | Set the root logger level to the specified |
807 | | level. |
808 +--------------+---------------------------------------------+
809 | ``stream`` | Use the specified stream to initialize the |
810 | | StreamHandler. Note that this argument is |
811 | | incompatible with 'filename' - if both are |
812 | | present, 'stream' is ignored. |
813 +--------------+---------------------------------------------+
814
815
816.. function:: shutdown()
817
818 Informs the logging system to perform an orderly shutdown by flushing and
Vinay Sajip91f0ee42008-03-16 21:35:58 +0000819 closing all handlers. This should be called at application exit and no
820 further use of the logging system should be made after this call.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000821
822
823.. function:: setLoggerClass(klass)
824
825 Tells the logging system to use the class *klass* when instantiating a logger.
826 The class should define :meth:`__init__` such that only a name argument is
827 required, and the :meth:`__init__` should call :meth:`Logger.__init__`. This
828 function is typically called before any loggers are instantiated by applications
829 which need to use custom logger behavior.
830
831
832.. seealso::
833
834 :pep:`282` - A Logging System
835 The proposal which described this feature for inclusion in the Python standard
836 library.
837
Georg Brandl2b92f6b2007-12-06 01:52:24 +0000838 `Original Python logging package <http://www.red-dove.com/python_logging.html>`_
Georg Brandl8ec7f652007-08-15 14:28:01 +0000839 This is the original source for the :mod:`logging` package. The version of the
840 package available from this site is suitable for use with Python 1.5.2, 2.1.x
841 and 2.2.x, which do not include the :mod:`logging` package in the standard
842 library.
843
Vinay Sajip4b782332009-01-19 06:49:19 +0000844.. _logger:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000845
846Logger Objects
847--------------
848
849Loggers have the following attributes and methods. Note that Loggers are never
850instantiated directly, but always through the module-level function
851``logging.getLogger(name)``.
852
853
854.. attribute:: Logger.propagate
855
856 If this evaluates to false, logging messages are not passed by this logger or by
857 child loggers to higher level (ancestor) loggers. The constructor sets this
858 attribute to 1.
859
860
861.. method:: Logger.setLevel(lvl)
862
863 Sets the threshold for this logger to *lvl*. Logging messages which are less
864 severe than *lvl* will be ignored. When a logger is created, the level is set to
865 :const:`NOTSET` (which causes all messages to be processed when the logger is
866 the root logger, or delegation to the parent when the logger is a non-root
867 logger). Note that the root logger is created with level :const:`WARNING`.
868
869 The term "delegation to the parent" means that if a logger has a level of
870 NOTSET, its chain of ancestor loggers is traversed until either an ancestor with
871 a level other than NOTSET is found, or the root is reached.
872
873 If an ancestor is found with a level other than NOTSET, then that ancestor's
874 level is treated as the effective level of the logger where the ancestor search
875 began, and is used to determine how a logging event is handled.
876
877 If the root is reached, and it has a level of NOTSET, then all messages will be
878 processed. Otherwise, the root's level will be used as the effective level.
879
880
881.. method:: Logger.isEnabledFor(lvl)
882
883 Indicates if a message of severity *lvl* would be processed by this logger.
884 This method checks first the module-level level set by
885 ``logging.disable(lvl)`` and then the logger's effective level as determined
886 by :meth:`getEffectiveLevel`.
887
888
889.. method:: Logger.getEffectiveLevel()
890
891 Indicates the effective level for this logger. If a value other than
892 :const:`NOTSET` has been set using :meth:`setLevel`, it is returned. Otherwise,
893 the hierarchy is traversed towards the root until a value other than
894 :const:`NOTSET` is found, and that value is returned.
895
896
Vinay Sajip804899b2010-03-22 15:29:01 +0000897.. method:: Logger.getChild(suffix)
898
899 Returns a logger which is a descendant to this logger, as determined by the suffix.
900 Thus, ``logging.getLogger('abc').getChild('def.ghi')`` would return the same
901 logger as would be returned by ``logging.getLogger('abc.def.ghi')``. This is a
902 convenience method, useful when the parent logger is named using e.g. ``__name__``
903 rather than a literal string.
904
905 .. versionadded:: 2.7
906
Georg Brandl8ec7f652007-08-15 14:28:01 +0000907.. method:: Logger.debug(msg[, *args[, **kwargs]])
908
909 Logs a message with level :const:`DEBUG` on this logger. The *msg* is the
910 message format string, and the *args* are the arguments which are merged into
911 *msg* using the string formatting operator. (Note that this means that you can
912 use keywords in the format string, together with a single dictionary argument.)
913
914 There are two keyword arguments in *kwargs* which are inspected: *exc_info*
915 which, if it does not evaluate as false, causes exception information to be
916 added to the logging message. If an exception tuple (in the format returned by
917 :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info`
918 is called to get the exception information.
919
920 The other optional keyword argument is *extra* which can be used to pass a
921 dictionary which is used to populate the __dict__ of the LogRecord created for
922 the logging event with user-defined attributes. These custom attributes can then
923 be used as you like. For example, they could be incorporated into logged
924 messages. For example::
925
926 FORMAT = "%(asctime)-15s %(clientip)s %(user)-8s %(message)s"
927 logging.basicConfig(format=FORMAT)
Neal Norwitz53004282007-10-23 05:44:27 +0000928 d = { 'clientip' : '192.168.0.1', 'user' : 'fbloggs' }
Georg Brandl8ec7f652007-08-15 14:28:01 +0000929 logger = logging.getLogger("tcpserver")
930 logger.warning("Protocol problem: %s", "connection reset", extra=d)
931
932 would print something like ::
933
934 2006-02-08 22:20:02,165 192.168.0.1 fbloggs Protocol problem: connection reset
935
936 The keys in the dictionary passed in *extra* should not clash with the keys used
937 by the logging system. (See the :class:`Formatter` documentation for more
938 information on which keys are used by the logging system.)
939
940 If you choose to use these attributes in logged messages, you need to exercise
941 some care. In the above example, for instance, the :class:`Formatter` has been
942 set up with a format string which expects 'clientip' and 'user' in the attribute
943 dictionary of the LogRecord. If these are missing, the message will not be
944 logged because a string formatting exception will occur. So in this case, you
945 always need to pass the *extra* dictionary with these keys.
946
947 While this might be annoying, this feature is intended for use in specialized
948 circumstances, such as multi-threaded servers where the same code executes in
949 many contexts, and interesting conditions which arise are dependent on this
950 context (such as remote client IP address and authenticated user name, in the
951 above example). In such circumstances, it is likely that specialized
952 :class:`Formatter`\ s would be used with particular :class:`Handler`\ s.
953
954 .. versionchanged:: 2.5
955 *extra* was added.
956
957
958.. method:: Logger.info(msg[, *args[, **kwargs]])
959
960 Logs a message with level :const:`INFO` on this logger. The arguments are
961 interpreted as for :meth:`debug`.
962
963
964.. method:: Logger.warning(msg[, *args[, **kwargs]])
965
966 Logs a message with level :const:`WARNING` on this logger. The arguments are
967 interpreted as for :meth:`debug`.
968
969
970.. method:: Logger.error(msg[, *args[, **kwargs]])
971
972 Logs a message with level :const:`ERROR` on this logger. The arguments are
973 interpreted as for :meth:`debug`.
974
975
976.. method:: Logger.critical(msg[, *args[, **kwargs]])
977
978 Logs a message with level :const:`CRITICAL` on this logger. The arguments are
979 interpreted as for :meth:`debug`.
980
981
982.. method:: Logger.log(lvl, msg[, *args[, **kwargs]])
983
984 Logs a message with integer level *lvl* on this logger. The other arguments are
985 interpreted as for :meth:`debug`.
986
987
988.. method:: Logger.exception(msg[, *args])
989
990 Logs a message with level :const:`ERROR` on this logger. The arguments are
991 interpreted as for :meth:`debug`. Exception info is added to the logging
992 message. This method should only be called from an exception handler.
993
994
995.. method:: Logger.addFilter(filt)
996
997 Adds the specified filter *filt* to this logger.
998
999
1000.. method:: Logger.removeFilter(filt)
1001
1002 Removes the specified filter *filt* from this logger.
1003
1004
1005.. method:: Logger.filter(record)
1006
1007 Applies this logger's filters to the record and returns a true value if the
1008 record is to be processed.
1009
1010
1011.. method:: Logger.addHandler(hdlr)
1012
1013 Adds the specified handler *hdlr* to this logger.
1014
1015
1016.. method:: Logger.removeHandler(hdlr)
1017
1018 Removes the specified handler *hdlr* from this logger.
1019
1020
1021.. method:: Logger.findCaller()
1022
1023 Finds the caller's source filename and line number. Returns the filename, line
1024 number and function name as a 3-element tuple.
1025
Matthias Klosef0e29182007-08-16 12:03:44 +00001026 .. versionchanged:: 2.4
Georg Brandl8ec7f652007-08-15 14:28:01 +00001027 The function name was added. In earlier versions, the filename and line number
1028 were returned as a 2-element tuple..
1029
1030
1031.. method:: Logger.handle(record)
1032
1033 Handles a record by passing it to all handlers associated with this logger and
1034 its ancestors (until a false value of *propagate* is found). This method is used
1035 for unpickled records received from a socket, as well as those created locally.
Georg Brandl9fa61bb2009-07-26 14:19:57 +00001036 Logger-level filtering is applied using :meth:`~Logger.filter`.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001037
1038
1039.. method:: Logger.makeRecord(name, lvl, fn, lno, msg, args, exc_info [, func, extra])
1040
1041 This is a factory method which can be overridden in subclasses to create
1042 specialized :class:`LogRecord` instances.
1043
1044 .. versionchanged:: 2.5
1045 *func* and *extra* were added.
1046
1047
1048.. _minimal-example:
1049
1050Basic example
1051-------------
1052
1053.. versionchanged:: 2.4
1054 formerly :func:`basicConfig` did not take any keyword arguments.
1055
1056The :mod:`logging` package provides a lot of flexibility, and its configuration
1057can appear daunting. This section demonstrates that simple use of the logging
1058package is possible.
1059
1060The simplest example shows logging to the console::
1061
1062 import logging
1063
1064 logging.debug('A debug message')
1065 logging.info('Some information')
1066 logging.warning('A shot across the bows')
1067
1068If you run the above script, you'll see this::
1069
1070 WARNING:root:A shot across the bows
1071
1072Because no particular logger was specified, the system used the root logger. The
1073debug and info messages didn't appear because by default, the root logger is
1074configured to only handle messages with a severity of WARNING or above. The
1075message format is also a configuration default, as is the output destination of
1076the messages - ``sys.stderr``. The severity level, the message format and
1077destination can be easily changed, as shown in the example below::
1078
1079 import logging
1080
1081 logging.basicConfig(level=logging.DEBUG,
1082 format='%(asctime)s %(levelname)s %(message)s',
1083 filename='/tmp/myapp.log',
1084 filemode='w')
1085 logging.debug('A debug message')
1086 logging.info('Some information')
1087 logging.warning('A shot across the bows')
1088
1089The :meth:`basicConfig` method is used to change the configuration defaults,
1090which results in output (written to ``/tmp/myapp.log``) which should look
1091something like the following::
1092
1093 2004-07-02 13:00:08,743 DEBUG A debug message
1094 2004-07-02 13:00:08,743 INFO Some information
1095 2004-07-02 13:00:08,743 WARNING A shot across the bows
1096
1097This time, all messages with a severity of DEBUG or above were handled, and the
1098format of the messages was also changed, and output went to the specified file
1099rather than the console.
1100
1101Formatting uses standard Python string formatting - see section
1102:ref:`string-formatting`. The format string takes the following common
1103specifiers. For a complete list of specifiers, consult the :class:`Formatter`
1104documentation.
1105
1106+-------------------+-----------------------------------------------+
1107| Format | Description |
1108+===================+===============================================+
1109| ``%(name)s`` | Name of the logger (logging channel). |
1110+-------------------+-----------------------------------------------+
1111| ``%(levelname)s`` | Text logging level for the message |
1112| | (``'DEBUG'``, ``'INFO'``, ``'WARNING'``, |
1113| | ``'ERROR'``, ``'CRITICAL'``). |
1114+-------------------+-----------------------------------------------+
1115| ``%(asctime)s`` | Human-readable time when the |
1116| | :class:`LogRecord` was created. By default |
1117| | this is of the form "2003-07-08 16:49:45,896" |
1118| | (the numbers after the comma are millisecond |
1119| | portion of the time). |
1120+-------------------+-----------------------------------------------+
1121| ``%(message)s`` | The logged message. |
1122+-------------------+-----------------------------------------------+
1123
1124To change the date/time format, you can pass an additional keyword parameter,
1125*datefmt*, as in the following::
1126
1127 import logging
1128
1129 logging.basicConfig(level=logging.DEBUG,
1130 format='%(asctime)s %(levelname)-8s %(message)s',
1131 datefmt='%a, %d %b %Y %H:%M:%S',
1132 filename='/temp/myapp.log',
1133 filemode='w')
1134 logging.debug('A debug message')
1135 logging.info('Some information')
1136 logging.warning('A shot across the bows')
1137
1138which would result in output like ::
1139
1140 Fri, 02 Jul 2004 13:06:18 DEBUG A debug message
1141 Fri, 02 Jul 2004 13:06:18 INFO Some information
1142 Fri, 02 Jul 2004 13:06:18 WARNING A shot across the bows
1143
1144The date format string follows the requirements of :func:`strftime` - see the
1145documentation for the :mod:`time` module.
1146
1147If, instead of sending logging output to the console or a file, you'd rather use
1148a file-like object which you have created separately, you can pass it to
1149:func:`basicConfig` using the *stream* keyword argument. Note that if both
1150*stream* and *filename* keyword arguments are passed, the *stream* argument is
1151ignored.
1152
1153Of course, you can put variable information in your output. To do this, simply
1154have the message be a format string and pass in additional arguments containing
1155the variable information, as in the following example::
1156
1157 import logging
1158
1159 logging.basicConfig(level=logging.DEBUG,
1160 format='%(asctime)s %(levelname)-8s %(message)s',
1161 datefmt='%a, %d %b %Y %H:%M:%S',
1162 filename='/temp/myapp.log',
1163 filemode='w')
1164 logging.error('Pack my box with %d dozen %s', 5, 'liquor jugs')
1165
1166which would result in ::
1167
1168 Wed, 21 Jul 2004 15:35:16 ERROR Pack my box with 5 dozen liquor jugs
1169
1170
1171.. _multiple-destinations:
1172
1173Logging to multiple destinations
1174--------------------------------
1175
1176Let's say you want to log to console and file with different message formats and
1177in differing circumstances. Say you want to log messages with levels of DEBUG
1178and higher to file, and those messages at level INFO and higher to the console.
1179Let's also assume that the file should contain timestamps, but the console
1180messages should not. Here's how you can achieve this::
1181
1182 import logging
1183
1184 # set up logging to file - see previous section for more details
1185 logging.basicConfig(level=logging.DEBUG,
1186 format='%(asctime)s %(name)-12s %(levelname)-8s %(message)s',
1187 datefmt='%m-%d %H:%M',
1188 filename='/temp/myapp.log',
1189 filemode='w')
1190 # define a Handler which writes INFO messages or higher to the sys.stderr
1191 console = logging.StreamHandler()
1192 console.setLevel(logging.INFO)
1193 # set a format which is simpler for console use
1194 formatter = logging.Formatter('%(name)-12s: %(levelname)-8s %(message)s')
1195 # tell the handler to use this format
1196 console.setFormatter(formatter)
1197 # add the handler to the root logger
1198 logging.getLogger('').addHandler(console)
1199
1200 # Now, we can log to the root logger, or any other logger. First the root...
1201 logging.info('Jackdaws love my big sphinx of quartz.')
1202
1203 # Now, define a couple of other loggers which might represent areas in your
1204 # application:
1205
1206 logger1 = logging.getLogger('myapp.area1')
1207 logger2 = logging.getLogger('myapp.area2')
1208
1209 logger1.debug('Quick zephyrs blow, vexing daft Jim.')
1210 logger1.info('How quickly daft jumping zebras vex.')
1211 logger2.warning('Jail zesty vixen who grabbed pay from quack.')
1212 logger2.error('The five boxing wizards jump quickly.')
1213
1214When you run this, on the console you will see ::
1215
1216 root : INFO Jackdaws love my big sphinx of quartz.
1217 myapp.area1 : INFO How quickly daft jumping zebras vex.
1218 myapp.area2 : WARNING Jail zesty vixen who grabbed pay from quack.
1219 myapp.area2 : ERROR The five boxing wizards jump quickly.
1220
1221and in the file you will see something like ::
1222
1223 10-22 22:19 root INFO Jackdaws love my big sphinx of quartz.
1224 10-22 22:19 myapp.area1 DEBUG Quick zephyrs blow, vexing daft Jim.
1225 10-22 22:19 myapp.area1 INFO How quickly daft jumping zebras vex.
1226 10-22 22:19 myapp.area2 WARNING Jail zesty vixen who grabbed pay from quack.
1227 10-22 22:19 myapp.area2 ERROR The five boxing wizards jump quickly.
1228
1229As you can see, the DEBUG message only shows up in the file. The other messages
1230are sent to both destinations.
1231
1232This example uses console and file handlers, but you can use any number and
1233combination of handlers you choose.
1234
Vinay Sajip333c6e72009-08-20 22:04:32 +00001235.. _logging-exceptions:
1236
1237Exceptions raised during logging
1238--------------------------------
1239
1240The logging package is designed to swallow exceptions which occur while logging
1241in production. This is so that errors which occur while handling logging events
1242- such as logging misconfiguration, network or other similar errors - do not
1243cause the application using logging to terminate prematurely.
1244
1245:class:`SystemExit` and :class:`KeyboardInterrupt` exceptions are never
1246swallowed. Other exceptions which occur during the :meth:`emit` method of a
1247:class:`Handler` subclass are passed to its :meth:`handleError` method.
1248
1249The default implementation of :meth:`handleError` in :class:`Handler` checks
Georg Brandlf6d367452010-03-12 10:02:03 +00001250to see if a module-level variable, :data:`raiseExceptions`, is set. If set, a
1251traceback is printed to :data:`sys.stderr`. If not set, the exception is swallowed.
Vinay Sajip333c6e72009-08-20 22:04:32 +00001252
Georg Brandlf6d367452010-03-12 10:02:03 +00001253**Note:** The default value of :data:`raiseExceptions` is ``True``. This is because
Vinay Sajip333c6e72009-08-20 22:04:32 +00001254during development, you typically want to be notified of any exceptions that
Georg Brandlf6d367452010-03-12 10:02:03 +00001255occur. It's advised that you set :data:`raiseExceptions` to ``False`` for production
Vinay Sajip333c6e72009-08-20 22:04:32 +00001256usage.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001257
Vinay Sajipaa0665b2008-01-07 19:40:10 +00001258.. _context-info:
1259
1260Adding contextual information to your logging output
1261----------------------------------------------------
1262
1263Sometimes you want logging output to contain contextual information in
1264addition to the parameters passed to the logging call. For example, in a
1265networked application, it may be desirable to log client-specific information
1266in the log (e.g. remote client's username, or IP address). Although you could
1267use the *extra* parameter to achieve this, it's not always convenient to pass
1268the information in this way. While it might be tempting to create
1269:class:`Logger` instances on a per-connection basis, this is not a good idea
1270because these instances are not garbage collected. While this is not a problem
1271in practice, when the number of :class:`Logger` instances is dependent on the
1272level of granularity you want to use in logging an application, it could
1273be hard to manage if the number of :class:`Logger` instances becomes
1274effectively unbounded.
1275
Vinay Sajipc7403352008-01-18 15:54:14 +00001276An easy way in which you can pass contextual information to be output along
1277with logging event information is to use the :class:`LoggerAdapter` class.
1278This class is designed to look like a :class:`Logger`, so that you can call
1279:meth:`debug`, :meth:`info`, :meth:`warning`, :meth:`error`,
1280:meth:`exception`, :meth:`critical` and :meth:`log`. These methods have the
1281same signatures as their counterparts in :class:`Logger`, so you can use the
1282two types of instances interchangeably.
Vinay Sajipaa0665b2008-01-07 19:40:10 +00001283
Vinay Sajipc7403352008-01-18 15:54:14 +00001284When you create an instance of :class:`LoggerAdapter`, you pass it a
1285:class:`Logger` instance and a dict-like object which contains your contextual
1286information. When you call one of the logging methods on an instance of
1287:class:`LoggerAdapter`, it delegates the call to the underlying instance of
1288:class:`Logger` passed to its constructor, and arranges to pass the contextual
1289information in the delegated call. Here's a snippet from the code of
1290:class:`LoggerAdapter`::
Vinay Sajipaa0665b2008-01-07 19:40:10 +00001291
Vinay Sajipc7403352008-01-18 15:54:14 +00001292 def debug(self, msg, *args, **kwargs):
1293 """
1294 Delegate a debug call to the underlying logger, after adding
1295 contextual information from this adapter instance.
1296 """
1297 msg, kwargs = self.process(msg, kwargs)
1298 self.logger.debug(msg, *args, **kwargs)
Vinay Sajipaa0665b2008-01-07 19:40:10 +00001299
Vinay Sajipc7403352008-01-18 15:54:14 +00001300The :meth:`process` method of :class:`LoggerAdapter` is where the contextual
1301information is added to the logging output. It's passed the message and
1302keyword arguments of the logging call, and it passes back (potentially)
1303modified versions of these to use in the call to the underlying logger. The
1304default implementation of this method leaves the message alone, but inserts
1305an "extra" key in the keyword argument whose value is the dict-like object
1306passed to the constructor. Of course, if you had passed an "extra" keyword
1307argument in the call to the adapter, it will be silently overwritten.
Vinay Sajipaa0665b2008-01-07 19:40:10 +00001308
Vinay Sajipc7403352008-01-18 15:54:14 +00001309The advantage of using "extra" is that the values in the dict-like object are
1310merged into the :class:`LogRecord` instance's __dict__, allowing you to use
1311customized strings with your :class:`Formatter` instances which know about
1312the keys of the dict-like object. If you need a different method, e.g. if you
1313want to prepend or append the contextual information to the message string,
1314you just need to subclass :class:`LoggerAdapter` and override :meth:`process`
1315to do what you need. Here's an example script which uses this class, which
1316also illustrates what dict-like behaviour is needed from an arbitrary
1317"dict-like" object for use in the constructor::
1318
Georg Brandlf8e6afb2008-01-19 10:11:27 +00001319 import logging
Vinay Sajip733024a2008-01-21 17:39:22 +00001320
Georg Brandlf8e6afb2008-01-19 10:11:27 +00001321 class ConnInfo:
1322 """
1323 An example class which shows how an arbitrary class can be used as
1324 the 'extra' context information repository passed to a LoggerAdapter.
1325 """
Vinay Sajip733024a2008-01-21 17:39:22 +00001326
Georg Brandlf8e6afb2008-01-19 10:11:27 +00001327 def __getitem__(self, name):
1328 """
1329 To allow this instance to look like a dict.
1330 """
1331 from random import choice
1332 if name == "ip":
1333 result = choice(["127.0.0.1", "192.168.0.1"])
1334 elif name == "user":
1335 result = choice(["jim", "fred", "sheila"])
1336 else:
1337 result = self.__dict__.get(name, "?")
1338 return result
Vinay Sajip733024a2008-01-21 17:39:22 +00001339
Georg Brandlf8e6afb2008-01-19 10:11:27 +00001340 def __iter__(self):
1341 """
1342 To allow iteration over keys, which will be merged into
1343 the LogRecord dict before formatting and output.
1344 """
1345 keys = ["ip", "user"]
1346 keys.extend(self.__dict__.keys())
1347 return keys.__iter__()
Vinay Sajip733024a2008-01-21 17:39:22 +00001348
Georg Brandlf8e6afb2008-01-19 10:11:27 +00001349 if __name__ == "__main__":
1350 from random import choice
1351 levels = (logging.DEBUG, logging.INFO, logging.WARNING, logging.ERROR, logging.CRITICAL)
1352 a1 = logging.LoggerAdapter(logging.getLogger("a.b.c"),
1353 { "ip" : "123.231.231.123", "user" : "sheila" })
1354 logging.basicConfig(level=logging.DEBUG,
1355 format="%(asctime)-15s %(name)-5s %(levelname)-8s IP: %(ip)-15s User: %(user)-8s %(message)s")
1356 a1.debug("A debug message")
1357 a1.info("An info message with %s", "some parameters")
1358 a2 = logging.LoggerAdapter(logging.getLogger("d.e.f"), ConnInfo())
1359 for x in range(10):
1360 lvl = choice(levels)
1361 lvlname = logging.getLevelName(lvl)
1362 a2.log(lvl, "A message at %s level with %d %s", lvlname, 2, "parameters")
Vinay Sajipc7403352008-01-18 15:54:14 +00001363
1364When this script is run, the output should look something like this::
1365
Georg Brandlf8e6afb2008-01-19 10:11:27 +00001366 2008-01-18 14:49:54,023 a.b.c DEBUG IP: 123.231.231.123 User: sheila A debug message
1367 2008-01-18 14:49:54,023 a.b.c INFO IP: 123.231.231.123 User: sheila An info message with some parameters
1368 2008-01-18 14:49:54,023 d.e.f CRITICAL IP: 192.168.0.1 User: jim A message at CRITICAL level with 2 parameters
1369 2008-01-18 14:49:54,033 d.e.f INFO IP: 192.168.0.1 User: jim A message at INFO level with 2 parameters
1370 2008-01-18 14:49:54,033 d.e.f WARNING IP: 192.168.0.1 User: sheila A message at WARNING level with 2 parameters
1371 2008-01-18 14:49:54,033 d.e.f ERROR IP: 127.0.0.1 User: fred A message at ERROR level with 2 parameters
1372 2008-01-18 14:49:54,033 d.e.f ERROR IP: 127.0.0.1 User: sheila A message at ERROR level with 2 parameters
1373 2008-01-18 14:49:54,033 d.e.f WARNING IP: 192.168.0.1 User: sheila A message at WARNING level with 2 parameters
1374 2008-01-18 14:49:54,033 d.e.f WARNING IP: 192.168.0.1 User: jim A message at WARNING level with 2 parameters
1375 2008-01-18 14:49:54,033 d.e.f INFO IP: 192.168.0.1 User: fred A message at INFO level with 2 parameters
1376 2008-01-18 14:49:54,033 d.e.f WARNING IP: 192.168.0.1 User: sheila A message at WARNING level with 2 parameters
1377 2008-01-18 14:49:54,033 d.e.f WARNING IP: 127.0.0.1 User: jim A message at WARNING level with 2 parameters
Vinay Sajipc7403352008-01-18 15:54:14 +00001378
1379.. versionadded:: 2.6
1380
1381The :class:`LoggerAdapter` class was not present in previous versions.
1382
Vinay Sajip3a0dc302009-08-15 23:23:12 +00001383.. _multiple-processes:
1384
1385Logging to a single file from multiple processes
1386------------------------------------------------
1387
1388Although logging is thread-safe, and logging to a single file from multiple
1389threads in a single process *is* supported, logging to a single file from
1390*multiple processes* is *not* supported, because there is no standard way to
1391serialize access to a single file across multiple processes in Python. If you
1392need to log to a single file from multiple processes, the best way of doing
1393this is to have all the processes log to a :class:`SocketHandler`, and have a
1394separate process which implements a socket server which reads from the socket
1395and logs to file. (If you prefer, you can dedicate one thread in one of the
1396existing processes to perform this function.) The following section documents
1397this approach in more detail and includes a working socket receiver which can
1398be used as a starting point for you to adapt in your own applications.
Vinay Sajipaa0665b2008-01-07 19:40:10 +00001399
Vinay Sajip1c0b24f2009-08-15 23:34:47 +00001400If you are using a recent version of Python which includes the
1401:mod:`multiprocessing` module, you can write your own handler which uses the
1402:class:`Lock` class from this module to serialize access to the file from
1403your processes. The existing :class:`FileHandler` and subclasses do not make
1404use of :mod:`multiprocessing` at present, though they may do so in the future.
Vinay Sajip5e7f6452009-08-17 13:14:37 +00001405Note that at present, the :mod:`multiprocessing` module does not provide
1406working lock functionality on all platforms (see
1407http://bugs.python.org/issue3770).
Vinay Sajip1c0b24f2009-08-15 23:34:47 +00001408
Georg Brandl8ec7f652007-08-15 14:28:01 +00001409.. _network-logging:
1410
1411Sending and receiving logging events across a network
1412-----------------------------------------------------
1413
1414Let's say you want to send logging events across a network, and handle them at
1415the receiving end. A simple way of doing this is attaching a
1416:class:`SocketHandler` instance to the root logger at the sending end::
1417
Benjamin Petersona7b55a32009-02-20 03:31:23 +00001418 import logging, logging.handlers
Georg Brandl8ec7f652007-08-15 14:28:01 +00001419
1420 rootLogger = logging.getLogger('')
1421 rootLogger.setLevel(logging.DEBUG)
1422 socketHandler = logging.handlers.SocketHandler('localhost',
1423 logging.handlers.DEFAULT_TCP_LOGGING_PORT)
1424 # don't bother with a formatter, since a socket handler sends the event as
1425 # an unformatted pickle
1426 rootLogger.addHandler(socketHandler)
1427
1428 # Now, we can log to the root logger, or any other logger. First the root...
1429 logging.info('Jackdaws love my big sphinx of quartz.')
1430
1431 # Now, define a couple of other loggers which might represent areas in your
1432 # application:
1433
1434 logger1 = logging.getLogger('myapp.area1')
1435 logger2 = logging.getLogger('myapp.area2')
1436
1437 logger1.debug('Quick zephyrs blow, vexing daft Jim.')
1438 logger1.info('How quickly daft jumping zebras vex.')
1439 logger2.warning('Jail zesty vixen who grabbed pay from quack.')
1440 logger2.error('The five boxing wizards jump quickly.')
1441
Georg Brandle152a772008-05-24 18:31:28 +00001442At the receiving end, you can set up a receiver using the :mod:`SocketServer`
Georg Brandl8ec7f652007-08-15 14:28:01 +00001443module. Here is a basic working example::
1444
1445 import cPickle
1446 import logging
1447 import logging.handlers
Georg Brandle152a772008-05-24 18:31:28 +00001448 import SocketServer
Georg Brandl8ec7f652007-08-15 14:28:01 +00001449 import struct
1450
1451
Georg Brandle152a772008-05-24 18:31:28 +00001452 class LogRecordStreamHandler(SocketServer.StreamRequestHandler):
Georg Brandl8ec7f652007-08-15 14:28:01 +00001453 """Handler for a streaming logging request.
1454
1455 This basically logs the record using whatever logging policy is
1456 configured locally.
1457 """
1458
1459 def handle(self):
1460 """
1461 Handle multiple requests - each expected to be a 4-byte length,
1462 followed by the LogRecord in pickle format. Logs the record
1463 according to whatever policy is configured locally.
1464 """
1465 while 1:
1466 chunk = self.connection.recv(4)
1467 if len(chunk) < 4:
1468 break
1469 slen = struct.unpack(">L", chunk)[0]
1470 chunk = self.connection.recv(slen)
1471 while len(chunk) < slen:
1472 chunk = chunk + self.connection.recv(slen - len(chunk))
1473 obj = self.unPickle(chunk)
1474 record = logging.makeLogRecord(obj)
1475 self.handleLogRecord(record)
1476
1477 def unPickle(self, data):
1478 return cPickle.loads(data)
1479
1480 def handleLogRecord(self, record):
1481 # if a name is specified, we use the named logger rather than the one
1482 # implied by the record.
1483 if self.server.logname is not None:
1484 name = self.server.logname
1485 else:
1486 name = record.name
1487 logger = logging.getLogger(name)
1488 # N.B. EVERY record gets logged. This is because Logger.handle
1489 # is normally called AFTER logger-level filtering. If you want
1490 # to do filtering, do it at the client end to save wasting
1491 # cycles and network bandwidth!
1492 logger.handle(record)
1493
Georg Brandle152a772008-05-24 18:31:28 +00001494 class LogRecordSocketReceiver(SocketServer.ThreadingTCPServer):
Georg Brandl8ec7f652007-08-15 14:28:01 +00001495 """simple TCP socket-based logging receiver suitable for testing.
1496 """
1497
1498 allow_reuse_address = 1
1499
1500 def __init__(self, host='localhost',
1501 port=logging.handlers.DEFAULT_TCP_LOGGING_PORT,
1502 handler=LogRecordStreamHandler):
Georg Brandle152a772008-05-24 18:31:28 +00001503 SocketServer.ThreadingTCPServer.__init__(self, (host, port), handler)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001504 self.abort = 0
1505 self.timeout = 1
1506 self.logname = None
1507
1508 def serve_until_stopped(self):
1509 import select
1510 abort = 0
1511 while not abort:
1512 rd, wr, ex = select.select([self.socket.fileno()],
1513 [], [],
1514 self.timeout)
1515 if rd:
1516 self.handle_request()
1517 abort = self.abort
1518
1519 def main():
1520 logging.basicConfig(
1521 format="%(relativeCreated)5d %(name)-15s %(levelname)-8s %(message)s")
1522 tcpserver = LogRecordSocketReceiver()
1523 print "About to start TCP server..."
1524 tcpserver.serve_until_stopped()
1525
1526 if __name__ == "__main__":
1527 main()
1528
1529First run the server, and then the client. On the client side, nothing is
1530printed on the console; on the server side, you should see something like::
1531
1532 About to start TCP server...
1533 59 root INFO Jackdaws love my big sphinx of quartz.
1534 59 myapp.area1 DEBUG Quick zephyrs blow, vexing daft Jim.
1535 69 myapp.area1 INFO How quickly daft jumping zebras vex.
1536 69 myapp.area2 WARNING Jail zesty vixen who grabbed pay from quack.
1537 69 myapp.area2 ERROR The five boxing wizards jump quickly.
1538
Vinay Sajipf778bec2009-09-22 17:23:41 +00001539Using arbitrary objects as messages
1540-----------------------------------
1541
1542In the preceding sections and examples, it has been assumed that the message
1543passed when logging the event is a string. However, this is not the only
1544possibility. You can pass an arbitrary object as a message, and its
1545:meth:`__str__` method will be called when the logging system needs to convert
1546it to a string representation. In fact, if you want to, you can avoid
1547computing a string representation altogether - for example, the
1548:class:`SocketHandler` emits an event by pickling it and sending it over the
1549wire.
1550
1551Optimization
1552------------
1553
1554Formatting of message arguments is deferred until it cannot be avoided.
1555However, computing the arguments passed to the logging method can also be
1556expensive, and you may want to avoid doing it if the logger will just throw
1557away your event. To decide what to do, you can call the :meth:`isEnabledFor`
1558method which takes a level argument and returns true if the event would be
1559created by the Logger for that level of call. You can write code like this::
1560
1561 if logger.isEnabledFor(logging.DEBUG):
1562 logger.debug("Message with %s, %s", expensive_func1(),
1563 expensive_func2())
1564
1565so that if the logger's threshold is set above ``DEBUG``, the calls to
1566:func:`expensive_func1` and :func:`expensive_func2` are never made.
1567
1568There are other optimizations which can be made for specific applications which
1569need more precise control over what logging information is collected. Here's a
1570list of things you can do to avoid processing during logging which you don't
1571need:
1572
1573+-----------------------------------------------+----------------------------------------+
1574| What you don't want to collect | How to avoid collecting it |
1575+===============================================+========================================+
1576| Information about where calls were made from. | Set ``logging._srcfile`` to ``None``. |
1577+-----------------------------------------------+----------------------------------------+
1578| Threading information. | Set ``logging.logThreads`` to ``0``. |
1579+-----------------------------------------------+----------------------------------------+
1580| Process information. | Set ``logging.logProcesses`` to ``0``. |
1581+-----------------------------------------------+----------------------------------------+
1582
1583Also note that the core logging module only includes the basic handlers. If
1584you don't import :mod:`logging.handlers` and :mod:`logging.config`, they won't
1585take up any memory.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001586
Vinay Sajip4b782332009-01-19 06:49:19 +00001587.. _handler:
1588
Georg Brandl8ec7f652007-08-15 14:28:01 +00001589Handler Objects
1590---------------
1591
1592Handlers have the following attributes and methods. Note that :class:`Handler`
1593is never instantiated directly; this class acts as a base for more useful
1594subclasses. However, the :meth:`__init__` method in subclasses needs to call
1595:meth:`Handler.__init__`.
1596
1597
1598.. method:: Handler.__init__(level=NOTSET)
1599
1600 Initializes the :class:`Handler` instance by setting its level, setting the list
1601 of filters to the empty list and creating a lock (using :meth:`createLock`) for
1602 serializing access to an I/O mechanism.
1603
1604
1605.. method:: Handler.createLock()
1606
1607 Initializes a thread lock which can be used to serialize access to underlying
1608 I/O functionality which may not be threadsafe.
1609
1610
1611.. method:: Handler.acquire()
1612
1613 Acquires the thread lock created with :meth:`createLock`.
1614
1615
1616.. method:: Handler.release()
1617
1618 Releases the thread lock acquired with :meth:`acquire`.
1619
1620
1621.. method:: Handler.setLevel(lvl)
1622
1623 Sets the threshold for this handler to *lvl*. Logging messages which are less
1624 severe than *lvl* will be ignored. When a handler is created, the level is set
1625 to :const:`NOTSET` (which causes all messages to be processed).
1626
1627
1628.. method:: Handler.setFormatter(form)
1629
1630 Sets the :class:`Formatter` for this handler to *form*.
1631
1632
1633.. method:: Handler.addFilter(filt)
1634
1635 Adds the specified filter *filt* to this handler.
1636
1637
1638.. method:: Handler.removeFilter(filt)
1639
1640 Removes the specified filter *filt* from this handler.
1641
1642
1643.. method:: Handler.filter(record)
1644
1645 Applies this handler's filters to the record and returns a true value if the
1646 record is to be processed.
1647
1648
1649.. method:: Handler.flush()
1650
1651 Ensure all logging output has been flushed. This version does nothing and is
1652 intended to be implemented by subclasses.
1653
1654
1655.. method:: Handler.close()
1656
Vinay Sajipaa5f8732008-09-01 17:44:14 +00001657 Tidy up any resources used by the handler. This version does no output but
1658 removes the handler from an internal list of handlers which is closed when
1659 :func:`shutdown` is called. Subclasses should ensure that this gets called
1660 from overridden :meth:`close` methods.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001661
1662
1663.. method:: Handler.handle(record)
1664
1665 Conditionally emits the specified logging record, depending on filters which may
1666 have been added to the handler. Wraps the actual emission of the record with
1667 acquisition/release of the I/O thread lock.
1668
1669
1670.. method:: Handler.handleError(record)
1671
1672 This method should be called from handlers when an exception is encountered
1673 during an :meth:`emit` call. By default it does nothing, which means that
1674 exceptions get silently ignored. This is what is mostly wanted for a logging
1675 system - most users will not care about errors in the logging system, they are
1676 more interested in application errors. You could, however, replace this with a
1677 custom handler if you wish. The specified record is the one which was being
1678 processed when the exception occurred.
1679
1680
1681.. method:: Handler.format(record)
1682
1683 Do formatting for a record - if a formatter is set, use it. Otherwise, use the
1684 default formatter for the module.
1685
1686
1687.. method:: Handler.emit(record)
1688
1689 Do whatever it takes to actually log the specified logging record. This version
1690 is intended to be implemented by subclasses and so raises a
1691 :exc:`NotImplementedError`.
1692
1693
Vinay Sajip4b782332009-01-19 06:49:19 +00001694.. _stream-handler:
1695
Georg Brandl8ec7f652007-08-15 14:28:01 +00001696StreamHandler
1697^^^^^^^^^^^^^
1698
1699The :class:`StreamHandler` class, located in the core :mod:`logging` package,
1700sends logging output to streams such as *sys.stdout*, *sys.stderr* or any
1701file-like object (or, more precisely, any object which supports :meth:`write`
1702and :meth:`flush` methods).
1703
1704
Vinay Sajip0c6a0e32009-12-17 14:52:00 +00001705.. currentmodule:: logging
1706
Vinay Sajip4780c9a2009-09-26 14:53:32 +00001707.. class:: StreamHandler([stream])
Georg Brandl8ec7f652007-08-15 14:28:01 +00001708
Vinay Sajip4780c9a2009-09-26 14:53:32 +00001709 Returns a new instance of the :class:`StreamHandler` class. If *stream* is
Georg Brandl8ec7f652007-08-15 14:28:01 +00001710 specified, the instance will use it for logging output; otherwise, *sys.stderr*
1711 will be used.
1712
1713
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001714 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001715
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001716 If a formatter is specified, it is used to format the record. The record
1717 is then written to the stream with a trailing newline. If exception
1718 information is present, it is formatted using
1719 :func:`traceback.print_exception` and appended to the stream.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001720
1721
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001722 .. method:: flush()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001723
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001724 Flushes the stream by calling its :meth:`flush` method. Note that the
1725 :meth:`close` method is inherited from :class:`Handler` and so does
Vinay Sajipaa5f8732008-09-01 17:44:14 +00001726 no output, so an explicit :meth:`flush` call may be needed at times.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001727
1728
Vinay Sajip4b782332009-01-19 06:49:19 +00001729.. _file-handler:
1730
Georg Brandl8ec7f652007-08-15 14:28:01 +00001731FileHandler
1732^^^^^^^^^^^
1733
1734The :class:`FileHandler` class, located in the core :mod:`logging` package,
1735sends logging output to a disk file. It inherits the output functionality from
1736:class:`StreamHandler`.
1737
1738
Vinay Sajipf38ba782008-01-24 12:38:30 +00001739.. class:: FileHandler(filename[, mode[, encoding[, delay]]])
Georg Brandl8ec7f652007-08-15 14:28:01 +00001740
1741 Returns a new instance of the :class:`FileHandler` class. The specified file is
1742 opened and used as the stream for logging. If *mode* is not specified,
1743 :const:`'a'` is used. If *encoding* is not *None*, it is used to open the file
Vinay Sajipf38ba782008-01-24 12:38:30 +00001744 with that encoding. If *delay* is true, then file opening is deferred until the
1745 first call to :meth:`emit`. By default, the file grows indefinitely.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001746
Vinay Sajip59584c42009-08-14 11:33:54 +00001747 .. versionchanged:: 2.6
1748 *delay* was added.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001749
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001750 .. method:: close()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001751
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001752 Closes the file.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001753
1754
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001755 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001756
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001757 Outputs the record to the file.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001758
Vinay Sajip4b782332009-01-19 06:49:19 +00001759.. _null-handler:
Georg Brandl8ec7f652007-08-15 14:28:01 +00001760
Vinay Sajip51104862009-01-02 18:53:04 +00001761NullHandler
1762^^^^^^^^^^^
1763
1764.. versionadded:: 2.7
1765
1766The :class:`NullHandler` class, located in the core :mod:`logging` package,
1767does not do any formatting or output. It is essentially a "no-op" handler
1768for use by library developers.
1769
1770
1771.. class:: NullHandler()
1772
1773 Returns a new instance of the :class:`NullHandler` class.
1774
1775
1776 .. method:: emit(record)
1777
1778 This method does nothing.
1779
Vinay Sajip99505c82009-01-10 13:38:04 +00001780See :ref:`library-config` for more information on how to use
1781:class:`NullHandler`.
1782
Vinay Sajip4b782332009-01-19 06:49:19 +00001783.. _watched-file-handler:
1784
Georg Brandl8ec7f652007-08-15 14:28:01 +00001785WatchedFileHandler
1786^^^^^^^^^^^^^^^^^^
1787
1788.. versionadded:: 2.6
1789
Vinay Sajipb1a15e42009-01-15 23:04:47 +00001790.. currentmodule:: logging.handlers
Vinay Sajip51104862009-01-02 18:53:04 +00001791
Georg Brandl8ec7f652007-08-15 14:28:01 +00001792The :class:`WatchedFileHandler` class, located in the :mod:`logging.handlers`
1793module, is a :class:`FileHandler` which watches the file it is logging to. If
1794the file changes, it is closed and reopened using the file name.
1795
1796A file change can happen because of usage of programs such as *newsyslog* and
1797*logrotate* which perform log file rotation. This handler, intended for use
1798under Unix/Linux, watches the file to see if it has changed since the last emit.
1799(A file is deemed to have changed if its device or inode have changed.) If the
1800file has changed, the old file stream is closed, and the file opened to get a
1801new stream.
1802
1803This handler is not appropriate for use under Windows, because under Windows
1804open log files cannot be moved or renamed - logging opens the files with
1805exclusive locks - and so there is no need for such a handler. Furthermore,
1806*ST_INO* is not supported under Windows; :func:`stat` always returns zero for
1807this value.
1808
1809
Vinay Sajipf38ba782008-01-24 12:38:30 +00001810.. class:: WatchedFileHandler(filename[,mode[, encoding[, delay]]])
Georg Brandl8ec7f652007-08-15 14:28:01 +00001811
1812 Returns a new instance of the :class:`WatchedFileHandler` class. The specified
1813 file is opened and used as the stream for logging. If *mode* is not specified,
1814 :const:`'a'` is used. If *encoding* is not *None*, it is used to open the file
Vinay Sajipf38ba782008-01-24 12:38:30 +00001815 with that encoding. If *delay* is true, then file opening is deferred until the
1816 first call to :meth:`emit`. By default, the file grows indefinitely.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001817
Vinay Sajip59584c42009-08-14 11:33:54 +00001818 .. versionchanged:: 2.6
1819 *delay* was added.
1820
Georg Brandl8ec7f652007-08-15 14:28:01 +00001821
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001822 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001823
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001824 Outputs the record to the file, but first checks to see if the file has
1825 changed. If it has, the existing stream is flushed and closed and the
1826 file opened again, before outputting the record to the file.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001827
Vinay Sajip4b782332009-01-19 06:49:19 +00001828.. _rotating-file-handler:
Georg Brandl8ec7f652007-08-15 14:28:01 +00001829
1830RotatingFileHandler
1831^^^^^^^^^^^^^^^^^^^
1832
1833The :class:`RotatingFileHandler` class, located in the :mod:`logging.handlers`
1834module, supports rotation of disk log files.
1835
1836
Vinay Sajipf38ba782008-01-24 12:38:30 +00001837.. class:: RotatingFileHandler(filename[, mode[, maxBytes[, backupCount[, encoding[, delay]]]]])
Georg Brandl8ec7f652007-08-15 14:28:01 +00001838
1839 Returns a new instance of the :class:`RotatingFileHandler` class. The specified
1840 file is opened and used as the stream for logging. If *mode* is not specified,
Vinay Sajipf38ba782008-01-24 12:38:30 +00001841 ``'a'`` is used. If *encoding* is not *None*, it is used to open the file
1842 with that encoding. If *delay* is true, then file opening is deferred until the
1843 first call to :meth:`emit`. By default, the file grows indefinitely.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001844
1845 You can use the *maxBytes* and *backupCount* values to allow the file to
1846 :dfn:`rollover` at a predetermined size. When the size is about to be exceeded,
1847 the file is closed and a new file is silently opened for output. Rollover occurs
1848 whenever the current log file is nearly *maxBytes* in length; if *maxBytes* is
1849 zero, rollover never occurs. If *backupCount* is non-zero, the system will save
1850 old log files by appending the extensions ".1", ".2" etc., to the filename. For
1851 example, with a *backupCount* of 5 and a base file name of :file:`app.log`, you
1852 would get :file:`app.log`, :file:`app.log.1`, :file:`app.log.2`, up to
1853 :file:`app.log.5`. The file being written to is always :file:`app.log`. When
1854 this file is filled, it is closed and renamed to :file:`app.log.1`, and if files
1855 :file:`app.log.1`, :file:`app.log.2`, etc. exist, then they are renamed to
1856 :file:`app.log.2`, :file:`app.log.3` etc. respectively.
1857
Vinay Sajip59584c42009-08-14 11:33:54 +00001858 .. versionchanged:: 2.6
1859 *delay* was added.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001860
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001861 .. method:: doRollover()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001862
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001863 Does a rollover, as described above.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001864
1865
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001866 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001867
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001868 Outputs the record to the file, catering for rollover as described
1869 previously.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001870
Vinay Sajip4b782332009-01-19 06:49:19 +00001871.. _timed-rotating-file-handler:
Georg Brandl8ec7f652007-08-15 14:28:01 +00001872
1873TimedRotatingFileHandler
1874^^^^^^^^^^^^^^^^^^^^^^^^
1875
1876The :class:`TimedRotatingFileHandler` class, located in the
1877:mod:`logging.handlers` module, supports rotation of disk log files at certain
1878timed intervals.
1879
1880
Andrew M. Kuchling6dd8cca2008-06-05 23:33:54 +00001881.. class:: TimedRotatingFileHandler(filename [,when [,interval [,backupCount[, encoding[, delay[, utc]]]]]])
Georg Brandl8ec7f652007-08-15 14:28:01 +00001882
1883 Returns a new instance of the :class:`TimedRotatingFileHandler` class. The
1884 specified file is opened and used as the stream for logging. On rotating it also
1885 sets the filename suffix. Rotating happens based on the product of *when* and
1886 *interval*.
1887
1888 You can use the *when* to specify the type of *interval*. The list of possible
Georg Brandld77554f2008-06-06 07:34:50 +00001889 values is below. Note that they are not case sensitive.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001890
Georg Brandl72780a42008-03-02 13:41:39 +00001891 +----------------+-----------------------+
1892 | Value | Type of interval |
1893 +================+=======================+
1894 | ``'S'`` | Seconds |
1895 +----------------+-----------------------+
1896 | ``'M'`` | Minutes |
1897 +----------------+-----------------------+
1898 | ``'H'`` | Hours |
1899 +----------------+-----------------------+
1900 | ``'D'`` | Days |
1901 +----------------+-----------------------+
1902 | ``'W'`` | Week day (0=Monday) |
1903 +----------------+-----------------------+
1904 | ``'midnight'`` | Roll over at midnight |
1905 +----------------+-----------------------+
Georg Brandl8ec7f652007-08-15 14:28:01 +00001906
Georg Brandle6dab2a2008-03-02 14:15:04 +00001907 The system will save old log files by appending extensions to the filename.
1908 The extensions are date-and-time based, using the strftime format
Vinay Sajip89a01cd2008-04-02 21:17:25 +00001909 ``%Y-%m-%d_%H-%M-%S`` or a leading portion thereof, depending on the
Vinay Sajip2a649f92008-07-18 09:00:35 +00001910 rollover interval.
Vinay Sajipecfa08f2010-03-12 09:16:10 +00001911
1912 When computing the next rollover time for the first time (when the handler
1913 is created), the last modification time of an existing log file, or else
1914 the current time, is used to compute when the next rotation will occur.
1915
Georg Brandld77554f2008-06-06 07:34:50 +00001916 If the *utc* argument is true, times in UTC will be used; otherwise
Andrew M. Kuchling6dd8cca2008-06-05 23:33:54 +00001917 local time is used.
1918
1919 If *backupCount* is nonzero, at most *backupCount* files
Vinay Sajip89a01cd2008-04-02 21:17:25 +00001920 will be kept, and if more would be created when rollover occurs, the oldest
1921 one is deleted. The deletion logic uses the interval to determine which
1922 files to delete, so changing the interval may leave old files lying around.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001923
Vinay Sajip59584c42009-08-14 11:33:54 +00001924 If *delay* is true, then file opening is deferred until the first call to
1925 :meth:`emit`.
1926
1927 .. versionchanged:: 2.6
1928 *delay* was added.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001929
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001930 .. method:: doRollover()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001931
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001932 Does a rollover, as described above.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001933
1934
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001935 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001936
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001937 Outputs the record to the file, catering for rollover as described above.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001938
1939
Vinay Sajip4b782332009-01-19 06:49:19 +00001940.. _socket-handler:
1941
Georg Brandl8ec7f652007-08-15 14:28:01 +00001942SocketHandler
1943^^^^^^^^^^^^^
1944
1945The :class:`SocketHandler` class, located in the :mod:`logging.handlers` module,
1946sends logging output to a network socket. The base class uses a TCP socket.
1947
1948
1949.. class:: SocketHandler(host, port)
1950
1951 Returns a new instance of the :class:`SocketHandler` class intended to
1952 communicate with a remote machine whose address is given by *host* and *port*.
1953
1954
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001955 .. method:: close()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001956
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001957 Closes the socket.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001958
1959
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001960 .. method:: emit()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001961
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001962 Pickles the record's attribute dictionary and writes it to the socket in
1963 binary format. If there is an error with the socket, silently drops the
1964 packet. If the connection was previously lost, re-establishes the
1965 connection. To unpickle the record at the receiving end into a
1966 :class:`LogRecord`, use the :func:`makeLogRecord` function.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001967
1968
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001969 .. method:: handleError()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001970
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001971 Handles an error which has occurred during :meth:`emit`. The most likely
1972 cause is a lost connection. Closes the socket so that we can retry on the
1973 next event.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001974
1975
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001976 .. method:: makeSocket()
Georg Brandl8ec7f652007-08-15 14:28:01 +00001977
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001978 This is a factory method which allows subclasses to define the precise
1979 type of socket they want. The default implementation creates a TCP socket
1980 (:const:`socket.SOCK_STREAM`).
Georg Brandl8ec7f652007-08-15 14:28:01 +00001981
1982
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001983 .. method:: makePickle(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001984
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001985 Pickles the record's attribute dictionary in binary format with a length
1986 prefix, and returns it ready for transmission across the socket.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001987
1988
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001989 .. method:: send(packet)
Georg Brandl8ec7f652007-08-15 14:28:01 +00001990
Benjamin Petersonc7b05922008-04-25 01:29:10 +00001991 Send a pickled string *packet* to the socket. This function allows for
1992 partial sends which can happen when the network is busy.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001993
1994
Vinay Sajip4b782332009-01-19 06:49:19 +00001995.. _datagram-handler:
1996
Georg Brandl8ec7f652007-08-15 14:28:01 +00001997DatagramHandler
1998^^^^^^^^^^^^^^^
1999
2000The :class:`DatagramHandler` class, located in the :mod:`logging.handlers`
2001module, inherits from :class:`SocketHandler` to support sending logging messages
2002over UDP sockets.
2003
2004
2005.. class:: DatagramHandler(host, port)
2006
2007 Returns a new instance of the :class:`DatagramHandler` class intended to
2008 communicate with a remote machine whose address is given by *host* and *port*.
2009
2010
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002011 .. method:: emit()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002012
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002013 Pickles the record's attribute dictionary and writes it to the socket in
2014 binary format. If there is an error with the socket, silently drops the
2015 packet. To unpickle the record at the receiving end into a
2016 :class:`LogRecord`, use the :func:`makeLogRecord` function.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002017
2018
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002019 .. method:: makeSocket()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002020
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002021 The factory method of :class:`SocketHandler` is here overridden to create
2022 a UDP socket (:const:`socket.SOCK_DGRAM`).
Georg Brandl8ec7f652007-08-15 14:28:01 +00002023
2024
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002025 .. method:: send(s)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002026
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002027 Send a pickled string to a socket.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002028
2029
Vinay Sajip4b782332009-01-19 06:49:19 +00002030.. _syslog-handler:
2031
Georg Brandl8ec7f652007-08-15 14:28:01 +00002032SysLogHandler
2033^^^^^^^^^^^^^
2034
2035The :class:`SysLogHandler` class, located in the :mod:`logging.handlers` module,
2036supports sending logging messages to a remote or local Unix syslog.
2037
2038
Vinay Sajip1c77b7f2009-10-10 20:32:36 +00002039.. class:: SysLogHandler([address[, facility[, socktype]]])
Georg Brandl8ec7f652007-08-15 14:28:01 +00002040
2041 Returns a new instance of the :class:`SysLogHandler` class intended to
2042 communicate with a remote Unix machine whose address is given by *address* in
2043 the form of a ``(host, port)`` tuple. If *address* is not specified,
Vinay Sajip1c77b7f2009-10-10 20:32:36 +00002044 ``('localhost', 514)`` is used. The address is used to open a socket. An
Georg Brandl8ec7f652007-08-15 14:28:01 +00002045 alternative to providing a ``(host, port)`` tuple is providing an address as a
2046 string, for example "/dev/log". In this case, a Unix domain socket is used to
2047 send the message to the syslog. If *facility* is not specified,
Vinay Sajip1c77b7f2009-10-10 20:32:36 +00002048 :const:`LOG_USER` is used. The type of socket opened depends on the
2049 *socktype* argument, which defaults to :const:`socket.SOCK_DGRAM` and thus
2050 opens a UDP socket. To open a TCP socket (for use with the newer syslog
2051 daemons such as rsyslog), specify a value of :const:`socket.SOCK_STREAM`.
2052
2053 .. versionchanged:: 2.7
2054 *socktype* was added.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002055
2056
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002057 .. method:: close()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002058
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002059 Closes the socket to the remote host.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002060
2061
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002062 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002063
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002064 The record is formatted, and then sent to the syslog server. If exception
2065 information is present, it is *not* sent to the server.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002066
2067
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002068 .. method:: encodePriority(facility, priority)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002069
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002070 Encodes the facility and priority into an integer. You can pass in strings
2071 or integers - if strings are passed, internal mapping dictionaries are
2072 used to convert them to integers.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002073
2074
Vinay Sajip4b782332009-01-19 06:49:19 +00002075.. _nt-eventlog-handler:
2076
Georg Brandl8ec7f652007-08-15 14:28:01 +00002077NTEventLogHandler
2078^^^^^^^^^^^^^^^^^
2079
2080The :class:`NTEventLogHandler` class, located in the :mod:`logging.handlers`
2081module, supports sending logging messages to a local Windows NT, Windows 2000 or
2082Windows XP event log. Before you can use it, you need Mark Hammond's Win32
2083extensions for Python installed.
2084
2085
2086.. class:: NTEventLogHandler(appname[, dllname[, logtype]])
2087
2088 Returns a new instance of the :class:`NTEventLogHandler` class. The *appname* is
2089 used to define the application name as it appears in the event log. An
2090 appropriate registry entry is created using this name. The *dllname* should give
2091 the fully qualified pathname of a .dll or .exe which contains message
2092 definitions to hold in the log (if not specified, ``'win32service.pyd'`` is used
2093 - this is installed with the Win32 extensions and contains some basic
2094 placeholder message definitions. Note that use of these placeholders will make
2095 your event logs big, as the entire message source is held in the log. If you
2096 want slimmer logs, you have to pass in the name of your own .dll or .exe which
2097 contains the message definitions you want to use in the event log). The
2098 *logtype* is one of ``'Application'``, ``'System'`` or ``'Security'``, and
2099 defaults to ``'Application'``.
2100
2101
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002102 .. method:: close()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002103
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002104 At this point, you can remove the application name from the registry as a
2105 source of event log entries. However, if you do this, you will not be able
2106 to see the events as you intended in the Event Log Viewer - it needs to be
2107 able to access the registry to get the .dll name. The current version does
Vinay Sajipaa5f8732008-09-01 17:44:14 +00002108 not do this.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002109
2110
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002111 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002112
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002113 Determines the message ID, event category and event type, and then logs
2114 the message in the NT event log.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002115
2116
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002117 .. method:: getEventCategory(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002118
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002119 Returns the event category for the record. Override this if you want to
2120 specify your own categories. This version returns 0.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002121
2122
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002123 .. method:: getEventType(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002124
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002125 Returns the event type for the record. Override this if you want to
2126 specify your own types. This version does a mapping using the handler's
2127 typemap attribute, which is set up in :meth:`__init__` to a dictionary
2128 which contains mappings for :const:`DEBUG`, :const:`INFO`,
2129 :const:`WARNING`, :const:`ERROR` and :const:`CRITICAL`. If you are using
2130 your own levels, you will either need to override this method or place a
2131 suitable dictionary in the handler's *typemap* attribute.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002132
2133
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002134 .. method:: getMessageID(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002135
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002136 Returns the message ID for the record. If you are using your own messages,
2137 you could do this by having the *msg* passed to the logger being an ID
2138 rather than a format string. Then, in here, you could use a dictionary
2139 lookup to get the message ID. This version returns 1, which is the base
2140 message ID in :file:`win32service.pyd`.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002141
Vinay Sajip4b782332009-01-19 06:49:19 +00002142.. _smtp-handler:
Georg Brandl8ec7f652007-08-15 14:28:01 +00002143
2144SMTPHandler
2145^^^^^^^^^^^
2146
2147The :class:`SMTPHandler` class, located in the :mod:`logging.handlers` module,
2148supports sending logging messages to an email address via SMTP.
2149
2150
2151.. class:: SMTPHandler(mailhost, fromaddr, toaddrs, subject[, credentials])
2152
2153 Returns a new instance of the :class:`SMTPHandler` class. The instance is
2154 initialized with the from and to addresses and subject line of the email. The
2155 *toaddrs* should be a list of strings. To specify a non-standard SMTP port, use
2156 the (host, port) tuple format for the *mailhost* argument. If you use a string,
2157 the standard SMTP port is used. If your SMTP server requires authentication, you
2158 can specify a (username, password) tuple for the *credentials* argument.
2159
2160 .. versionchanged:: 2.6
2161 *credentials* was added.
2162
2163
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002164 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002165
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002166 Formats the record and sends it to the specified addressees.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002167
2168
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002169 .. method:: getSubject(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002170
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002171 If you want to specify a subject line which is record-dependent, override
2172 this method.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002173
Vinay Sajip4b782332009-01-19 06:49:19 +00002174.. _memory-handler:
Georg Brandl8ec7f652007-08-15 14:28:01 +00002175
2176MemoryHandler
2177^^^^^^^^^^^^^
2178
2179The :class:`MemoryHandler` class, located in the :mod:`logging.handlers` module,
2180supports buffering of logging records in memory, periodically flushing them to a
2181:dfn:`target` handler. Flushing occurs whenever the buffer is full, or when an
2182event of a certain severity or greater is seen.
2183
2184:class:`MemoryHandler` is a subclass of the more general
2185:class:`BufferingHandler`, which is an abstract class. This buffers logging
2186records in memory. Whenever each record is added to the buffer, a check is made
2187by calling :meth:`shouldFlush` to see if the buffer should be flushed. If it
2188should, then :meth:`flush` is expected to do the needful.
2189
2190
2191.. class:: BufferingHandler(capacity)
2192
2193 Initializes the handler with a buffer of the specified capacity.
2194
2195
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002196 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002197
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002198 Appends the record to the buffer. If :meth:`shouldFlush` returns true,
2199 calls :meth:`flush` to process the buffer.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002200
2201
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002202 .. method:: flush()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002203
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002204 You can override this to implement custom flushing behavior. This version
2205 just zaps the buffer to empty.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002206
2207
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002208 .. method:: shouldFlush(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002209
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002210 Returns true if the buffer is up to capacity. This method can be
2211 overridden to implement custom flushing strategies.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002212
2213
2214.. class:: MemoryHandler(capacity[, flushLevel [, target]])
2215
2216 Returns a new instance of the :class:`MemoryHandler` class. The instance is
2217 initialized with a buffer size of *capacity*. If *flushLevel* is not specified,
2218 :const:`ERROR` is used. If no *target* is specified, the target will need to be
2219 set using :meth:`setTarget` before this handler does anything useful.
2220
2221
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002222 .. method:: close()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002223
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002224 Calls :meth:`flush`, sets the target to :const:`None` and clears the
2225 buffer.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002226
2227
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002228 .. method:: flush()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002229
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002230 For a :class:`MemoryHandler`, flushing means just sending the buffered
2231 records to the target, if there is one. Override if you want different
2232 behavior.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002233
2234
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002235 .. method:: setTarget(target)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002236
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002237 Sets the target handler for this handler.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002238
2239
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002240 .. method:: shouldFlush(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002241
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002242 Checks for buffer full or a record at the *flushLevel* or higher.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002243
2244
Vinay Sajip4b782332009-01-19 06:49:19 +00002245.. _http-handler:
2246
Georg Brandl8ec7f652007-08-15 14:28:01 +00002247HTTPHandler
2248^^^^^^^^^^^
2249
2250The :class:`HTTPHandler` class, located in the :mod:`logging.handlers` module,
2251supports sending logging messages to a Web server, using either ``GET`` or
2252``POST`` semantics.
2253
2254
2255.. class:: HTTPHandler(host, url[, method])
2256
2257 Returns a new instance of the :class:`HTTPHandler` class. The instance is
2258 initialized with a host address, url and HTTP method. The *host* can be of the
2259 form ``host:port``, should you need to use a specific port number. If no
2260 *method* is specified, ``GET`` is used.
2261
2262
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002263 .. method:: emit(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002264
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002265 Sends the record to the Web server as an URL-encoded dictionary.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002266
2267
Vinay Sajip4b782332009-01-19 06:49:19 +00002268.. _formatter:
Georg Brandlc37f2882007-12-04 17:46:27 +00002269
Georg Brandl8ec7f652007-08-15 14:28:01 +00002270Formatter Objects
2271-----------------
2272
Georg Brandl430effb2009-01-01 13:05:13 +00002273.. currentmodule:: logging
2274
Georg Brandl8ec7f652007-08-15 14:28:01 +00002275:class:`Formatter`\ s have the following attributes and methods. They are
2276responsible for converting a :class:`LogRecord` to (usually) a string which can
2277be interpreted by either a human or an external system. The base
2278:class:`Formatter` allows a formatting string to be specified. If none is
2279supplied, the default value of ``'%(message)s'`` is used.
2280
2281A Formatter can be initialized with a format string which makes use of knowledge
2282of the :class:`LogRecord` attributes - such as the default value mentioned above
2283making use of the fact that the user's message and arguments are pre-formatted
2284into a :class:`LogRecord`'s *message* attribute. This format string contains
Ezio Melotti062d2b52009-12-19 22:41:49 +00002285standard Python %-style mapping keys. See section :ref:`string-formatting`
Georg Brandl8ec7f652007-08-15 14:28:01 +00002286for more information on string formatting.
2287
2288Currently, the useful mapping keys in a :class:`LogRecord` are:
2289
2290+-------------------------+-----------------------------------------------+
2291| Format | Description |
2292+=========================+===============================================+
2293| ``%(name)s`` | Name of the logger (logging channel). |
2294+-------------------------+-----------------------------------------------+
2295| ``%(levelno)s`` | Numeric logging level for the message |
2296| | (:const:`DEBUG`, :const:`INFO`, |
2297| | :const:`WARNING`, :const:`ERROR`, |
2298| | :const:`CRITICAL`). |
2299+-------------------------+-----------------------------------------------+
2300| ``%(levelname)s`` | Text logging level for the message |
2301| | (``'DEBUG'``, ``'INFO'``, ``'WARNING'``, |
2302| | ``'ERROR'``, ``'CRITICAL'``). |
2303+-------------------------+-----------------------------------------------+
2304| ``%(pathname)s`` | Full pathname of the source file where the |
2305| | logging call was issued (if available). |
2306+-------------------------+-----------------------------------------------+
2307| ``%(filename)s`` | Filename portion of pathname. |
2308+-------------------------+-----------------------------------------------+
2309| ``%(module)s`` | Module (name portion of filename). |
2310+-------------------------+-----------------------------------------------+
2311| ``%(funcName)s`` | Name of function containing the logging call. |
2312+-------------------------+-----------------------------------------------+
2313| ``%(lineno)d`` | Source line number where the logging call was |
2314| | issued (if available). |
2315+-------------------------+-----------------------------------------------+
2316| ``%(created)f`` | Time when the :class:`LogRecord` was created |
2317| | (as returned by :func:`time.time`). |
2318+-------------------------+-----------------------------------------------+
2319| ``%(relativeCreated)d`` | Time in milliseconds when the LogRecord was |
2320| | created, relative to the time the logging |
2321| | module was loaded. |
2322+-------------------------+-----------------------------------------------+
2323| ``%(asctime)s`` | Human-readable time when the |
2324| | :class:`LogRecord` was created. By default |
2325| | this is of the form "2003-07-08 16:49:45,896" |
2326| | (the numbers after the comma are millisecond |
2327| | portion of the time). |
2328+-------------------------+-----------------------------------------------+
2329| ``%(msecs)d`` | Millisecond portion of the time when the |
2330| | :class:`LogRecord` was created. |
2331+-------------------------+-----------------------------------------------+
2332| ``%(thread)d`` | Thread ID (if available). |
2333+-------------------------+-----------------------------------------------+
2334| ``%(threadName)s`` | Thread name (if available). |
2335+-------------------------+-----------------------------------------------+
2336| ``%(process)d`` | Process ID (if available). |
2337+-------------------------+-----------------------------------------------+
2338| ``%(message)s`` | The logged message, computed as ``msg % |
2339| | args``. |
2340+-------------------------+-----------------------------------------------+
2341
2342.. versionchanged:: 2.5
2343 *funcName* was added.
2344
2345
2346.. class:: Formatter([fmt[, datefmt]])
2347
2348 Returns a new instance of the :class:`Formatter` class. The instance is
2349 initialized with a format string for the message as a whole, as well as a format
2350 string for the date/time portion of a message. If no *fmt* is specified,
2351 ``'%(message)s'`` is used. If no *datefmt* is specified, the ISO8601 date format
2352 is used.
2353
2354
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002355 .. method:: format(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002356
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002357 The record's attribute dictionary is used as the operand to a string
2358 formatting operation. Returns the resulting string. Before formatting the
2359 dictionary, a couple of preparatory steps are carried out. The *message*
2360 attribute of the record is computed using *msg* % *args*. If the
2361 formatting string contains ``'(asctime)'``, :meth:`formatTime` is called
2362 to format the event time. If there is exception information, it is
2363 formatted using :meth:`formatException` and appended to the message. Note
2364 that the formatted exception information is cached in attribute
2365 *exc_text*. This is useful because the exception information can be
2366 pickled and sent across the wire, but you should be careful if you have
2367 more than one :class:`Formatter` subclass which customizes the formatting
2368 of exception information. In this case, you will have to clear the cached
2369 value after a formatter has done its formatting, so that the next
2370 formatter to handle the event doesn't use the cached value but
2371 recalculates it afresh.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002372
2373
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002374 .. method:: formatTime(record[, datefmt])
Georg Brandl8ec7f652007-08-15 14:28:01 +00002375
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002376 This method should be called from :meth:`format` by a formatter which
2377 wants to make use of a formatted time. This method can be overridden in
2378 formatters to provide for any specific requirement, but the basic behavior
2379 is as follows: if *datefmt* (a string) is specified, it is used with
2380 :func:`time.strftime` to format the creation time of the
2381 record. Otherwise, the ISO8601 format is used. The resulting string is
2382 returned.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002383
2384
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002385 .. method:: formatException(exc_info)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002386
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002387 Formats the specified exception information (a standard exception tuple as
2388 returned by :func:`sys.exc_info`) as a string. This default implementation
2389 just uses :func:`traceback.print_exception`. The resulting string is
2390 returned.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002391
Vinay Sajip4b782332009-01-19 06:49:19 +00002392.. _filter:
Georg Brandl8ec7f652007-08-15 14:28:01 +00002393
2394Filter Objects
2395--------------
2396
Vinay Sajip4b782332009-01-19 06:49:19 +00002397Filters can be used by :class:`Handler`\ s and :class:`Logger`\ s for
Georg Brandl8ec7f652007-08-15 14:28:01 +00002398more sophisticated filtering than is provided by levels. The base filter class
2399only allows events which are below a certain point in the logger hierarchy. For
2400example, a filter initialized with "A.B" will allow events logged by loggers
2401"A.B", "A.B.C", "A.B.C.D", "A.B.D" etc. but not "A.BB", "B.A.B" etc. If
2402initialized with the empty string, all events are passed.
2403
2404
2405.. class:: Filter([name])
2406
2407 Returns an instance of the :class:`Filter` class. If *name* is specified, it
2408 names a logger which, together with its children, will have its events allowed
2409 through the filter. If no name is specified, allows every event.
2410
2411
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002412 .. method:: filter(record)
Georg Brandl8ec7f652007-08-15 14:28:01 +00002413
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002414 Is the specified record to be logged? Returns zero for no, nonzero for
2415 yes. If deemed appropriate, the record may be modified in-place by this
2416 method.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002417
Vinay Sajip4b782332009-01-19 06:49:19 +00002418.. _log-record:
Georg Brandl8ec7f652007-08-15 14:28:01 +00002419
2420LogRecord Objects
2421-----------------
2422
2423:class:`LogRecord` instances are created every time something is logged. They
2424contain all the information pertinent to the event being logged. The main
2425information passed in is in msg and args, which are combined using msg % args to
2426create the message field of the record. The record also includes information
2427such as when the record was created, the source line where the logging call was
2428made, and any exception information to be logged.
2429
2430
2431.. class:: LogRecord(name, lvl, pathname, lineno, msg, args, exc_info [, func])
2432
2433 Returns an instance of :class:`LogRecord` initialized with interesting
2434 information. The *name* is the logger name; *lvl* is the numeric level;
2435 *pathname* is the absolute pathname of the source file in which the logging
2436 call was made; *lineno* is the line number in that file where the logging
2437 call is found; *msg* is the user-supplied message (a format string); *args*
2438 is the tuple which, together with *msg*, makes up the user message; and
2439 *exc_info* is the exception tuple obtained by calling :func:`sys.exc_info`
2440 (or :const:`None`, if no exception information is available). The *func* is
2441 the name of the function from which the logging call was made. If not
2442 specified, it defaults to ``None``.
2443
2444 .. versionchanged:: 2.5
2445 *func* was added.
2446
2447
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002448 .. method:: getMessage()
Georg Brandl8ec7f652007-08-15 14:28:01 +00002449
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002450 Returns the message for this :class:`LogRecord` instance after merging any
2451 user-supplied arguments with the message.
2452
Vinay Sajip4b782332009-01-19 06:49:19 +00002453.. _logger-adapter:
Georg Brandl8ec7f652007-08-15 14:28:01 +00002454
Vinay Sajipc7403352008-01-18 15:54:14 +00002455LoggerAdapter Objects
2456---------------------
2457
2458.. versionadded:: 2.6
2459
2460:class:`LoggerAdapter` instances are used to conveniently pass contextual
Vinay Sajip733024a2008-01-21 17:39:22 +00002461information into logging calls. For a usage example , see the section on
2462`adding contextual information to your logging output`__.
2463
2464__ context-info_
Vinay Sajipc7403352008-01-18 15:54:14 +00002465
2466.. class:: LoggerAdapter(logger, extra)
2467
2468 Returns an instance of :class:`LoggerAdapter` initialized with an
2469 underlying :class:`Logger` instance and a dict-like object.
2470
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002471 .. method:: process(msg, kwargs)
Vinay Sajipc7403352008-01-18 15:54:14 +00002472
Benjamin Petersonc7b05922008-04-25 01:29:10 +00002473 Modifies the message and/or keyword arguments passed to a logging call in
2474 order to insert contextual information. This implementation takes the object
2475 passed as *extra* to the constructor and adds it to *kwargs* using key
2476 'extra'. The return value is a (*msg*, *kwargs*) tuple which has the
2477 (possibly modified) versions of the arguments passed in.
Vinay Sajipc7403352008-01-18 15:54:14 +00002478
2479In addition to the above, :class:`LoggerAdapter` supports all the logging
2480methods of :class:`Logger`, i.e. :meth:`debug`, :meth:`info`, :meth:`warning`,
2481:meth:`error`, :meth:`exception`, :meth:`critical` and :meth:`log`. These
2482methods have the same signatures as their counterparts in :class:`Logger`, so
2483you can use the two types of instances interchangeably.
2484
Vinay Sajip804899b2010-03-22 15:29:01 +00002485.. versionchanged:: 2.7
2486
2487The :meth:`isEnabledFor` method was added to :class:`LoggerAdapter`. This method
2488delegates to the underlying logger.
2489
Georg Brandl8ec7f652007-08-15 14:28:01 +00002490
2491Thread Safety
2492-------------
2493
2494The logging module is intended to be thread-safe without any special work
2495needing to be done by its clients. It achieves this though using threading
2496locks; there is one lock to serialize access to the module's shared data, and
2497each handler also creates a lock to serialize access to its underlying I/O.
2498
Vinay Sajip353a85f2009-04-03 21:58:16 +00002499If you are implementing asynchronous signal handlers using the :mod:`signal`
2500module, you may not be able to use logging from within such handlers. This is
2501because lock implementations in the :mod:`threading` module are not always
2502re-entrant, and so cannot be invoked from such signal handlers.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002503
Vinay Sajip61afd262010-02-19 23:53:17 +00002504
2505Integration with the warnings module
2506------------------------------------
2507
2508The :func:`captureWarnings` function can be used to integrate :mod:`logging`
2509with the :mod:`warnings` module.
2510
2511.. function:: captureWarnings(capture)
2512
2513 This function is used to turn the capture of warnings by logging on and
2514 off.
2515
Georg Brandlf6d367452010-03-12 10:02:03 +00002516 If *capture* is ``True``, warnings issued by the :mod:`warnings` module
Vinay Sajip61afd262010-02-19 23:53:17 +00002517 will be redirected to the logging system. Specifically, a warning will be
2518 formatted using :func:`warnings.formatwarning` and the resulting string
Georg Brandlf6d367452010-03-12 10:02:03 +00002519 logged to a logger named "py.warnings" with a severity of ``WARNING``.
Vinay Sajip61afd262010-02-19 23:53:17 +00002520
Georg Brandlf6d367452010-03-12 10:02:03 +00002521 If *capture* is ``False``, the redirection of warnings to the logging system
Vinay Sajip61afd262010-02-19 23:53:17 +00002522 will stop, and warnings will be redirected to their original destinations
Georg Brandlf6d367452010-03-12 10:02:03 +00002523 (i.e. those in effect before ``captureWarnings(True)`` was called).
Vinay Sajip61afd262010-02-19 23:53:17 +00002524
2525
Georg Brandl8ec7f652007-08-15 14:28:01 +00002526Configuration
2527-------------
2528
2529
2530.. _logging-config-api:
2531
2532Configuration functions
2533^^^^^^^^^^^^^^^^^^^^^^^
2534
Georg Brandl8ec7f652007-08-15 14:28:01 +00002535The following functions configure the logging module. They are located in the
2536:mod:`logging.config` module. Their use is optional --- you can configure the
2537logging module using these functions or by making calls to the main API (defined
2538in :mod:`logging` itself) and defining handlers which are declared either in
2539:mod:`logging` or :mod:`logging.handlers`.
2540
2541
2542.. function:: fileConfig(fname[, defaults])
2543
Vinay Sajip51104862009-01-02 18:53:04 +00002544 Reads the logging configuration from a :mod:`ConfigParser`\-format file named
2545 *fname*. This function can be called several times from an application,
2546 allowing an end user the ability to select from various pre-canned
2547 configurations (if the developer provides a mechanism to present the choices
2548 and load the chosen configuration). Defaults to be passed to the ConfigParser
2549 can be specified in the *defaults* argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002550
2551
2552.. function:: listen([port])
2553
2554 Starts up a socket server on the specified port, and listens for new
2555 configurations. If no port is specified, the module's default
2556 :const:`DEFAULT_LOGGING_CONFIG_PORT` is used. Logging configurations will be
2557 sent as a file suitable for processing by :func:`fileConfig`. Returns a
2558 :class:`Thread` instance on which you can call :meth:`start` to start the
2559 server, and which you can :meth:`join` when appropriate. To stop the server,
Georg Brandlc37f2882007-12-04 17:46:27 +00002560 call :func:`stopListening`.
2561
2562 To send a configuration to the socket, read in the configuration file and
2563 send it to the socket as a string of bytes preceded by a four-byte length
2564 string packed in binary using ``struct.pack('>L', n)``.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002565
2566
2567.. function:: stopListening()
2568
Georg Brandlc37f2882007-12-04 17:46:27 +00002569 Stops the listening server which was created with a call to :func:`listen`.
2570 This is typically called before calling :meth:`join` on the return value from
Georg Brandl8ec7f652007-08-15 14:28:01 +00002571 :func:`listen`.
2572
2573
2574.. _logging-config-fileformat:
2575
2576Configuration file format
2577^^^^^^^^^^^^^^^^^^^^^^^^^
2578
Georg Brandl392c6fc2008-05-25 07:25:25 +00002579The configuration file format understood by :func:`fileConfig` is based on
Vinay Sajip51104862009-01-02 18:53:04 +00002580:mod:`ConfigParser` functionality. The file must contain sections called
2581``[loggers]``, ``[handlers]`` and ``[formatters]`` which identify by name the
2582entities of each type which are defined in the file. For each such entity,
2583there is a separate section which identifies how that entity is configured.
2584Thus, for a logger named ``log01`` in the ``[loggers]`` section, the relevant
2585configuration details are held in a section ``[logger_log01]``. Similarly, a
2586handler called ``hand01`` in the ``[handlers]`` section will have its
2587configuration held in a section called ``[handler_hand01]``, while a formatter
2588called ``form01`` in the ``[formatters]`` section will have its configuration
2589specified in a section called ``[formatter_form01]``. The root logger
2590configuration must be specified in a section called ``[logger_root]``.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002591
2592Examples of these sections in the file are given below. ::
2593
2594 [loggers]
2595 keys=root,log02,log03,log04,log05,log06,log07
2596
2597 [handlers]
2598 keys=hand01,hand02,hand03,hand04,hand05,hand06,hand07,hand08,hand09
2599
2600 [formatters]
2601 keys=form01,form02,form03,form04,form05,form06,form07,form08,form09
2602
2603The root logger must specify a level and a list of handlers. An example of a
2604root logger section is given below. ::
2605
2606 [logger_root]
2607 level=NOTSET
2608 handlers=hand01
2609
2610The ``level`` entry can be one of ``DEBUG, INFO, WARNING, ERROR, CRITICAL`` or
2611``NOTSET``. For the root logger only, ``NOTSET`` means that all messages will be
2612logged. Level values are :func:`eval`\ uated in the context of the ``logging``
2613package's namespace.
2614
2615The ``handlers`` entry is a comma-separated list of handler names, which must
2616appear in the ``[handlers]`` section. These names must appear in the
2617``[handlers]`` section and have corresponding sections in the configuration
2618file.
2619
2620For loggers other than the root logger, some additional information is required.
2621This is illustrated by the following example. ::
2622
2623 [logger_parser]
2624 level=DEBUG
2625 handlers=hand01
2626 propagate=1
2627 qualname=compiler.parser
2628
2629The ``level`` and ``handlers`` entries are interpreted as for the root logger,
2630except that if a non-root logger's level is specified as ``NOTSET``, the system
2631consults loggers higher up the hierarchy to determine the effective level of the
2632logger. The ``propagate`` entry is set to 1 to indicate that messages must
2633propagate to handlers higher up the logger hierarchy from this logger, or 0 to
2634indicate that messages are **not** propagated to handlers up the hierarchy. The
2635``qualname`` entry is the hierarchical channel name of the logger, that is to
2636say the name used by the application to get the logger.
2637
2638Sections which specify handler configuration are exemplified by the following.
2639::
2640
2641 [handler_hand01]
2642 class=StreamHandler
2643 level=NOTSET
2644 formatter=form01
2645 args=(sys.stdout,)
2646
2647The ``class`` entry indicates the handler's class (as determined by :func:`eval`
2648in the ``logging`` package's namespace). The ``level`` is interpreted as for
2649loggers, and ``NOTSET`` is taken to mean "log everything".
2650
Vinay Sajip2a649f92008-07-18 09:00:35 +00002651.. versionchanged:: 2.6
2652 Added support for resolving the handler's class as a dotted module and class
2653 name.
2654
Georg Brandl8ec7f652007-08-15 14:28:01 +00002655The ``formatter`` entry indicates the key name of the formatter for this
2656handler. If blank, a default formatter (``logging._defaultFormatter``) is used.
2657If a name is specified, it must appear in the ``[formatters]`` section and have
2658a corresponding section in the configuration file.
2659
2660The ``args`` entry, when :func:`eval`\ uated in the context of the ``logging``
2661package's namespace, is the list of arguments to the constructor for the handler
2662class. Refer to the constructors for the relevant handlers, or to the examples
2663below, to see how typical entries are constructed. ::
2664
2665 [handler_hand02]
2666 class=FileHandler
2667 level=DEBUG
2668 formatter=form02
2669 args=('python.log', 'w')
2670
2671 [handler_hand03]
2672 class=handlers.SocketHandler
2673 level=INFO
2674 formatter=form03
2675 args=('localhost', handlers.DEFAULT_TCP_LOGGING_PORT)
2676
2677 [handler_hand04]
2678 class=handlers.DatagramHandler
2679 level=WARN
2680 formatter=form04
2681 args=('localhost', handlers.DEFAULT_UDP_LOGGING_PORT)
2682
2683 [handler_hand05]
2684 class=handlers.SysLogHandler
2685 level=ERROR
2686 formatter=form05
2687 args=(('localhost', handlers.SYSLOG_UDP_PORT), handlers.SysLogHandler.LOG_USER)
2688
2689 [handler_hand06]
2690 class=handlers.NTEventLogHandler
2691 level=CRITICAL
2692 formatter=form06
2693 args=('Python Application', '', 'Application')
2694
2695 [handler_hand07]
2696 class=handlers.SMTPHandler
2697 level=WARN
2698 formatter=form07
2699 args=('localhost', 'from@abc', ['user1@abc', 'user2@xyz'], 'Logger Subject')
2700
2701 [handler_hand08]
2702 class=handlers.MemoryHandler
2703 level=NOTSET
2704 formatter=form08
2705 target=
2706 args=(10, ERROR)
2707
2708 [handler_hand09]
2709 class=handlers.HTTPHandler
2710 level=NOTSET
2711 formatter=form09
2712 args=('localhost:9022', '/log', 'GET')
2713
2714Sections which specify formatter configuration are typified by the following. ::
2715
2716 [formatter_form01]
2717 format=F1 %(asctime)s %(levelname)s %(message)s
2718 datefmt=
2719 class=logging.Formatter
2720
2721The ``format`` entry is the overall format string, and the ``datefmt`` entry is
Georg Brandlb19be572007-12-29 10:57:00 +00002722the :func:`strftime`\ -compatible date/time format string. If empty, the
2723package substitutes ISO8601 format date/times, which is almost equivalent to
2724specifying the date format string ``"%Y-%m-%d %H:%M:%S"``. The ISO8601 format
2725also specifies milliseconds, which are appended to the result of using the above
2726format string, with a comma separator. An example time in ISO8601 format is
2727``2003-01-23 00:29:50,411``.
Georg Brandl8ec7f652007-08-15 14:28:01 +00002728
2729The ``class`` entry is optional. It indicates the name of the formatter's class
2730(as a dotted module and class name.) This option is useful for instantiating a
2731:class:`Formatter` subclass. Subclasses of :class:`Formatter` can present
2732exception tracebacks in an expanded or condensed format.
2733
Georg Brandlc37f2882007-12-04 17:46:27 +00002734
2735Configuration server example
2736^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2737
2738Here is an example of a module using the logging configuration server::
2739
2740 import logging
2741 import logging.config
2742 import time
2743 import os
2744
2745 # read initial config file
2746 logging.config.fileConfig("logging.conf")
2747
2748 # create and start listener on port 9999
2749 t = logging.config.listen(9999)
2750 t.start()
2751
2752 logger = logging.getLogger("simpleExample")
2753
2754 try:
2755 # loop through logging calls to see the difference
2756 # new configurations make, until Ctrl+C is pressed
2757 while True:
2758 logger.debug("debug message")
2759 logger.info("info message")
2760 logger.warn("warn message")
2761 logger.error("error message")
2762 logger.critical("critical message")
2763 time.sleep(5)
2764 except KeyboardInterrupt:
2765 # cleanup
2766 logging.config.stopListening()
2767 t.join()
2768
2769And here is a script that takes a filename and sends that file to the server,
2770properly preceded with the binary-encoded length, as the new logging
2771configuration::
2772
2773 #!/usr/bin/env python
Benjamin Petersona7b55a32009-02-20 03:31:23 +00002774 import socket, sys, struct
Georg Brandlc37f2882007-12-04 17:46:27 +00002775
2776 data_to_send = open(sys.argv[1], "r").read()
2777
2778 HOST = 'localhost'
2779 PORT = 9999
2780 s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
2781 print "connecting..."
2782 s.connect((HOST, PORT))
2783 print "sending config..."
2784 s.send(struct.pack(">L", len(data_to_send)))
2785 s.send(data_to_send)
2786 s.close()
2787 print "complete"
2788
2789
2790More examples
2791-------------
2792
2793Multiple handlers and formatters
2794^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2795
2796Loggers are plain Python objects. The :func:`addHandler` method has no minimum
2797or maximum quota for the number of handlers you may add. Sometimes it will be
2798beneficial for an application to log all messages of all severities to a text
2799file while simultaneously logging errors or above to the console. To set this
2800up, simply configure the appropriate handlers. The logging calls in the
2801application code will remain unchanged. Here is a slight modification to the
2802previous simple module-based configuration example::
2803
2804 import logging
2805
2806 logger = logging.getLogger("simple_example")
2807 logger.setLevel(logging.DEBUG)
2808 # create file handler which logs even debug messages
2809 fh = logging.FileHandler("spam.log")
2810 fh.setLevel(logging.DEBUG)
2811 # create console handler with a higher log level
2812 ch = logging.StreamHandler()
2813 ch.setLevel(logging.ERROR)
2814 # create formatter and add it to the handlers
2815 formatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s")
2816 ch.setFormatter(formatter)
2817 fh.setFormatter(formatter)
2818 # add the handlers to logger
2819 logger.addHandler(ch)
2820 logger.addHandler(fh)
2821
2822 # "application" code
2823 logger.debug("debug message")
2824 logger.info("info message")
2825 logger.warn("warn message")
2826 logger.error("error message")
2827 logger.critical("critical message")
2828
2829Notice that the "application" code does not care about multiple handlers. All
2830that changed was the addition and configuration of a new handler named *fh*.
2831
2832The ability to create new handlers with higher- or lower-severity filters can be
2833very helpful when writing and testing an application. Instead of using many
2834``print`` statements for debugging, use ``logger.debug``: Unlike the print
2835statements, which you will have to delete or comment out later, the logger.debug
2836statements can remain intact in the source code and remain dormant until you
2837need them again. At that time, the only change that needs to happen is to
2838modify the severity level of the logger and/or handler to debug.
2839
2840
2841Using logging in multiple modules
2842^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2843
2844It was mentioned above that multiple calls to
2845``logging.getLogger('someLogger')`` return a reference to the same logger
2846object. This is true not only within the same module, but also across modules
2847as long as it is in the same Python interpreter process. It is true for
2848references to the same object; additionally, application code can define and
2849configure a parent logger in one module and create (but not configure) a child
2850logger in a separate module, and all logger calls to the child will pass up to
2851the parent. Here is a main module::
2852
2853 import logging
2854 import auxiliary_module
2855
2856 # create logger with "spam_application"
2857 logger = logging.getLogger("spam_application")
2858 logger.setLevel(logging.DEBUG)
2859 # create file handler which logs even debug messages
2860 fh = logging.FileHandler("spam.log")
2861 fh.setLevel(logging.DEBUG)
2862 # create console handler with a higher log level
2863 ch = logging.StreamHandler()
2864 ch.setLevel(logging.ERROR)
2865 # create formatter and add it to the handlers
2866 formatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s")
2867 fh.setFormatter(formatter)
2868 ch.setFormatter(formatter)
2869 # add the handlers to the logger
2870 logger.addHandler(fh)
2871 logger.addHandler(ch)
2872
2873 logger.info("creating an instance of auxiliary_module.Auxiliary")
2874 a = auxiliary_module.Auxiliary()
2875 logger.info("created an instance of auxiliary_module.Auxiliary")
2876 logger.info("calling auxiliary_module.Auxiliary.do_something")
2877 a.do_something()
2878 logger.info("finished auxiliary_module.Auxiliary.do_something")
2879 logger.info("calling auxiliary_module.some_function()")
2880 auxiliary_module.some_function()
2881 logger.info("done with auxiliary_module.some_function()")
2882
2883Here is the auxiliary module::
2884
2885 import logging
2886
2887 # create logger
2888 module_logger = logging.getLogger("spam_application.auxiliary")
2889
2890 class Auxiliary:
2891 def __init__(self):
2892 self.logger = logging.getLogger("spam_application.auxiliary.Auxiliary")
2893 self.logger.info("creating an instance of Auxiliary")
2894 def do_something(self):
2895 self.logger.info("doing something")
2896 a = 1 + 1
2897 self.logger.info("done doing something")
2898
2899 def some_function():
2900 module_logger.info("received a call to \"some_function\"")
2901
2902The output looks like this::
2903
Vinay Sajipe28fa292008-01-07 15:30:36 +00002904 2005-03-23 23:47:11,663 - spam_application - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002905 creating an instance of auxiliary_module.Auxiliary
Vinay Sajipe28fa292008-01-07 15:30:36 +00002906 2005-03-23 23:47:11,665 - spam_application.auxiliary.Auxiliary - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002907 creating an instance of Auxiliary
Vinay Sajipe28fa292008-01-07 15:30:36 +00002908 2005-03-23 23:47:11,665 - spam_application - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002909 created an instance of auxiliary_module.Auxiliary
Vinay Sajipe28fa292008-01-07 15:30:36 +00002910 2005-03-23 23:47:11,668 - spam_application - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002911 calling auxiliary_module.Auxiliary.do_something
Vinay Sajipe28fa292008-01-07 15:30:36 +00002912 2005-03-23 23:47:11,668 - spam_application.auxiliary.Auxiliary - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002913 doing something
Vinay Sajipe28fa292008-01-07 15:30:36 +00002914 2005-03-23 23:47:11,669 - spam_application.auxiliary.Auxiliary - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002915 done doing something
Vinay Sajipe28fa292008-01-07 15:30:36 +00002916 2005-03-23 23:47:11,670 - spam_application - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002917 finished auxiliary_module.Auxiliary.do_something
Vinay Sajipe28fa292008-01-07 15:30:36 +00002918 2005-03-23 23:47:11,671 - spam_application - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002919 calling auxiliary_module.some_function()
Vinay Sajipe28fa292008-01-07 15:30:36 +00002920 2005-03-23 23:47:11,672 - spam_application.auxiliary - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002921 received a call to "some_function"
Vinay Sajipe28fa292008-01-07 15:30:36 +00002922 2005-03-23 23:47:11,673 - spam_application - INFO -
Georg Brandlc37f2882007-12-04 17:46:27 +00002923 done with auxiliary_module.some_function()
2924