blob: e8189c2ecef3e546efdbab9d16a97f4449cb455f [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001:mod:`logging` --- Logging facility for Python
2==============================================
3
4.. module:: logging
Vinay Sajip5dbca9c2011-04-08 11:40:38 +01005 :synopsis: Flexible event logging system for applications.
Georg Brandl8ec7f652007-08-15 14:28:01 +00006
7
8.. moduleauthor:: Vinay Sajip <vinay_sajip@red-dove.com>
9.. sectionauthor:: Vinay Sajip <vinay_sajip@red-dove.com>
10
11
Georg Brandl8ec7f652007-08-15 14:28:01 +000012.. index:: pair: Errors; logging
13
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010014.. sidebar:: Important
15
16 This page contains the API reference information. For tutorial
17 information and discussion of more advanced topics, see
18
19 * :ref:`Basic Tutorial <logging-basic-tutorial>`
20 * :ref:`Advanced Tutorial <logging-advanced-tutorial>`
21 * :ref:`Logging Cookbook <logging-cookbook>`
22
Vinay Sajip6971f2e2013-09-05 22:57:20 +010023**Source code:** :source:`Lib/logging/__init__.py`
24
25--------------
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010026
Georg Brandl8ec7f652007-08-15 14:28:01 +000027.. versionadded:: 2.3
28
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010029This module defines functions and classes which implement a flexible event
30logging system for applications and libraries.
Georg Brandlc37f2882007-12-04 17:46:27 +000031
32The key benefit of having the logging API provided by a standard library module
33is that all Python modules can participate in logging, so your application log
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010034can include your own messages integrated with messages from third-party
35modules.
Georg Brandlc37f2882007-12-04 17:46:27 +000036
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010037The module provides a lot of functionality and flexibility. If you are
38unfamiliar with logging, the best way to get to grips with it is to see the
39tutorials (see the links on the right).
Georg Brandlc37f2882007-12-04 17:46:27 +000040
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010041The basic classes defined by the module, together with their functions, are
42listed below.
Georg Brandlc37f2882007-12-04 17:46:27 +000043
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010044* Loggers expose the interface that application code directly uses.
45* Handlers send the log records (created by loggers) to the appropriate
46 destination.
47* Filters provide a finer grained facility for determining which log records
48 to output.
49* Formatters specify the layout of log records in the final output.
Georg Brandlc37f2882007-12-04 17:46:27 +000050
Georg Brandlc37f2882007-12-04 17:46:27 +000051
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010052.. _logger:
Georg Brandlc37f2882007-12-04 17:46:27 +000053
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010054Logger Objects
Georg Brandlc37f2882007-12-04 17:46:27 +000055--------------
56
Vinay Sajip2a1c13b2012-04-10 19:52:06 +010057Loggers have the following attributes and methods. Note that Loggers are never
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010058instantiated directly, but always through the module-level function
Vinay Sajip2a1c13b2012-04-10 19:52:06 +010059``logging.getLogger(name)``. Multiple calls to :func:`getLogger` with the same
60name will always return a reference to the same Logger object.
61
62The ``name`` is potentially a period-separated hierarchical value, like
63``foo.bar.baz`` (though it could also be just plain ``foo``, for example).
64Loggers that are further down in the hierarchical list are children of loggers
65higher up in the list. For example, given a logger with a name of ``foo``,
66loggers with names of ``foo.bar``, ``foo.bar.baz``, and ``foo.bam`` are all
67descendants of ``foo``. The logger name hierarchy is analogous to the Python
68package hierarchy, and identical to it if you organise your loggers on a
69per-module basis using the recommended construction
70``logging.getLogger(__name__)``. That's because in a module, ``__name__``
71is the module's name in the Python package namespace.
Georg Brandl8ec7f652007-08-15 14:28:01 +000072
Vinay Sajipcb309c52013-01-21 19:43:51 +000073
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010074.. class:: Logger
Georg Brandl8ec7f652007-08-15 14:28:01 +000075
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010076.. attribute:: Logger.propagate
Georg Brandl8ec7f652007-08-15 14:28:01 +000077
Vinay Sajipcb309c52013-01-21 19:43:51 +000078 If this evaluates to true, events logged to this logger will be passed to the
79 handlers of higher level (ancestor) loggers, in addition to any handlers
80 attached to this logger. Messages are passed directly to the ancestor
81 loggers' handlers - neither the level nor filters of the ancestor loggers in
82 question are considered.
Vinay Sajip36398072011-11-23 08:51:35 +000083
84 If this evaluates to false, logging messages are not passed to the handlers
85 of ancestor loggers.
86
Benjamin Petersonc016f462011-12-30 13:47:25 -060087 The constructor sets this attribute to ``True``.
Vinay Sajip89e1ae22010-09-17 10:09:04 +000088
Vinay Sajip8a459d92013-01-21 21:56:35 +000089 .. note:: If you attach a handler to a logger *and* one or more of its
90 ancestors, it may emit the same record multiple times. In general, you
91 should not need to attach a handler to more than one logger - if you just
92 attach it to the appropriate logger which is highest in the logger
93 hierarchy, then it will see all events logged by all descendant loggers,
94 provided that their propagate setting is left set to ``True``. A common
95 scenario is to attach handlers only to the root logger, and to let
96 propagation take care of the rest.
Vinay Sajip89e1ae22010-09-17 10:09:04 +000097
Vinay Sajip5dbca9c2011-04-08 11:40:38 +010098.. method:: Logger.setLevel(lvl)
99
100 Sets the threshold for this logger to *lvl*. Logging messages which are less
101 severe than *lvl* will be ignored. When a logger is created, the level is set to
102 :const:`NOTSET` (which causes all messages to be processed when the logger is
103 the root logger, or delegation to the parent when the logger is a non-root
104 logger). Note that the root logger is created with level :const:`WARNING`.
105
106 The term 'delegation to the parent' means that if a logger has a level of
107 NOTSET, its chain of ancestor loggers is traversed until either an ancestor with
108 a level other than NOTSET is found, or the root is reached.
109
110 If an ancestor is found with a level other than NOTSET, then that ancestor's
111 level is treated as the effective level of the logger where the ancestor search
112 began, and is used to determine how a logging event is handled.
113
114 If the root is reached, and it has a level of NOTSET, then all messages will be
115 processed. Otherwise, the root's level will be used as the effective level.
116
Vinay Sajipd46a31f2013-12-19 11:42:18 +0000117 See :ref:`levels` for a list of levels.
118
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100119
120.. method:: Logger.isEnabledFor(lvl)
121
122 Indicates if a message of severity *lvl* would be processed by this logger.
123 This method checks first the module-level level set by
124 ``logging.disable(lvl)`` and then the logger's effective level as determined
125 by :meth:`getEffectiveLevel`.
126
127
128.. method:: Logger.getEffectiveLevel()
129
130 Indicates the effective level for this logger. If a value other than
131 :const:`NOTSET` has been set using :meth:`setLevel`, it is returned. Otherwise,
132 the hierarchy is traversed towards the root until a value other than
133 :const:`NOTSET` is found, and that value is returned.
134
135
136.. method:: Logger.getChild(suffix)
137
138 Returns a logger which is a descendant to this logger, as determined by the suffix.
139 Thus, ``logging.getLogger('abc').getChild('def.ghi')`` would return the same
140 logger as would be returned by ``logging.getLogger('abc.def.ghi')``. This is a
141 convenience method, useful when the parent logger is named using e.g. ``__name__``
142 rather than a literal string.
143
144 .. versionadded:: 2.7
145
146
147.. method:: Logger.debug(msg, *args, **kwargs)
148
149 Logs a message with level :const:`DEBUG` on this logger. The *msg* is the
150 message format string, and the *args* are the arguments which are merged into
151 *msg* using the string formatting operator. (Note that this means that you can
152 use keywords in the format string, together with a single dictionary argument.)
153
154 There are two keyword arguments in *kwargs* which are inspected: *exc_info*
155 which, if it does not evaluate as false, causes exception information to be
156 added to the logging message. If an exception tuple (in the format returned by
157 :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info`
158 is called to get the exception information.
159
160 The second keyword argument is *extra* which can be used to pass a
161 dictionary which is used to populate the __dict__ of the LogRecord created for
162 the logging event with user-defined attributes. These custom attributes can then
163 be used as you like. For example, they could be incorporated into logged
164 messages. For example::
165
166 FORMAT = '%(asctime)-15s %(clientip)s %(user)-8s %(message)s'
167 logging.basicConfig(format=FORMAT)
Jason R. Coombsd6a80ee2012-03-07 10:24:04 -0500168 d = {'clientip': '192.168.0.1', 'user': 'fbloggs'}
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100169 logger = logging.getLogger('tcpserver')
170 logger.warning('Protocol problem: %s', 'connection reset', extra=d)
171
172 would print something like ::
173
174 2006-02-08 22:20:02,165 192.168.0.1 fbloggs Protocol problem: connection reset
175
176 The keys in the dictionary passed in *extra* should not clash with the keys used
177 by the logging system. (See the :class:`Formatter` documentation for more
178 information on which keys are used by the logging system.)
179
180 If you choose to use these attributes in logged messages, you need to exercise
181 some care. In the above example, for instance, the :class:`Formatter` has been
182 set up with a format string which expects 'clientip' and 'user' in the attribute
183 dictionary of the LogRecord. If these are missing, the message will not be
184 logged because a string formatting exception will occur. So in this case, you
185 always need to pass the *extra* dictionary with these keys.
186
187 While this might be annoying, this feature is intended for use in specialized
188 circumstances, such as multi-threaded servers where the same code executes in
189 many contexts, and interesting conditions which arise are dependent on this
190 context (such as remote client IP address and authenticated user name, in the
191 above example). In such circumstances, it is likely that specialized
192 :class:`Formatter`\ s would be used with particular :class:`Handler`\ s.
193
194
195.. method:: Logger.info(msg, *args, **kwargs)
196
197 Logs a message with level :const:`INFO` on this logger. The arguments are
198 interpreted as for :meth:`debug`.
199
200
201.. method:: Logger.warning(msg, *args, **kwargs)
202
203 Logs a message with level :const:`WARNING` on this logger. The arguments are
204 interpreted as for :meth:`debug`.
205
206
207.. method:: Logger.error(msg, *args, **kwargs)
208
209 Logs a message with level :const:`ERROR` on this logger. The arguments are
210 interpreted as for :meth:`debug`.
211
212
213.. method:: Logger.critical(msg, *args, **kwargs)
214
215 Logs a message with level :const:`CRITICAL` on this logger. The arguments are
216 interpreted as for :meth:`debug`.
217
218
219.. method:: Logger.log(lvl, msg, *args, **kwargs)
220
221 Logs a message with integer level *lvl* on this logger. The other arguments are
222 interpreted as for :meth:`debug`.
223
224
225.. method:: Logger.exception(msg, *args)
226
227 Logs a message with level :const:`ERROR` on this logger. The arguments are
228 interpreted as for :meth:`debug`. Exception info is added to the logging
229 message. This method should only be called from an exception handler.
230
231
232.. method:: Logger.addFilter(filt)
233
234 Adds the specified filter *filt* to this logger.
235
236
237.. method:: Logger.removeFilter(filt)
238
239 Removes the specified filter *filt* from this logger.
240
241
242.. method:: Logger.filter(record)
243
244 Applies this logger's filters to the record and returns a true value if the
Vinay Sajipcb309c52013-01-21 19:43:51 +0000245 record is to be processed. The filters are consulted in turn, until one of
246 them returns a false value. If none of them return a false value, the record
247 will be processed (passed to handlers). If one returns a false value, no
248 further processing of the record occurs.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100249
250
251.. method:: Logger.addHandler(hdlr)
252
253 Adds the specified handler *hdlr* to this logger.
254
255
256.. method:: Logger.removeHandler(hdlr)
257
258 Removes the specified handler *hdlr* from this logger.
259
260
261.. method:: Logger.findCaller()
262
263 Finds the caller's source filename and line number. Returns the filename, line
264 number and function name as a 3-element tuple.
265
266 .. versionchanged:: 2.4
267 The function name was added. In earlier versions, the filename and line
268 number were returned as a 2-element tuple.
269
270.. method:: Logger.handle(record)
271
272 Handles a record by passing it to all handlers associated with this logger and
273 its ancestors (until a false value of *propagate* is found). This method is used
274 for unpickled records received from a socket, as well as those created locally.
275 Logger-level filtering is applied using :meth:`~Logger.filter`.
276
277
278.. method:: Logger.makeRecord(name, lvl, fn, lno, msg, args, exc_info, func=None, extra=None)
279
280 This is a factory method which can be overridden in subclasses to create
281 specialized :class:`LogRecord` instances.
282
283 .. versionchanged:: 2.5
284 *func* and *extra* were added.
285
Vinay Sajipd46a31f2013-12-19 11:42:18 +0000286
287.. _levels:
288
289Logging Levels
290--------------
291
292The numeric values of logging levels are given in the following table. These are
293primarily of interest if you want to define your own levels, and need them to
294have specific values relative to the predefined levels. If you define a level
295with the same numeric value, it overwrites the predefined value; the predefined
296name is lost.
297
298+--------------+---------------+
299| Level | Numeric value |
300+==============+===============+
301| ``CRITICAL`` | 50 |
302+--------------+---------------+
303| ``ERROR`` | 40 |
304+--------------+---------------+
305| ``WARNING`` | 30 |
306+--------------+---------------+
307| ``INFO`` | 20 |
308+--------------+---------------+
309| ``DEBUG`` | 10 |
310+--------------+---------------+
311| ``NOTSET`` | 0 |
312+--------------+---------------+
313
314
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100315.. _handler:
316
317Handler Objects
Vinay Sajipb5902e62009-01-15 22:48:13 +0000318---------------
319
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100320Handlers have the following attributes and methods. Note that :class:`Handler`
321is never instantiated directly; this class acts as a base for more useful
322subclasses. However, the :meth:`__init__` method in subclasses needs to call
323:meth:`Handler.__init__`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000324
Georg Brandl8ec7f652007-08-15 14:28:01 +0000325
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100326.. method:: Handler.__init__(level=NOTSET)
Vinay Sajipb1a15e42009-01-15 23:04:47 +0000327
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100328 Initializes the :class:`Handler` instance by setting its level, setting the list
329 of filters to the empty list and creating a lock (using :meth:`createLock`) for
330 serializing access to an I/O mechanism.
Vinay Sajipc2211ad2009-01-10 19:22:57 +0000331
Georg Brandl8ec7f652007-08-15 14:28:01 +0000332
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100333.. method:: Handler.createLock()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000334
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100335 Initializes a thread lock which can be used to serialize access to underlying
336 I/O functionality which may not be threadsafe.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000337
Georg Brandl8ec7f652007-08-15 14:28:01 +0000338
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100339.. method:: Handler.acquire()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000340
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100341 Acquires the thread lock created with :meth:`createLock`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000342
Georg Brandl8ec7f652007-08-15 14:28:01 +0000343
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100344.. method:: Handler.release()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000345
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100346 Releases the thread lock acquired with :meth:`acquire`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000347
Vinay Sajipc2211ad2009-01-10 19:22:57 +0000348
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100349.. method:: Handler.setLevel(lvl)
Vinay Sajip213faca2008-12-03 23:22:58 +0000350
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100351 Sets the threshold for this handler to *lvl*. Logging messages which are less
352 severe than *lvl* will be ignored. When a handler is created, the level is set
353 to :const:`NOTSET` (which causes all messages to be processed).
Vinay Sajip213faca2008-12-03 23:22:58 +0000354
Vinay Sajipd46a31f2013-12-19 11:42:18 +0000355 See :ref:`levels` for a list of levels.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000356
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100357.. method:: Handler.setFormatter(form)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000358
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100359 Sets the :class:`Formatter` for this handler to *form*.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000360
Georg Brandl8ec7f652007-08-15 14:28:01 +0000361
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100362.. method:: Handler.addFilter(filt)
363
364 Adds the specified filter *filt* to this handler.
365
366
367.. method:: Handler.removeFilter(filt)
368
369 Removes the specified filter *filt* from this handler.
370
371
372.. method:: Handler.filter(record)
373
374 Applies this handler's filters to the record and returns a true value if the
Vinay Sajipcb309c52013-01-21 19:43:51 +0000375 record is to be processed. The filters are consulted in turn, until one of
376 them returns a false value. If none of them return a false value, the record
377 will be emitted. If one returns a false value, the handler will not emit the
378 record.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100379
380
381.. method:: Handler.flush()
382
383 Ensure all logging output has been flushed. This version does nothing and is
384 intended to be implemented by subclasses.
385
386
387.. method:: Handler.close()
388
389 Tidy up any resources used by the handler. This version does no output but
390 removes the handler from an internal list of handlers which is closed when
391 :func:`shutdown` is called. Subclasses should ensure that this gets called
392 from overridden :meth:`close` methods.
393
394
395.. method:: Handler.handle(record)
396
397 Conditionally emits the specified logging record, depending on filters which may
398 have been added to the handler. Wraps the actual emission of the record with
399 acquisition/release of the I/O thread lock.
400
401
402.. method:: Handler.handleError(record)
403
404 This method should be called from handlers when an exception is encountered
Vinay Sajip7d13cd32012-02-20 18:34:07 +0000405 during an :meth:`emit` call. If the module-level attribute
406 ``raiseExceptions`` is ``False``, exceptions get silently ignored. This is
407 what is mostly wanted for a logging system - most users will not care about
408 errors in the logging system, they are more interested in application
409 errors. You could, however, replace this with a custom handler if you wish.
410 The specified record is the one which was being processed when the exception
411 occurred. (The default value of ``raiseExceptions`` is ``True``, as that is
412 more useful during development).
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100413
414
415.. method:: Handler.format(record)
416
417 Do formatting for a record - if a formatter is set, use it. Otherwise, use the
418 default formatter for the module.
419
420
421.. method:: Handler.emit(record)
422
423 Do whatever it takes to actually log the specified logging record. This version
424 is intended to be implemented by subclasses and so raises a
425 :exc:`NotImplementedError`.
426
427For a list of handlers included as standard, see :mod:`logging.handlers`.
428
429.. _formatter-objects:
430
431Formatter Objects
432-----------------
433
434.. currentmodule:: logging
435
436:class:`Formatter` objects have the following attributes and methods. They are
437responsible for converting a :class:`LogRecord` to (usually) a string which can
438be interpreted by either a human or an external system. The base
439:class:`Formatter` allows a formatting string to be specified. If none is
440supplied, the default value of ``'%(message)s'`` is used.
441
442A Formatter can be initialized with a format string which makes use of knowledge
443of the :class:`LogRecord` attributes - such as the default value mentioned above
444making use of the fact that the user's message and arguments are pre-formatted
445into a :class:`LogRecord`'s *message* attribute. This format string contains
446standard Python %-style mapping keys. See section :ref:`string-formatting`
447for more information on string formatting.
448
449The useful mapping keys in a :class:`LogRecord` are given in the section on
450:ref:`logrecord-attributes`.
451
452
453.. class:: Formatter(fmt=None, datefmt=None)
454
455 Returns a new instance of the :class:`Formatter` class. The instance is
456 initialized with a format string for the message as a whole, as well as a
457 format string for the date/time portion of a message. If no *fmt* is
458 specified, ``'%(message)s'`` is used. If no *datefmt* is specified, the
459 ISO8601 date format is used.
460
461 .. method:: format(record)
462
463 The record's attribute dictionary is used as the operand to a string
464 formatting operation. Returns the resulting string. Before formatting the
465 dictionary, a couple of preparatory steps are carried out. The *message*
466 attribute of the record is computed using *msg* % *args*. If the
467 formatting string contains ``'(asctime)'``, :meth:`formatTime` is called
468 to format the event time. If there is exception information, it is
469 formatted using :meth:`formatException` and appended to the message. Note
470 that the formatted exception information is cached in attribute
471 *exc_text*. This is useful because the exception information can be
472 pickled and sent across the wire, but you should be careful if you have
473 more than one :class:`Formatter` subclass which customizes the formatting
474 of exception information. In this case, you will have to clear the cached
475 value after a formatter has done its formatting, so that the next
476 formatter to handle the event doesn't use the cached value but
477 recalculates it afresh.
478
479
480 .. method:: formatTime(record, datefmt=None)
481
482 This method should be called from :meth:`format` by a formatter which
483 wants to make use of a formatted time. This method can be overridden in
484 formatters to provide for any specific requirement, but the basic behavior
485 is as follows: if *datefmt* (a string) is specified, it is used with
486 :func:`time.strftime` to format the creation time of the
487 record. Otherwise, the ISO8601 format is used. The resulting string is
488 returned.
489
Vinay Sajipad52cb22011-06-13 14:59:36 +0100490 This function uses a user-configurable function to convert the creation
491 time to a tuple. By default, :func:`time.localtime` is used; to change
492 this for a particular formatter instance, set the ``converter`` attribute
493 to a function with the same signature as :func:`time.localtime` or
494 :func:`time.gmtime`. To change it for all formatters, for example if you
495 want all logging times to be shown in GMT, set the ``converter``
496 attribute in the ``Formatter`` class.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100497
498 .. method:: formatException(exc_info)
499
500 Formats the specified exception information (a standard exception tuple as
501 returned by :func:`sys.exc_info`) as a string. This default implementation
502 just uses :func:`traceback.print_exception`. The resulting string is
503 returned.
504
505.. _filter:
506
507Filter Objects
508--------------
509
510``Filters`` can be used by ``Handlers`` and ``Loggers`` for more sophisticated
511filtering than is provided by levels. The base filter class only allows events
512which are below a certain point in the logger hierarchy. For example, a filter
513initialized with 'A.B' will allow events logged by loggers 'A.B', 'A.B.C',
514'A.B.C.D', 'A.B.D' etc. but not 'A.BB', 'B.A.B' etc. If initialized with the
515empty string, all events are passed.
516
517
518.. class:: Filter(name='')
519
520 Returns an instance of the :class:`Filter` class. If *name* is specified, it
521 names a logger which, together with its children, will have its events allowed
522 through the filter. If *name* is the empty string, allows every event.
523
524
525 .. method:: filter(record)
526
527 Is the specified record to be logged? Returns zero for no, nonzero for
528 yes. If deemed appropriate, the record may be modified in-place by this
529 method.
530
Vinay Sajipcb309c52013-01-21 19:43:51 +0000531Note that filters attached to handlers are consulted before an event is
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100532emitted by the handler, whereas filters attached to loggers are consulted
Vinay Sajipcb309c52013-01-21 19:43:51 +0000533whenever an event is logged (using :meth:`debug`, :meth:`info`,
534etc.), before sending an event to handlers. This means that events which have
535been generated by descendant loggers will not be filtered by a logger's filter
536setting, unless the filter has also been applied to those descendant loggers.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100537
538You don't actually need to subclass ``Filter``: you can pass any instance
539which has a ``filter`` method with the same semantics.
540
541Although filters are used primarily to filter records based on more
542sophisticated criteria than levels, they get to see every record which is
543processed by the handler or logger they're attached to: this can be useful if
544you want to do things like counting how many records were processed by a
545particular logger or handler, or adding, changing or removing attributes in
546the LogRecord being processed. Obviously changing the LogRecord needs to be
547done with some care, but it does allow the injection of contextual information
548into logs (see :ref:`filters-contextual`).
549
550.. _log-record:
551
552LogRecord Objects
553-----------------
554
555:class:`LogRecord` instances are created automatically by the :class:`Logger`
556every time something is logged, and can be created manually via
557:func:`makeLogRecord` (for example, from a pickled event received over the
558wire).
559
560
561.. class:: LogRecord(name, level, pathname, lineno, msg, args, exc_info, func=None)
562
563 Contains all the information pertinent to the event being logged.
564
565 The primary information is passed in :attr:`msg` and :attr:`args`, which
566 are combined using ``msg % args`` to create the :attr:`message` field of the
567 record.
568
569 :param name: The name of the logger used to log the event represented by
Vinay Sajipcb309c52013-01-21 19:43:51 +0000570 this LogRecord. Note that this name will always have this
571 value, even though it may be emitted by a handler attached to
572 a different (ancestor) logger.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100573 :param level: The numeric level of the logging event (one of DEBUG, INFO etc.)
Vinay Sajipad52cb22011-06-13 14:59:36 +0100574 Note that this is converted to *two* attributes of the LogRecord:
575 ``levelno`` for the numeric value and ``levelname`` for the
576 corresponding level name.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100577 :param pathname: The full pathname of the source file where the logging call
578 was made.
579 :param lineno: The line number in the source file where the logging call was
580 made.
581 :param msg: The event description message, possibly a format string with
582 placeholders for variable data.
583 :param args: Variable data to merge into the *msg* argument to obtain the
584 event description.
585 :param exc_info: An exception tuple with the current exception information,
586 or *None* if no exception information is available.
587 :param func: The name of the function or method from which the logging call
588 was invoked.
589
590 .. versionchanged:: 2.5
591 *func* was added.
592
593 .. method:: getMessage()
594
595 Returns the message for this :class:`LogRecord` instance after merging any
596 user-supplied arguments with the message. If the user-supplied message
597 argument to the logging call is not a string, :func:`str` is called on it to
598 convert it to a string. This allows use of user-defined classes as
599 messages, whose ``__str__`` method can return the actual format string to
600 be used.
601
602
603.. _logrecord-attributes:
604
605LogRecord attributes
606--------------------
607
608The LogRecord has a number of attributes, most of which are derived from the
609parameters to the constructor. (Note that the names do not always correspond
610exactly between the LogRecord constructor parameters and the LogRecord
611attributes.) These attributes can be used to merge data from the record into
612the format string. The following table lists (in alphabetical order) the
613attribute names, their meanings and the corresponding placeholder in a %-style
614format string.
615
616+----------------+-------------------------+-----------------------------------------------+
617| Attribute name | Format | Description |
618+================+=========================+===============================================+
619| args | You shouldn't need to | The tuple of arguments merged into ``msg`` to |
620| | format this yourself. | produce ``message``. |
621+----------------+-------------------------+-----------------------------------------------+
622| asctime | ``%(asctime)s`` | Human-readable time when the |
623| | | :class:`LogRecord` was created. By default |
624| | | this is of the form '2003-07-08 16:49:45,896' |
625| | | (the numbers after the comma are millisecond |
626| | | portion of the time). |
627+----------------+-------------------------+-----------------------------------------------+
628| created | ``%(created)f`` | Time when the :class:`LogRecord` was created |
629| | | (as returned by :func:`time.time`). |
630+----------------+-------------------------+-----------------------------------------------+
631| exc_info | You shouldn't need to | Exception tuple (à la ``sys.exc_info``) or, |
632| | format this yourself. | if no exception has occurred, *None*. |
633+----------------+-------------------------+-----------------------------------------------+
634| filename | ``%(filename)s`` | Filename portion of ``pathname``. |
635+----------------+-------------------------+-----------------------------------------------+
636| funcName | ``%(funcName)s`` | Name of function containing the logging call. |
637+----------------+-------------------------+-----------------------------------------------+
638| levelname | ``%(levelname)s`` | Text logging level for the message |
639| | | (``'DEBUG'``, ``'INFO'``, ``'WARNING'``, |
640| | | ``'ERROR'``, ``'CRITICAL'``). |
641+----------------+-------------------------+-----------------------------------------------+
642| levelno | ``%(levelno)s`` | Numeric logging level for the message |
643| | | (:const:`DEBUG`, :const:`INFO`, |
644| | | :const:`WARNING`, :const:`ERROR`, |
645| | | :const:`CRITICAL`). |
646+----------------+-------------------------+-----------------------------------------------+
647| lineno | ``%(lineno)d`` | Source line number where the logging call was |
648| | | issued (if available). |
649+----------------+-------------------------+-----------------------------------------------+
650| module | ``%(module)s`` | Module (name portion of ``filename``). |
651+----------------+-------------------------+-----------------------------------------------+
652| msecs | ``%(msecs)d`` | Millisecond portion of the time when the |
653| | | :class:`LogRecord` was created. |
654+----------------+-------------------------+-----------------------------------------------+
655| message | ``%(message)s`` | The logged message, computed as ``msg % |
656| | | args``. This is set when |
657| | | :meth:`Formatter.format` is invoked. |
658+----------------+-------------------------+-----------------------------------------------+
659| msg | You shouldn't need to | The format string passed in the original |
660| | format this yourself. | logging call. Merged with ``args`` to |
661| | | produce ``message``, or an arbitrary object |
662| | | (see :ref:`arbitrary-object-messages`). |
663+----------------+-------------------------+-----------------------------------------------+
664| name | ``%(name)s`` | Name of the logger used to log the call. |
665+----------------+-------------------------+-----------------------------------------------+
666| pathname | ``%(pathname)s`` | Full pathname of the source file where the |
667| | | logging call was issued (if available). |
668+----------------+-------------------------+-----------------------------------------------+
669| process | ``%(process)d`` | Process ID (if available). |
670+----------------+-------------------------+-----------------------------------------------+
671| processName | ``%(processName)s`` | Process name (if available). |
672+----------------+-------------------------+-----------------------------------------------+
673| relativeCreated| ``%(relativeCreated)d`` | Time in milliseconds when the LogRecord was |
674| | | created, relative to the time the logging |
675| | | module was loaded. |
676+----------------+-------------------------+-----------------------------------------------+
677| thread | ``%(thread)d`` | Thread ID (if available). |
678+----------------+-------------------------+-----------------------------------------------+
679| threadName | ``%(threadName)s`` | Thread name (if available). |
680+----------------+-------------------------+-----------------------------------------------+
681
682.. versionchanged:: 2.5
683 *funcName* was added.
684
Vinay Sajipbee739b2012-07-20 09:48:46 +0100685.. versionchanged:: 2.6
686 *processName* was added.
687
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100688.. _logger-adapter:
689
690LoggerAdapter Objects
691---------------------
692
693:class:`LoggerAdapter` instances are used to conveniently pass contextual
694information into logging calls. For a usage example , see the section on
695:ref:`adding contextual information to your logging output <context-info>`.
696
697.. versionadded:: 2.6
698
699
700.. class:: LoggerAdapter(logger, extra)
701
702 Returns an instance of :class:`LoggerAdapter` initialized with an
703 underlying :class:`Logger` instance and a dict-like object.
704
705 .. method:: process(msg, kwargs)
706
707 Modifies the message and/or keyword arguments passed to a logging call in
708 order to insert contextual information. This implementation takes the object
709 passed as *extra* to the constructor and adds it to *kwargs* using key
710 'extra'. The return value is a (*msg*, *kwargs*) tuple which has the
711 (possibly modified) versions of the arguments passed in.
712
713In addition to the above, :class:`LoggerAdapter` supports the following
Vinay Sajip41e9b402013-10-31 01:08:59 +0000714methods of :class:`Logger`: :meth:`~Logger.debug`, :meth:`~Logger.info`,
715:meth:`~Logger.warning`, :meth:`~Logger.error`, :meth:`~Logger.exception`,
716:meth:`~Logger.critical`, :meth:`~Logger.log` and :meth:`~Logger.isEnabledFor`.
717These methods have the same signatures as their counterparts in :class:`Logger`,
718so you can use the two types of instances interchangeably for these calls.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100719
720.. versionchanged:: 2.7
Vinay Sajip41e9b402013-10-31 01:08:59 +0000721 The :meth:`~Logger.isEnabledFor` method was added to :class:`LoggerAdapter`.
722 This method delegates to the underlying logger.
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100723
724
725Thread Safety
726-------------
727
728The logging module is intended to be thread-safe without any special work
729needing to be done by its clients. It achieves this though using threading
730locks; there is one lock to serialize access to the module's shared data, and
731each handler also creates a lock to serialize access to its underlying I/O.
732
733If you are implementing asynchronous signal handlers using the :mod:`signal`
734module, you may not be able to use logging from within such handlers. This is
735because lock implementations in the :mod:`threading` module are not always
736re-entrant, and so cannot be invoked from such signal handlers.
737
Georg Brandl8ec7f652007-08-15 14:28:01 +0000738
Vinay Sajipb5902e62009-01-15 22:48:13 +0000739Module-Level Functions
740----------------------
741
Georg Brandl8ec7f652007-08-15 14:28:01 +0000742In addition to the classes described above, there are a number of module- level
743functions.
744
745
746.. function:: getLogger([name])
747
748 Return a logger with the specified name or, if no name is specified, return a
749 logger which is the root logger of the hierarchy. If specified, the name is
750 typically a dot-separated hierarchical name like *"a"*, *"a.b"* or *"a.b.c.d"*.
751 Choice of these names is entirely up to the developer who is using logging.
752
753 All calls to this function with a given name return the same logger instance.
754 This means that logger instances never need to be passed between different parts
755 of an application.
756
757
758.. function:: getLoggerClass()
759
760 Return either the standard :class:`Logger` class, or the last class passed to
761 :func:`setLoggerClass`. This function may be called from within a new class
Vinay Sajip6afafc72013-11-15 20:54:15 +0000762 definition, to ensure that installing a customized :class:`Logger` class will
763 not undo customizations already applied by other code. For example::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000764
765 class MyLogger(logging.getLoggerClass()):
766 # ... override behaviour here
767
768
769.. function:: debug(msg[, *args[, **kwargs]])
770
771 Logs a message with level :const:`DEBUG` on the root logger. The *msg* is the
772 message format string, and the *args* are the arguments which are merged into
773 *msg* using the string formatting operator. (Note that this means that you can
774 use keywords in the format string, together with a single dictionary argument.)
775
776 There are two keyword arguments in *kwargs* which are inspected: *exc_info*
777 which, if it does not evaluate as false, causes exception information to be
778 added to the logging message. If an exception tuple (in the format returned by
779 :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info`
780 is called to get the exception information.
781
782 The other optional keyword argument is *extra* which can be used to pass a
783 dictionary which is used to populate the __dict__ of the LogRecord created for
784 the logging event with user-defined attributes. These custom attributes can then
785 be used as you like. For example, they could be incorporated into logged
786 messages. For example::
787
788 FORMAT = "%(asctime)-15s %(clientip)s %(user)-8s %(message)s"
789 logging.basicConfig(format=FORMAT)
790 d = {'clientip': '192.168.0.1', 'user': 'fbloggs'}
791 logging.warning("Protocol problem: %s", "connection reset", extra=d)
792
Vinay Sajipfe08e6f2010-09-11 10:25:28 +0000793 would print something like::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000794
795 2006-02-08 22:20:02,165 192.168.0.1 fbloggs Protocol problem: connection reset
796
797 The keys in the dictionary passed in *extra* should not clash with the keys used
798 by the logging system. (See the :class:`Formatter` documentation for more
799 information on which keys are used by the logging system.)
800
801 If you choose to use these attributes in logged messages, you need to exercise
802 some care. In the above example, for instance, the :class:`Formatter` has been
803 set up with a format string which expects 'clientip' and 'user' in the attribute
804 dictionary of the LogRecord. If these are missing, the message will not be
805 logged because a string formatting exception will occur. So in this case, you
806 always need to pass the *extra* dictionary with these keys.
807
808 While this might be annoying, this feature is intended for use in specialized
809 circumstances, such as multi-threaded servers where the same code executes in
810 many contexts, and interesting conditions which arise are dependent on this
811 context (such as remote client IP address and authenticated user name, in the
812 above example). In such circumstances, it is likely that specialized
813 :class:`Formatter`\ s would be used with particular :class:`Handler`\ s.
814
815 .. versionchanged:: 2.5
816 *extra* was added.
817
818
819.. function:: info(msg[, *args[, **kwargs]])
820
821 Logs a message with level :const:`INFO` on the root logger. The arguments are
822 interpreted as for :func:`debug`.
823
824
825.. function:: warning(msg[, *args[, **kwargs]])
826
827 Logs a message with level :const:`WARNING` on the root logger. The arguments are
828 interpreted as for :func:`debug`.
829
830
831.. function:: error(msg[, *args[, **kwargs]])
832
833 Logs a message with level :const:`ERROR` on the root logger. The arguments are
834 interpreted as for :func:`debug`.
835
836
837.. function:: critical(msg[, *args[, **kwargs]])
838
839 Logs a message with level :const:`CRITICAL` on the root logger. The arguments
840 are interpreted as for :func:`debug`.
841
842
843.. function:: exception(msg[, *args])
844
845 Logs a message with level :const:`ERROR` on the root logger. The arguments are
846 interpreted as for :func:`debug`. Exception info is added to the logging
847 message. This function should only be called from an exception handler.
848
849
850.. function:: log(level, msg[, *args[, **kwargs]])
851
852 Logs a message with level *level* on the root logger. The other arguments are
853 interpreted as for :func:`debug`.
854
Vinay Sajip3a5fc4b2013-01-08 11:18:42 +0000855 .. note:: The above module-level functions which delegate to the root
856 logger should *not* be used in threads, in versions of Python earlier
857 than 2.7.1 and 3.2, unless at least one handler has been added to the
858 root logger *before* the threads are started. These convenience functions
859 call :func:`basicConfig` to ensure that at least one handler is
860 available; in earlier versions of Python, this can (under rare
861 circumstances) lead to handlers being added multiple times to the root
862 logger, which can in turn lead to multiple messages for the same event.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000863
864.. function:: disable(lvl)
865
866 Provides an overriding level *lvl* for all loggers which takes precedence over
867 the logger's own level. When the need arises to temporarily throttle logging
Vinay Sajip2060e422010-03-17 15:05:57 +0000868 output down across the whole application, this function can be useful. Its
869 effect is to disable all logging calls of severity *lvl* and below, so that
870 if you call it with a value of INFO, then all INFO and DEBUG events would be
871 discarded, whereas those of severity WARNING and above would be processed
Vinay Sajipe9cb5e92013-11-30 22:43:13 +0000872 according to the logger's effective level. If
873 ``logging.disable(logging.NOTSET)`` is called, it effectively removes this
874 overriding level, so that logging output again depends on the effective
875 levels of individual loggers.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000876
877
878.. function:: addLevelName(lvl, levelName)
879
880 Associates level *lvl* with text *levelName* in an internal dictionary, which is
881 used to map numeric levels to a textual representation, for example when a
882 :class:`Formatter` formats a message. This function can also be used to define
883 your own levels. The only constraints are that all levels used must be
884 registered using this function, levels should be positive integers and they
885 should increase in increasing order of severity.
886
Vinay Sajip3a5fc4b2013-01-08 11:18:42 +0000887 .. note:: If you are thinking of defining your own levels, please see the
888 section on :ref:`custom-levels`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000889
890.. function:: getLevelName(lvl)
891
892 Returns the textual representation of logging level *lvl*. If the level is one
893 of the predefined levels :const:`CRITICAL`, :const:`ERROR`, :const:`WARNING`,
894 :const:`INFO` or :const:`DEBUG` then you get the corresponding string. If you
895 have associated levels with names using :func:`addLevelName` then the name you
896 have associated with *lvl* is returned. If a numeric value corresponding to one
897 of the defined levels is passed in, the corresponding string representation is
898 returned. Otherwise, the string "Level %s" % lvl is returned.
899
900
901.. function:: makeLogRecord(attrdict)
902
903 Creates and returns a new :class:`LogRecord` instance whose attributes are
904 defined by *attrdict*. This function is useful for taking a pickled
905 :class:`LogRecord` attribute dictionary, sent over a socket, and reconstituting
906 it as a :class:`LogRecord` instance at the receiving end.
907
908
909.. function:: basicConfig([**kwargs])
910
911 Does basic configuration for the logging system by creating a
912 :class:`StreamHandler` with a default :class:`Formatter` and adding it to the
Vinay Sajip1c77b7f2009-10-10 20:32:36 +0000913 root logger. The functions :func:`debug`, :func:`info`, :func:`warning`,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000914 :func:`error` and :func:`critical` will call :func:`basicConfig` automatically
915 if no handlers are defined for the root logger.
916
Vinay Sajip1c77b7f2009-10-10 20:32:36 +0000917 This function does nothing if the root logger already has handlers
918 configured for it.
Georg Brandldfb5bbd2008-05-09 06:18:27 +0000919
Georg Brandl8ec7f652007-08-15 14:28:01 +0000920 .. versionchanged:: 2.4
921 Formerly, :func:`basicConfig` did not take any keyword arguments.
922
Vinay Sajip3a5fc4b2013-01-08 11:18:42 +0000923 .. note:: This function should be called from the main thread before other
924 threads are started. In versions of Python prior to 2.7.1 and 3.2, if
925 this function is called from multiple threads, it is possible (in rare
926 circumstances) that a handler will be added to the root logger more than
927 once, leading to unexpected results such as messages being duplicated in
928 the log.
Vinay Sajip89e1ae22010-09-17 10:09:04 +0000929
Georg Brandl8ec7f652007-08-15 14:28:01 +0000930 The following keyword arguments are supported.
931
Georg Brandl44ea77b2013-03-28 13:28:44 +0100932 .. tabularcolumns:: |l|L|
933
Georg Brandl8ec7f652007-08-15 14:28:01 +0000934 +--------------+---------------------------------------------+
935 | Format | Description |
936 +==============+=============================================+
937 | ``filename`` | Specifies that a FileHandler be created, |
938 | | using the specified filename, rather than a |
939 | | StreamHandler. |
940 +--------------+---------------------------------------------+
941 | ``filemode`` | Specifies the mode to open the file, if |
942 | | filename is specified (if filemode is |
943 | | unspecified, it defaults to 'a'). |
944 +--------------+---------------------------------------------+
945 | ``format`` | Use the specified format string for the |
946 | | handler. |
947 +--------------+---------------------------------------------+
948 | ``datefmt`` | Use the specified date/time format. |
949 +--------------+---------------------------------------------+
950 | ``level`` | Set the root logger level to the specified |
951 | | level. |
952 +--------------+---------------------------------------------+
953 | ``stream`` | Use the specified stream to initialize the |
954 | | StreamHandler. Note that this argument is |
955 | | incompatible with 'filename' - if both are |
956 | | present, 'stream' is ignored. |
957 +--------------+---------------------------------------------+
958
959
960.. function:: shutdown()
961
962 Informs the logging system to perform an orderly shutdown by flushing and
Vinay Sajip91f0ee42008-03-16 21:35:58 +0000963 closing all handlers. This should be called at application exit and no
964 further use of the logging system should be made after this call.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000965
966
967.. function:: setLoggerClass(klass)
968
969 Tells the logging system to use the class *klass* when instantiating a logger.
970 The class should define :meth:`__init__` such that only a name argument is
971 required, and the :meth:`__init__` should call :meth:`Logger.__init__`. This
972 function is typically called before any loggers are instantiated by applications
973 which need to use custom logger behavior.
974
975
Vinay Sajip61afd262010-02-19 23:53:17 +0000976Integration with the warnings module
977------------------------------------
978
979The :func:`captureWarnings` function can be used to integrate :mod:`logging`
980with the :mod:`warnings` module.
981
982.. function:: captureWarnings(capture)
983
984 This function is used to turn the capture of warnings by logging on and
985 off.
986
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100987 If *capture* is ``True``, warnings issued by the :mod:`warnings` module will
988 be redirected to the logging system. Specifically, a warning will be
Vinay Sajip61afd262010-02-19 23:53:17 +0000989 formatted using :func:`warnings.formatwarning` and the resulting string
Éric Araujoa318a3b2012-02-26 01:36:31 +0100990 logged to a logger named ``'py.warnings'`` with a severity of :const:`WARNING`.
Vinay Sajip61afd262010-02-19 23:53:17 +0000991
Georg Brandlf6d367452010-03-12 10:02:03 +0000992 If *capture* is ``False``, the redirection of warnings to the logging system
Vinay Sajip61afd262010-02-19 23:53:17 +0000993 will stop, and warnings will be redirected to their original destinations
Éric Araujoa318a3b2012-02-26 01:36:31 +0100994 (i.e. those in effect before ``captureWarnings(True)`` was called).
Vinay Sajip61afd262010-02-19 23:53:17 +0000995
Georg Brandl8ec7f652007-08-15 14:28:01 +0000996
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100997.. seealso::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000998
Vinay Sajip5dbca9c2011-04-08 11:40:38 +0100999 Module :mod:`logging.config`
1000 Configuration API for the logging module.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001001
Vinay Sajip5dbca9c2011-04-08 11:40:38 +01001002 Module :mod:`logging.handlers`
1003 Useful handlers included with the logging module.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001004
Vinay Sajip5dbca9c2011-04-08 11:40:38 +01001005 :pep:`282` - A Logging System
1006 The proposal which described this feature for inclusion in the Python standard
1007 library.
Georg Brandl8ec7f652007-08-15 14:28:01 +00001008
Vinay Sajip5dbca9c2011-04-08 11:40:38 +01001009 `Original Python logging package <http://www.red-dove.com/python_logging.html>`_
1010 This is the original source for the :mod:`logging` package. The version of the
1011 package available from this site is suitable for use with Python 1.5.2, 2.1.x
1012 and 2.2.x, which do not include the :mod:`logging` package in the standard
1013 library.
Georg Brandlc37f2882007-12-04 17:46:27 +00001014