Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1 | :mod:`logging` --- Logging facility for Python |
| 2 | ============================================== |
| 3 | |
| 4 | .. module:: logging |
Vinay Sajip | 1d5d685 | 2010-12-12 22:47:13 +0000 | [diff] [blame] | 5 | :synopsis: Flexible event logging system for applications. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 6 | |
| 7 | |
| 8 | .. moduleauthor:: Vinay Sajip <vinay_sajip@red-dove.com> |
| 9 | .. sectionauthor:: Vinay Sajip <vinay_sajip@red-dove.com> |
| 10 | |
| 11 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 12 | .. index:: pair: Errors; logging |
| 13 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 14 | .. sidebar:: Important |
| 15 | |
| 16 | The tutorials have been moved to the HOWTO section: |
| 17 | |
| 18 | * :ref:`Basic Tutorial <logging-basic-tutorial>` |
| 19 | * :ref:`Advanced Tutorial <logging-advanced-tutorial>` |
| 20 | * :ref:`Logging Cookbook <logging-cookbook>` |
| 21 | |
| 22 | |
| 23 | |
Vinay Sajip | 1d5d685 | 2010-12-12 22:47:13 +0000 | [diff] [blame] | 24 | This module defines functions and classes which implement a flexible event |
Vinay Sajip | 36675b6 | 2010-12-12 22:30:17 +0000 | [diff] [blame] | 25 | logging system for applications and libraries. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 26 | |
Vinay Sajip | a18b959 | 2010-12-12 13:20:55 +0000 | [diff] [blame] | 27 | The key benefit of having the logging API provided by a standard library module |
| 28 | is that all Python modules can participate in logging, so your application log |
| 29 | can include your own messages integrated with messages from third-party |
| 30 | modules. |
| 31 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 32 | The module provides a lot of functionality and flexibility. If you are |
| 33 | unfamiliar with logging, the best way to get to grips with it is to see the |
| 34 | tutorials (see the links on the right). This page contains the API reference |
| 35 | information. |
Vinay Sajip | a18b959 | 2010-12-12 13:20:55 +0000 | [diff] [blame] | 36 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 37 | The basic classes defined by the module, together with their functions, are |
| 38 | listed below. |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 39 | |
| 40 | * Loggers expose the interface that application code directly uses. |
| 41 | * Handlers send the log records (created by loggers) to the appropriate |
| 42 | destination. |
| 43 | * Filters provide a finer grained facility for determining which log records |
| 44 | to output. |
| 45 | * Formatters specify the layout of log records in the final output. |
Vinay Sajip | a18b959 | 2010-12-12 13:20:55 +0000 | [diff] [blame] | 46 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 47 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 48 | .. _logger: |
Vinay Sajip | 5286ccf | 2010-12-12 13:25:29 +0000 | [diff] [blame] | 49 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 50 | Logger Objects |
Christian Heimes | 8b0facf | 2007-12-04 19:30:01 +0000 | [diff] [blame] | 51 | -------------- |
| 52 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 53 | Loggers have the following attributes and methods. Note that Loggers are never |
| 54 | instantiated directly, but always through the module-level function |
| 55 | ``logging.getLogger(name)``. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 56 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 57 | .. class:: Logger |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 58 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 59 | .. attribute:: Logger.propagate |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 60 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 61 | If this evaluates to false, logging messages are not passed by this logger or by |
| 62 | its child loggers to the handlers of higher level (ancestor) loggers. The |
| 63 | constructor sets this attribute to 1. |
Vinay Sajip | c8c8c69 | 2010-09-17 10:09:04 +0000 | [diff] [blame] | 64 | |
| 65 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 66 | .. method:: Logger.setLevel(lvl) |
Vinay Sajip | f234eb9 | 2010-12-12 17:37:27 +0000 | [diff] [blame] | 67 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 68 | Sets the threshold for this logger to *lvl*. Logging messages which are less |
| 69 | severe than *lvl* will be ignored. When a logger is created, the level is set to |
| 70 | :const:`NOTSET` (which causes all messages to be processed when the logger is |
| 71 | the root logger, or delegation to the parent when the logger is a non-root |
| 72 | logger). Note that the root logger is created with level :const:`WARNING`. |
| 73 | |
| 74 | The term 'delegation to the parent' means that if a logger has a level of |
| 75 | NOTSET, its chain of ancestor loggers is traversed until either an ancestor with |
| 76 | a level other than NOTSET is found, or the root is reached. |
| 77 | |
| 78 | If an ancestor is found with a level other than NOTSET, then that ancestor's |
| 79 | level is treated as the effective level of the logger where the ancestor search |
| 80 | began, and is used to determine how a logging event is handled. |
| 81 | |
| 82 | If the root is reached, and it has a level of NOTSET, then all messages will be |
| 83 | processed. Otherwise, the root's level will be used as the effective level. |
| 84 | |
| 85 | |
| 86 | .. method:: Logger.isEnabledFor(lvl) |
| 87 | |
| 88 | Indicates if a message of severity *lvl* would be processed by this logger. |
| 89 | This method checks first the module-level level set by |
| 90 | ``logging.disable(lvl)`` and then the logger's effective level as determined |
| 91 | by :meth:`getEffectiveLevel`. |
| 92 | |
| 93 | |
| 94 | .. method:: Logger.getEffectiveLevel() |
| 95 | |
| 96 | Indicates the effective level for this logger. If a value other than |
| 97 | :const:`NOTSET` has been set using :meth:`setLevel`, it is returned. Otherwise, |
| 98 | the hierarchy is traversed towards the root until a value other than |
| 99 | :const:`NOTSET` is found, and that value is returned. |
| 100 | |
| 101 | |
| 102 | .. method:: Logger.getChild(suffix) |
| 103 | |
| 104 | Returns a logger which is a descendant to this logger, as determined by the suffix. |
| 105 | Thus, ``logging.getLogger('abc').getChild('def.ghi')`` would return the same |
| 106 | logger as would be returned by ``logging.getLogger('abc.def.ghi')``. This is a |
| 107 | convenience method, useful when the parent logger is named using e.g. ``__name__`` |
| 108 | rather than a literal string. |
| 109 | |
| 110 | .. versionadded:: 3.2 |
| 111 | |
| 112 | |
| 113 | .. method:: Logger.debug(msg, *args, **kwargs) |
| 114 | |
| 115 | Logs a message with level :const:`DEBUG` on this logger. The *msg* is the |
| 116 | message format string, and the *args* are the arguments which are merged into |
| 117 | *msg* using the string formatting operator. (Note that this means that you can |
| 118 | use keywords in the format string, together with a single dictionary argument.) |
| 119 | |
| 120 | There are three keyword arguments in *kwargs* which are inspected: *exc_info* |
| 121 | which, if it does not evaluate as false, causes exception information to be |
| 122 | added to the logging message. If an exception tuple (in the format returned by |
| 123 | :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info` |
| 124 | is called to get the exception information. |
| 125 | |
| 126 | The second optional keyword argument is *stack_info*, which defaults to |
| 127 | False. If specified as True, stack information is added to the logging |
| 128 | message, including the actual logging call. Note that this is not the same |
| 129 | stack information as that displayed through specifying *exc_info*: The |
| 130 | former is stack frames from the bottom of the stack up to the logging call |
| 131 | in the current thread, whereas the latter is information about stack frames |
| 132 | which have been unwound, following an exception, while searching for |
| 133 | exception handlers. |
| 134 | |
| 135 | You can specify *stack_info* independently of *exc_info*, e.g. to just show |
| 136 | how you got to a certain point in your code, even when no exceptions were |
| 137 | raised. The stack frames are printed following a header line which says:: |
| 138 | |
| 139 | Stack (most recent call last): |
| 140 | |
| 141 | This mimics the `Traceback (most recent call last):` which is used when |
| 142 | displaying exception frames. |
| 143 | |
| 144 | The third keyword argument is *extra* which can be used to pass a |
| 145 | dictionary which is used to populate the __dict__ of the LogRecord created for |
| 146 | the logging event with user-defined attributes. These custom attributes can then |
| 147 | be used as you like. For example, they could be incorporated into logged |
| 148 | messages. For example:: |
| 149 | |
| 150 | FORMAT = '%(asctime)-15s %(clientip)s %(user)-8s %(message)s' |
| 151 | logging.basicConfig(format=FORMAT) |
| 152 | d = { 'clientip' : '192.168.0.1', 'user' : 'fbloggs' } |
| 153 | logger = logging.getLogger('tcpserver') |
| 154 | logger.warning('Protocol problem: %s', 'connection reset', extra=d) |
| 155 | |
| 156 | would print something like :: |
| 157 | |
| 158 | 2006-02-08 22:20:02,165 192.168.0.1 fbloggs Protocol problem: connection reset |
| 159 | |
| 160 | The keys in the dictionary passed in *extra* should not clash with the keys used |
| 161 | by the logging system. (See the :class:`Formatter` documentation for more |
| 162 | information on which keys are used by the logging system.) |
| 163 | |
| 164 | If you choose to use these attributes in logged messages, you need to exercise |
| 165 | some care. In the above example, for instance, the :class:`Formatter` has been |
| 166 | set up with a format string which expects 'clientip' and 'user' in the attribute |
| 167 | dictionary of the LogRecord. If these are missing, the message will not be |
| 168 | logged because a string formatting exception will occur. So in this case, you |
| 169 | always need to pass the *extra* dictionary with these keys. |
| 170 | |
| 171 | While this might be annoying, this feature is intended for use in specialized |
| 172 | circumstances, such as multi-threaded servers where the same code executes in |
| 173 | many contexts, and interesting conditions which arise are dependent on this |
| 174 | context (such as remote client IP address and authenticated user name, in the |
| 175 | above example). In such circumstances, it is likely that specialized |
| 176 | :class:`Formatter`\ s would be used with particular :class:`Handler`\ s. |
| 177 | |
| 178 | .. versionadded:: 3.2 |
| 179 | The *stack_info* parameter was added. |
| 180 | |
| 181 | |
| 182 | .. method:: Logger.info(msg, *args, **kwargs) |
| 183 | |
| 184 | Logs a message with level :const:`INFO` on this logger. The arguments are |
| 185 | interpreted as for :meth:`debug`. |
| 186 | |
| 187 | |
| 188 | .. method:: Logger.warning(msg, *args, **kwargs) |
| 189 | |
| 190 | Logs a message with level :const:`WARNING` on this logger. The arguments are |
| 191 | interpreted as for :meth:`debug`. |
| 192 | |
| 193 | |
| 194 | .. method:: Logger.error(msg, *args, **kwargs) |
| 195 | |
| 196 | Logs a message with level :const:`ERROR` on this logger. The arguments are |
| 197 | interpreted as for :meth:`debug`. |
| 198 | |
| 199 | |
| 200 | .. method:: Logger.critical(msg, *args, **kwargs) |
| 201 | |
| 202 | Logs a message with level :const:`CRITICAL` on this logger. The arguments are |
| 203 | interpreted as for :meth:`debug`. |
| 204 | |
| 205 | |
| 206 | .. method:: Logger.log(lvl, msg, *args, **kwargs) |
| 207 | |
| 208 | Logs a message with integer level *lvl* on this logger. The other arguments are |
| 209 | interpreted as for :meth:`debug`. |
| 210 | |
| 211 | |
| 212 | .. method:: Logger.exception(msg, *args) |
| 213 | |
| 214 | Logs a message with level :const:`ERROR` on this logger. The arguments are |
| 215 | interpreted as for :meth:`debug`. Exception info is added to the logging |
| 216 | message. This method should only be called from an exception handler. |
| 217 | |
| 218 | |
| 219 | .. method:: Logger.addFilter(filt) |
| 220 | |
| 221 | Adds the specified filter *filt* to this logger. |
| 222 | |
| 223 | |
| 224 | .. method:: Logger.removeFilter(filt) |
| 225 | |
| 226 | Removes the specified filter *filt* from this logger. |
| 227 | |
| 228 | |
| 229 | .. method:: Logger.filter(record) |
| 230 | |
| 231 | Applies this logger's filters to the record and returns a true value if the |
| 232 | record is to be processed. |
| 233 | |
| 234 | |
| 235 | .. method:: Logger.addHandler(hdlr) |
| 236 | |
| 237 | Adds the specified handler *hdlr* to this logger. |
| 238 | |
| 239 | |
| 240 | .. method:: Logger.removeHandler(hdlr) |
| 241 | |
| 242 | Removes the specified handler *hdlr* from this logger. |
| 243 | |
| 244 | |
| 245 | .. method:: Logger.findCaller(stack_info=False) |
| 246 | |
| 247 | Finds the caller's source filename and line number. Returns the filename, line |
| 248 | number, function name and stack information as a 4-element tuple. The stack |
| 249 | information is returned as *None* unless *stack_info* is *True*. |
| 250 | |
| 251 | |
| 252 | .. method:: Logger.handle(record) |
| 253 | |
| 254 | Handles a record by passing it to all handlers associated with this logger and |
| 255 | its ancestors (until a false value of *propagate* is found). This method is used |
| 256 | for unpickled records received from a socket, as well as those created locally. |
| 257 | Logger-level filtering is applied using :meth:`~Logger.filter`. |
| 258 | |
| 259 | |
| 260 | .. method:: Logger.makeRecord(name, lvl, fn, lno, msg, args, exc_info, func=None, extra=None, sinfo=None) |
| 261 | |
| 262 | This is a factory method which can be overridden in subclasses to create |
| 263 | specialized :class:`LogRecord` instances. |
| 264 | |
| 265 | .. method:: Logger.hasHandlers() |
| 266 | |
| 267 | Checks to see if this logger has any handlers configured. This is done by |
| 268 | looking for handlers in this logger and its parents in the logger hierarchy. |
| 269 | Returns True if a handler was found, else False. The method stops searching |
| 270 | up the hierarchy whenever a logger with the 'propagate' attribute set to |
| 271 | False is found - that will be the last logger which is checked for the |
| 272 | existence of handlers. |
| 273 | |
| 274 | .. versionadded:: 3.2 |
| 275 | |
| 276 | |
| 277 | .. _handler: |
| 278 | |
| 279 | Handler Objects |
Benjamin Peterson | 058e31e | 2009-01-16 03:54:08 +0000 | [diff] [blame] | 280 | --------------- |
| 281 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 282 | Handlers have the following attributes and methods. Note that :class:`Handler` |
| 283 | is never instantiated directly; this class acts as a base for more useful |
| 284 | subclasses. However, the :meth:`__init__` method in subclasses needs to call |
| 285 | :meth:`Handler.__init__`. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 286 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 287 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 288 | .. method:: Handler.__init__(level=NOTSET) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 289 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 290 | Initializes the :class:`Handler` instance by setting its level, setting the list |
| 291 | of filters to the empty list and creating a lock (using :meth:`createLock`) for |
| 292 | serializing access to an I/O mechanism. |
Vinay Sajip | 30bf122 | 2009-01-10 19:23:34 +0000 | [diff] [blame] | 293 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 294 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 295 | .. method:: Handler.createLock() |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 296 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 297 | Initializes a thread lock which can be used to serialize access to underlying |
| 298 | I/O functionality which may not be threadsafe. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 299 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 300 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 301 | .. method:: Handler.acquire() |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 302 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 303 | Acquires the thread lock created with :meth:`createLock`. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 304 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 305 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 306 | .. method:: Handler.release() |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 307 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 308 | Releases the thread lock acquired with :meth:`acquire`. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 309 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 310 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 311 | .. method:: Handler.setLevel(lvl) |
Vinay Sajip | 30bf122 | 2009-01-10 19:23:34 +0000 | [diff] [blame] | 312 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 313 | Sets the threshold for this handler to *lvl*. Logging messages which are less |
| 314 | severe than *lvl* will be ignored. When a handler is created, the level is set |
| 315 | to :const:`NOTSET` (which causes all messages to be processed). |
| 316 | |
| 317 | |
| 318 | .. method:: Handler.setFormatter(form) |
| 319 | |
| 320 | Sets the :class:`Formatter` for this handler to *form*. |
| 321 | |
| 322 | |
| 323 | .. method:: Handler.addFilter(filt) |
| 324 | |
| 325 | Adds the specified filter *filt* to this handler. |
| 326 | |
| 327 | |
| 328 | .. method:: Handler.removeFilter(filt) |
| 329 | |
| 330 | Removes the specified filter *filt* from this handler. |
| 331 | |
| 332 | |
| 333 | .. method:: Handler.filter(record) |
| 334 | |
| 335 | Applies this handler's filters to the record and returns a true value if the |
| 336 | record is to be processed. |
| 337 | |
| 338 | |
| 339 | .. method:: Handler.flush() |
| 340 | |
| 341 | Ensure all logging output has been flushed. This version does nothing and is |
| 342 | intended to be implemented by subclasses. |
| 343 | |
| 344 | |
| 345 | .. method:: Handler.close() |
| 346 | |
| 347 | Tidy up any resources used by the handler. This version does no output but |
| 348 | removes the handler from an internal list of handlers which is closed when |
| 349 | :func:`shutdown` is called. Subclasses should ensure that this gets called |
| 350 | from overridden :meth:`close` methods. |
| 351 | |
| 352 | |
| 353 | .. method:: Handler.handle(record) |
| 354 | |
| 355 | Conditionally emits the specified logging record, depending on filters which may |
| 356 | have been added to the handler. Wraps the actual emission of the record with |
| 357 | acquisition/release of the I/O thread lock. |
| 358 | |
| 359 | |
| 360 | .. method:: Handler.handleError(record) |
| 361 | |
| 362 | This method should be called from handlers when an exception is encountered |
| 363 | during an :meth:`emit` call. By default it does nothing, which means that |
| 364 | exceptions get silently ignored. This is what is mostly wanted for a logging |
| 365 | system - most users will not care about errors in the logging system, they are |
| 366 | more interested in application errors. You could, however, replace this with a |
| 367 | custom handler if you wish. The specified record is the one which was being |
| 368 | processed when the exception occurred. |
| 369 | |
| 370 | |
| 371 | .. method:: Handler.format(record) |
| 372 | |
| 373 | Do formatting for a record - if a formatter is set, use it. Otherwise, use the |
| 374 | default formatter for the module. |
| 375 | |
| 376 | |
| 377 | .. method:: Handler.emit(record) |
| 378 | |
| 379 | Do whatever it takes to actually log the specified logging record. This version |
| 380 | is intended to be implemented by subclasses and so raises a |
| 381 | :exc:`NotImplementedError`. |
| 382 | |
| 383 | For a list of handlers included as standard, see :mod:`logging.handlers`. |
| 384 | |
| 385 | .. _formatter-objects: |
| 386 | |
| 387 | Formatter Objects |
| 388 | ----------------- |
Vinay Sajip | 121a1c4 | 2010-09-08 10:46:15 +0000 | [diff] [blame] | 389 | |
Vinay Sajip | 30bf122 | 2009-01-10 19:23:34 +0000 | [diff] [blame] | 390 | .. currentmodule:: logging |
| 391 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 392 | :class:`Formatter` objects have the following attributes and methods. They are |
| 393 | responsible for converting a :class:`LogRecord` to (usually) a string which can |
| 394 | be interpreted by either a human or an external system. The base |
| 395 | :class:`Formatter` allows a formatting string to be specified. If none is |
| 396 | supplied, the default value of ``'%(message)s'`` is used. |
Georg Brandl | f973407 | 2008-12-07 15:30:06 +0000 | [diff] [blame] | 397 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 398 | A Formatter can be initialized with a format string which makes use of knowledge |
| 399 | of the :class:`LogRecord` attributes - such as the default value mentioned above |
| 400 | making use of the fact that the user's message and arguments are pre-formatted |
| 401 | into a :class:`LogRecord`'s *message* attribute. This format string contains |
| 402 | standard Python %-style mapping keys. See section :ref:`old-string-formatting` |
| 403 | for more information on string formatting. |
Georg Brandl | f973407 | 2008-12-07 15:30:06 +0000 | [diff] [blame] | 404 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 405 | The useful mapping keys in a :class:`LogRecord` are given in the section on |
| 406 | :ref:`logrecord-attributes`. |
Vinay Sajip | 121a1c4 | 2010-09-08 10:46:15 +0000 | [diff] [blame] | 407 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 408 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 409 | .. class:: Formatter(fmt=None, datefmt=None) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 410 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 411 | Returns a new instance of the :class:`Formatter` class. The instance is |
| 412 | initialized with a format string for the message as a whole, as well as a |
| 413 | format string for the date/time portion of a message. If no *fmt* is |
| 414 | specified, ``'%(message)s'`` is used. If no *datefmt* is specified, the |
| 415 | ISO8601 date format is used. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 416 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 417 | .. method:: format(record) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 418 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 419 | The record's attribute dictionary is used as the operand to a string |
| 420 | formatting operation. Returns the resulting string. Before formatting the |
| 421 | dictionary, a couple of preparatory steps are carried out. The *message* |
| 422 | attribute of the record is computed using *msg* % *args*. If the |
| 423 | formatting string contains ``'(asctime)'``, :meth:`formatTime` is called |
| 424 | to format the event time. If there is exception information, it is |
| 425 | formatted using :meth:`formatException` and appended to the message. Note |
| 426 | that the formatted exception information is cached in attribute |
| 427 | *exc_text*. This is useful because the exception information can be |
| 428 | pickled and sent across the wire, but you should be careful if you have |
| 429 | more than one :class:`Formatter` subclass which customizes the formatting |
| 430 | of exception information. In this case, you will have to clear the cached |
| 431 | value after a formatter has done its formatting, so that the next |
| 432 | formatter to handle the event doesn't use the cached value but |
| 433 | recalculates it afresh. |
| 434 | |
| 435 | If stack information is available, it's appended after the exception |
| 436 | information, using :meth:`formatStack` to transform it if necessary. |
| 437 | |
| 438 | |
| 439 | .. method:: formatTime(record, datefmt=None) |
| 440 | |
| 441 | This method should be called from :meth:`format` by a formatter which |
| 442 | wants to make use of a formatted time. This method can be overridden in |
| 443 | formatters to provide for any specific requirement, but the basic behavior |
| 444 | is as follows: if *datefmt* (a string) is specified, it is used with |
| 445 | :func:`time.strftime` to format the creation time of the |
| 446 | record. Otherwise, the ISO8601 format is used. The resulting string is |
| 447 | returned. |
| 448 | |
| 449 | |
| 450 | .. method:: formatException(exc_info) |
| 451 | |
| 452 | Formats the specified exception information (a standard exception tuple as |
| 453 | returned by :func:`sys.exc_info`) as a string. This default implementation |
| 454 | just uses :func:`traceback.print_exception`. The resulting string is |
| 455 | returned. |
| 456 | |
| 457 | .. method:: formatStack(stack_info) |
| 458 | |
| 459 | Formats the specified stack information (a string as returned by |
| 460 | :func:`traceback.print_stack`, but with the last newline removed) as a |
| 461 | string. This default implementation just returns the input value. |
| 462 | |
| 463 | .. _filter: |
| 464 | |
| 465 | Filter Objects |
| 466 | -------------- |
| 467 | |
| 468 | ``Filters`` can be used by ``Handlers`` and ``Loggers`` for more sophisticated |
| 469 | filtering than is provided by levels. The base filter class only allows events |
| 470 | which are below a certain point in the logger hierarchy. For example, a filter |
| 471 | initialized with 'A.B' will allow events logged by loggers 'A.B', 'A.B.C', |
| 472 | 'A.B.C.D', 'A.B.D' etc. but not 'A.BB', 'B.A.B' etc. If initialized with the |
| 473 | empty string, all events are passed. |
| 474 | |
| 475 | |
| 476 | .. class:: Filter(name='') |
| 477 | |
| 478 | Returns an instance of the :class:`Filter` class. If *name* is specified, it |
| 479 | names a logger which, together with its children, will have its events allowed |
| 480 | through the filter. If *name* is the empty string, allows every event. |
| 481 | |
| 482 | |
| 483 | .. method:: filter(record) |
| 484 | |
| 485 | Is the specified record to be logged? Returns zero for no, nonzero for |
| 486 | yes. If deemed appropriate, the record may be modified in-place by this |
| 487 | method. |
| 488 | |
| 489 | Note that filters attached to handlers are consulted whenever an event is |
| 490 | emitted by the handler, whereas filters attached to loggers are consulted |
| 491 | whenever an event is logged to the handler (using :meth:`debug`, :meth:`info`, |
| 492 | etc.) This means that events which have been generated by descendant loggers |
| 493 | will not be filtered by a logger's filter setting, unless the filter has also |
| 494 | been applied to those descendant loggers. |
| 495 | |
| 496 | You don't actually need to subclass ``Filter``: you can pass any instance |
| 497 | which has a ``filter`` method with the same semantics. |
| 498 | |
| 499 | .. versionchanged:: 3.2 |
| 500 | You don't need to create specialized ``Filter`` classes, or use other |
| 501 | classes with a ``filter`` method: you can use a function (or other |
| 502 | callable) as a filter. The filtering logic will check to see if the filter |
| 503 | object has a ``filter`` attribute: if it does, it's assumed to be a |
| 504 | ``Filter`` and its :meth:`~Filter.filter` method is called. Otherwise, it's |
| 505 | assumed to be a callable and called with the record as the single |
| 506 | parameter. The returned value should conform to that returned by |
| 507 | :meth:`~Filter.filter`. |
| 508 | |
| 509 | Although filters are used primarily to filter records based on more |
| 510 | sophisticated criteria than levels, they get to see every record which is |
| 511 | processed by the handler or logger they're attached to: this can be useful if |
| 512 | you want to do things like counting how many records were processed by a |
| 513 | particular logger or handler, or adding, changing or removing attributes in |
| 514 | the LogRecord being processed. Obviously changing the LogRecord needs to be |
| 515 | done with some care, but it does allow the injection of contextual information |
| 516 | into logs (see :ref:`filters-contextual`). |
| 517 | |
| 518 | .. _log-record: |
| 519 | |
| 520 | LogRecord Objects |
| 521 | ----------------- |
| 522 | |
| 523 | :class:`LogRecord` instances are created automatically by the :class:`Logger` |
| 524 | every time something is logged, and can be created manually via |
| 525 | :func:`makeLogRecord` (for example, from a pickled event received over the |
| 526 | wire). |
| 527 | |
| 528 | |
| 529 | .. class:: LogRecord(name, level, pathname, lineno, msg, args, exc_info, func=None, sinfo=None) |
| 530 | |
| 531 | Contains all the information pertinent to the event being logged. |
| 532 | |
| 533 | The primary information is passed in :attr:`msg` and :attr:`args`, which |
| 534 | are combined using ``msg % args`` to create the :attr:`message` field of the |
| 535 | record. |
| 536 | |
| 537 | :param name: The name of the logger used to log the event represented by |
| 538 | this LogRecord. |
| 539 | :param level: The numeric level of the logging event (one of DEBUG, INFO etc.) |
| 540 | :param pathname: The full pathname of the source file where the logging call |
| 541 | was made. |
| 542 | :param lineno: The line number in the source file where the logging call was |
| 543 | made. |
| 544 | :param msg: The event description message, possibly a format string with |
| 545 | placeholders for variable data. |
| 546 | :param args: Variable data to merge into the *msg* argument to obtain the |
| 547 | event description. |
| 548 | :param exc_info: An exception tuple with the current exception information, |
| 549 | or *None* if no exception information is available. |
| 550 | :param func: The name of the function or method from which the logging call |
| 551 | was invoked. |
| 552 | :param sinfo: A text string representing stack information from the base of |
| 553 | the stack in the current thread, up to the logging call. |
| 554 | |
| 555 | .. method:: getMessage() |
| 556 | |
| 557 | Returns the message for this :class:`LogRecord` instance after merging any |
| 558 | user-supplied arguments with the message. If the user-supplied message |
| 559 | argument to the logging call is not a string, :func:`str` is called on it to |
| 560 | convert it to a string. This allows use of user-defined classes as |
| 561 | messages, whose ``__str__`` method can return the actual format string to |
| 562 | be used. |
| 563 | |
| 564 | .. versionchanged:: 3.2 |
| 565 | The creation of a ``LogRecord`` has been made more configurable by |
| 566 | providing a factory which is used to create the record. The factory can be |
| 567 | set using :func:`getLogRecordFactory` and :func:`setLogRecordFactory` |
| 568 | (see this for the factory's signature). |
| 569 | |
| 570 | This functionality can be used to inject your own values into a |
| 571 | LogRecord at creation time. You can use the following pattern:: |
| 572 | |
| 573 | old_factory = logging.getLogRecordFactory() |
| 574 | |
| 575 | def record_factory(*args, **kwargs): |
| 576 | record = old_factory(*args, **kwargs) |
| 577 | record.custom_attribute = 0xdecafbad |
| 578 | return record |
| 579 | |
| 580 | logging.setLogRecordFactory(record_factory) |
| 581 | |
| 582 | With this pattern, multiple factories could be chained, and as long |
| 583 | as they don't overwrite each other's attributes or unintentionally |
| 584 | overwrite the standard attributes listed above, there should be no |
| 585 | surprises. |
| 586 | |
| 587 | |
| 588 | .. _logrecord-attributes: |
| 589 | |
| 590 | LogRecord attributes |
| 591 | -------------------- |
| 592 | |
| 593 | The LogRecord has a number of attributes, most of which are derived from the |
| 594 | parameters to the constructor. (Note that the names do not always correspond |
| 595 | exactly between the LogRecord constructor parameters and the LogRecord |
| 596 | attributes.) These attributes can be used to merge data from the record into |
| 597 | the format string. The following table lists (in alphabetical order) the |
| 598 | attribute names, their meanings and the corresponding placeholder in a %-style |
| 599 | format string. |
| 600 | |
| 601 | If you are using {}-formatting (:func:`str.format`), you can use |
| 602 | ``{attrname}`` as the placeholder in the format string. If you are using |
| 603 | $-formatting (:class:`string.Template`), use the form ``${attrname}``. In |
| 604 | both cases, of course, replace ``attrname`` with the actual attribute name |
| 605 | you want to use. |
| 606 | |
| 607 | In the case of {}-formatting, you can specify formatting flags by placing them |
| 608 | after the attribute name, separated from it with a colon. For example: a |
| 609 | placeholder of ``{msecs:03d}`` would format a millisecond value of ``4`` as |
| 610 | ``004``. Refer to the :meth:`str.format` documentation for full details on |
| 611 | the options available to you. |
| 612 | |
| 613 | +----------------+-------------------------+-----------------------------------------------+ |
| 614 | | Attribute name | Format | Description | |
| 615 | +================+=========================+===============================================+ |
| 616 | | args | You shouldn't need to | The tuple of arguments merged into ``msg`` to | |
| 617 | | | format this yourself. | produce ``message``. | |
| 618 | +----------------+-------------------------+-----------------------------------------------+ |
| 619 | | asctime | ``%(asctime)s`` | Human-readable time when the | |
| 620 | | | | :class:`LogRecord` was created. By default | |
| 621 | | | | this is of the form '2003-07-08 16:49:45,896' | |
| 622 | | | | (the numbers after the comma are millisecond | |
| 623 | | | | portion of the time). | |
| 624 | +----------------+-------------------------+-----------------------------------------------+ |
| 625 | | created | ``%(created)f`` | Time when the :class:`LogRecord` was created | |
| 626 | | | | (as returned by :func:`time.time`). | |
| 627 | +----------------+-------------------------+-----------------------------------------------+ |
| 628 | | exc_info | You shouldn't need to | Exception tuple (Ã la ``sys.exc_info``) or, | |
| 629 | | | format this yourself. | if no exception has occurred, *None*. | |
| 630 | +----------------+-------------------------+-----------------------------------------------+ |
| 631 | | filename | ``%(filename)s`` | Filename portion of ``pathname``. | |
| 632 | +----------------+-------------------------+-----------------------------------------------+ |
| 633 | | funcName | ``%(funcName)s`` | Name of function containing the logging call. | |
| 634 | +----------------+-------------------------+-----------------------------------------------+ |
| 635 | | levelname | ``%(levelname)s`` | Text logging level for the message | |
| 636 | | | | (``'DEBUG'``, ``'INFO'``, ``'WARNING'``, | |
| 637 | | | | ``'ERROR'``, ``'CRITICAL'``). | |
| 638 | +----------------+-------------------------+-----------------------------------------------+ |
| 639 | | levelno | ``%(levelno)s`` | Numeric logging level for the message | |
| 640 | | | | (:const:`DEBUG`, :const:`INFO`, | |
| 641 | | | | :const:`WARNING`, :const:`ERROR`, | |
| 642 | | | | :const:`CRITICAL`). | |
| 643 | +----------------+-------------------------+-----------------------------------------------+ |
| 644 | | lineno | ``%(lineno)d`` | Source line number where the logging call was | |
| 645 | | | | issued (if available). | |
| 646 | +----------------+-------------------------+-----------------------------------------------+ |
| 647 | | module | ``%(module)s`` | Module (name portion of ``filename``). | |
| 648 | +----------------+-------------------------+-----------------------------------------------+ |
| 649 | | msecs | ``%(msecs)d`` | Millisecond portion of the time when the | |
| 650 | | | | :class:`LogRecord` was created. | |
| 651 | +----------------+-------------------------+-----------------------------------------------+ |
| 652 | | message | ``%(message)s`` | The logged message, computed as ``msg % | |
| 653 | | | | args``. This is set when | |
| 654 | | | | :meth:`Formatter.format` is invoked. | |
| 655 | +----------------+-------------------------+-----------------------------------------------+ |
| 656 | | msg | You shouldn't need to | The format string passed in the original | |
| 657 | | | format this yourself. | logging call. Merged with ``args`` to | |
| 658 | | | | produce ``message``, or an arbitrary object | |
| 659 | | | | (see :ref:`arbitrary-object-messages`). | |
| 660 | +----------------+-------------------------+-----------------------------------------------+ |
| 661 | | name | ``%(name)s`` | Name of the logger used to log the call. | |
| 662 | +----------------+-------------------------+-----------------------------------------------+ |
| 663 | | pathname | ``%(pathname)s`` | Full pathname of the source file where the | |
| 664 | | | | logging call was issued (if available). | |
| 665 | +----------------+-------------------------+-----------------------------------------------+ |
| 666 | | process | ``%(process)d`` | Process ID (if available). | |
| 667 | +----------------+-------------------------+-----------------------------------------------+ |
| 668 | | processName | ``%(processName)s`` | Process name (if available). | |
| 669 | +----------------+-------------------------+-----------------------------------------------+ |
| 670 | | relativeCreated| ``%(relativeCreated)d`` | Time in milliseconds when the LogRecord was | |
| 671 | | | | created, relative to the time the logging | |
| 672 | | | | module was loaded. | |
| 673 | +----------------+-------------------------+-----------------------------------------------+ |
| 674 | | stack_info | You shouldn't need to | Stack frame information (where available) | |
| 675 | | | format this yourself. | from the bottom of the stack in the current | |
| 676 | | | | thread, up to and including the stack frame | |
| 677 | | | | of the logging call which resulted in the | |
| 678 | | | | creation of this record. | |
| 679 | +----------------+-------------------------+-----------------------------------------------+ |
| 680 | | thread | ``%(thread)d`` | Thread ID (if available). | |
| 681 | +----------------+-------------------------+-----------------------------------------------+ |
| 682 | | threadName | ``%(threadName)s`` | Thread name (if available). | |
| 683 | +----------------+-------------------------+-----------------------------------------------+ |
| 684 | |
| 685 | |
| 686 | .. _logger-adapter: |
| 687 | |
| 688 | LoggerAdapter Objects |
| 689 | --------------------- |
| 690 | |
| 691 | :class:`LoggerAdapter` instances are used to conveniently pass contextual |
| 692 | information into logging calls. For a usage example , see the section on |
| 693 | :ref:`adding contextual information to your logging output <context-info>`. |
| 694 | |
| 695 | |
| 696 | .. class:: LoggerAdapter(logger, extra) |
| 697 | |
| 698 | Returns an instance of :class:`LoggerAdapter` initialized with an |
| 699 | underlying :class:`Logger` instance and a dict-like object. |
| 700 | |
| 701 | .. method:: process(msg, kwargs) |
| 702 | |
| 703 | Modifies the message and/or keyword arguments passed to a logging call in |
| 704 | order to insert contextual information. This implementation takes the object |
| 705 | passed as *extra* to the constructor and adds it to *kwargs* using key |
| 706 | 'extra'. The return value is a (*msg*, *kwargs*) tuple which has the |
| 707 | (possibly modified) versions of the arguments passed in. |
| 708 | |
| 709 | In addition to the above, :class:`LoggerAdapter` supports the following |
| 710 | methods of :class:`Logger`, i.e. :meth:`debug`, :meth:`info`, :meth:`warning`, |
| 711 | :meth:`error`, :meth:`exception`, :meth:`critical`, :meth:`log`, |
| 712 | :meth:`isEnabledFor`, :meth:`getEffectiveLevel`, :meth:`setLevel`, |
| 713 | :meth:`hasHandlers`. These methods have the same signatures as their |
| 714 | counterparts in :class:`Logger`, so you can use the two types of instances |
| 715 | interchangeably. |
| 716 | |
| 717 | .. versionchanged:: 3.2 |
| 718 | The :meth:`isEnabledFor`, :meth:`getEffectiveLevel`, :meth:`setLevel` and |
| 719 | :meth:`hasHandlers` methods were added to :class:`LoggerAdapter`. These |
| 720 | methods delegate to the underlying logger. |
| 721 | |
| 722 | |
| 723 | Thread Safety |
| 724 | ------------- |
| 725 | |
| 726 | The logging module is intended to be thread-safe without any special work |
| 727 | needing to be done by its clients. It achieves this though using threading |
| 728 | locks; there is one lock to serialize access to the module's shared data, and |
| 729 | each handler also creates a lock to serialize access to its underlying I/O. |
| 730 | |
| 731 | If you are implementing asynchronous signal handlers using the :mod:`signal` |
| 732 | module, you may not be able to use logging from within such handlers. This is |
| 733 | because lock implementations in the :mod:`threading` module are not always |
| 734 | re-entrant, and so cannot be invoked from such signal handlers. |
| 735 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 736 | |
Benjamin Peterson | 058e31e | 2009-01-16 03:54:08 +0000 | [diff] [blame] | 737 | Module-Level Functions |
| 738 | ---------------------- |
| 739 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 740 | In addition to the classes described above, there are a number of module- level |
| 741 | functions. |
| 742 | |
| 743 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 744 | .. function:: getLogger(name=None) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 745 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 746 | Return a logger with the specified name or, if name is ``None``, return a |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 747 | logger which is the root logger of the hierarchy. If specified, the name is |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 748 | typically a dot-separated hierarchical name like *'a'*, *'a.b'* or *'a.b.c.d'*. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 749 | Choice of these names is entirely up to the developer who is using logging. |
| 750 | |
| 751 | All calls to this function with a given name return the same logger instance. |
| 752 | This means that logger instances never need to be passed between different parts |
| 753 | of an application. |
| 754 | |
| 755 | |
| 756 | .. function:: getLoggerClass() |
| 757 | |
| 758 | Return either the standard :class:`Logger` class, or the last class passed to |
| 759 | :func:`setLoggerClass`. This function may be called from within a new class |
| 760 | definition, to ensure that installing a customised :class:`Logger` class will |
| 761 | not undo customisations already applied by other code. For example:: |
| 762 | |
| 763 | class MyLogger(logging.getLoggerClass()): |
| 764 | # ... override behaviour here |
| 765 | |
| 766 | |
Vinay Sajip | 6156152 | 2010-12-03 11:50:38 +0000 | [diff] [blame] | 767 | .. function:: getLogRecordFactory() |
| 768 | |
| 769 | Return a callable which is used to create a :class:`LogRecord`. |
| 770 | |
| 771 | .. versionadded:: 3.2 |
Vinay Sajip | 6156152 | 2010-12-03 11:50:38 +0000 | [diff] [blame] | 772 | This function has been provided, along with :func:`setLogRecordFactory`, |
| 773 | to allow developers more control over how the :class:`LogRecord` |
| 774 | representing a logging event is constructed. |
| 775 | |
| 776 | See :func:`setLogRecordFactory` for more information about the how the |
| 777 | factory is called. |
| 778 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 779 | .. function:: debug(msg, *args, **kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 780 | |
| 781 | Logs a message with level :const:`DEBUG` on the root logger. The *msg* is the |
| 782 | message format string, and the *args* are the arguments which are merged into |
| 783 | *msg* using the string formatting operator. (Note that this means that you can |
| 784 | use keywords in the format string, together with a single dictionary argument.) |
| 785 | |
Vinay Sajip | 8593ae6 | 2010-11-14 21:33:04 +0000 | [diff] [blame] | 786 | There are three keyword arguments in *kwargs* which are inspected: *exc_info* |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 787 | which, if it does not evaluate as false, causes exception information to be |
| 788 | added to the logging message. If an exception tuple (in the format returned by |
| 789 | :func:`sys.exc_info`) is provided, it is used; otherwise, :func:`sys.exc_info` |
| 790 | is called to get the exception information. |
| 791 | |
Vinay Sajip | 8593ae6 | 2010-11-14 21:33:04 +0000 | [diff] [blame] | 792 | The second optional keyword argument is *stack_info*, which defaults to |
| 793 | False. If specified as True, stack information is added to the logging |
| 794 | message, including the actual logging call. Note that this is not the same |
| 795 | stack information as that displayed through specifying *exc_info*: The |
| 796 | former is stack frames from the bottom of the stack up to the logging call |
| 797 | in the current thread, whereas the latter is information about stack frames |
| 798 | which have been unwound, following an exception, while searching for |
| 799 | exception handlers. |
| 800 | |
| 801 | You can specify *stack_info* independently of *exc_info*, e.g. to just show |
| 802 | how you got to a certain point in your code, even when no exceptions were |
| 803 | raised. The stack frames are printed following a header line which says:: |
| 804 | |
| 805 | Stack (most recent call last): |
| 806 | |
| 807 | This mimics the `Traceback (most recent call last):` which is used when |
| 808 | displaying exception frames. |
| 809 | |
| 810 | The third optional keyword argument is *extra* which can be used to pass a |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 811 | dictionary which is used to populate the __dict__ of the LogRecord created for |
| 812 | the logging event with user-defined attributes. These custom attributes can then |
| 813 | be used as you like. For example, they could be incorporated into logged |
| 814 | messages. For example:: |
| 815 | |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 816 | FORMAT = '%(asctime)-15s %(clientip)s %(user)-8s %(message)s' |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 817 | logging.basicConfig(format=FORMAT) |
| 818 | d = {'clientip': '192.168.0.1', 'user': 'fbloggs'} |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 819 | logging.warning('Protocol problem: %s', 'connection reset', extra=d) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 820 | |
Vinay Sajip | 4039aff | 2010-09-11 10:25:28 +0000 | [diff] [blame] | 821 | would print something like:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 822 | |
| 823 | 2006-02-08 22:20:02,165 192.168.0.1 fbloggs Protocol problem: connection reset |
| 824 | |
| 825 | The keys in the dictionary passed in *extra* should not clash with the keys used |
| 826 | by the logging system. (See the :class:`Formatter` documentation for more |
| 827 | information on which keys are used by the logging system.) |
| 828 | |
| 829 | If you choose to use these attributes in logged messages, you need to exercise |
| 830 | some care. In the above example, for instance, the :class:`Formatter` has been |
| 831 | set up with a format string which expects 'clientip' and 'user' in the attribute |
| 832 | dictionary of the LogRecord. If these are missing, the message will not be |
| 833 | logged because a string formatting exception will occur. So in this case, you |
| 834 | always need to pass the *extra* dictionary with these keys. |
| 835 | |
| 836 | While this might be annoying, this feature is intended for use in specialized |
| 837 | circumstances, such as multi-threaded servers where the same code executes in |
| 838 | many contexts, and interesting conditions which arise are dependent on this |
| 839 | context (such as remote client IP address and authenticated user name, in the |
| 840 | above example). In such circumstances, it is likely that specialized |
| 841 | :class:`Formatter`\ s would be used with particular :class:`Handler`\ s. |
| 842 | |
Vinay Sajip | 8593ae6 | 2010-11-14 21:33:04 +0000 | [diff] [blame] | 843 | .. versionadded:: 3.2 |
| 844 | The *stack_info* parameter was added. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 845 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 846 | .. function:: info(msg, *args, **kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 847 | |
| 848 | Logs a message with level :const:`INFO` on the root logger. The arguments are |
| 849 | interpreted as for :func:`debug`. |
| 850 | |
| 851 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 852 | .. function:: warning(msg, *args, **kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 853 | |
| 854 | Logs a message with level :const:`WARNING` on the root logger. The arguments are |
| 855 | interpreted as for :func:`debug`. |
| 856 | |
| 857 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 858 | .. function:: error(msg, *args, **kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 859 | |
| 860 | Logs a message with level :const:`ERROR` on the root logger. The arguments are |
| 861 | interpreted as for :func:`debug`. |
| 862 | |
| 863 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 864 | .. function:: critical(msg, *args, **kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 865 | |
| 866 | Logs a message with level :const:`CRITICAL` on the root logger. The arguments |
| 867 | are interpreted as for :func:`debug`. |
| 868 | |
| 869 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 870 | .. function:: exception(msg, *args) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 871 | |
| 872 | Logs a message with level :const:`ERROR` on the root logger. The arguments are |
| 873 | interpreted as for :func:`debug`. Exception info is added to the logging |
| 874 | message. This function should only be called from an exception handler. |
| 875 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 876 | .. function:: log(level, msg, *args, **kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 877 | |
| 878 | Logs a message with level *level* on the root logger. The other arguments are |
| 879 | interpreted as for :func:`debug`. |
| 880 | |
Vinay Sajip | c8c8c69 | 2010-09-17 10:09:04 +0000 | [diff] [blame] | 881 | PLEASE NOTE: The above module-level functions which delegate to the root |
| 882 | logger should *not* be used in threads, in versions of Python earlier than |
| 883 | 2.7.1 and 3.2, unless at least one handler has been added to the root |
| 884 | logger *before* the threads are started. These convenience functions call |
| 885 | :func:`basicConfig` to ensure that at least one handler is available; in |
| 886 | earlier versions of Python, this can (under rare circumstances) lead to |
| 887 | handlers being added multiple times to the root logger, which can in turn |
| 888 | lead to multiple messages for the same event. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 889 | |
| 890 | .. function:: disable(lvl) |
| 891 | |
| 892 | Provides an overriding level *lvl* for all loggers which takes precedence over |
| 893 | the logger's own level. When the need arises to temporarily throttle logging |
Benjamin Peterson | 886af96 | 2010-03-21 23:13:07 +0000 | [diff] [blame] | 894 | output down across the whole application, this function can be useful. Its |
| 895 | effect is to disable all logging calls of severity *lvl* and below, so that |
| 896 | if you call it with a value of INFO, then all INFO and DEBUG events would be |
| 897 | discarded, whereas those of severity WARNING and above would be processed |
| 898 | according to the logger's effective level. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 899 | |
| 900 | |
| 901 | .. function:: addLevelName(lvl, levelName) |
| 902 | |
| 903 | Associates level *lvl* with text *levelName* in an internal dictionary, which is |
| 904 | used to map numeric levels to a textual representation, for example when a |
| 905 | :class:`Formatter` formats a message. This function can also be used to define |
| 906 | your own levels. The only constraints are that all levels used must be |
| 907 | registered using this function, levels should be positive integers and they |
| 908 | should increase in increasing order of severity. |
| 909 | |
Vinay Sajip | c8c8c69 | 2010-09-17 10:09:04 +0000 | [diff] [blame] | 910 | NOTE: If you are thinking of defining your own levels, please see the section |
| 911 | on :ref:`custom-levels`. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 912 | |
| 913 | .. function:: getLevelName(lvl) |
| 914 | |
| 915 | Returns the textual representation of logging level *lvl*. If the level is one |
| 916 | of the predefined levels :const:`CRITICAL`, :const:`ERROR`, :const:`WARNING`, |
| 917 | :const:`INFO` or :const:`DEBUG` then you get the corresponding string. If you |
| 918 | have associated levels with names using :func:`addLevelName` then the name you |
| 919 | have associated with *lvl* is returned. If a numeric value corresponding to one |
| 920 | of the defined levels is passed in, the corresponding string representation is |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 921 | returned. Otherwise, the string 'Level %s' % lvl is returned. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 922 | |
| 923 | |
| 924 | .. function:: makeLogRecord(attrdict) |
| 925 | |
| 926 | Creates and returns a new :class:`LogRecord` instance whose attributes are |
| 927 | defined by *attrdict*. This function is useful for taking a pickled |
| 928 | :class:`LogRecord` attribute dictionary, sent over a socket, and reconstituting |
| 929 | it as a :class:`LogRecord` instance at the receiving end. |
| 930 | |
| 931 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 932 | .. function:: basicConfig(**kwargs) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 933 | |
| 934 | Does basic configuration for the logging system by creating a |
| 935 | :class:`StreamHandler` with a default :class:`Formatter` and adding it to the |
Vinay Sajip | cbabd7e | 2009-10-10 20:32:36 +0000 | [diff] [blame] | 936 | root logger. The functions :func:`debug`, :func:`info`, :func:`warning`, |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 937 | :func:`error` and :func:`critical` will call :func:`basicConfig` automatically |
| 938 | if no handlers are defined for the root logger. |
| 939 | |
Vinay Sajip | cbabd7e | 2009-10-10 20:32:36 +0000 | [diff] [blame] | 940 | This function does nothing if the root logger already has handlers |
| 941 | configured for it. |
| 942 | |
Vinay Sajip | c8c8c69 | 2010-09-17 10:09:04 +0000 | [diff] [blame] | 943 | PLEASE NOTE: This function should be called from the main thread |
| 944 | before other threads are started. In versions of Python prior to |
| 945 | 2.7.1 and 3.2, if this function is called from multiple threads, |
| 946 | it is possible (in rare circumstances) that a handler will be added |
| 947 | to the root logger more than once, leading to unexpected results |
| 948 | such as messages being duplicated in the log. |
| 949 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 950 | The following keyword arguments are supported. |
| 951 | |
| 952 | +--------------+---------------------------------------------+ |
| 953 | | Format | Description | |
| 954 | +==============+=============================================+ |
| 955 | | ``filename`` | Specifies that a FileHandler be created, | |
| 956 | | | using the specified filename, rather than a | |
| 957 | | | StreamHandler. | |
| 958 | +--------------+---------------------------------------------+ |
| 959 | | ``filemode`` | Specifies the mode to open the file, if | |
| 960 | | | filename is specified (if filemode is | |
| 961 | | | unspecified, it defaults to 'a'). | |
| 962 | +--------------+---------------------------------------------+ |
| 963 | | ``format`` | Use the specified format string for the | |
| 964 | | | handler. | |
| 965 | +--------------+---------------------------------------------+ |
| 966 | | ``datefmt`` | Use the specified date/time format. | |
| 967 | +--------------+---------------------------------------------+ |
Vinay Sajip | c5b2730 | 2010-10-31 14:59:16 +0000 | [diff] [blame] | 968 | | ``style`` | If ``format`` is specified, use this style | |
| 969 | | | for the format string. One of '%', '{' or | |
| 970 | | | '$' for %-formatting, :meth:`str.format` or | |
| 971 | | | :class:`string.Template` respectively, and | |
| 972 | | | defaulting to '%' if not specified. | |
| 973 | +--------------+---------------------------------------------+ |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 974 | | ``level`` | Set the root logger level to the specified | |
| 975 | | | level. | |
| 976 | +--------------+---------------------------------------------+ |
| 977 | | ``stream`` | Use the specified stream to initialize the | |
| 978 | | | StreamHandler. Note that this argument is | |
| 979 | | | incompatible with 'filename' - if both are | |
| 980 | | | present, 'stream' is ignored. | |
| 981 | +--------------+---------------------------------------------+ |
| 982 | |
Vinay Sajip | c5b2730 | 2010-10-31 14:59:16 +0000 | [diff] [blame] | 983 | .. versionchanged:: 3.2 |
| 984 | The ``style`` argument was added. |
| 985 | |
| 986 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 987 | .. function:: shutdown() |
| 988 | |
| 989 | Informs the logging system to perform an orderly shutdown by flushing and |
Christian Heimes | b186d00 | 2008-03-18 15:15:01 +0000 | [diff] [blame] | 990 | closing all handlers. This should be called at application exit and no |
| 991 | further use of the logging system should be made after this call. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 992 | |
| 993 | |
| 994 | .. function:: setLoggerClass(klass) |
| 995 | |
| 996 | Tells the logging system to use the class *klass* when instantiating a logger. |
| 997 | The class should define :meth:`__init__` such that only a name argument is |
| 998 | required, and the :meth:`__init__` should call :meth:`Logger.__init__`. This |
| 999 | function is typically called before any loggers are instantiated by applications |
| 1000 | which need to use custom logger behavior. |
| 1001 | |
Georg Brandl | 1eb40bc | 2010-12-03 15:30:09 +0000 | [diff] [blame] | 1002 | |
Vinay Sajip | 6156152 | 2010-12-03 11:50:38 +0000 | [diff] [blame] | 1003 | .. function:: setLogRecordFactory(factory) |
| 1004 | |
| 1005 | Set a callable which is used to create a :class:`LogRecord`. |
| 1006 | |
| 1007 | :param factory: The factory callable to be used to instantiate a log record. |
| 1008 | |
| 1009 | .. versionadded:: 3.2 |
Georg Brandl | 1eb40bc | 2010-12-03 15:30:09 +0000 | [diff] [blame] | 1010 | This function has been provided, along with :func:`getLogRecordFactory`, to |
| 1011 | allow developers more control over how the :class:`LogRecord` representing |
| 1012 | a logging event is constructed. |
Vinay Sajip | 6156152 | 2010-12-03 11:50:38 +0000 | [diff] [blame] | 1013 | |
Georg Brandl | 1eb40bc | 2010-12-03 15:30:09 +0000 | [diff] [blame] | 1014 | The factory has the following signature: |
Vinay Sajip | 6156152 | 2010-12-03 11:50:38 +0000 | [diff] [blame] | 1015 | |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 1016 | ``factory(name, level, fn, lno, msg, args, exc_info, func=None, sinfo=None, **kwargs)`` |
Vinay Sajip | 6156152 | 2010-12-03 11:50:38 +0000 | [diff] [blame] | 1017 | |
| 1018 | :name: The logger name. |
| 1019 | :level: The logging level (numeric). |
| 1020 | :fn: The full pathname of the file where the logging call was made. |
| 1021 | :lno: The line number in the file where the logging call was made. |
| 1022 | :msg: The logging message. |
| 1023 | :args: The arguments for the logging message. |
| 1024 | :exc_info: An exception tuple, or None. |
| 1025 | :func: The name of the function or method which invoked the logging |
| 1026 | call. |
| 1027 | :sinfo: A stack traceback such as is provided by |
| 1028 | :func:`traceback.print_stack`, showing the call hierarchy. |
| 1029 | :kwargs: Additional keyword arguments. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1030 | |
Georg Brandl | 1eb40bc | 2010-12-03 15:30:09 +0000 | [diff] [blame] | 1031 | |
Benjamin Peterson | 9451a1c | 2010-03-13 22:30:34 +0000 | [diff] [blame] | 1032 | Integration with the warnings module |
| 1033 | ------------------------------------ |
| 1034 | |
| 1035 | The :func:`captureWarnings` function can be used to integrate :mod:`logging` |
| 1036 | with the :mod:`warnings` module. |
| 1037 | |
| 1038 | .. function:: captureWarnings(capture) |
| 1039 | |
| 1040 | This function is used to turn the capture of warnings by logging on and |
| 1041 | off. |
| 1042 | |
Senthil Kumaran | 46a48be | 2010-10-15 13:10:10 +0000 | [diff] [blame] | 1043 | If *capture* is ``True``, warnings issued by the :mod:`warnings` module will |
| 1044 | be redirected to the logging system. Specifically, a warning will be |
Benjamin Peterson | 9451a1c | 2010-03-13 22:30:34 +0000 | [diff] [blame] | 1045 | formatted using :func:`warnings.formatwarning` and the resulting string |
Vinay Sajip | 9a6b400 | 2010-12-14 19:40:21 +0000 | [diff] [blame] | 1046 | logged to a logger named 'py.warnings' with a severity of `WARNING`. |
Benjamin Peterson | 9451a1c | 2010-03-13 22:30:34 +0000 | [diff] [blame] | 1047 | |
Senthil Kumaran | 46a48be | 2010-10-15 13:10:10 +0000 | [diff] [blame] | 1048 | If *capture* is ``False``, the redirection of warnings to the logging system |
Benjamin Peterson | 9451a1c | 2010-03-13 22:30:34 +0000 | [diff] [blame] | 1049 | will stop, and warnings will be redirected to their original destinations |
| 1050 | (i.e. those in effect before `captureWarnings(True)` was called). |
| 1051 | |
| 1052 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 1053 | .. seealso:: |
Vinay Sajip | 7504302 | 2010-12-19 06:02:31 +0000 | [diff] [blame] | 1054 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 1055 | Module :mod:`logging.config` |
| 1056 | Configuration API for the logging module. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1057 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 1058 | Module :mod:`logging.handlers` |
| 1059 | Useful handlers included with the logging module. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1060 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 1061 | :pep:`282` - A Logging System |
| 1062 | The proposal which described this feature for inclusion in the Python standard |
| 1063 | library. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1064 | |
Vinay Sajip | c63619b | 2010-12-19 12:56:57 +0000 | [diff] [blame^] | 1065 | `Original Python logging package <http://www.red-dove.com/python_logging.html>`_ |
| 1066 | This is the original source for the :mod:`logging` package. The version of the |
| 1067 | package available from this site is suitable for use with Python 1.5.2, 2.1.x |
| 1068 | and 2.2.x, which do not include the :mod:`logging` package in the standard |
| 1069 | library. |
Christian Heimes | 8b0facf | 2007-12-04 19:30:01 +0000 | [diff] [blame] | 1070 | |