blob: cca83ca501be2d115387ad073463e5795697cc13 [file] [log] [blame]
Skip Montanaro649698f2002-11-14 03:57:19 +00001\section{\module{logging} ---
2 Logging facility for Python}
3
Fred Drake9a5b6a62003-07-08 15:38:40 +00004\declaremodule{standard}{logging}
Skip Montanaro649698f2002-11-14 03:57:19 +00005
6% These apply to all modules, and may be given more than once:
7
8\moduleauthor{Vinay Sajip}{vinay_sajip@red-dove.com}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00009\sectionauthor{Vinay Sajip}{vinay_sajip@red-dove.com}
Skip Montanaro649698f2002-11-14 03:57:19 +000010
Fred Drake68e6d572003-01-28 22:02:35 +000011\modulesynopsis{Logging module for Python based on \pep{282}.}
Skip Montanaro649698f2002-11-14 03:57:19 +000012
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000013\indexii{Errors}{logging}
Skip Montanaro649698f2002-11-14 03:57:19 +000014
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000015\versionadded{2.3}
16This module defines functions and classes which implement a flexible
17error logging system for applications.
Skip Montanaro649698f2002-11-14 03:57:19 +000018
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000019Logging is performed by calling methods on instances of the
20\class{Logger} class (hereafter called \dfn{loggers}). Each instance has a
21name, and they are conceptually arranged in a name space hierarchy
22using dots (periods) as separators. For example, a logger named
23"scan" is the parent of loggers "scan.text", "scan.html" and "scan.pdf".
24Logger names can be anything you want, and indicate the area of an
25application in which a logged message originates.
Skip Montanaro649698f2002-11-14 03:57:19 +000026
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000027Logged messages also have levels of importance associated with them.
28The default levels provided are \constant{DEBUG}, \constant{INFO},
29\constant{WARNING}, \constant{ERROR} and \constant{CRITICAL}. As a
30convenience, you indicate the importance of a logged message by calling
31an appropriate method of \class{Logger}. The methods are
Fred Drakec23e0192003-01-28 22:09:16 +000032\method{debug()}, \method{info()}, \method{warning()}, \method{error()} and
33\method{critical()}, which mirror the default levels. You are not
34constrained to use these levels: you can specify your own and use a
35more general \class{Logger} method, \method{log()}, which takes an
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000036explicit level argument.
Skip Montanaro649698f2002-11-14 03:57:19 +000037
Vinay Sajipe8fdc452004-12-02 21:27:42 +000038The numeric values of logging levels are given in the following table. These
39are primarily of interest if you want to define your own levels, and need
40them to have specific values relative to the predefined levels. If you
41define a level with the same numeric value, it overwrites the predefined
42value; the predefined name is lost.
43
44\begin{tableii}{l|l}{code}{Level}{Numeric value}
45 \lineii{CRITICAL}{50}
46 \lineii{ERROR}{40}
47 \lineii{WARNING}{30}
48 \lineii{INFO}{20}
49 \lineii{DEBUG}{10}
50 \lineii{NOTSET}{0}
51\end{tableii}
52
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000053Levels can also be associated with loggers, being set either by the
54developer or through loading a saved logging configuration. When a
55logging method is called on a logger, the logger compares its own
56level with the level associated with the method call. If the logger's
57level is higher than the method call's, no logging message is actually
58generated. This is the basic mechanism controlling the verbosity of
59logging output.
Skip Montanaro649698f2002-11-14 03:57:19 +000060
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000061Logging messages are encoded as instances of the \class{LogRecord} class.
62When a logger decides to actually log an event, an \class{LogRecord}
63instance is created from the logging message.
Skip Montanaro649698f2002-11-14 03:57:19 +000064
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000065Logging messages are subjected to a dispatch mechanism through the
66use of \dfn{handlers}, which are instances of subclasses of the
67\class{Handler} class. Handlers are responsible for ensuring that a logged
68message (in the form of a \class{LogRecord}) ends up in a particular
69location (or set of locations) which is useful for the target audience for
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +000070that message (such as end users, support desk staff, system administrators,
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000071developers). Handlers are passed \class{LogRecord} instances intended for
72particular destinations. Each logger can have zero, one or more handlers
Fred Drake6b3b0462004-04-09 18:26:40 +000073associated with it (via the \method{addHandler()} method of \class{Logger}).
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000074In addition to any handlers directly associated with a logger,
Fred Drakec23e0192003-01-28 22:09:16 +000075\emph{all handlers associated with all ancestors of the logger} are
76called to dispatch the message.
Skip Montanaro649698f2002-11-14 03:57:19 +000077
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000078Just as for loggers, handlers can have levels associated with them.
79A handler's level acts as a filter in the same way as a logger's level does.
Fred Drakec23e0192003-01-28 22:09:16 +000080If a handler decides to actually dispatch an event, the \method{emit()} method
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000081is used to send the message to its destination. Most user-defined subclasses
Fred Drakec23e0192003-01-28 22:09:16 +000082of \class{Handler} will need to override this \method{emit()}.
Skip Montanaro649698f2002-11-14 03:57:19 +000083
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000084In addition to the base \class{Handler} class, many useful subclasses
85are provided:
Skip Montanaro649698f2002-11-14 03:57:19 +000086
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000087\begin{enumerate}
Skip Montanaro649698f2002-11-14 03:57:19 +000088
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000089\item \class{StreamHandler} instances send error messages to
90streams (file-like objects).
Skip Montanaro649698f2002-11-14 03:57:19 +000091
Neal Norwitzcd5c8c22003-01-25 21:29:41 +000092\item \class{FileHandler} instances send error messages to disk
93files.
94
Johannes Gijsbersf1643222004-11-07 16:11:35 +000095\item \class{BaseRotatingHandler} is tha base class for handlers that
96rotate log files at a certain point. It is not meant to be instantiated
Vinay Sajipedde4922004-11-11 13:54:48 +000097directly. Instead, use \class{RotatingFileHandler} or
98\class{TimedRotatingFileHandler}.
Johannes Gijsbersf1643222004-11-07 16:11:35 +000099
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000100\item \class{RotatingFileHandler} instances send error messages to disk
101files, with support for maximum log file sizes and log file rotation.
102
Johannes Gijsbers4f802ac2004-11-07 14:14:27 +0000103\item \class{TimedRotatingFileHandler} instances send error messages to
104disk files rotating the log file at certain timed intervals.
105
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000106\item \class{SocketHandler} instances send error messages to
107TCP/IP sockets.
108
109\item \class{DatagramHandler} instances send error messages to UDP
110sockets.
111
112\item \class{SMTPHandler} instances send error messages to a
113designated email address.
114
115\item \class{SysLogHandler} instances send error messages to a
Fred Drake68e6d572003-01-28 22:02:35 +0000116\UNIX{} syslog daemon, possibly on a remote machine.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000117
118\item \class{NTEventLogHandler} instances send error messages to a
119Windows NT/2000/XP event log.
120
121\item \class{MemoryHandler} instances send error messages to a
122buffer in memory, which is flushed whenever specific criteria are
123met.
124
125\item \class{HTTPHandler} instances send error messages to an
Fred Drake68e6d572003-01-28 22:02:35 +0000126HTTP server using either \samp{GET} or \samp{POST} semantics.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000127
128\end{enumerate}
129
130The \class{StreamHandler} and \class{FileHandler} classes are defined
131in the core logging package. The other handlers are defined in a sub-
132module, \module{logging.handlers}. (There is also another sub-module,
133\module{logging.config}, for configuration functionality.)
134
135Logged messages are formatted for presentation through instances of the
136\class{Formatter} class. They are initialized with a format string
137suitable for use with the \% operator and a dictionary.
138
139For formatting multiple messages in a batch, instances of
140\class{BufferingFormatter} can be used. In addition to the format string
141(which is applied to each message in the batch), there is provision for
142header and trailer format strings.
143
144When filtering based on logger level and/or handler level is not enough,
145instances of \class{Filter} can be added to both \class{Logger} and
Fred Drakec23e0192003-01-28 22:09:16 +0000146\class{Handler} instances (through their \method{addFilter()} method).
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000147Before deciding to process a message further, both loggers and handlers
148consult all their filters for permission. If any filter returns a false
149value, the message is not processed further.
150
151The basic \class{Filter} functionality allows filtering by specific logger
152name. If this feature is used, messages sent to the named logger and its
153children are allowed through the filter, and all others dropped.
154
155In addition to the classes described above, there are a number of module-
156level functions.
157
158\begin{funcdesc}{getLogger}{\optional{name}}
159Return a logger with the specified name or, if no name is specified, return
Vinay Sajip17952b72004-08-31 10:21:51 +0000160a logger which is the root logger of the hierarchy. If specified, the name
161is typically a dot-separated hierarchical name like \var{"a"}, \var{"a.b"}
162or \var{"a.b.c.d"}. Choice of these names is entirely up to the developer
163who is using logging.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000164
165All calls to this function with a given name return the same logger instance.
166This means that logger instances never need to be passed between different
167parts of an application.
Skip Montanaro649698f2002-11-14 03:57:19 +0000168\end{funcdesc}
169
Vinay Sajipc6646c02004-09-22 12:55:16 +0000170\begin{funcdesc}{getLoggerClass}{}
171Return either the standard \class{Logger} class, or the last class passed to
172\function{setLoggerClass()}. This function may be called from within a new
173class definition, to ensure that installing a customised \class{Logger} class
174will not undo customisations already applied by other code. For example:
175
176\begin{verbatim}
177 class MyLogger(logging.getLoggerClass()):
178 # ... override behaviour here
179\end{verbatim}
180
181\end{funcdesc}
182
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000183\begin{funcdesc}{debug}{msg\optional{, *args\optional{, **kwargs}}}
184Logs a message with level \constant{DEBUG} on the root logger.
185The \var{msg} is the message format string, and the \var{args} are the
186arguments which are merged into \var{msg}. The only keyword argument in
187\var{kwargs} which is inspected is \var{exc_info} which, if it does not
Vinay Sajip1dc5b1e2004-10-03 19:10:05 +0000188evaluate as false, causes exception information to be added to the logging
189message. If an exception tuple (in the format returned by
190\function{sys.exc_info()}) is provided, it is used; otherwise,
191\function{sys.exc_info()} is called to get the exception information.
Skip Montanaro649698f2002-11-14 03:57:19 +0000192\end{funcdesc}
193
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000194\begin{funcdesc}{info}{msg\optional{, *args\optional{, **kwargs}}}
195Logs a message with level \constant{INFO} on the root logger.
196The arguments are interpreted as for \function{debug()}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000197\end{funcdesc}
198
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000199\begin{funcdesc}{warning}{msg\optional{, *args\optional{, **kwargs}}}
200Logs a message with level \constant{WARNING} on the root logger.
201The arguments are interpreted as for \function{debug()}.
202\end{funcdesc}
203
204\begin{funcdesc}{error}{msg\optional{, *args\optional{, **kwargs}}}
205Logs a message with level \constant{ERROR} on the root logger.
206The arguments are interpreted as for \function{debug()}.
207\end{funcdesc}
208
209\begin{funcdesc}{critical}{msg\optional{, *args\optional{, **kwargs}}}
210Logs a message with level \constant{CRITICAL} on the root logger.
211The arguments are interpreted as for \function{debug()}.
212\end{funcdesc}
213
214\begin{funcdesc}{exception}{msg\optional{, *args}}
215Logs a message with level \constant{ERROR} on the root logger.
216The arguments are interpreted as for \function{debug()}. Exception info
217is added to the logging message. This function should only be called
218from an exception handler.
219\end{funcdesc}
220
Vinay Sajip739d49e2004-09-24 11:46:44 +0000221\begin{funcdesc}{log}{level, msg\optional{, *args\optional{, **kwargs}}}
222Logs a message with level \var{level} on the root logger.
223The other arguments are interpreted as for \function{debug()}.
224\end{funcdesc}
225
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000226\begin{funcdesc}{disable}{lvl}
227Provides an overriding level \var{lvl} for all loggers which takes
228precedence over the logger's own level. When the need arises to
229temporarily throttle logging output down across the whole application,
230this function can be useful.
231\end{funcdesc}
232
233\begin{funcdesc}{addLevelName}{lvl, levelName}
234Associates level \var{lvl} with text \var{levelName} in an internal
235dictionary, which is used to map numeric levels to a textual
236representation, for example when a \class{Formatter} formats a message.
237This function can also be used to define your own levels. The only
238constraints are that all levels used must be registered using this
239function, levels should be positive integers and they should increase
240in increasing order of severity.
241\end{funcdesc}
242
243\begin{funcdesc}{getLevelName}{lvl}
244Returns the textual representation of logging level \var{lvl}. If the
245level is one of the predefined levels \constant{CRITICAL},
246\constant{ERROR}, \constant{WARNING}, \constant{INFO} or \constant{DEBUG}
247then you get the corresponding string. If you have associated levels
248with names using \function{addLevelName()} then the name you have associated
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000249with \var{lvl} is returned. If a numeric value corresponding to one of the
250defined levels is passed in, the corresponding string representation is
251returned. Otherwise, the string "Level \%s" \% lvl is returned.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000252\end{funcdesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000253
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +0000254\begin{funcdesc}{makeLogRecord}{attrdict}
255Creates and returns a new \class{LogRecord} instance whose attributes are
256defined by \var{attrdict}. This function is useful for taking a pickled
257\class{LogRecord} attribute dictionary, sent over a socket, and reconstituting
258it as a \class{LogRecord} instance at the receiving end.
259\end{funcdesc}
260
Skip Montanaro649698f2002-11-14 03:57:19 +0000261\begin{funcdesc}{basicConfig}{}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000262Does basic configuration for the logging system by creating a
263\class{StreamHandler} with a default \class{Formatter} and adding it to
264the root logger. The functions \function{debug()}, \function{info()},
265\function{warning()}, \function{error()} and \function{critical()} will call
266\function{basicConfig()} automatically if no handlers are defined for the
267root logger.
Skip Montanaro649698f2002-11-14 03:57:19 +0000268\end{funcdesc}
269
Skip Montanaro649698f2002-11-14 03:57:19 +0000270\begin{funcdesc}{shutdown}{}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000271Informs the logging system to perform an orderly shutdown by flushing and
272closing all handlers.
Skip Montanaro649698f2002-11-14 03:57:19 +0000273\end{funcdesc}
274
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000275\begin{funcdesc}{setLoggerClass}{klass}
276Tells the logging system to use the class \var{klass} when instantiating a
277logger. The class should define \method{__init__()} such that only a name
278argument is required, and the \method{__init__()} should call
279\method{Logger.__init__()}. This function is typically called before any
280loggers are instantiated by applications which need to use custom logger
281behavior.
282\end{funcdesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000283
Fred Drake68e6d572003-01-28 22:02:35 +0000284
285\begin{seealso}
286 \seepep{282}{A Logging System}
287 {The proposal which described this feature for inclusion in
288 the Python standard library.}
Fred Drake11514792004-01-08 14:59:02 +0000289 \seelink{http://www.red-dove.com/python_logging.html}
290 {Original Python \module{logging} package}
291 {This is the original source for the \module{logging}
292 package. The version of the package available from this
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000293 site is suitable for use with Python 1.5.2, 2.1.x and 2.2.x,
294 which do not include the \module{logging} package in the standard
Fred Drake11514792004-01-08 14:59:02 +0000295 library.}
Fred Drake68e6d572003-01-28 22:02:35 +0000296\end{seealso}
297
298
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000299\subsection{Logger Objects}
Skip Montanaro649698f2002-11-14 03:57:19 +0000300
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000301Loggers have the following attributes and methods. Note that Loggers are
302never instantiated directly, but always through the module-level function
303\function{logging.getLogger(name)}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000304
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000305\begin{datadesc}{propagate}
306If this evaluates to false, logging messages are not passed by this
307logger or by child loggers to higher level (ancestor) loggers. The
308constructor sets this attribute to 1.
Skip Montanaro649698f2002-11-14 03:57:19 +0000309\end{datadesc}
310
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000311\begin{methoddesc}{setLevel}{lvl}
312Sets the threshold for this logger to \var{lvl}. Logging messages
313which are less severe than \var{lvl} will be ignored. When a logger is
Neal Norwitz6fa635d2003-02-18 14:20:07 +0000314created, the level is set to \constant{NOTSET} (which causes all messages
Vinay Sajipe8fdc452004-12-02 21:27:42 +0000315to be processed when the logger is the root logger, or delegation to the
316parent when the logger is a non-root logger). Note that the root logger
317is created with level \constant{WARNING}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000318\end{methoddesc}
319
320\begin{methoddesc}{isEnabledFor}{lvl}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000321Indicates if a message of severity \var{lvl} would be processed by
322this logger. This method checks first the module-level level set by
323\function{logging.disable(lvl)} and then the logger's effective level as
324determined by \method{getEffectiveLevel()}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000325\end{methoddesc}
326
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000327\begin{methoddesc}{getEffectiveLevel}{}
328Indicates the effective level for this logger. If a value other than
Neal Norwitz6fa635d2003-02-18 14:20:07 +0000329\constant{NOTSET} has been set using \method{setLevel()}, it is returned.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000330Otherwise, the hierarchy is traversed towards the root until a value
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +0000331other than \constant{NOTSET} is found, and that value is returned.
Skip Montanaro649698f2002-11-14 03:57:19 +0000332\end{methoddesc}
333
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000334\begin{methoddesc}{debug}{msg\optional{, *args\optional{, **kwargs}}}
335Logs a message with level \constant{DEBUG} on this logger.
336The \var{msg} is the message format string, and the \var{args} are the
337arguments which are merged into \var{msg}. The only keyword argument in
338\var{kwargs} which is inspected is \var{exc_info} which, if it does not
Vinay Sajip1dc5b1e2004-10-03 19:10:05 +0000339evaluate as false, causes exception information to be added to the logging
340message. If an exception tuple (as provided by \function{sys.exc_info()})
341is provided, it is used; otherwise, \function{sys.exc_info()} is called
342to get the exception information.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000343\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000344
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000345\begin{methoddesc}{info}{msg\optional{, *args\optional{, **kwargs}}}
346Logs a message with level \constant{INFO} on this logger.
347The arguments are interpreted as for \method{debug()}.
348\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000349
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000350\begin{methoddesc}{warning}{msg\optional{, *args\optional{, **kwargs}}}
351Logs a message with level \constant{WARNING} on this logger.
352The arguments are interpreted as for \method{debug()}.
353\end{methoddesc}
354
355\begin{methoddesc}{error}{msg\optional{, *args\optional{, **kwargs}}}
356Logs a message with level \constant{ERROR} on this logger.
357The arguments are interpreted as for \method{debug()}.
358\end{methoddesc}
359
360\begin{methoddesc}{critical}{msg\optional{, *args\optional{, **kwargs}}}
361Logs a message with level \constant{CRITICAL} on this logger.
362The arguments are interpreted as for \method{debug()}.
363\end{methoddesc}
364
365\begin{methoddesc}{log}{lvl, msg\optional{, *args\optional{, **kwargs}}}
Vinay Sajip1cf56d02004-08-04 08:36:44 +0000366Logs a message with integer level \var{lvl} on this logger.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000367The other arguments are interpreted as for \method{debug()}.
368\end{methoddesc}
369
370\begin{methoddesc}{exception}{msg\optional{, *args}}
371Logs a message with level \constant{ERROR} on this logger.
372The arguments are interpreted as for \method{debug()}. Exception info
373is added to the logging message. This method should only be called
374from an exception handler.
375\end{methoddesc}
376
377\begin{methoddesc}{addFilter}{filt}
378Adds the specified filter \var{filt} to this logger.
379\end{methoddesc}
380
381\begin{methoddesc}{removeFilter}{filt}
382Removes the specified filter \var{filt} from this logger.
383\end{methoddesc}
384
385\begin{methoddesc}{filter}{record}
386Applies this logger's filters to the record and returns a true value if
387the record is to be processed.
388\end{methoddesc}
389
390\begin{methoddesc}{addHandler}{hdlr}
391Adds the specified handler \var{hdlr} to this logger.
Skip Montanaro649698f2002-11-14 03:57:19 +0000392\end{methoddesc}
393
394\begin{methoddesc}{removeHandler}{hdlr}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000395Removes the specified handler \var{hdlr} from this logger.
Skip Montanaro649698f2002-11-14 03:57:19 +0000396\end{methoddesc}
397
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000398\begin{methoddesc}{findCaller}{}
399Finds the caller's source filename and line number. Returns the filename
400and line number as a 2-element tuple.
Skip Montanaro649698f2002-11-14 03:57:19 +0000401\end{methoddesc}
402
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000403\begin{methoddesc}{handle}{record}
404Handles a record by passing it to all handlers associated with this logger
405and its ancestors (until a false value of \var{propagate} is found).
406This method is used for unpickled records received from a socket, as well
407as those created locally. Logger-level filtering is applied using
408\method{filter()}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000409\end{methoddesc}
410
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000411\begin{methoddesc}{makeRecord}{name, lvl, fn, lno, msg, args, exc_info}
412This is a factory method which can be overridden in subclasses to create
413specialized \class{LogRecord} instances.
Skip Montanaro649698f2002-11-14 03:57:19 +0000414\end{methoddesc}
415
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000416\subsection{Basic example \label{minimal-example}}
417
418The \module{logging} package provides a lot of flexibility, and its
419configuration can appear daunting. This section demonstrates that simple
420use of the logging package is possible.
421
422The simplest example shows logging to the console:
423
424\begin{verbatim}
425import logging
426
427logging.debug('A debug message')
428logging.info('Some information')
429logging.warning('A shot across the bows')
430\end{verbatim}
431
432If you run the above script, you'll see this:
433\begin{verbatim}
434WARNING:root:A shot across the bows
435\end{verbatim}
436
437Because no particular logger was specified, the system used the root logger.
438The debug and info messages didn't appear because by default, the root
439logger is configured to only handle messages with a severity of WARNING
440or above. The message format is also a configuration default, as is the output
441destination of the messages - \code{sys.stderr}. The severity level,
442the message format and destination can be easily changed, as shown in
443the example below:
444
445\begin{verbatim}
446import logging
447
448logging.basicConfig(level=logging.DEBUG,
Vinay Sajipe3c330b2004-07-07 15:59:49 +0000449 format='%(asctime)s %(levelname)s %(message)s',
450 filename='/tmp/myapp.log',
451 filemode='w')
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000452logging.debug('A debug message')
453logging.info('Some information')
454logging.warning('A shot across the bows')
455\end{verbatim}
456
457The \method{basicConfig()} method is used to change the configuration
458defaults, which results in output (written to \code{/tmp/myapp.log})
459which should look something like the following:
460
461\begin{verbatim}
4622004-07-02 13:00:08,743 DEBUG A debug message
4632004-07-02 13:00:08,743 INFO Some information
4642004-07-02 13:00:08,743 WARNING A shot across the bows
465\end{verbatim}
466
467This time, all messages with a severity of DEBUG or above were handled,
468and the format of the messages was also changed, and output went to the
469specified file rather than the console.
470
471Formatting uses standard Python string formatting - see section
472\ref{typesseq-strings}. The format string takes the following
473common specifiers. For a complete list of specifiers, consult the
474\class{Formatter} documentation.
475
476\begin{tableii}{l|l}{code}{Format}{Description}
477\lineii{\%(name)s} {Name of the logger (logging channel).}
478\lineii{\%(levelname)s}{Text logging level for the message
479 (\code{'DEBUG'}, \code{'INFO'},
480 \code{'WARNING'}, \code{'ERROR'},
481 \code{'CRITICAL'}).}
482\lineii{\%(asctime)s} {Human-readable time when the \class{LogRecord}
483 was created. By default this is of the form
484 ``2003-07-08 16:49:45,896'' (the numbers after the
485 comma are millisecond portion of the time).}
486\lineii{\%(message)s} {The logged message.}
487\end{tableii}
488
489To change the date/time format, you can pass an additional keyword parameter,
490\var{datefmt}, as in the following:
491
492\begin{verbatim}
493import logging
494
495logging.basicConfig(level=logging.DEBUG,
Vinay Sajipe3c330b2004-07-07 15:59:49 +0000496 format='%(asctime)s %(levelname)-8s %(message)s',
497 datefmt='%a, %d %b %Y %H:%M:%S',
498 filename='/temp/myapp.log',
499 filemode='w')
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000500logging.debug('A debug message')
501logging.info('Some information')
502logging.warning('A shot across the bows')
503\end{verbatim}
504
505which would result in output like
506
507\begin{verbatim}
508Fri, 02 Jul 2004 13:06:18 DEBUG A debug message
509Fri, 02 Jul 2004 13:06:18 INFO Some information
510Fri, 02 Jul 2004 13:06:18 WARNING A shot across the bows
511\end{verbatim}
512
513The date format string follows the requirements of \function{strftime()} -
514see the documentation for the \refmodule{time} module.
515
516If, instead of sending logging output to the console or a file, you'd rather
517use a file-like object which you have created separately, you can pass it
518to \function{basicConfig()} using the \var{stream} keyword argument. Note
519that if both \var{stream} and \var{filename} keyword arguments are passed,
520the \var{stream} argument is ignored.
521
Vinay Sajipb4bf62f2004-07-21 14:40:11 +0000522Of course, you can put variable information in your output. To do this,
523simply have the message be a format string and pass in additional arguments
524containing the variable information, as in the following example:
525
526\begin{verbatim}
527import logging
528
529logging.basicConfig(level=logging.DEBUG,
530 format='%(asctime)s %(levelname)-8s %(message)s',
531 datefmt='%a, %d %b %Y %H:%M:%S',
532 filename='/temp/myapp.log',
533 filemode='w')
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000534logging.error('Pack my box with %d dozen %s', 5, 'liquor jugs')
Vinay Sajipb4bf62f2004-07-21 14:40:11 +0000535\end{verbatim}
536
537which would result in
538
539\begin{verbatim}
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000540Wed, 21 Jul 2004 15:35:16 ERROR Pack my box with 5 dozen liquor jugs
Vinay Sajipb4bf62f2004-07-21 14:40:11 +0000541\end{verbatim}
542
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000543\subsection{Logging to multiple destinations \label{multiple-destinations}}
544
545Let's say you want to log to console and file with different message formats
546and in differing circumstances. Say you want to log messages with levels
547of DEBUG and higher to file, and those messages at level INFO and higher to
548the console. Let's also assume that the file should contain timestamps, but
549the console messages should not. Here's how you can achieve this:
550
551\begin{verbatim}
552import logging
553
Fred Drake048840c2004-10-29 14:35:42 +0000554# set up logging to file - see previous section for more details
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000555logging.basicConfig(level=logging.DEBUG,
556 format='%(asctime)s %(name)-12s %(levelname)-8s %(message)s',
557 datefmt='%m-%d %H:%M',
558 filename='/temp/myapp.log',
559 filemode='w')
Fred Drake048840c2004-10-29 14:35:42 +0000560# define a Handler which writes INFO messages or higher to the sys.stderr
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000561console = logging.StreamHandler()
562console.setLevel(logging.INFO)
Fred Drake048840c2004-10-29 14:35:42 +0000563# set a format which is simpler for console use
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000564formatter = logging.Formatter('%(name)-12s: %(levelname)-8s %(message)s')
Fred Drake048840c2004-10-29 14:35:42 +0000565# tell the handler to use this format
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000566console.setFormatter(formatter)
Fred Drake048840c2004-10-29 14:35:42 +0000567# add the handler to the root logger
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000568logging.getLogger('').addHandler(console)
569
Fred Drake048840c2004-10-29 14:35:42 +0000570# Now, we can log to the root logger, or any other logger. First the root...
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000571logging.info('Jackdaws love my big sphinx of quartz.')
572
Fred Drake048840c2004-10-29 14:35:42 +0000573# Now, define a couple of other loggers which might represent areas in your
574# application:
Vinay Sajip93ae4c12004-10-22 21:43:15 +0000575
576logger1 = logging.getLogger('myapp.area1')
577logger2 = logging.getLogger('myapp.area2')
578
579logger1.debug('Quick zephyrs blow, vexing daft Jim.')
580logger1.info('How quickly daft jumping zebras vex.')
581logger2.warning('Jail zesty vixen who grabbed pay from quack.')
582logger2.error('The five boxing wizards jump quickly.')
583\end{verbatim}
584
585When you run this, on the console you will see
586
587\begin{verbatim}
588root : INFO Jackdaws love my big sphinx of quartz.
589myapp.area1 : INFO How quickly daft jumping zebras vex.
590myapp.area2 : WARNING Jail zesty vixen who grabbed pay from quack.
591myapp.area2 : ERROR The five boxing wizards jump quickly.
592\end{verbatim}
593
594and in the file you will see something like
595
596\begin{verbatim}
59710-22 22:19 root INFO Jackdaws love my big sphinx of quartz.
59810-22 22:19 myapp.area1 DEBUG Quick zephyrs blow, vexing daft Jim.
59910-22 22:19 myapp.area1 INFO How quickly daft jumping zebras vex.
60010-22 22:19 myapp.area2 WARNING Jail zesty vixen who grabbed pay from quack.
60110-22 22:19 myapp.area2 ERROR The five boxing wizards jump quickly.
602\end{verbatim}
603
604As you can see, the DEBUG message only shows up in the file. The other
605messages are sent to both destinations.
606
Vinay Sajip006483b2004-10-29 12:30:28 +0000607This example uses console and file handlers, but you can use any number and
608combination of handlers you choose.
609
610\subsection{Sending and receiving logging events across a network
611\label{network-logging}}
612
613Let's say you want to send logging events across a network, and handle them
614at the receiving end. A simple way of doing this is attaching a
615\class{SocketHandler} instance to the root logger at the sending end:
616
617\begin{verbatim}
618import logging, logging.handlers
619
620rootLogger = logging.getLogger('')
621rootLogger.setLevel(logging.DEBUG)
622socketHandler = logging.handlers.SocketHandler('localhost',
623 logging.handlers.DEFAULT_TCP_LOGGING_PORT)
624# don't bother with a formatter, since a socket handler sends the event as
625# an unformatted pickle
626rootLogger.addHandler(socketHandler)
627
Fred Drake048840c2004-10-29 14:35:42 +0000628# Now, we can log to the root logger, or any other logger. First the root...
Vinay Sajip006483b2004-10-29 12:30:28 +0000629logging.info('Jackdaws love my big sphinx of quartz.')
630
Fred Drake048840c2004-10-29 14:35:42 +0000631# Now, define a couple of other loggers which might represent areas in your
632# application:
Vinay Sajip006483b2004-10-29 12:30:28 +0000633
634logger1 = logging.getLogger('myapp.area1')
635logger2 = logging.getLogger('myapp.area2')
636
637logger1.debug('Quick zephyrs blow, vexing daft Jim.')
638logger1.info('How quickly daft jumping zebras vex.')
639logger2.warning('Jail zesty vixen who grabbed pay from quack.')
640logger2.error('The five boxing wizards jump quickly.')
641\end{verbatim}
642
643At the receiving end, you can set up a receiver using the
644\module{SocketServer} module. Here is a basic working example:
645
646\begin{verbatim}
Fred Drake048840c2004-10-29 14:35:42 +0000647import cPickle
648import logging
649import logging.handlers
650import SocketServer
651import struct
Vinay Sajip006483b2004-10-29 12:30:28 +0000652
Vinay Sajip006483b2004-10-29 12:30:28 +0000653
Fred Drake048840c2004-10-29 14:35:42 +0000654class LogRecordStreamHandler(SocketServer.StreamRequestHandler):
655 """Handler for a streaming logging request.
656
657 This basically logs the record using whatever logging policy is
658 configured locally.
Vinay Sajip006483b2004-10-29 12:30:28 +0000659 """
660
661 def handle(self):
662 """
663 Handle multiple requests - each expected to be a 4-byte length,
664 followed by the LogRecord in pickle format. Logs the record
665 according to whatever policy is configured locally.
666 """
667 while 1:
668 chunk = self.connection.recv(4)
669 if len(chunk) < 4:
670 break
671 slen = struct.unpack(">L", chunk)[0]
672 chunk = self.connection.recv(slen)
673 while len(chunk) < slen:
674 chunk = chunk + self.connection.recv(slen - len(chunk))
675 obj = self.unPickle(chunk)
676 record = logging.makeLogRecord(obj)
677 self.handleLogRecord(record)
678
679 def unPickle(self, data):
680 return cPickle.loads(data)
681
682 def handleLogRecord(self, record):
Fred Drake048840c2004-10-29 14:35:42 +0000683 # if a name is specified, we use the named logger rather than the one
684 # implied by the record.
Vinay Sajip006483b2004-10-29 12:30:28 +0000685 if self.server.logname is not None:
686 name = self.server.logname
687 else:
688 name = record.name
689 logger = logging.getLogger(name)
Fred Drake048840c2004-10-29 14:35:42 +0000690 # N.B. EVERY record gets logged. This is because Logger.handle
691 # is normally called AFTER logger-level filtering. If you want
692 # to do filtering, do it at the client end to save wasting
693 # cycles and network bandwidth!
Vinay Sajip006483b2004-10-29 12:30:28 +0000694 logger.handle(record)
695
Fred Drake048840c2004-10-29 14:35:42 +0000696class LogRecordSocketReceiver(SocketServer.ThreadingTCPServer):
697 """simple TCP socket-based logging receiver suitable for testing.
Vinay Sajip006483b2004-10-29 12:30:28 +0000698 """
699
700 allow_reuse_address = 1
701
702 def __init__(self, host='localhost',
Fred Drake048840c2004-10-29 14:35:42 +0000703 port=logging.handlers.DEFAULT_TCP_LOGGING_PORT,
704 handler=LogRecordStreamHandler):
705 SocketServer.ThreadingTCPServer.__init__(self, (host, port), handler)
Vinay Sajip006483b2004-10-29 12:30:28 +0000706 self.abort = 0
707 self.timeout = 1
708 self.logname = None
709
710 def serve_until_stopped(self):
711 import select
712 abort = 0
713 while not abort:
714 rd, wr, ex = select.select([self.socket.fileno()],
715 [], [],
716 self.timeout)
717 if rd:
718 self.handle_request()
719 abort = self.abort
720
721def main():
722 logging.basicConfig(
Vinay Sajipedde4922004-11-11 13:54:48 +0000723 format="%(relativeCreated)5d %(name)-15s %(levelname)-8s %(message)s")
Vinay Sajip006483b2004-10-29 12:30:28 +0000724 tcpserver = LogRecordSocketReceiver()
725 print "About to start TCP server..."
726 tcpserver.serve_until_stopped()
727
728if __name__ == "__main__":
729 main()
730\end{verbatim}
731
Vinay Sajipedde4922004-11-11 13:54:48 +0000732First run the server, and then the client. On the client side, nothing is
733printed on the console; on the server side, you should see something like:
Vinay Sajip006483b2004-10-29 12:30:28 +0000734
735\begin{verbatim}
736About to start TCP server...
737 59 root INFO Jackdaws love my big sphinx of quartz.
738 59 myapp.area1 DEBUG Quick zephyrs blow, vexing daft Jim.
739 69 myapp.area1 INFO How quickly daft jumping zebras vex.
740 69 myapp.area2 WARNING Jail zesty vixen who grabbed pay from quack.
741 69 myapp.area2 ERROR The five boxing wizards jump quickly.
742\end{verbatim}
743
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000744\subsection{Handler Objects}
Skip Montanaro649698f2002-11-14 03:57:19 +0000745
Fred Drake68e6d572003-01-28 22:02:35 +0000746Handlers have the following attributes and methods. Note that
747\class{Handler} is never instantiated directly; this class acts as a
748base for more useful subclasses. However, the \method{__init__()}
749method in subclasses needs to call \method{Handler.__init__()}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000750
Neal Norwitz6fa635d2003-02-18 14:20:07 +0000751\begin{methoddesc}{__init__}{level=\constant{NOTSET}}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000752Initializes the \class{Handler} instance by setting its level, setting
753the list of filters to the empty list and creating a lock (using
Raymond Hettingerc75c3e02003-09-01 22:50:52 +0000754\method{createLock()}) for serializing access to an I/O mechanism.
Skip Montanaro649698f2002-11-14 03:57:19 +0000755\end{methoddesc}
756
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000757\begin{methoddesc}{createLock}{}
758Initializes a thread lock which can be used to serialize access to
759underlying I/O functionality which may not be threadsafe.
Skip Montanaro649698f2002-11-14 03:57:19 +0000760\end{methoddesc}
761
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000762\begin{methoddesc}{acquire}{}
763Acquires the thread lock created with \method{createLock()}.
764\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000765
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000766\begin{methoddesc}{release}{}
767Releases the thread lock acquired with \method{acquire()}.
768\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000769
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000770\begin{methoddesc}{setLevel}{lvl}
771Sets the threshold for this handler to \var{lvl}. Logging messages which are
772less severe than \var{lvl} will be ignored. When a handler is created, the
Neal Norwitz6fa635d2003-02-18 14:20:07 +0000773level is set to \constant{NOTSET} (which causes all messages to be processed).
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000774\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000775
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000776\begin{methoddesc}{setFormatter}{form}
777Sets the \class{Formatter} for this handler to \var{form}.
778\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000779
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000780\begin{methoddesc}{addFilter}{filt}
781Adds the specified filter \var{filt} to this handler.
782\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000783
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000784\begin{methoddesc}{removeFilter}{filt}
785Removes the specified filter \var{filt} from this handler.
786\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000787
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000788\begin{methoddesc}{filter}{record}
789Applies this handler's filters to the record and returns a true value if
790the record is to be processed.
Skip Montanaro649698f2002-11-14 03:57:19 +0000791\end{methoddesc}
792
793\begin{methoddesc}{flush}{}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000794Ensure all logging output has been flushed. This version does
795nothing and is intended to be implemented by subclasses.
Skip Montanaro649698f2002-11-14 03:57:19 +0000796\end{methoddesc}
797
Skip Montanaro649698f2002-11-14 03:57:19 +0000798\begin{methoddesc}{close}{}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000799Tidy up any resources used by the handler. This version does
800nothing and is intended to be implemented by subclasses.
Skip Montanaro649698f2002-11-14 03:57:19 +0000801\end{methoddesc}
802
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000803\begin{methoddesc}{handle}{record}
804Conditionally emits the specified logging record, depending on
805filters which may have been added to the handler. Wraps the actual
806emission of the record with acquisition/release of the I/O thread
807lock.
Skip Montanaro649698f2002-11-14 03:57:19 +0000808\end{methoddesc}
809
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000810\begin{methoddesc}{handleError}{record}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000811This method should be called from handlers when an exception is
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000812encountered during an \method{emit()} call. By default it does nothing,
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000813which means that exceptions get silently ignored. This is what is
814mostly wanted for a logging system - most users will not care
815about errors in the logging system, they are more interested in
816application errors. You could, however, replace this with a custom
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000817handler if you wish. The specified record is the one which was being
818processed when the exception occurred.
Skip Montanaro649698f2002-11-14 03:57:19 +0000819\end{methoddesc}
820
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000821\begin{methoddesc}{format}{record}
822Do formatting for a record - if a formatter is set, use it.
823Otherwise, use the default formatter for the module.
Skip Montanaro649698f2002-11-14 03:57:19 +0000824\end{methoddesc}
825
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000826\begin{methoddesc}{emit}{record}
827Do whatever it takes to actually log the specified logging record.
828This version is intended to be implemented by subclasses and so
829raises a \exception{NotImplementedError}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000830\end{methoddesc}
831
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000832\subsubsection{StreamHandler}
Skip Montanaro649698f2002-11-14 03:57:19 +0000833
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000834The \class{StreamHandler} class sends logging output to streams such as
835\var{sys.stdout}, \var{sys.stderr} or any file-like object (or, more
836precisely, any object which supports \method{write()} and \method{flush()}
Raymond Hettinger2ef85a72003-01-25 21:46:53 +0000837methods).
Skip Montanaro649698f2002-11-14 03:57:19 +0000838
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000839\begin{classdesc}{StreamHandler}{\optional{strm}}
840Returns a new instance of the \class{StreamHandler} class. If \var{strm} is
841specified, the instance will use it for logging output; otherwise,
842\var{sys.stderr} will be used.
Skip Montanaro649698f2002-11-14 03:57:19 +0000843\end{classdesc}
844
845\begin{methoddesc}{emit}{record}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000846If a formatter is specified, it is used to format the record.
847The record is then written to the stream with a trailing newline.
848If exception information is present, it is formatted using
849\function{traceback.print_exception()} and appended to the stream.
Skip Montanaro649698f2002-11-14 03:57:19 +0000850\end{methoddesc}
851
852\begin{methoddesc}{flush}{}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000853Flushes the stream by calling its \method{flush()} method. Note that
854the \method{close()} method is inherited from \class{Handler} and
855so does nothing, so an explicit \method{flush()} call may be needed
856at times.
Skip Montanaro649698f2002-11-14 03:57:19 +0000857\end{methoddesc}
858
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000859\subsubsection{FileHandler}
Skip Montanaro649698f2002-11-14 03:57:19 +0000860
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000861The \class{FileHandler} class sends logging output to a disk file.
Fred Drake68e6d572003-01-28 22:02:35 +0000862It inherits the output functionality from \class{StreamHandler}.
Skip Montanaro649698f2002-11-14 03:57:19 +0000863
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000864\begin{classdesc}{FileHandler}{filename\optional{, mode}}
865Returns a new instance of the \class{FileHandler} class. The specified
866file is opened and used as the stream for logging. If \var{mode} is
Fred Drake9a5b6a62003-07-08 15:38:40 +0000867not specified, \constant{'a'} is used. By default, the file grows
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000868indefinitely.
Skip Montanaro649698f2002-11-14 03:57:19 +0000869\end{classdesc}
870
871\begin{methoddesc}{close}{}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000872Closes the file.
Skip Montanaro649698f2002-11-14 03:57:19 +0000873\end{methoddesc}
874
875\begin{methoddesc}{emit}{record}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000876Outputs the record to the file.
877\end{methoddesc}
Skip Montanaro649698f2002-11-14 03:57:19 +0000878
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000879\subsubsection{RotatingFileHandler}
Skip Montanaro649698f2002-11-14 03:57:19 +0000880
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000881The \class{RotatingFileHandler} class supports rotation of disk log files.
882
Fred Drake9a5b6a62003-07-08 15:38:40 +0000883\begin{classdesc}{RotatingFileHandler}{filename\optional{, mode\optional{,
884 maxBytes\optional{, backupCount}}}}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000885Returns a new instance of the \class{RotatingFileHandler} class. The
886specified file is opened and used as the stream for logging. If
Fred Drake68e6d572003-01-28 22:02:35 +0000887\var{mode} is not specified, \code{'a'} is used. By default, the
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000888file grows indefinitely.
Andrew M. Kuchling7cf4d9b2003-09-26 13:45:18 +0000889
890You can use the \var{maxBytes} and
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000891\var{backupCount} values to allow the file to \dfn{rollover} at a
892predetermined size. When the size is about to be exceeded, the file is
Andrew M. Kuchling7cf4d9b2003-09-26 13:45:18 +0000893closed and a new file is silently opened for output. Rollover occurs
894whenever the current log file is nearly \var{maxBytes} in length; if
895\var{maxBytes} is zero, rollover never occurs. If \var{backupCount}
896is non-zero, the system will save old log files by appending the
897extensions ".1", ".2" etc., to the filename. For example, with
898a \var{backupCount} of 5 and a base file name of
899\file{app.log}, you would get \file{app.log},
900\file{app.log.1}, \file{app.log.2}, up to \file{app.log.5}. The file being
901written to is always \file{app.log}. When this file is filled, it is
902closed and renamed to \file{app.log.1}, and if files \file{app.log.1},
903\file{app.log.2}, etc. exist, then they are renamed to \file{app.log.2},
Vinay Sajipa13c60b2004-07-03 11:45:53 +0000904\file{app.log.3} etc. respectively.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000905\end{classdesc}
906
907\begin{methoddesc}{doRollover}{}
908Does a rollover, as described above.
909\end{methoddesc}
910
911\begin{methoddesc}{emit}{record}
Johannes Gijsbersf1643222004-11-07 16:11:35 +0000912Outputs the record to the file, catering for rollover as described previously.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000913\end{methoddesc}
914
Johannes Gijsbers4f802ac2004-11-07 14:14:27 +0000915\subsubsection{TimedRotatingFileHandler}
916
917The \class{TimedRotatingFileHandler} class supports rotation of disk log files
918at certain timed intervals.
919
920\begin{classdesc}{TimedRotatingFileHandler}{filename
921 \optional{,when
922 \optional{,interval
923 \optional{,backupCount}}}}
924
925Returns a new instance of the \class{TimedRotatingFileHandler} class. The
926specified file is opened and used as the stream for logging. On rotating
927it also sets the filename suffix. Rotating happens based on the product
Vinay Sajipedde4922004-11-11 13:54:48 +0000928of \var{when} and \var{interval}.
Johannes Gijsbers4f802ac2004-11-07 14:14:27 +0000929
930You can use the \var{when} to specify the type of \var{interval}. The
931list of possible values is, note that they are not case sensitive:
932
933\begin{tableii}{l|l}{}{Value}{Type of interval}
934 \lineii{S}{Seconds}
935 \lineii{M}{Minutes}
936 \lineii{H}{Hours}
937 \lineii{D}{Days}
938 \lineii{W}{Week day (0=Monday)}
939 \lineii{midnight}{Roll over at midnight}
940\end{tableii}
941
942If \var{backupCount} is non-zero, the system will save old log files by
943appending the extensions ".1", ".2" etc., to the filename. For example,
944with a \var{backupCount} of 5 and a base file name of \file{app.log},
945you would get \file{app.log}, \file{app.log.1}, \file{app.log.2}, up to
946\file{app.log.5}. The file being written to is always \file{app.log}.
947When this file is filled, it is closed and renamed to \file{app.log.1},
948and if files \file{app.log.1}, \file{app.log.2}, etc. exist, then they
949are renamed to \file{app.log.2}, \file{app.log.3} etc. respectively.
950\end{classdesc}
951
952\begin{methoddesc}{doRollover}{}
953Does a rollover, as described above.
954\end{methoddesc}
955
956\begin{methoddesc}{emit}{record}
957Outputs the record to the file, catering for rollover as described
958above.
959\end{methoddesc}
960
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000961\subsubsection{SocketHandler}
962
963The \class{SocketHandler} class sends logging output to a network
964socket. The base class uses a TCP socket.
965
966\begin{classdesc}{SocketHandler}{host, port}
967Returns a new instance of the \class{SocketHandler} class intended to
968communicate with a remote machine whose address is given by \var{host}
969and \var{port}.
970\end{classdesc}
971
972\begin{methoddesc}{close}{}
973Closes the socket.
974\end{methoddesc}
975
976\begin{methoddesc}{handleError}{}
977\end{methoddesc}
978
979\begin{methoddesc}{emit}{}
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +0000980Pickles the record's attribute dictionary and writes it to the socket in
981binary format. If there is an error with the socket, silently drops the
982packet. If the connection was previously lost, re-establishes the connection.
Fred Drake6b3b0462004-04-09 18:26:40 +0000983To unpickle the record at the receiving end into a \class{LogRecord}, use the
984\function{makeLogRecord()} function.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +0000985\end{methoddesc}
986
987\begin{methoddesc}{handleError}{}
988Handles an error which has occurred during \method{emit()}. The
989most likely cause is a lost connection. Closes the socket so that
990we can retry on the next event.
991\end{methoddesc}
992
993\begin{methoddesc}{makeSocket}{}
994This is a factory method which allows subclasses to define the precise
995type of socket they want. The default implementation creates a TCP
996socket (\constant{socket.SOCK_STREAM}).
997\end{methoddesc}
998
999\begin{methoddesc}{makePickle}{record}
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +00001000Pickles the record's attribute dictionary in binary format with a length
1001prefix, and returns it ready for transmission across the socket.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001002\end{methoddesc}
1003
1004\begin{methoddesc}{send}{packet}
Raymond Hettinger2ef85a72003-01-25 21:46:53 +00001005Send a pickled string \var{packet} to the socket. This function allows
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001006for partial sends which can happen when the network is busy.
1007\end{methoddesc}
1008
1009\subsubsection{DatagramHandler}
1010
1011The \class{DatagramHandler} class inherits from \class{SocketHandler}
1012to support sending logging messages over UDP sockets.
1013
1014\begin{classdesc}{DatagramHandler}{host, port}
1015Returns a new instance of the \class{DatagramHandler} class intended to
1016communicate with a remote machine whose address is given by \var{host}
1017and \var{port}.
1018\end{classdesc}
1019
1020\begin{methoddesc}{emit}{}
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +00001021Pickles the record's attribute dictionary and writes it to the socket in
1022binary format. If there is an error with the socket, silently drops the
1023packet.
Fred Drake6b3b0462004-04-09 18:26:40 +00001024To unpickle the record at the receiving end into a \class{LogRecord}, use the
1025\function{makeLogRecord()} function.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001026\end{methoddesc}
1027
1028\begin{methoddesc}{makeSocket}{}
1029The factory method of \class{SocketHandler} is here overridden to create
1030a UDP socket (\constant{socket.SOCK_DGRAM}).
1031\end{methoddesc}
1032
1033\begin{methoddesc}{send}{s}
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +00001034Send a pickled string to a socket.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001035\end{methoddesc}
1036
1037\subsubsection{SysLogHandler}
1038
1039The \class{SysLogHandler} class supports sending logging messages to a
Fred Drake68e6d572003-01-28 22:02:35 +00001040remote or local \UNIX{} syslog.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001041
1042\begin{classdesc}{SysLogHandler}{\optional{address\optional{, facility}}}
1043Returns a new instance of the \class{SysLogHandler} class intended to
Fred Drake68e6d572003-01-28 22:02:35 +00001044communicate with a remote \UNIX{} machine whose address is given by
1045\var{address} in the form of a \code{(\var{host}, \var{port})}
1046tuple. If \var{address} is not specified, \code{('localhost', 514)} is
1047used. The address is used to open a UDP socket. If \var{facility} is
1048not specified, \constant{LOG_USER} is used.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001049\end{classdesc}
1050
1051\begin{methoddesc}{close}{}
1052Closes the socket to the remote host.
1053\end{methoddesc}
1054
1055\begin{methoddesc}{emit}{record}
1056The record is formatted, and then sent to the syslog server. If
1057exception information is present, it is \emph{not} sent to the server.
Skip Montanaro649698f2002-11-14 03:57:19 +00001058\end{methoddesc}
1059
1060\begin{methoddesc}{encodePriority}{facility, priority}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001061Encodes the facility and priority into an integer. You can pass in strings
1062or integers - if strings are passed, internal mapping dictionaries are used
1063to convert them to integers.
Skip Montanaro649698f2002-11-14 03:57:19 +00001064\end{methoddesc}
1065
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001066\subsubsection{NTEventLogHandler}
Skip Montanaro649698f2002-11-14 03:57:19 +00001067
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001068The \class{NTEventLogHandler} class supports sending logging messages
1069to a local Windows NT, Windows 2000 or Windows XP event log. Before
1070you can use it, you need Mark Hammond's Win32 extensions for Python
1071installed.
Skip Montanaro649698f2002-11-14 03:57:19 +00001072
Fred Drake9a5b6a62003-07-08 15:38:40 +00001073\begin{classdesc}{NTEventLogHandler}{appname\optional{,
1074 dllname\optional{, logtype}}}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001075Returns a new instance of the \class{NTEventLogHandler} class. The
1076\var{appname} is used to define the application name as it appears in the
1077event log. An appropriate registry entry is created using this name.
1078The \var{dllname} should give the fully qualified pathname of a .dll or .exe
1079which contains message definitions to hold in the log (if not specified,
Fred Drake9a5b6a62003-07-08 15:38:40 +00001080\code{'win32service.pyd'} is used - this is installed with the Win32
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001081extensions and contains some basic placeholder message definitions.
1082Note that use of these placeholders will make your event logs big, as the
1083entire message source is held in the log. If you want slimmer logs, you have
1084to pass in the name of your own .dll or .exe which contains the message
1085definitions you want to use in the event log). The \var{logtype} is one of
Fred Drake9a5b6a62003-07-08 15:38:40 +00001086\code{'Application'}, \code{'System'} or \code{'Security'}, and
1087defaults to \code{'Application'}.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001088\end{classdesc}
1089
1090\begin{methoddesc}{close}{}
1091At this point, you can remove the application name from the registry as a
1092source of event log entries. However, if you do this, you will not be able
1093to see the events as you intended in the Event Log Viewer - it needs to be
1094able to access the registry to get the .dll name. The current version does
1095not do this (in fact it doesn't do anything).
1096\end{methoddesc}
1097
1098\begin{methoddesc}{emit}{record}
1099Determines the message ID, event category and event type, and then logs the
1100message in the NT event log.
1101\end{methoddesc}
1102
1103\begin{methoddesc}{getEventCategory}{record}
1104Returns the event category for the record. Override this if you
1105want to specify your own categories. This version returns 0.
1106\end{methoddesc}
1107
1108\begin{methoddesc}{getEventType}{record}
1109Returns the event type for the record. Override this if you want
1110to specify your own types. This version does a mapping using the
1111handler's typemap attribute, which is set up in \method{__init__()}
1112to a dictionary which contains mappings for \constant{DEBUG},
1113\constant{INFO}, \constant{WARNING}, \constant{ERROR} and
1114\constant{CRITICAL}. If you are using your own levels, you will either need
1115to override this method or place a suitable dictionary in the
1116handler's \var{typemap} attribute.
1117\end{methoddesc}
1118
1119\begin{methoddesc}{getMessageID}{record}
1120Returns the message ID for the record. If you are using your
1121own messages, you could do this by having the \var{msg} passed to the
1122logger being an ID rather than a format string. Then, in here,
1123you could use a dictionary lookup to get the message ID. This
1124version returns 1, which is the base message ID in
Fred Drake9a5b6a62003-07-08 15:38:40 +00001125\file{win32service.pyd}.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001126\end{methoddesc}
1127
1128\subsubsection{SMTPHandler}
1129
1130The \class{SMTPHandler} class supports sending logging messages to an email
1131address via SMTP.
1132
1133\begin{classdesc}{SMTPHandler}{mailhost, fromaddr, toaddrs, subject}
1134Returns a new instance of the \class{SMTPHandler} class. The
1135instance is initialized with the from and to addresses and subject
Vinay Sajip84df97f2005-02-18 11:50:11 +00001136line of the email. The \var{toaddrs} should be a list of strings. To specify a
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001137non-standard SMTP port, use the (host, port) tuple format for the
1138\var{mailhost} argument. If you use a string, the standard SMTP port
1139is used.
1140\end{classdesc}
1141
1142\begin{methoddesc}{emit}{record}
1143Formats the record and sends it to the specified addressees.
1144\end{methoddesc}
1145
1146\begin{methoddesc}{getSubject}{record}
1147If you want to specify a subject line which is record-dependent,
1148override this method.
1149\end{methoddesc}
1150
1151\subsubsection{MemoryHandler}
1152
1153The \class{MemoryHandler} supports buffering of logging records in memory,
1154periodically flushing them to a \dfn{target} handler. Flushing occurs
1155whenever the buffer is full, or when an event of a certain severity or
1156greater is seen.
1157
1158\class{MemoryHandler} is a subclass of the more general
1159\class{BufferingHandler}, which is an abstract class. This buffers logging
1160records in memory. Whenever each record is added to the buffer, a
1161check is made by calling \method{shouldFlush()} to see if the buffer
1162should be flushed. If it should, then \method{flush()} is expected to
1163do the needful.
1164
1165\begin{classdesc}{BufferingHandler}{capacity}
1166Initializes the handler with a buffer of the specified capacity.
1167\end{classdesc}
1168
1169\begin{methoddesc}{emit}{record}
1170Appends the record to the buffer. If \method{shouldFlush()} returns true,
1171calls \method{flush()} to process the buffer.
1172\end{methoddesc}
1173
1174\begin{methoddesc}{flush}{}
Raymond Hettinger2ef85a72003-01-25 21:46:53 +00001175You can override this to implement custom flushing behavior. This version
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001176just zaps the buffer to empty.
1177\end{methoddesc}
1178
1179\begin{methoddesc}{shouldFlush}{record}
1180Returns true if the buffer is up to capacity. This method can be
1181overridden to implement custom flushing strategies.
1182\end{methoddesc}
1183
1184\begin{classdesc}{MemoryHandler}{capacity\optional{, flushLevel
Neal Norwitz6fa635d2003-02-18 14:20:07 +00001185\optional{, target}}}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001186Returns a new instance of the \class{MemoryHandler} class. The
1187instance is initialized with a buffer size of \var{capacity}. If
1188\var{flushLevel} is not specified, \constant{ERROR} is used. If no
1189\var{target} is specified, the target will need to be set using
1190\method{setTarget()} before this handler does anything useful.
1191\end{classdesc}
1192
1193\begin{methoddesc}{close}{}
1194Calls \method{flush()}, sets the target to \constant{None} and
1195clears the buffer.
1196\end{methoddesc}
1197
1198\begin{methoddesc}{flush}{}
1199For a \class{MemoryHandler}, flushing means just sending the buffered
1200records to the target, if there is one. Override if you want
Raymond Hettinger2ef85a72003-01-25 21:46:53 +00001201different behavior.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001202\end{methoddesc}
1203
1204\begin{methoddesc}{setTarget}{target}
1205Sets the target handler for this handler.
1206\end{methoddesc}
1207
1208\begin{methoddesc}{shouldFlush}{record}
1209Checks for buffer full or a record at the \var{flushLevel} or higher.
1210\end{methoddesc}
1211
1212\subsubsection{HTTPHandler}
1213
1214The \class{HTTPHandler} class supports sending logging messages to a
Fred Drake68e6d572003-01-28 22:02:35 +00001215Web server, using either \samp{GET} or \samp{POST} semantics.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001216
1217\begin{classdesc}{HTTPHandler}{host, url\optional{, method}}
1218Returns a new instance of the \class{HTTPHandler} class. The
1219instance is initialized with a host address, url and HTTP method.
Fred Drake68e6d572003-01-28 22:02:35 +00001220If no \var{method} is specified, \samp{GET} is used.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001221\end{classdesc}
1222
1223\begin{methoddesc}{emit}{record}
1224Sends the record to the Web server as an URL-encoded dictionary.
1225\end{methoddesc}
1226
1227\subsection{Formatter Objects}
1228
1229\class{Formatter}s have the following attributes and methods. They are
1230responsible for converting a \class{LogRecord} to (usually) a string
1231which can be interpreted by either a human or an external system. The
1232base
1233\class{Formatter} allows a formatting string to be specified. If none is
Fred Drake8efc74d2004-04-15 06:18:48 +00001234supplied, the default value of \code{'\%(message)s'} is used.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001235
1236A Formatter can be initialized with a format string which makes use of
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +00001237knowledge of the \class{LogRecord} attributes - such as the default value
1238mentioned above making use of the fact that the user's message and
Fred Drake6b3b0462004-04-09 18:26:40 +00001239arguments are pre-formatted into a \class{LogRecord}'s \var{message}
Anthony Baxtera6b7d342003-07-08 08:40:20 +00001240attribute. This format string contains standard python \%-style
1241mapping keys. See section \ref{typesseq-strings}, ``String Formatting
1242Operations,'' for more information on string formatting.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001243
Fred Drake6b3b0462004-04-09 18:26:40 +00001244Currently, the useful mapping keys in a \class{LogRecord} are:
Anthony Baxtera6b7d342003-07-08 08:40:20 +00001245
Fred Drake9a5b6a62003-07-08 15:38:40 +00001246\begin{tableii}{l|l}{code}{Format}{Description}
1247\lineii{\%(name)s} {Name of the logger (logging channel).}
1248\lineii{\%(levelno)s} {Numeric logging level for the message
1249 (\constant{DEBUG}, \constant{INFO},
1250 \constant{WARNING}, \constant{ERROR},
1251 \constant{CRITICAL}).}
1252\lineii{\%(levelname)s}{Text logging level for the message
1253 (\code{'DEBUG'}, \code{'INFO'},
1254 \code{'WARNING'}, \code{'ERROR'},
1255 \code{'CRITICAL'}).}
1256\lineii{\%(pathname)s} {Full pathname of the source file where the logging
1257 call was issued (if available).}
1258\lineii{\%(filename)s} {Filename portion of pathname.}
1259\lineii{\%(module)s} {Module (name portion of filename).}
1260\lineii{\%(lineno)d} {Source line number where the logging call was issued
1261 (if available).}
Fred Drake6b3b0462004-04-09 18:26:40 +00001262\lineii{\%(created)f} {Time when the \class{LogRecord} was created (as
Fred Drake9a5b6a62003-07-08 15:38:40 +00001263 returned by \function{time.time()}).}
Fred Drake6b3b0462004-04-09 18:26:40 +00001264\lineii{\%(asctime)s} {Human-readable time when the \class{LogRecord}
1265 was created. By default this is of the form
Fred Drake9a5b6a62003-07-08 15:38:40 +00001266 ``2003-07-08 16:49:45,896'' (the numbers after the
1267 comma are millisecond portion of the time).}
1268\lineii{\%(msecs)d} {Millisecond portion of the time when the
1269 \class{LogRecord} was created.}
1270\lineii{\%(thread)d} {Thread ID (if available).}
Vinay Sajip99358df2005-03-31 20:18:06 +00001271\lineii{\%(threadName)s} {Thread name (if available).}
Fred Drake9a5b6a62003-07-08 15:38:40 +00001272\lineii{\%(process)d} {Process ID (if available).}
1273\lineii{\%(message)s} {The logged message, computed as \code{msg \% args}.}
Anthony Baxtera6b7d342003-07-08 08:40:20 +00001274\end{tableii}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001275
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001276\begin{classdesc}{Formatter}{\optional{fmt\optional{, datefmt}}}
1277Returns a new instance of the \class{Formatter} class. The
1278instance is initialized with a format string for the message as a whole,
1279as well as a format string for the date/time portion of a message. If
Neal Norwitzdd3afa72003-07-08 16:26:34 +00001280no \var{fmt} is specified, \code{'\%(message)s'} is used. If no \var{datefmt}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001281is specified, the ISO8601 date format is used.
1282\end{classdesc}
1283
1284\begin{methoddesc}{format}{record}
1285The record's attribute dictionary is used as the operand to a
1286string formatting operation. Returns the resulting string.
1287Before formatting the dictionary, a couple of preparatory steps
1288are carried out. The \var{message} attribute of the record is computed
1289using \var{msg} \% \var{args}. If the formatting string contains
Fred Drake9a5b6a62003-07-08 15:38:40 +00001290\code{'(asctime)'}, \method{formatTime()} is called to format the
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001291event time. If there is exception information, it is formatted using
1292\method{formatException()} and appended to the message.
1293\end{methoddesc}
1294
1295\begin{methoddesc}{formatTime}{record\optional{, datefmt}}
1296This method should be called from \method{format()} by a formatter which
1297wants to make use of a formatted time. This method can be overridden
1298in formatters to provide for any specific requirement, but the
Raymond Hettinger2ef85a72003-01-25 21:46:53 +00001299basic behavior is as follows: if \var{datefmt} (a string) is specified,
Fred Drakec23e0192003-01-28 22:09:16 +00001300it is used with \function{time.strftime()} to format the creation time of the
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001301record. Otherwise, the ISO8601 format is used. The resulting
1302string is returned.
1303\end{methoddesc}
1304
1305\begin{methoddesc}{formatException}{exc_info}
1306Formats the specified exception information (a standard exception tuple
Fred Drakec23e0192003-01-28 22:09:16 +00001307as returned by \function{sys.exc_info()}) as a string. This default
1308implementation just uses \function{traceback.print_exception()}.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001309The resulting string is returned.
1310\end{methoddesc}
1311
1312\subsection{Filter Objects}
1313
1314\class{Filter}s can be used by \class{Handler}s and \class{Logger}s for
1315more sophisticated filtering than is provided by levels. The base filter
1316class only allows events which are below a certain point in the logger
1317hierarchy. For example, a filter initialized with "A.B" will allow events
1318logged by loggers "A.B", "A.B.C", "A.B.C.D", "A.B.D" etc. but not "A.BB",
1319"B.A.B" etc. If initialized with the empty string, all events are passed.
1320
1321\begin{classdesc}{Filter}{\optional{name}}
1322Returns an instance of the \class{Filter} class. If \var{name} is specified,
1323it names a logger which, together with its children, will have its events
1324allowed through the filter. If no name is specified, allows every event.
1325\end{classdesc}
1326
1327\begin{methoddesc}{filter}{record}
1328Is the specified record to be logged? Returns zero for no, nonzero for
1329yes. If deemed appropriate, the record may be modified in-place by this
1330method.
1331\end{methoddesc}
1332
1333\subsection{LogRecord Objects}
1334
Fred Drake6b3b0462004-04-09 18:26:40 +00001335\class{LogRecord} instances are created every time something is logged. They
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001336contain all the information pertinent to the event being logged. The
1337main information passed in is in msg and args, which are combined
1338using msg \% args to create the message field of the record. The record
1339also includes information such as when the record was created, the
1340source line where the logging call was made, and any exception
1341information to be logged.
1342
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001343\begin{classdesc}{LogRecord}{name, lvl, pathname, lineno, msg, args,
Fred Drake9a5b6a62003-07-08 15:38:40 +00001344 exc_info}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001345Returns an instance of \class{LogRecord} initialized with interesting
1346information. The \var{name} is the logger name; \var{lvl} is the
1347numeric level; \var{pathname} is the absolute pathname of the source
1348file in which the logging call was made; \var{lineno} is the line
1349number in that file where the logging call is found; \var{msg} is the
1350user-supplied message (a format string); \var{args} is the tuple
1351which, together with \var{msg}, makes up the user message; and
1352\var{exc_info} is the exception tuple obtained by calling
1353\function{sys.exc_info() }(or \constant{None}, if no exception information
1354is available).
1355\end{classdesc}
1356
Vinay Sajipe8fdc452004-12-02 21:27:42 +00001357\begin{methoddesc}{getMessage}{}
1358Returns the message for this \class{LogRecord} instance after merging any
1359user-supplied arguments with the message.
1360\end{methoddesc}
1361
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001362\subsection{Thread Safety}
1363
1364The logging module is intended to be thread-safe without any special work
1365needing to be done by its clients. It achieves this though using threading
1366locks; there is one lock to serialize access to the module's shared data,
1367and each handler also creates a lock to serialize access to its underlying
1368I/O.
1369
1370\subsection{Configuration}
1371
1372
Fred Drake94ffbb72004-04-08 19:44:31 +00001373\subsubsection{Configuration functions%
1374 \label{logging-config-api}}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001375
Fred Drake9a5b6a62003-07-08 15:38:40 +00001376The following functions allow the logging module to be
1377configured. Before they can be used, you must import
1378\module{logging.config}. Their use is optional --- you can configure
1379the logging module entirely by making calls to the main API (defined
1380in \module{logging} itself) and defining handlers which are declared
Raymond Hettinger6f3eaa62003-06-27 21:43:39 +00001381either in \module{logging} or \module{logging.handlers}.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001382
1383\begin{funcdesc}{fileConfig}{fname\optional{, defaults}}
1384Reads the logging configuration from a ConfigParser-format file named
1385\var{fname}. This function can be called several times from an application,
1386allowing an end user the ability to select from various pre-canned
1387configurations (if the developer provides a mechanism to present the
1388choices and load the chosen configuration). Defaults to be passed to
1389ConfigParser can be specified in the \var{defaults} argument.
1390\end{funcdesc}
1391
1392\begin{funcdesc}{listen}{\optional{port}}
1393Starts up a socket server on the specified port, and listens for new
1394configurations. If no port is specified, the module's default
1395\constant{DEFAULT_LOGGING_CONFIG_PORT} is used. Logging configurations
1396will be sent as a file suitable for processing by \function{fileConfig()}.
1397Returns a \class{Thread} instance on which you can call \method{start()}
1398to start the server, and which you can \method{join()} when appropriate.
Vinay Sajip4c1423b2005-06-05 20:39:36 +00001399To stop the server, call \function{stopListening()}. To send a configuration
1400to the socket, read in the configuration file and send it to the socket
1401as a string of bytes preceded by a four-byte length packed in binary using
1402struct.\code{pack(">L", n)}.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001403\end{funcdesc}
1404
1405\begin{funcdesc}{stopListening}{}
1406Stops the listening server which was created with a call to
1407\function{listen()}. This is typically called before calling \method{join()}
1408on the return value from \function{listen()}.
1409\end{funcdesc}
1410
Fred Drake94ffbb72004-04-08 19:44:31 +00001411\subsubsection{Configuration file format%
1412 \label{logging-config-fileformat}}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001413
Fred Drake6b3b0462004-04-09 18:26:40 +00001414The configuration file format understood by \function{fileConfig()} is
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001415based on ConfigParser functionality. The file must contain sections
1416called \code{[loggers]}, \code{[handlers]} and \code{[formatters]}
1417which identify by name the entities of each type which are defined in
1418the file. For each such entity, there is a separate section which
1419identified how that entity is configured. Thus, for a logger named
1420\code{log01} in the \code{[loggers]} section, the relevant
1421configuration details are held in a section
1422\code{[logger_log01]}. Similarly, a handler called \code{hand01} in
1423the \code{[handlers]} section will have its configuration held in a
1424section called \code{[handler_hand01]}, while a formatter called
1425\code{form01} in the \code{[formatters]} section will have its
1426configuration specified in a section called
1427\code{[formatter_form01]}. The root logger configuration must be
1428specified in a section called \code{[logger_root]}.
1429
1430Examples of these sections in the file are given below.
Skip Montanaro649698f2002-11-14 03:57:19 +00001431
1432\begin{verbatim}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001433[loggers]
1434keys=root,log02,log03,log04,log05,log06,log07
Skip Montanaro649698f2002-11-14 03:57:19 +00001435
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001436[handlers]
1437keys=hand01,hand02,hand03,hand04,hand05,hand06,hand07,hand08,hand09
1438
1439[formatters]
1440keys=form01,form02,form03,form04,form05,form06,form07,form08,form09
Skip Montanaro649698f2002-11-14 03:57:19 +00001441\end{verbatim}
1442
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001443The root logger must specify a level and a list of handlers. An
1444example of a root logger section is given below.
Skip Montanaro649698f2002-11-14 03:57:19 +00001445
1446\begin{verbatim}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001447[logger_root]
1448level=NOTSET
1449handlers=hand01
Skip Montanaro649698f2002-11-14 03:57:19 +00001450\end{verbatim}
1451
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001452The \code{level} entry can be one of \code{DEBUG, INFO, WARNING,
1453ERROR, CRITICAL} or \code{NOTSET}. For the root logger only,
1454\code{NOTSET} means that all messages will be logged. Level values are
1455\function{eval()}uated in the context of the \code{logging} package's
1456namespace.
Skip Montanaro649698f2002-11-14 03:57:19 +00001457
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001458The \code{handlers} entry is a comma-separated list of handler names,
1459which must appear in the \code{[handlers]} section. These names must
1460appear in the \code{[handlers]} section and have corresponding
1461sections in the configuration file.
Skip Montanaro649698f2002-11-14 03:57:19 +00001462
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001463For loggers other than the root logger, some additional information is
1464required. This is illustrated by the following example.
Skip Montanaro649698f2002-11-14 03:57:19 +00001465
1466\begin{verbatim}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001467[logger_parser]
1468level=DEBUG
1469handlers=hand01
1470propagate=1
1471qualname=compiler.parser
Skip Montanaro649698f2002-11-14 03:57:19 +00001472\end{verbatim}
1473
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001474The \code{level} and \code{handlers} entries are interpreted as for
1475the root logger, except that if a non-root logger's level is specified
1476as \code{NOTSET}, the system consults loggers higher up the hierarchy
1477to determine the effective level of the logger. The \code{propagate}
1478entry is set to 1 to indicate that messages must propagate to handlers
1479higher up the logger hierarchy from this logger, or 0 to indicate that
1480messages are \strong{not} propagated to handlers up the hierarchy. The
1481\code{qualname} entry is the hierarchical channel name of the logger,
Vinay Sajipa13c60b2004-07-03 11:45:53 +00001482that is to say the name used by the application to get the logger.
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001483
1484Sections which specify handler configuration are exemplified by the
1485following.
1486
Skip Montanaro649698f2002-11-14 03:57:19 +00001487\begin{verbatim}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001488[handler_hand01]
1489class=StreamHandler
1490level=NOTSET
1491formatter=form01
1492args=(sys.stdout,)
Skip Montanaro649698f2002-11-14 03:57:19 +00001493\end{verbatim}
1494
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001495The \code{class} entry indicates the handler's class (as determined by
1496\function{eval()} in the \code{logging} package's namespace). The
1497\code{level} is interpreted as for loggers, and \code{NOTSET} is taken
1498to mean "log everything".
1499
1500The \code{formatter} entry indicates the key name of the formatter for
1501this handler. If blank, a default formatter
1502(\code{logging._defaultFormatter}) is used. If a name is specified, it
1503must appear in the \code{[formatters]} section and have a
1504corresponding section in the configuration file.
1505
1506The \code{args} entry, when \function{eval()}uated in the context of
1507the \code{logging} package's namespace, is the list of arguments to
1508the constructor for the handler class. Refer to the constructors for
1509the relevant handlers, or to the examples below, to see how typical
1510entries are constructed.
Skip Montanaro649698f2002-11-14 03:57:19 +00001511
1512\begin{verbatim}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001513[handler_hand02]
1514class=FileHandler
1515level=DEBUG
1516formatter=form02
1517args=('python.log', 'w')
1518
1519[handler_hand03]
1520class=handlers.SocketHandler
1521level=INFO
1522formatter=form03
1523args=('localhost', handlers.DEFAULT_TCP_LOGGING_PORT)
1524
1525[handler_hand04]
1526class=handlers.DatagramHandler
1527level=WARN
1528formatter=form04
1529args=('localhost', handlers.DEFAULT_UDP_LOGGING_PORT)
1530
1531[handler_hand05]
1532class=handlers.SysLogHandler
1533level=ERROR
1534formatter=form05
1535args=(('localhost', handlers.SYSLOG_UDP_PORT), handlers.SysLogHandler.LOG_USER)
1536
1537[handler_hand06]
Vinay Sajip20f42c42004-07-12 15:48:04 +00001538class=handlers.NTEventLogHandler
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001539level=CRITICAL
1540formatter=form06
1541args=('Python Application', '', 'Application')
1542
1543[handler_hand07]
Vinay Sajip20f42c42004-07-12 15:48:04 +00001544class=handlers.SMTPHandler
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001545level=WARN
1546formatter=form07
1547args=('localhost', 'from@abc', ['user1@abc', 'user2@xyz'], 'Logger Subject')
1548
1549[handler_hand08]
Vinay Sajip20f42c42004-07-12 15:48:04 +00001550class=handlers.MemoryHandler
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001551level=NOTSET
1552formatter=form08
1553target=
1554args=(10, ERROR)
1555
1556[handler_hand09]
Vinay Sajip20f42c42004-07-12 15:48:04 +00001557class=handlers.HTTPHandler
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001558level=NOTSET
1559formatter=form09
1560args=('localhost:9022', '/log', 'GET')
Skip Montanaro649698f2002-11-14 03:57:19 +00001561\end{verbatim}
Neal Norwitzcd5c8c22003-01-25 21:29:41 +00001562
1563Sections which specify formatter configuration are typified by the following.
1564
1565\begin{verbatim}
1566[formatter_form01]
1567format=F1 %(asctime)s %(levelname)s %(message)s
1568datefmt=
1569\end{verbatim}
1570
1571The \code{format} entry is the overall format string, and the
1572\code{datefmt} entry is the \function{strftime()}-compatible date/time format
1573string. If empty, the package substitutes ISO8601 format date/times, which
1574is almost equivalent to specifying the date format string "%Y-%m-%d %H:%M:%S".
1575The ISO8601 format also specifies milliseconds, which are appended to the
1576result of using the above format string, with a comma separator. An example
1577time in ISO8601 format is \code{2003-01-23 00:29:50,411}.