blob: 5cb7029adf5e9e3bb51654f61a361c72651830c6 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`trace` --- Trace or track Python statement execution
2==========================================================
3
4.. module:: trace
5 :synopsis: Trace or track Python statement execution.
6
Raymond Hettinger10480942011-01-10 03:26:08 +00007**Source code:** :source:`Lib/trace.py`
Georg Brandl116aa622007-08-15 14:28:22 +00008
Raymond Hettinger4f707fd2011-01-10 19:54:11 +00009--------------
10
Georg Brandl116aa622007-08-15 14:28:22 +000011The :mod:`trace` module allows you to trace program execution, generate
12annotated statement coverage listings, print caller/callee relationships and
13list functions executed during a program run. It can be used in another program
14or from the command line.
15
Marco Buttu5dfccb02017-03-03 21:42:04 +010016.. seealso::
17
18 `Coverage.py <https://coverage.readthedocs.io/>`_
19 A popular third-party coverage tool that provides HTML
20 output along with advanced features such as branch coverage.
21
Georg Brandl116aa622007-08-15 14:28:22 +000022.. _trace-cli:
23
Éric Araujod00862a2010-12-15 19:09:58 +000024Command-Line Usage
Georg Brandl116aa622007-08-15 14:28:22 +000025------------------
26
27The :mod:`trace` module can be invoked from the command line. It can be as
28simple as ::
29
Éric Araujod00862a2010-12-15 19:09:58 +000030 python -m trace --count -C . somefile.py ...
Georg Brandl116aa622007-08-15 14:28:22 +000031
Éric Araujo67f0b6c2010-12-15 19:30:15 +000032The above will execute :file:`somefile.py` and generate annotated listings of
33all Python modules imported during the execution into the current directory.
Georg Brandl116aa622007-08-15 14:28:22 +000034
Éric Araujod00862a2010-12-15 19:09:58 +000035.. program:: trace
Georg Brandl116aa622007-08-15 14:28:22 +000036
Éric Araujod00862a2010-12-15 19:09:58 +000037.. cmdoption:: --help
38
39 Display usage and exit.
40
41.. cmdoption:: --version
42
43 Display the version of the module and exit.
44
45Main options
46^^^^^^^^^^^^
47
Éric Araujo67f0b6c2010-12-15 19:30:15 +000048At least one of the following options must be specified when invoking
49:mod:`trace`. The :option:`--listfuncs <-l>` option is mutually exclusive with
Senthil Kumaranf5c34052014-04-06 10:59:47 -070050the :option:`--trace <-t>` and :option:`--count <-c>` options. When
51:option:`--listfuncs <-l>` is provided, neither :option:`--count <-c>` nor
Éric Araujo67f0b6c2010-12-15 19:30:15 +000052:option:`--trace <-t>` are accepted, and vice versa.
Éric Araujod00862a2010-12-15 19:09:58 +000053
54.. program:: trace
55
56.. cmdoption:: -c, --count
57
58 Produce a set of annotated listing files upon program completion that shows
Éric Araujo67f0b6c2010-12-15 19:30:15 +000059 how many times each statement was executed. See also
60 :option:`--coverdir <-C>`, :option:`--file <-f>` and
Éric Araujod00862a2010-12-15 19:09:58 +000061 :option:`--no-report <-R>` below.
62
63.. cmdoption:: -t, --trace
64
Georg Brandl116aa622007-08-15 14:28:22 +000065 Display lines as they are executed.
66
Éric Araujod00862a2010-12-15 19:09:58 +000067.. cmdoption:: -l, --listfuncs
Georg Brandl116aa622007-08-15 14:28:22 +000068
Éric Araujod00862a2010-12-15 19:09:58 +000069 Display the functions executed by running the program.
70
71.. cmdoption:: -r, --report
72
Georg Brandl116aa622007-08-15 14:28:22 +000073 Produce an annotated list from an earlier program run that used the
Éric Araujo67f0b6c2010-12-15 19:30:15 +000074 :option:`--count <-c>` and :option:`--file <-f>` option. This does not
75 execute any code.
Georg Brandl116aa622007-08-15 14:28:22 +000076
Éric Araujod00862a2010-12-15 19:09:58 +000077.. cmdoption:: -T, --trackcalls
Georg Brandl116aa622007-08-15 14:28:22 +000078
Éric Araujod00862a2010-12-15 19:09:58 +000079 Display the calling relationships exposed by running the program.
Georg Brandl116aa622007-08-15 14:28:22 +000080
Éric Araujod00862a2010-12-15 19:09:58 +000081Modifiers
82^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +000083
Éric Araujod00862a2010-12-15 19:09:58 +000084.. program:: trace
Georg Brandl116aa622007-08-15 14:28:22 +000085
Éric Araujod00862a2010-12-15 19:09:58 +000086.. cmdoption:: -f, --file=<file>
Georg Brandl116aa622007-08-15 14:28:22 +000087
Éric Araujo67f0b6c2010-12-15 19:30:15 +000088 Name of a file to accumulate counts over several tracing runs. Should be
89 used with the :option:`--count <-c>` option.
Éric Araujod00862a2010-12-15 19:09:58 +000090
91.. cmdoption:: -C, --coverdir=<dir>
92
Éric Araujo67f0b6c2010-12-15 19:30:15 +000093 Directory where the report files go. The coverage report for
Éric Araujod00862a2010-12-15 19:09:58 +000094 ``package.module`` is written to file :file:`{dir}/{package}/{module}.cover`.
95
96.. cmdoption:: -m, --missing
97
Georg Brandl116aa622007-08-15 14:28:22 +000098 When generating annotated listings, mark lines which were not executed with
Éric Araujod00862a2010-12-15 19:09:58 +000099 ``>>>>>>``.
Georg Brandl116aa622007-08-15 14:28:22 +0000100
Éric Araujod00862a2010-12-15 19:09:58 +0000101.. cmdoption:: -s, --summary
Georg Brandl116aa622007-08-15 14:28:22 +0000102
Éric Araujod00862a2010-12-15 19:09:58 +0000103 When using :option:`--count <-c>` or :option:`--report <-r>`, write a brief
104 summary to stdout for each file processed.
Georg Brandl116aa622007-08-15 14:28:22 +0000105
Éric Araujod00862a2010-12-15 19:09:58 +0000106.. cmdoption:: -R, --no-report
Georg Brandl116aa622007-08-15 14:28:22 +0000107
Éric Araujod00862a2010-12-15 19:09:58 +0000108 Do not generate annotated listings. This is useful if you intend to make
109 several runs with :option:`--count <-c>`, and then produce a single set of
110 annotated listings at the end.
111
112.. cmdoption:: -g, --timing
113
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000114 Prefix each line with the time since the program started. Only used while
Éric Araujod00862a2010-12-15 19:09:58 +0000115 tracing.
116
117Filters
118^^^^^^^
119
120These options may be repeated multiple times.
121
122.. program:: trace
123
124.. cmdoption:: --ignore-module=<mod>
125
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000126 Ignore each of the given module names and its submodules (if it is a
127 package). The argument can be a list of names separated by a comma.
Éric Araujod00862a2010-12-15 19:09:58 +0000128
129.. cmdoption:: --ignore-dir=<dir>
130
131 Ignore all modules and packages in the named directory and subdirectories.
132 The argument can be a list of directories separated by :data:`os.pathsep`.
Georg Brandl116aa622007-08-15 14:28:22 +0000133
134.. _trace-api:
135
Éric Araujod00862a2010-12-15 19:09:58 +0000136Programmatic Interface
137----------------------
Georg Brandl116aa622007-08-15 14:28:22 +0000138
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000139.. class:: Trace(count=1, trace=1, countfuncs=0, countcallers=0, ignoremods=(),\
140 ignoredirs=(), infile=None, outfile=None, timing=False)
Georg Brandl116aa622007-08-15 14:28:22 +0000141
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000142 Create an object to trace execution of a single statement or expression. All
143 parameters are optional. *count* enables counting of line numbers. *trace*
144 enables line execution tracing. *countfuncs* enables listing of the
145 functions called during the run. *countcallers* enables call relationship
146 tracking. *ignoremods* is a list of modules or packages to ignore.
147 *ignoredirs* is a list of directories whose modules or packages should be
148 ignored. *infile* is the name of the file from which to read stored count
149 information. *outfile* is the name of the file in which to write updated
150 count information. *timing* enables a timestamp relative to when tracing was
151 started to be displayed.
Georg Brandl116aa622007-08-15 14:28:22 +0000152
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000153 .. method:: run(cmd)
Georg Brandl116aa622007-08-15 14:28:22 +0000154
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000155 Execute the command and gather statistics from the execution with
156 the current tracing parameters. *cmd* must be a string or code object,
157 suitable for passing into :func:`exec`.
Georg Brandl116aa622007-08-15 14:28:22 +0000158
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000159 .. method:: runctx(cmd, globals=None, locals=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000160
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000161 Execute the command and gather statistics from the execution with the
162 current tracing parameters, in the defined global and local
163 environments. If not defined, *globals* and *locals* default to empty
164 dictionaries.
Georg Brandl116aa622007-08-15 14:28:22 +0000165
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000166 .. method:: runfunc(func, *args, **kwds)
Georg Brandl116aa622007-08-15 14:28:22 +0000167
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000168 Call *func* with the given arguments under control of the :class:`Trace`
169 object with the current tracing parameters.
Georg Brandl116aa622007-08-15 14:28:22 +0000170
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000171 .. method:: results()
Éric Araujod00862a2010-12-15 19:09:58 +0000172
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000173 Return a :class:`CoverageResults` object that contains the cumulative
174 results of all previous calls to ``run``, ``runctx`` and ``runfunc``
175 for the given :class:`Trace` instance. Does not reset the accumulated
176 trace results.
Éric Araujod00862a2010-12-15 19:09:58 +0000177
178.. class:: CoverageResults
179
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000180 A container for coverage results, created by :meth:`Trace.results`. Should
181 not be created directly by the user.
Éric Araujod00862a2010-12-15 19:09:58 +0000182
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000183 .. method:: update(other)
Éric Araujod00862a2010-12-15 19:09:58 +0000184
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000185 Merge in data from another :class:`CoverageResults` object.
Éric Araujod00862a2010-12-15 19:09:58 +0000186
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000187 .. method:: write_results(show_missing=True, summary=False, coverdir=None)
Éric Araujod00862a2010-12-15 19:09:58 +0000188
Éric Araujo67f0b6c2010-12-15 19:30:15 +0000189 Write coverage results. Set *show_missing* to show lines that had no
190 hits. Set *summary* to include in the output the coverage summary per
191 module. *coverdir* specifies the directory into which the coverage
192 result files will be output. If ``None``, the results for each source
193 file are placed in its directory.
Éric Araujod00862a2010-12-15 19:09:58 +0000194
195A simple example demonstrating the use of the programmatic interface::
Georg Brandl116aa622007-08-15 14:28:22 +0000196
197 import sys
198 import trace
199
200 # create a Trace object, telling it what to ignore, and whether to
201 # do tracing or line-counting or both.
202 tracer = trace.Trace(
203 ignoredirs=[sys.prefix, sys.exec_prefix],
204 trace=0,
205 count=1)
206
207 # run the new command using the given tracer
208 tracer.run('main()')
209
Petri Lehtinen9f74c6c2013-02-23 19:26:56 +0100210 # make a report, placing output in the current directory
Georg Brandl116aa622007-08-15 14:28:22 +0000211 r = tracer.results()
Petri Lehtinen9f74c6c2013-02-23 19:26:56 +0100212 r.write_results(show_missing=True, coverdir=".")
Georg Brandl116aa622007-08-15 14:28:22 +0000213