blob: d720e01050577df465bd6522bee19436b0232e45 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`py_compile` --- Compile Python source files
2=================================================
3
4.. module:: py_compile
5 :synopsis: Generate byte-code files from Python source files.
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04006
Christian Heimes5b5e81c2007-12-31 16:14:33 +00007.. sectionauthor:: Fred L. Drake, Jr. <fdrake@acm.org>
8.. documentation based on module docstrings
Georg Brandl116aa622007-08-15 14:28:22 +00009
Raymond Hettinger469271d2011-01-27 20:38:46 +000010**Source code:** :source:`Lib/py_compile.py`
11
Terry Jan Reedyfa089b92016-06-11 15:02:54 -040012.. index:: pair: file; byte-code
13
Raymond Hettinger469271d2011-01-27 20:38:46 +000014--------------
15
Georg Brandl116aa622007-08-15 14:28:22 +000016The :mod:`py_compile` module provides a function to generate a byte-code file
17from a source file, and another function used when the module source file is
18invoked as a script.
19
20Though not often needed, this function can be useful when installing modules for
21shared use, especially if some of the users may not have permission to write the
22byte-code cache files in the directory containing the source code.
23
24
25.. exception:: PyCompileError
26
27 Exception raised when an error occurs while attempting to compile the file.
28
29
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080030.. function:: compile(file, cfile=None, dfile=None, doraise=False, optimize=-1, invalidation_mode=PycInvalidationMode.TIMESTAMP)
Georg Brandl116aa622007-08-15 14:28:22 +000031
Brett Cannonaa73a1c2013-03-13 09:37:42 -070032 Compile a source file to byte-code and write out the byte-code cache file.
R David Murray689016f2016-08-13 14:47:18 -040033 The source code is loaded from the file named *file*. The byte-code is
Larry Hastings770ce202015-04-19 13:50:12 -070034 written to *cfile*, which defaults to the :pep:`3147`/:pep:`488` path, ending
Brett Cannonf299abd2015-04-13 14:21:02 -040035 in ``.pyc``.
Éric Araujo930df312010-12-16 06:28:48 +000036 For example, if *file* is ``/foo/bar/baz.py`` *cfile* will default to
37 ``/foo/bar/__pycache__/baz.cpython-32.pyc`` for Python 3.2. If *dfile* is
38 specified, it is used as the name of the source file in error messages when
39 instead of *file*. If *doraise* is true, a :exc:`PyCompileError` is raised
40 when an error is encountered while compiling *file*. If *doraise* is false
41 (the default), an error string is written to ``sys.stderr``, but no exception
42 is raised. This function returns the path to byte-compiled file, i.e.
43 whatever *cfile* value was used.
Georg Brandl116aa622007-08-15 14:28:22 +000044
Brett Cannon33915eb2013-06-14 18:33:00 -040045 If the path that *cfile* becomes (either explicitly specified or computed)
46 is a symlink or non-regular file, :exc:`FileExistsError` will be raised.
47 This is to act as a warning that import will turn those paths into regular
48 files if it is allowed to write byte-compiled files to those paths. This is
49 a side-effect of import using file renaming to place the final byte-compiled
50 file into place to prevent concurrent file writing issues.
51
Georg Brandl8334fd92010-12-04 10:26:46 +000052 *optimize* controls the optimization level and is passed to the built-in
53 :func:`compile` function. The default of ``-1`` selects the optimization
54 level of the current interpreter.
55
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080056 *invalidation_mode* should be a member of the :class:`PycInvalidationMode`
57 enum and controls how the generated ``.pyc`` files are invalidated at
Bernhard M. Wiedemannccbe5812018-01-24 22:26:18 +010058 runtime. If the :envvar:`SOURCE_DATE_EPOCH` environment variable is set,
59 *invalidation_mode* will be forced to
60 :attr:`PycInvalidationMode.CHECKED_HASH`.
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080061
Georg Brandl8334fd92010-12-04 10:26:46 +000062 .. versionchanged:: 3.2
Éric Araujo930df312010-12-16 06:28:48 +000063 Changed default value of *cfile* to be :PEP:`3147`-compliant. Previous
64 default was *file* + ``'c'`` (``'o'`` if optimization was enabled).
65 Also added the *optimize* parameter.
Georg Brandl8334fd92010-12-04 10:26:46 +000066
Brett Cannonaa73a1c2013-03-13 09:37:42 -070067 .. versionchanged:: 3.4
68 Changed code to use :mod:`importlib` for the byte-code cache file writing.
69 This means file creation/writing semantics now match what :mod:`importlib`
Brett Cannon33915eb2013-06-14 18:33:00 -040070 does, e.g. permissions, write-and-move semantics, etc. Also added the
71 caveat that :exc:`FileExistsError` is raised if *cfile* is a symlink or
72 non-regular file.
Brett Cannonaa73a1c2013-03-13 09:37:42 -070073
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080074 .. versionchanged:: 3.7
75 The *invalidation_mode* parameter was added as specified in :pep:`552`.
Bernhard M. Wiedemannccbe5812018-01-24 22:26:18 +010076 If the :envvar:`SOURCE_DATE_EPOCH` environment variable is set,
77 *invalidation_mode* will be forced to
78 :attr:`PycInvalidationMode.CHECKED_HASH`.
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080079
80
81.. class:: PycInvalidationMode
82
83 A enumeration of possible methods the interpreter can use to determine
84 whether a bytecode file is up to date with a source file. The ``.pyc`` file
85 indicates the desired invalidation mode in its header. See
86 :ref:`pyc-invalidation` for more information on how Python invalidates
87 ``.pyc`` files at runtime.
88
89 .. versionadded:: 3.7
90
91 .. attribute:: TIMESTAMP
92
93 The ``.pyc`` file includes the timestamp and size of the source file,
94 which Python will compare against the metadata of the source file at
95 runtime to determine if the ``.pyc`` file needs to be regenerated.
96
97 .. attribute:: CHECKED_HASH
98
99 The ``.pyc`` file includes a hash of the source file content, which Python
100 will compare against the source at runtime to determine if the ``.pyc``
101 file needs to be regenerated.
102
103 .. attribute:: UNCHECKED_HASH
104
105 Like :attr:`CHECKED_HASH`, the ``.pyc`` file includes a hash of the source
106 file content. However, Python will at runtime assume the ``.pyc`` file is
107 up to date and not validate the ``.pyc`` against the source file at all.
108
109 This option is useful when the ``.pycs`` are kept up to date by some
110 system external to Python like a build system.
111
Georg Brandl116aa622007-08-15 14:28:22 +0000112
Georg Brandl18244152009-09-02 20:34:52 +0000113.. function:: main(args=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000114
115 Compile several source files. The files named in *args* (or on the command
Brett Cannonf299abd2015-04-13 14:21:02 -0400116 line, if *args* is ``None``) are compiled and the resulting byte-code is
Georg Brandl116aa622007-08-15 14:28:22 +0000117 cached in the normal manner. This function does not search a directory
118 structure to locate source files; it only compiles files named explicitly.
Éric Araujo930df312010-12-16 06:28:48 +0000119 If ``'-'`` is the only parameter in args, the list of files is taken from
120 standard input.
121
122 .. versionchanged:: 3.2
123 Added support for ``'-'``.
Georg Brandl116aa622007-08-15 14:28:22 +0000124
125When this module is run as a script, the :func:`main` is used to compile all the
Christian Heimesdd15f6c2008-03-16 00:07:10 +0000126files named on the command line. The exit status is nonzero if one of the files
127could not be compiled.
128
Georg Brandl116aa622007-08-15 14:28:22 +0000129
130.. seealso::
131
132 Module :mod:`compileall`
133 Utilities to compile all Python source files in a directory tree.