blob: ced8837d37363f1d62b95424a478d6595fe665b2 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001.. _api-reference:
2
3*************
4API Reference
5*************
6
7
8:mod:`distutils.core` --- Core Distutils functionality
9======================================================
10
11.. module:: distutils.core
12 :synopsis: The core Distutils functionality
13
14
15The :mod:`distutils.core` module is the only module that needs to be installed
16to use the Distutils. It provides the :func:`setup` (which is called from the
17setup script). Indirectly provides the :class:`distutils.dist.Distribution` and
18:class:`distutils.cmd.Command` class.
19
20
21.. function:: setup(arguments)
22
23 The basic do-everything function that does most everything you could ever ask
Éric Araujo000893f2011-05-29 00:14:45 +020024 for from a Distutils method.
Georg Brandl116aa622007-08-15 14:28:22 +000025
26 The setup function takes a large number of arguments. These are laid out in the
27 following table.
28
Georg Brandl44ea77b2013-03-28 13:28:44 +010029 .. tabularcolumns:: |l|L|L|
30
Georg Brandl116aa622007-08-15 14:28:22 +000031 +--------------------+--------------------------------+-------------------------------------------------------------+
32 | argument name | value | type |
33 +====================+================================+=============================================================+
34 | *name* | The name of the package | a string |
35 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020036 | *version* | The version number of the | a string |
37 | | package; see | |
38 | | :mod:`distutils.version` | |
Georg Brandl116aa622007-08-15 14:28:22 +000039 +--------------------+--------------------------------+-------------------------------------------------------------+
40 | *description* | A single line describing the | a string |
41 | | package | |
42 +--------------------+--------------------------------+-------------------------------------------------------------+
43 | *long_description* | Longer description of the | a string |
44 | | package | |
45 +--------------------+--------------------------------+-------------------------------------------------------------+
46 | *author* | The name of the package author | a string |
47 +--------------------+--------------------------------+-------------------------------------------------------------+
48 | *author_email* | The email address of the | a string |
49 | | package author | |
50 +--------------------+--------------------------------+-------------------------------------------------------------+
51 | *maintainer* | The name of the current | a string |
52 | | maintainer, if different from | |
Petri Lehtinen905b6482013-02-23 21:05:27 +010053 | | the author. Note that if | |
54 | | the maintainer is provided, | |
55 | | distutils will use it as the | |
56 | | author in :file:`PKG-INFO` | |
Georg Brandl116aa622007-08-15 14:28:22 +000057 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020058 | *maintainer_email* | The email address of the | a string |
Georg Brandl116aa622007-08-15 14:28:22 +000059 | | current maintainer, if | |
60 | | different from the author | |
61 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020062 | *url* | A URL for the package | a string |
Georg Brandl116aa622007-08-15 14:28:22 +000063 | | (homepage) | |
64 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020065 | *download_url* | A URL to download the package | a string |
Georg Brandl116aa622007-08-15 14:28:22 +000066 +--------------------+--------------------------------+-------------------------------------------------------------+
67 | *packages* | A list of Python packages that | a list of strings |
68 | | distutils will manipulate | |
69 +--------------------+--------------------------------+-------------------------------------------------------------+
70 | *py_modules* | A list of Python modules that | a list of strings |
71 | | distutils will manipulate | |
72 +--------------------+--------------------------------+-------------------------------------------------------------+
73 | *scripts* | A list of standalone script | a list of strings |
74 | | files to be built and | |
75 | | installed | |
76 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020077 | *ext_modules* | A list of Python extensions to | a list of instances of |
Georg Brandl116aa622007-08-15 14:28:22 +000078 | | be built | :class:`distutils.core.Extension` |
79 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020080 | *classifiers* | A list of categories for the | a list of strings; valid classifiers are listed on `PyPI |
Georg Brandle73778c2014-10-29 08:36:35 +010081 | | package | <https://pypi.python.org/pypi?:action=list_classifiers>`_. |
Georg Brandl116aa622007-08-15 14:28:22 +000082 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020083 | *distclass* | the :class:`Distribution` | a subclass of |
Georg Brandl116aa622007-08-15 14:28:22 +000084 | | class to use | :class:`distutils.core.Distribution` |
85 +--------------------+--------------------------------+-------------------------------------------------------------+
86 | *script_name* | The name of the setup.py | a string |
87 | | script - defaults to | |
88 | | ``sys.argv[0]`` | |
89 +--------------------+--------------------------------+-------------------------------------------------------------+
90 | *script_args* | Arguments to supply to the | a list of strings |
91 | | setup script | |
92 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020093 | *options* | default options for the setup | a dictionary |
Georg Brandl116aa622007-08-15 14:28:22 +000094 | | script | |
95 +--------------------+--------------------------------+-------------------------------------------------------------+
Benjamin Peterson75edad02009-01-01 15:05:06 +000096 | *license* | The license for the package | a string |
Georg Brandl116aa622007-08-15 14:28:22 +000097 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +020098 | *keywords* | Descriptive meta-data, see | a list of strings or a comma-separated string |
Georg Brandl116aa622007-08-15 14:28:22 +000099 | | :pep:`314` | |
100 +--------------------+--------------------------------+-------------------------------------------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200101 | *platforms* | | a list of strings or a comma-separated string |
Georg Brandl116aa622007-08-15 14:28:22 +0000102 +--------------------+--------------------------------+-------------------------------------------------------------+
103 | *cmdclass* | A mapping of command names to | a dictionary |
104 | | :class:`Command` subclasses | |
105 +--------------------+--------------------------------+-------------------------------------------------------------+
Benjamin Peterson75edad02009-01-01 15:05:06 +0000106 | *data_files* | A list of data files to | a list |
107 | | install | |
108 +--------------------+--------------------------------+-------------------------------------------------------------+
109 | *package_dir* | A mapping of package to | a dictionary |
110 | | directory names | |
111 +--------------------+--------------------------------+-------------------------------------------------------------+
Georg Brandl48310cd2009-01-03 21:18:54 +0000112
Georg Brandl116aa622007-08-15 14:28:22 +0000113
114
115.. function:: run_setup(script_name[, script_args=None, stop_after='run'])
116
117 Run a setup script in a somewhat controlled environment, and return the
118 :class:`distutils.dist.Distribution` instance that drives things. This is
119 useful if you need to find out the distribution meta-data (passed as keyword
120 args from *script* to :func:`setup`), or the contents of the config files or
121 command-line.
122
123 *script_name* is a file that will be read and run with :func:`exec`. ``sys.argv[0]``
124 will be replaced with *script* for the duration of the call. *script_args* is a
125 list of strings; if supplied, ``sys.argv[1:]`` will be replaced by *script_args*
126 for the duration of the call.
127
128 *stop_after* tells :func:`setup` when to stop processing; possible values:
129
Georg Brandl44ea77b2013-03-28 13:28:44 +0100130 .. tabularcolumns:: |l|L|
131
Georg Brandl116aa622007-08-15 14:28:22 +0000132 +---------------+---------------------------------------------+
133 | value | description |
134 +===============+=============================================+
135 | *init* | Stop after the :class:`Distribution` |
136 | | instance has been created and populated |
137 | | with the keyword arguments to :func:`setup` |
138 +---------------+---------------------------------------------+
139 | *config* | Stop after config files have been parsed |
140 | | (and their data stored in the |
141 | | :class:`Distribution` instance) |
142 +---------------+---------------------------------------------+
143 | *commandline* | Stop after the command-line |
144 | | (``sys.argv[1:]`` or *script_args*) have |
145 | | been parsed (and the data stored in the |
146 | | :class:`Distribution` instance.) |
147 +---------------+---------------------------------------------+
148 | *run* | Stop after all commands have been run (the |
149 | | same as if :func:`setup` had been called |
150 | | in the usual way). This is the default |
151 | | value. |
152 +---------------+---------------------------------------------+
153
154In addition, the :mod:`distutils.core` module exposed a number of classes that
155live elsewhere.
156
Georg Brandl4009c9e2010-10-06 08:26:09 +0000157* :class:`~distutils.extension.Extension` from :mod:`distutils.extension`
Georg Brandl116aa622007-08-15 14:28:22 +0000158
Georg Brandl4009c9e2010-10-06 08:26:09 +0000159* :class:`~distutils.cmd.Command` from :mod:`distutils.cmd`
Georg Brandl116aa622007-08-15 14:28:22 +0000160
Georg Brandl4009c9e2010-10-06 08:26:09 +0000161* :class:`~distutils.dist.Distribution` from :mod:`distutils.dist`
Georg Brandl116aa622007-08-15 14:28:22 +0000162
163A short description of each of these follows, but see the relevant module for
164the full reference.
165
166
167.. class:: Extension
168
Martin Panter04b3d8b2016-11-05 02:40:31 +0000169 The Extension class describes a single C or C++ extension module in a setup
Éric Araujob008d3d2011-08-26 01:23:20 +0200170 script. It accepts the following keyword arguments in its constructor:
Georg Brandl116aa622007-08-15 14:28:22 +0000171
Georg Brandl44ea77b2013-03-28 13:28:44 +0100172 .. tabularcolumns:: |l|L|l|
173
Georg Brandl116aa622007-08-15 14:28:22 +0000174 +------------------------+--------------------------------+---------------------------+
175 | argument name | value | type |
176 +========================+================================+===========================+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200177 | *name* | the full name of the | a string |
Georg Brandl116aa622007-08-15 14:28:22 +0000178 | | extension, including any | |
179 | | packages --- ie. *not* a | |
180 | | filename or pathname, but | |
181 | | Python dotted name | |
182 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200183 | *sources* | list of source filenames, | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000184 | | relative to the distribution | |
185 | | root (where the setup script | |
186 | | lives), in Unix form (slash- | |
187 | | separated) for portability. | |
188 | | Source files may be C, C++, | |
189 | | SWIG (.i), platform-specific | |
190 | | resource files, or whatever | |
191 | | else is recognized by the | |
192 | | :command:`build_ext` command | |
193 | | as source for a Python | |
194 | | extension. | |
195 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200196 | *include_dirs* | list of directories to search | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000197 | | for C/C++ header files (in | |
198 | | Unix form for portability) | |
199 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200200 | *define_macros* | list of macros to define; each | a list of tuples |
201 | | macro is defined using a | |
Georg Brandl1f01deb2009-01-03 22:47:39 +0000202 | | 2-tuple ``(name, value)``, | |
203 | | where *value* is | |
Georg Brandl116aa622007-08-15 14:28:22 +0000204 | | either the string to define it | |
205 | | to or ``None`` to define it | |
206 | | without a particular value | |
207 | | (equivalent of ``#define FOO`` | |
Martin Panter5c679332016-10-30 04:20:17 +0000208 | | in source or :option:`!-DFOO` | |
Georg Brandl116aa622007-08-15 14:28:22 +0000209 | | on Unix C compiler command | |
210 | | line) | |
211 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200212 | *undef_macros* | list of macros to undefine | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000213 | | explicitly | |
214 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200215 | *library_dirs* | list of directories to search | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000216 | | for C/C++ libraries at link | |
217 | | time | |
218 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200219 | *libraries* | list of library names (not | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000220 | | filenames or paths) to link | |
221 | | against | |
222 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200223 | *runtime_library_dirs* | list of directories to search | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000224 | | for C/C++ libraries at run | |
225 | | time (for shared extensions, | |
226 | | this is when the extension is | |
227 | | loaded) | |
228 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200229 | *extra_objects* | list of extra files to link | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000230 | | with (eg. object files not | |
231 | | implied by 'sources', static | |
232 | | library that must be | |
233 | | explicitly specified, binary | |
234 | | resource files, etc.) | |
235 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200236 | *extra_compile_args* | any extra platform- and | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000237 | | compiler-specific information | |
238 | | to use when compiling the | |
239 | | source files in 'sources'. For | |
240 | | platforms and compilers where | |
241 | | a command line makes sense, | |
242 | | this is typically a list of | |
243 | | command-line arguments, but | |
244 | | for other platforms it could | |
245 | | be anything. | |
246 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200247 | *extra_link_args* | any extra platform- and | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000248 | | compiler-specific information | |
249 | | to use when linking object | |
250 | | files together to create the | |
251 | | extension (or to create a new | |
252 | | static Python interpreter). | |
253 | | Similar interpretation as for | |
254 | | 'extra_compile_args'. | |
255 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200256 | *export_symbols* | list of symbols to be exported | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000257 | | from a shared extension. Not | |
258 | | used on all platforms, and not | |
259 | | generally necessary for Python | |
260 | | extensions, which typically | |
261 | | export exactly one symbol: | |
262 | | ``init`` + extension_name. | |
263 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200264 | *depends* | list of files that the | a list of strings |
Georg Brandl116aa622007-08-15 14:28:22 +0000265 | | extension depends on | |
266 +------------------------+--------------------------------+---------------------------+
Éric Araujo3f5e9582011-08-26 00:44:37 +0200267 | *language* | extension language (i.e. | a string |
Georg Brandl116aa622007-08-15 14:28:22 +0000268 | | ``'c'``, ``'c++'``, | |
269 | | ``'objc'``). Will be detected | |
270 | | from the source extensions if | |
271 | | not provided. | |
272 +------------------------+--------------------------------+---------------------------+
Éric Araujo77443822011-08-26 00:45:18 +0200273 | *optional* | specifies that a build failure | a boolean |
274 | | in the extension should not | |
275 | | abort the build process, but | |
276 | | simply skip the extension. | |
277 +------------------------+--------------------------------+---------------------------+
Georg Brandl116aa622007-08-15 14:28:22 +0000278
279
280.. class:: Distribution
281
282 A :class:`Distribution` describes how to build, install and package up a Python
283 software package.
284
285 See the :func:`setup` function for a list of keyword arguments accepted by the
286 Distribution constructor. :func:`setup` creates a Distribution instance.
287
Berker Peksagdcaed6b2017-11-23 21:34:20 +0300288 .. versionchanged:: 3.7
289 :class:`~distutils.core.Distribution` now raises a :exc:`TypeError` if
290 ``classifiers``, ``keywords`` and ``platforms`` fields are not specified
291 as a list.
Georg Brandl116aa622007-08-15 14:28:22 +0000292
293.. class:: Command
294
295 A :class:`Command` class (or rather, an instance of one of its subclasses)
296 implement a single distutils command.
297
298
299:mod:`distutils.ccompiler` --- CCompiler base class
300===================================================
301
302.. module:: distutils.ccompiler
303 :synopsis: Abstract CCompiler class
304
305
306This module provides the abstract base class for the :class:`CCompiler`
307classes. A :class:`CCompiler` instance can be used for all the compile and
308link steps needed to build a single project. Methods are provided to set
309options for the compiler --- macro definitions, include directories, link path,
310libraries and the like.
311
312This module provides the following functions.
313
314
315.. function:: gen_lib_options(compiler, library_dirs, runtime_library_dirs, libraries)
316
317 Generate linker options for searching library directories and linking with
318 specific libraries. *libraries* and *library_dirs* are, respectively, lists of
319 library names (not filenames!) and search directories. Returns a list of
320 command-line options suitable for use with some compiler (depending on the two
321 format strings passed in).
322
323
324.. function:: gen_preprocess_options(macros, include_dirs)
325
Martin Panter5c679332016-10-30 04:20:17 +0000326 Generate C pre-processor options (:option:`!-D`, :option:`!-U`, :option:`!-I`) as
Georg Brandl116aa622007-08-15 14:28:22 +0000327 used by at least two types of compilers: the typical Unix compiler and Visual
328 C++. *macros* is the usual thing, a list of 1- or 2-tuples, where ``(name,)``
Martin Panter00ccacc2016-04-16 04:59:38 +0000329 means undefine (:option:`!-U`) macro *name*, and ``(name, value)`` means define
Martin Panter5c679332016-10-30 04:20:17 +0000330 (:option:`!-D`) macro *name* to *value*. *include_dirs* is just a list of
Martin Panter00ccacc2016-04-16 04:59:38 +0000331 directory names to be added to the header file search path (:option:`!-I`).
Georg Brandl116aa622007-08-15 14:28:22 +0000332 Returns a list of command-line options suitable for either Unix compilers or
333 Visual C++.
334
335
336.. function:: get_default_compiler(osname, platform)
337
338 Determine the default compiler to use for the given platform.
339
340 *osname* should be one of the standard Python OS names (i.e. the ones returned
341 by ``os.name``) and *platform* the common value returned by ``sys.platform`` for
342 the platform in question.
343
344 The default values are ``os.name`` and ``sys.platform`` in case the parameters
345 are not given.
346
347
348.. function:: new_compiler(plat=None, compiler=None, verbose=0, dry_run=0, force=0)
349
350 Factory function to generate an instance of some CCompiler subclass for the
351 supplied platform/compiler combination. *plat* defaults to ``os.name`` (eg.
352 ``'posix'``, ``'nt'``), and *compiler* defaults to the default compiler for
353 that platform. Currently only ``'posix'`` and ``'nt'`` are supported, and the
354 default compilers are "traditional Unix interface" (:class:`UnixCCompiler`
Georg Brandlc575c902008-09-13 17:46:05 +0000355 class) and Visual C++ (:class:`MSVCCompiler` class). Note that it's perfectly
Georg Brandl116aa622007-08-15 14:28:22 +0000356 possible to ask for a Unix compiler object under Windows, and a Microsoft
357 compiler object under Unix---if you supply a value for *compiler*, *plat* is
358 ignored.
359
360 .. % Is the posix/nt only thing still true? Mac OS X seems to work, and
361 .. % returns a UnixCCompiler instance. How to document this... hmm.
362
363
364.. function:: show_compilers()
365
Martin Panter5c679332016-10-30 04:20:17 +0000366 Print list of available compilers (used by the :option:`!--help-compiler` options
Georg Brandl116aa622007-08-15 14:28:22 +0000367 to :command:`build`, :command:`build_ext`, :command:`build_clib`).
368
369
370.. class:: CCompiler([verbose=0, dry_run=0, force=0])
371
372 The abstract base class :class:`CCompiler` defines the interface that must be
373 implemented by real compiler classes. The class also has some utility methods
374 used by several compiler classes.
375
376 The basic idea behind a compiler abstraction class is that each instance can be
377 used for all the compile/link steps in building a single project. Thus,
378 attributes common to all of those compile and link steps --- include
379 directories, macros to define, libraries to link against, etc. --- are
380 attributes of the compiler instance. To allow for variability in how individual
381 files are treated, most of those attributes may be varied on a per-compilation
382 or per-link basis.
383
384 The constructor for each subclass creates an instance of the Compiler object.
385 Flags are *verbose* (show verbose output), *dry_run* (don't actually execute the
386 steps) and *force* (rebuild everything, regardless of dependencies). All of
387 these flags default to ``0`` (off). Note that you probably don't want to
388 instantiate :class:`CCompiler` or one of its subclasses directly - use the
389 :func:`distutils.CCompiler.new_compiler` factory function instead.
390
391 The following methods allow you to manually alter compiler options for the
392 instance of the Compiler class.
393
394
395 .. method:: CCompiler.add_include_dir(dir)
396
397 Add *dir* to the list of directories that will be searched for header files.
398 The compiler is instructed to search directories in the order in which they are
399 supplied by successive calls to :meth:`add_include_dir`.
400
401
402 .. method:: CCompiler.set_include_dirs(dirs)
403
404 Set the list of directories that will be searched to *dirs* (a list of strings).
405 Overrides any preceding calls to :meth:`add_include_dir`; subsequent calls to
406 :meth:`add_include_dir` add to the list passed to :meth:`set_include_dirs`.
407 This does not affect any list of standard include directories that the compiler
408 may search by default.
409
410
411 .. method:: CCompiler.add_library(libname)
412
413 Add *libname* to the list of libraries that will be included in all links driven
414 by this compiler object. Note that *libname* should \*not\* be the name of a
415 file containing a library, but the name of the library itself: the actual
416 filename will be inferred by the linker, the compiler, or the compiler class
417 (depending on the platform).
418
419 The linker will be instructed to link against libraries in the order they were
420 supplied to :meth:`add_library` and/or :meth:`set_libraries`. It is perfectly
421 valid to duplicate library names; the linker will be instructed to link against
422 libraries as many times as they are mentioned.
423
424
425 .. method:: CCompiler.set_libraries(libnames)
426
427 Set the list of libraries to be included in all links driven by this compiler
428 object to *libnames* (a list of strings). This does not affect any standard
429 system libraries that the linker may include by default.
430
431
432 .. method:: CCompiler.add_library_dir(dir)
433
434 Add *dir* to the list of directories that will be searched for libraries
435 specified to :meth:`add_library` and :meth:`set_libraries`. The linker will be
436 instructed to search for libraries in the order they are supplied to
437 :meth:`add_library_dir` and/or :meth:`set_library_dirs`.
438
439
440 .. method:: CCompiler.set_library_dirs(dirs)
441
442 Set the list of library search directories to *dirs* (a list of strings). This
443 does not affect any standard library search path that the linker may search by
444 default.
445
446
447 .. method:: CCompiler.add_runtime_library_dir(dir)
448
449 Add *dir* to the list of directories that will be searched for shared libraries
450 at runtime.
451
452
453 .. method:: CCompiler.set_runtime_library_dirs(dirs)
454
455 Set the list of directories to search for shared libraries at runtime to *dirs*
456 (a list of strings). This does not affect any standard search path that the
457 runtime linker may search by default.
458
459
460 .. method:: CCompiler.define_macro(name[, value=None])
461
462 Define a preprocessor macro for all compilations driven by this compiler object.
463 The optional parameter *value* should be a string; if it is not supplied, then
464 the macro will be defined without an explicit value and the exact outcome
Éric Araujo9cff4272012-01-15 02:25:31 +0100465 depends on the compiler used.
466
467 .. XXX true? does ANSI say anything about this?
Georg Brandl116aa622007-08-15 14:28:22 +0000468
469
470 .. method:: CCompiler.undefine_macro(name)
471
472 Undefine a preprocessor macro for all compilations driven by this compiler
473 object. If the same macro is defined by :meth:`define_macro` and
474 undefined by :meth:`undefine_macro` the last call takes precedence
475 (including multiple redefinitions or undefinitions). If the macro is
476 redefined/undefined on a per-compilation basis (ie. in the call to
477 :meth:`compile`), then that takes precedence.
478
479
480 .. method:: CCompiler.add_link_object(object)
481
482 Add *object* to the list of object files (or analogues, such as explicitly named
483 library files or the output of "resource compilers") to be included in every
484 link driven by this compiler object.
485
486
487 .. method:: CCompiler.set_link_objects(objects)
488
489 Set the list of object files (or analogues) to be included in every link to
490 *objects*. This does not affect any standard object files that the linker may
491 include by default (such as system libraries).
492
493 The following methods implement methods for autodetection of compiler options,
494 providing some functionality similar to GNU :program:`autoconf`.
495
496
497 .. method:: CCompiler.detect_language(sources)
498
499 Detect the language of a given file, or list of files. Uses the instance
500 attributes :attr:`language_map` (a dictionary), and :attr:`language_order` (a
501 list) to do the job.
502
503
504 .. method:: CCompiler.find_library_file(dirs, lib[, debug=0])
505
506 Search the specified list of directories for a static or shared library file
507 *lib* and return the full path to that file. If *debug* is true, look for a
508 debugging version (if that makes sense on the current platform). Return
509 ``None`` if *lib* wasn't found in any of the specified directories.
510
511
512 .. method:: CCompiler.has_function(funcname [, includes=None, include_dirs=None, libraries=None, library_dirs=None])
513
514 Return a boolean indicating whether *funcname* is supported on the current
515 platform. The optional arguments can be used to augment the compilation
516 environment by providing additional include files and paths and libraries and
517 paths.
518
519
520 .. method:: CCompiler.library_dir_option(dir)
521
522 Return the compiler option to add *dir* to the list of directories searched for
523 libraries.
524
525
526 .. method:: CCompiler.library_option(lib)
527
Benjamin Peterson40198522015-09-12 17:20:47 -0700528 Return the compiler option to add *lib* to the list of libraries linked into the
Georg Brandl116aa622007-08-15 14:28:22 +0000529 shared library or executable.
530
531
532 .. method:: CCompiler.runtime_library_dir_option(dir)
533
534 Return the compiler option to add *dir* to the list of directories searched for
535 runtime libraries.
536
537
538 .. method:: CCompiler.set_executables(**args)
539
540 Define the executables (and options for them) that will be run to perform the
541 various stages of compilation. The exact set of executables that may be
542 specified here depends on the compiler class (via the 'executables' class
543 attribute), but most will have:
544
545 +--------------+------------------------------------------+
546 | attribute | description |
547 +==============+==========================================+
548 | *compiler* | the C/C++ compiler |
549 +--------------+------------------------------------------+
550 | *linker_so* | linker used to create shared objects and |
551 | | libraries |
552 +--------------+------------------------------------------+
553 | *linker_exe* | linker used to create binary executables |
554 +--------------+------------------------------------------+
555 | *archiver* | static library creator |
556 +--------------+------------------------------------------+
557
558 On platforms with a command-line (Unix, DOS/Windows), each of these is a string
559 that will be split into executable name and (optional) list of arguments.
560 (Splitting the string is done similarly to how Unix shells operate: words are
561 delimited by spaces, but quotes and backslashes can override this. See
562 :func:`distutils.util.split_quoted`.)
563
564 The following methods invoke stages in the build process.
565
566
567 .. method:: CCompiler.compile(sources[, output_dir=None, macros=None, include_dirs=None, debug=0, extra_preargs=None, extra_postargs=None, depends=None])
568
569 Compile one or more source files. Generates object files (e.g. transforms a
570 :file:`.c` file to a :file:`.o` file.)
571
572 *sources* must be a list of filenames, most likely C/C++ files, but in reality
573 anything that can be handled by a particular compiler and compiler class (eg.
574 :class:`MSVCCompiler` can handle resource files in *sources*). Return a list of
575 object filenames, one per source filename in *sources*. Depending on the
576 implementation, not all source files will necessarily be compiled, but all
577 corresponding object filenames will be returned.
578
579 If *output_dir* is given, object files will be put under it, while retaining
580 their original path component. That is, :file:`foo/bar.c` normally compiles to
581 :file:`foo/bar.o` (for a Unix implementation); if *output_dir* is *build*, then
582 it would compile to :file:`build/foo/bar.o`.
583
584 *macros*, if given, must be a list of macro definitions. A macro definition is
585 either a ``(name, value)`` 2-tuple or a ``(name,)`` 1-tuple. The former defines
586 a macro; if the value is ``None``, the macro is defined without an explicit
587 value. The 1-tuple case undefines a macro. Later
588 definitions/redefinitions/undefinitions take precedence.
589
590 *include_dirs*, if given, must be a list of strings, the directories to add to
591 the default include file search path for this compilation only.
592
593 *debug* is a boolean; if true, the compiler will be instructed to output debug
594 symbols in (or alongside) the object file(s).
595
596 *extra_preargs* and *extra_postargs* are implementation-dependent. On platforms
597 that have the notion of a command-line (e.g. Unix, DOS/Windows), they are most
598 likely lists of strings: extra command-line arguments to prepend/append to the
599 compiler command line. On other platforms, consult the implementation class
600 documentation. In any event, they are intended as an escape hatch for those
601 occasions when the abstract compiler framework doesn't cut the mustard.
602
603 *depends*, if given, is a list of filenames that all targets depend on. If a
604 source file is older than any file in depends, then the source file will be
605 recompiled. This supports dependency tracking, but only at a coarse
606 granularity.
607
608 Raises :exc:`CompileError` on failure.
609
610
611 .. method:: CCompiler.create_static_lib(objects, output_libname[, output_dir=None, debug=0, target_lang=None])
612
613 Link a bunch of stuff together to create a static library file. The "bunch of
614 stuff" consists of the list of object files supplied as *objects*, the extra
615 object files supplied to :meth:`add_link_object` and/or
616 :meth:`set_link_objects`, the libraries supplied to :meth:`add_library` and/or
617 :meth:`set_libraries`, and the libraries supplied as *libraries* (if any).
618
619 *output_libname* should be a library name, not a filename; the filename will be
620 inferred from the library name. *output_dir* is the directory where the library
Éric Araujo9cff4272012-01-15 02:25:31 +0100621 file will be put.
622
623 .. XXX defaults to what?
Georg Brandl116aa622007-08-15 14:28:22 +0000624
625 *debug* is a boolean; if true, debugging information will be included in the
626 library (note that on most platforms, it is the compile step where this matters:
627 the *debug* flag is included here just for consistency).
628
629 *target_lang* is the target language for which the given objects are being
630 compiled. This allows specific linkage time treatment of certain languages.
631
632 Raises :exc:`LibError` on failure.
633
634
635 .. method:: CCompiler.link(target_desc, objects, output_filename[, output_dir=None, libraries=None, library_dirs=None, runtime_library_dirs=None, export_symbols=None, debug=0, extra_preargs=None, extra_postargs=None, build_temp=None, target_lang=None])
636
637 Link a bunch of stuff together to create an executable or shared library file.
638
639 The "bunch of stuff" consists of the list of object files supplied as *objects*.
640 *output_filename* should be a filename. If *output_dir* is supplied,
641 *output_filename* is relative to it (i.e. *output_filename* can provide
642 directory components if needed).
643
644 *libraries* is a list of libraries to link against. These are library names,
645 not filenames, since they're translated into filenames in a platform-specific
646 way (eg. *foo* becomes :file:`libfoo.a` on Unix and :file:`foo.lib` on
647 DOS/Windows). However, they can include a directory component, which means the
648 linker will look in that specific directory rather than searching all the normal
649 locations.
650
651 *library_dirs*, if supplied, should be a list of directories to search for
652 libraries that were specified as bare library names (ie. no directory
653 component). These are on top of the system default and those supplied to
654 :meth:`add_library_dir` and/or :meth:`set_library_dirs`. *runtime_library_dirs*
655 is a list of directories that will be embedded into the shared library and used
656 to search for other shared libraries that \*it\* depends on at run-time. (This
657 may only be relevant on Unix.)
658
659 *export_symbols* is a list of symbols that the shared library will export.
660 (This appears to be relevant only on Windows.)
661
662 *debug* is as for :meth:`compile` and :meth:`create_static_lib`, with the
663 slight distinction that it actually matters on most platforms (as opposed to
664 :meth:`create_static_lib`, which includes a *debug* flag mostly for form's
665 sake).
666
667 *extra_preargs* and *extra_postargs* are as for :meth:`compile` (except of
668 course that they supply command-line arguments for the particular linker being
669 used).
670
671 *target_lang* is the target language for which the given objects are being
672 compiled. This allows specific linkage time treatment of certain languages.
673
674 Raises :exc:`LinkError` on failure.
675
676
677 .. method:: CCompiler.link_executable(objects, output_progname[, output_dir=None, libraries=None, library_dirs=None, runtime_library_dirs=None, debug=0, extra_preargs=None, extra_postargs=None, target_lang=None])
678
679 Link an executable. *output_progname* is the name of the file executable, while
680 *objects* are a list of object filenames to link in. Other arguments are as for
681 the :meth:`link` method.
682
683
684 .. method:: CCompiler.link_shared_lib(objects, output_libname[, output_dir=None, libraries=None, library_dirs=None, runtime_library_dirs=None, export_symbols=None, debug=0, extra_preargs=None, extra_postargs=None, build_temp=None, target_lang=None])
685
686 Link a shared library. *output_libname* is the name of the output library,
687 while *objects* is a list of object filenames to link in. Other arguments are
688 as for the :meth:`link` method.
689
690
691 .. method:: CCompiler.link_shared_object(objects, output_filename[, output_dir=None, libraries=None, library_dirs=None, runtime_library_dirs=None, export_symbols=None, debug=0, extra_preargs=None, extra_postargs=None, build_temp=None, target_lang=None])
692
693 Link a shared object. *output_filename* is the name of the shared object that
694 will be created, while *objects* is a list of object filenames to link in.
695 Other arguments are as for the :meth:`link` method.
696
697
698 .. method:: CCompiler.preprocess(source[, output_file=None, macros=None, include_dirs=None, extra_preargs=None, extra_postargs=None])
699
700 Preprocess a single C/C++ source file, named in *source*. Output will be written
701 to file named *output_file*, or *stdout* if *output_file* not supplied.
702 *macros* is a list of macro definitions as for :meth:`compile`, which will
703 augment the macros set with :meth:`define_macro` and :meth:`undefine_macro`.
704 *include_dirs* is a list of directory names that will be added to the default
705 list, in the same way as :meth:`add_include_dir`.
706
707 Raises :exc:`PreprocessError` on failure.
708
709 The following utility methods are defined by the :class:`CCompiler` class, for
710 use by the various concrete subclasses.
711
712
713 .. method:: CCompiler.executable_filename(basename[, strip_dir=0, output_dir=''])
714
715 Returns the filename of the executable for the given *basename*. Typically for
716 non-Windows platforms this is the same as the basename, while Windows will get
717 a :file:`.exe` added.
718
719
720 .. method:: CCompiler.library_filename(libname[, lib_type='static', strip_dir=0, output_dir=''])
721
722 Returns the filename for the given library name on the current platform. On Unix
723 a library with *lib_type* of ``'static'`` will typically be of the form
724 :file:`liblibname.a`, while a *lib_type* of ``'dynamic'`` will be of the form
725 :file:`liblibname.so`.
726
727
728 .. method:: CCompiler.object_filenames(source_filenames[, strip_dir=0, output_dir=''])
729
730 Returns the name of the object files for the given source files.
731 *source_filenames* should be a list of filenames.
732
733
734 .. method:: CCompiler.shared_object_filename(basename[, strip_dir=0, output_dir=''])
735
736 Returns the name of a shared object file for the given file name *basename*.
737
738
739 .. method:: CCompiler.execute(func, args[, msg=None, level=1])
740
Georg Brandla710fda2013-10-06 11:12:29 +0200741 Invokes :func:`distutils.util.execute`. This method invokes a Python function
Georg Brandl116aa622007-08-15 14:28:22 +0000742 *func* with the given arguments *args*, after logging and taking into account
Éric Araujo9cff4272012-01-15 02:25:31 +0100743 the *dry_run* flag.
Georg Brandl116aa622007-08-15 14:28:22 +0000744
745
746 .. method:: CCompiler.spawn(cmd)
747
748 Invokes :func:`distutils.util.spawn`. This invokes an external process to run
Éric Araujo9cff4272012-01-15 02:25:31 +0100749 the given command.
Georg Brandl116aa622007-08-15 14:28:22 +0000750
751
752 .. method:: CCompiler.mkpath(name[, mode=511])
753
754 Invokes :func:`distutils.dir_util.mkpath`. This creates a directory and any
Éric Araujo9cff4272012-01-15 02:25:31 +0100755 missing ancestor directories.
Georg Brandl116aa622007-08-15 14:28:22 +0000756
757
758 .. method:: CCompiler.move_file(src, dst)
759
Éric Araujo9cff4272012-01-15 02:25:31 +0100760 Invokes :meth:`distutils.file_util.move_file`. Renames *src* to *dst*.
Georg Brandl116aa622007-08-15 14:28:22 +0000761
762
763 .. method:: CCompiler.announce(msg[, level=1])
764
Éric Araujo9cff4272012-01-15 02:25:31 +0100765 Write a message using :func:`distutils.log.debug`.
Georg Brandl116aa622007-08-15 14:28:22 +0000766
767
768 .. method:: CCompiler.warn(msg)
769
770 Write a warning message *msg* to standard error.
771
772
773 .. method:: CCompiler.debug_print(msg)
774
775 If the *debug* flag is set on this :class:`CCompiler` instance, print *msg* to
776 standard output, otherwise do nothing.
777
778.. % \subsection{Compiler-specific modules}
Georg Brandl48310cd2009-01-03 21:18:54 +0000779.. %
Georg Brandl116aa622007-08-15 14:28:22 +0000780.. % The following modules implement concrete subclasses of the abstract
781.. % \class{CCompiler} class. They should not be instantiated directly, but should
782.. % be created using \function{distutils.ccompiler.new_compiler()} factory
783.. % function.
784
785
786:mod:`distutils.unixccompiler` --- Unix C Compiler
787==================================================
788
789.. module:: distutils.unixccompiler
790 :synopsis: UNIX C Compiler
791
792
793This module provides the :class:`UnixCCompiler` class, a subclass of
794:class:`CCompiler` that handles the typical Unix-style command-line C compiler:
795
Martin Panter5c679332016-10-30 04:20:17 +0000796* macros defined with :option:`!-Dname[=value]`
Georg Brandl116aa622007-08-15 14:28:22 +0000797
Martin Panter5c679332016-10-30 04:20:17 +0000798* macros undefined with :option:`!-Uname`
Georg Brandl116aa622007-08-15 14:28:22 +0000799
Martin Panter5c679332016-10-30 04:20:17 +0000800* include search directories specified with :option:`!-Idir`
Georg Brandl116aa622007-08-15 14:28:22 +0000801
Martin Panter5c679332016-10-30 04:20:17 +0000802* libraries specified with :option:`!-llib`
Georg Brandl116aa622007-08-15 14:28:22 +0000803
Martin Panter5c679332016-10-30 04:20:17 +0000804* library search directories specified with :option:`!-Ldir`
Georg Brandl116aa622007-08-15 14:28:22 +0000805
Martin Panter00ccacc2016-04-16 04:59:38 +0000806* compile handled by :program:`cc` (or similar) executable with :option:`!-c`
Georg Brandl116aa622007-08-15 14:28:22 +0000807 option: compiles :file:`.c` to :file:`.o`
808
809* link static library handled by :program:`ar` command (possibly with
810 :program:`ranlib`)
811
Martin Panter5c679332016-10-30 04:20:17 +0000812* link shared library handled by :program:`cc` :option:`!-shared`
Georg Brandl116aa622007-08-15 14:28:22 +0000813
814
815:mod:`distutils.msvccompiler` --- Microsoft Compiler
816====================================================
817
818.. module:: distutils.msvccompiler
819 :synopsis: Microsoft Compiler
820
Zachary Ware49ce74e2017-09-06 15:45:25 -0700821.. XXX: This is *waaaaay* out of date!
Georg Brandl116aa622007-08-15 14:28:22 +0000822
823This module provides :class:`MSVCCompiler`, an implementation of the abstract
824:class:`CCompiler` class for Microsoft Visual Studio. Typically, extension
825modules need to be compiled with the same compiler that was used to compile
826Python. For Python 2.3 and earlier, the compiler was Visual Studio 6. For Python
Zachary Ware49ce74e2017-09-06 15:45:25 -07008272.4 and 2.5, the compiler is Visual Studio .NET 2003.
Georg Brandl116aa622007-08-15 14:28:22 +0000828
829:class:`MSVCCompiler` will normally choose the right compiler, linker etc. on
830its own. To override this choice, the environment variables *DISTUTILS_USE_SDK*
831and *MSSdk* must be both set. *MSSdk* indicates that the current environment has
832been setup by the SDK's ``SetEnv.Cmd`` script, or that the environment variables
833had been registered when the SDK was installed; *DISTUTILS_USE_SDK* indicates
834that the distutils user has made an explicit choice to override the compiler
835selection by :class:`MSVCCompiler`.
836
837
838:mod:`distutils.bcppcompiler` --- Borland Compiler
839==================================================
840
841.. module:: distutils.bcppcompiler
842
843
Serhiy Storchaka6a7b3a72016-04-17 08:32:47 +0300844This module provides :class:`BorlandCCompiler`, a subclass of the abstract
Georg Brandl116aa622007-08-15 14:28:22 +0000845:class:`CCompiler` class for the Borland C++ compiler.
846
847
848:mod:`distutils.cygwincompiler` --- Cygwin Compiler
849===================================================
850
851.. module:: distutils.cygwinccompiler
852
853
854This module provides the :class:`CygwinCCompiler` class, a subclass of
855:class:`UnixCCompiler` that handles the Cygwin port of the GNU C compiler to
856Windows. It also contains the Mingw32CCompiler class which handles the mingw32
857port of GCC (same as cygwin in no-cygwin mode).
858
859
Georg Brandl116aa622007-08-15 14:28:22 +0000860:mod:`distutils.archive_util` --- Archiving utilities
861======================================================
862
863.. module:: distutils.archive_util
864 :synopsis: Utility functions for creating archive files (tarballs, zip files, ...)
865
866
867This module provides a few functions for creating archive files, such as
868tarballs or zipfiles.
869
870
871.. function:: make_archive(base_name, format[, root_dir=None, base_dir=None, verbose=0, dry_run=0])
872
873 Create an archive file (eg. ``zip`` or ``tar``). *base_name* is the name of
874 the file to create, minus any format-specific extension; *format* is the
Serhiy Storchakab9cec6a2015-05-16 22:13:27 +0300875 archive format: one of ``zip``, ``tar``, ``gztar``, ``bztar``, ``xztar``, or
876 ``ztar``. *root_dir* is a directory that will be the root directory of the
877 archive; ie. we typically ``chdir`` into *root_dir* before creating the
878 archive. *base_dir* is the directory where we start archiving from; ie.
879 *base_dir* will be the common prefix of all files and directories in the
880 archive. *root_dir* and *base_dir* both default to the current directory.
881 Returns the name of the archive file.
882
Georg Brandl8c16cb92016-02-25 20:17:45 +0100883 .. versionchanged:: 3.5
Serhiy Storchakab9cec6a2015-05-16 22:13:27 +0300884 Added support for the ``xztar`` format.
Georg Brandl116aa622007-08-15 14:28:22 +0000885
Georg Brandl116aa622007-08-15 14:28:22 +0000886
887.. function:: make_tarball(base_name, base_dir[, compress='gzip', verbose=0, dry_run=0])
888
889 'Create an (optional compressed) archive as a tar file from all files in and
Serhiy Storchakab9cec6a2015-05-16 22:13:27 +0300890 under *base_dir*. *compress* must be ``'gzip'`` (the default),
891 ``'bzip2'``, ``'xz'``, ``'compress'``, or ``None``. For the ``'compress'``
892 method the compression utility named by :program:`compress` must be on the
893 default program search path, so this is probably Unix-specific. The output
894 tar file will be named :file:`base_dir.tar`, possibly plus the appropriate
895 compression extension (``.gz``, ``.bz2``, ``.xz`` or ``.Z``). Return the
896 output filename.
897
Georg Brandl8c16cb92016-02-25 20:17:45 +0100898 .. versionchanged:: 3.5
Serhiy Storchakab9cec6a2015-05-16 22:13:27 +0300899 Added support for the ``xz`` compression.
Georg Brandl116aa622007-08-15 14:28:22 +0000900
Georg Brandl116aa622007-08-15 14:28:22 +0000901
902.. function:: make_zipfile(base_name, base_dir[, verbose=0, dry_run=0])
903
904 Create a zip file from all files in and under *base_dir*. The output zip file
Éric Araujo4433a5f2010-12-15 20:26:30 +0000905 will be named *base_name* + :file:`.zip`. Uses either the :mod:`zipfile` Python
Georg Brandl116aa622007-08-15 14:28:22 +0000906 module (if available) or the InfoZIP :file:`zip` utility (if installed and
907 found on the default search path). If neither tool is available, raises
908 :exc:`DistutilsExecError`. Returns the name of the output zip file.
909
910
911:mod:`distutils.dep_util` --- Dependency checking
912=================================================
913
914.. module:: distutils.dep_util
915 :synopsis: Utility functions for simple dependency checking
916
917
918This module provides functions for performing simple, timestamp-based
919dependency of files and groups of files; also, functions based entirely on such
920timestamp dependency analysis.
921
922
923.. function:: newer(source, target)
924
925 Return true if *source* exists and is more recently modified than *target*, or
926 if *source* exists and *target* doesn't. Return false if both exist and *target*
927 is the same age or newer than *source*. Raise :exc:`DistutilsFileError` if
928 *source* does not exist.
929
930
931.. function:: newer_pairwise(sources, targets)
932
933 Walk two filename lists in parallel, testing if each source is newer than its
934 corresponding target. Return a pair of lists (*sources*, *targets*) where
Martin Panterd21e0b52015-10-10 10:36:22 +0000935 source is newer than target, according to the semantics of :func:`newer`.
Georg Brandl116aa622007-08-15 14:28:22 +0000936
937 .. % % equivalent to a listcomp...
938
939
940.. function:: newer_group(sources, target[, missing='error'])
941
942 Return true if *target* is out-of-date with respect to any file listed in
943 *sources* In other words, if *target* exists and is newer than every file in
944 *sources*, return false; otherwise return true. *missing* controls what we do
945 when a source file is missing; the default (``'error'``) is to blow up with an
946 :exc:`OSError` from inside :func:`os.stat`; if it is ``'ignore'``, we silently
947 drop any missing source files; if it is ``'newer'``, any missing source files
948 make us assume that *target* is out-of-date (this is handy in "dry-run" mode:
949 it'll make you pretend to carry out commands that wouldn't work because inputs
950 are missing, but that doesn't matter because you're not actually going to run
951 the commands).
952
953
954:mod:`distutils.dir_util` --- Directory tree operations
955=======================================================
956
957.. module:: distutils.dir_util
958 :synopsis: Utility functions for operating on directories and directory trees
959
960
961This module provides functions for operating on directories and trees of
962directories.
963
964
Georg Brandlf4a41232008-05-26 17:55:52 +0000965.. function:: mkpath(name[, mode=0o777, verbose=0, dry_run=0])
Georg Brandl116aa622007-08-15 14:28:22 +0000966
967 Create a directory and any missing ancestor directories. If the directory
968 already exists (or if *name* is the empty string, which means the current
969 directory, which of course exists), then do nothing. Raise
970 :exc:`DistutilsFileError` if unable to create some directory along the way (eg.
971 some sub-path exists, but is a file rather than a directory). If *verbose* is
972 true, print a one-line summary of each mkdir to stdout. Return the list of
973 directories actually created.
974
975
Georg Brandlf4a41232008-05-26 17:55:52 +0000976.. function:: create_tree(base_dir, files[, mode=0o777, verbose=0, dry_run=0])
Georg Brandl116aa622007-08-15 14:28:22 +0000977
978 Create all the empty directories under *base_dir* needed to put *files* there.
Benjamin Peterson82f34ad2015-01-13 09:17:24 -0500979 *base_dir* is just the name of a directory which doesn't necessarily exist
Georg Brandl116aa622007-08-15 14:28:22 +0000980 yet; *files* is a list of filenames to be interpreted relative to *base_dir*.
981 *base_dir* + the directory portion of every file in *files* will be created if
982 it doesn't already exist. *mode*, *verbose* and *dry_run* flags are as for
983 :func:`mkpath`.
984
985
986.. function:: copy_tree(src, dst[, preserve_mode=1, preserve_times=1, preserve_symlinks=0, update=0, verbose=0, dry_run=0])
987
988 Copy an entire directory tree *src* to a new location *dst*. Both *src* and
989 *dst* must be directory names. If *src* is not a directory, raise
990 :exc:`DistutilsFileError`. If *dst* does not exist, it is created with
991 :func:`mkpath`. The end result of the copy is that every file in *src* is
992 copied to *dst*, and directories under *src* are recursively copied to *dst*.
993 Return the list of files that were copied or might have been copied, using their
994 output name. The return value is unaffected by *update* or *dry_run*: it is
995 simply the list of all files under *src*, with the names changed to be under
996 *dst*.
997
Serhiy Storchaka7880db62013-10-09 14:09:16 +0300998 *preserve_mode* and *preserve_times* are the same as for
999 :func:`distutils.file_util.copy_file`; note that they only apply to
1000 regular files, not to
Georg Brandl116aa622007-08-15 14:28:22 +00001001 directories. If *preserve_symlinks* is true, symlinks will be copied as
1002 symlinks (on platforms that support them!); otherwise (the default), the
1003 destination of the symlink will be copied. *update* and *verbose* are the same
1004 as for :func:`copy_file`.
1005
Éric Araujo3e4a3dc2012-12-08 14:21:51 -05001006 Files in *src* that begin with :file:`.nfs` are skipped (more information on
1007 these files is available in answer D2 of the `NFS FAQ page
Zachary Ware253deed2014-03-20 09:46:09 -05001008 <http://nfs.sourceforge.net/#section_d>`_).
Éric Araujo3e4a3dc2012-12-08 14:21:51 -05001009
Éric Araujo3f7c0e42012-12-08 22:53:43 -05001010 .. versionchanged:: 3.3.1
Éric Araujo3e4a3dc2012-12-08 14:21:51 -05001011 NFS files are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001012
1013.. function:: remove_tree(directory[, verbose=0, dry_run=0])
1014
1015 Recursively remove *directory* and all files and directories underneath it. Any
1016 errors are ignored (apart from being reported to ``sys.stdout`` if *verbose* is
1017 true).
1018
Georg Brandl116aa622007-08-15 14:28:22 +00001019
1020:mod:`distutils.file_util` --- Single file operations
1021=====================================================
1022
1023.. module:: distutils.file_util
1024 :synopsis: Utility functions for operating on single files
1025
1026
1027This module contains some utility functions for operating on individual files.
1028
1029
1030.. function:: copy_file(src, dst[, preserve_mode=1, preserve_times=1, update=0, link=None, verbose=0, dry_run=0])
1031
1032 Copy file *src* to *dst*. If *dst* is a directory, then *src* is copied there
1033 with the same name; otherwise, it must be a filename. (If the file exists, it
1034 will be ruthlessly clobbered.) If *preserve_mode* is true (the default), the
1035 file's mode (type and permission bits, or whatever is analogous on the
1036 current platform) is copied. If *preserve_times* is true (the default), the
1037 last-modified and last-access times are copied as well. If *update* is true,
1038 *src* will only be copied if *dst* does not exist, or if *dst* does exist but
1039 is older than *src*.
1040
1041 *link* allows you to make hard links (using :func:`os.link`) or symbolic links
1042 (using :func:`os.symlink`) instead of copying: set it to ``'hard'`` or
1043 ``'sym'``; if it is ``None`` (the default), files are copied. Don't set *link*
1044 on systems that don't support it: :func:`copy_file` doesn't check if hard or
1045 symbolic linking is available. It uses :func:`_copy_file_contents` to copy file
1046 contents.
1047
1048 Return a tuple ``(dest_name, copied)``: *dest_name* is the actual name of the
1049 output file, and *copied* is true if the file was copied (or would have been
1050 copied, if *dry_run* true).
1051
1052 .. % XXX if the destination file already exists, we clobber it if
1053 .. % copying, but blow up if linking. Hmmm. And I don't know what
1054 .. % macostools.copyfile() does. Should definitely be consistent, and
1055 .. % should probably blow up if destination exists and we would be
1056 .. % changing it (ie. it's not already a hard/soft link to src OR
1057 .. % (not update) and (src newer than dst)).
1058
1059
1060.. function:: move_file(src, dst[, verbose, dry_run])
1061
1062 Move file *src* to *dst*. If *dst* is a directory, the file will be moved into
1063 it with the same name; otherwise, *src* is just renamed to *dst*. Returns the
1064 new full name of the file.
1065
1066 .. warning::
1067
Benjamin Petersond23f8222009-04-05 19:13:16 +00001068 Handles cross-device moves on Unix using :func:`copy_file`. What about
1069 other systems?
Georg Brandl116aa622007-08-15 14:28:22 +00001070
1071
1072.. function:: write_file(filename, contents)
1073
1074 Create a file called *filename* and write *contents* (a sequence of strings
1075 without line terminators) to it.
1076
1077
1078:mod:`distutils.util` --- Miscellaneous other utility functions
1079===============================================================
1080
1081.. module:: distutils.util
1082 :synopsis: Miscellaneous other utility functions
1083
1084
1085This module contains other assorted bits and pieces that don't fit into any
1086other utility module.
1087
1088
1089.. function:: get_platform()
1090
1091 Return a string that identifies the current platform. This is used mainly to
1092 distinguish platform-specific build directories and platform-specific built
Benjamin Peterson06930632017-09-04 16:36:05 -07001093 distributions. Typically includes the OS name and version and the
1094 architecture (as supplied by 'os.uname()'), although the exact information
1095 included depends on the OS; e.g., on Linux, the kernel version isn't
1096 particularly important.
Georg Brandl116aa622007-08-15 14:28:22 +00001097
1098 Examples of returned values:
1099
1100 * ``linux-i586``
1101 * ``linux-alpha``
1102 * ``solaris-2.6-sun4u``
Georg Brandl116aa622007-08-15 14:28:22 +00001103
1104 For non-POSIX platforms, currently just returns ``sys.platform``.
1105
Benjamin Petersond23f8222009-04-05 19:13:16 +00001106 For Mac OS X systems the OS version reflects the minimal version on which
Benjamin Petersonc39d7622008-12-30 17:56:45 +00001107 binaries will run (that is, the value of ``MACOSX_DEPLOYMENT_TARGET``
Georg Brandl48310cd2009-01-03 21:18:54 +00001108 during the build of Python), not the OS version of the current system.
Benjamin Petersonc39d7622008-12-30 17:56:45 +00001109
Benjamin Petersond23f8222009-04-05 19:13:16 +00001110 For universal binary builds on Mac OS X the architecture value reflects
Donald Stufft8b852f12014-05-20 12:58:38 -04001111 the universal binary status instead of the architecture of the current
Georg Brandl48310cd2009-01-03 21:18:54 +00001112 processor. For 32-bit universal binaries the architecture is ``fat``,
1113 for 64-bit universal binaries the architecture is ``fat64``, and
Ronald Oussorenbea37ae2009-09-15 19:16:02 +00001114 for 4-way universal binaries the architecture is ``universal``. Starting
1115 from Python 2.7 and Python 3.2 the architecture ``fat3`` is used for
1116 a 3-way universal build (ppc, i386, x86_64) and ``intel`` is used for
Donald Stufft8b852f12014-05-20 12:58:38 -04001117 a universal build with the i386 and x86_64 architectures
Benjamin Petersonc39d7622008-12-30 17:56:45 +00001118
Benjamin Petersond23f8222009-04-05 19:13:16 +00001119 Examples of returned values on Mac OS X:
Benjamin Petersonc39d7622008-12-30 17:56:45 +00001120
1121 * ``macosx-10.3-ppc``
1122
1123 * ``macosx-10.3-fat``
1124
1125 * ``macosx-10.5-universal``
1126
Ronald Oussorenbea37ae2009-09-15 19:16:02 +00001127 * ``macosx-10.6-intel``
1128
Georg Brandl116aa622007-08-15 14:28:22 +00001129
1130.. function:: convert_path(pathname)
1131
1132 Return 'pathname' as a name that will work on the native filesystem, i.e. split
1133 it on '/' and put it back together again using the current directory separator.
1134 Needed because filenames in the setup script are always supplied in Unix style,
1135 and have to be converted to the local convention before we can actually use them
1136 in the filesystem. Raises :exc:`ValueError` on non-Unix-ish systems if
1137 *pathname* either starts or ends with a slash.
1138
1139
1140.. function:: change_root(new_root, pathname)
1141
1142 Return *pathname* with *new_root* prepended. If *pathname* is relative, this is
1143 equivalent to ``os.path.join(new_root,pathname)`` Otherwise, it requires making
1144 *pathname* relative and then joining the two, which is tricky on DOS/Windows.
1145
1146
1147.. function:: check_environ()
1148
1149 Ensure that 'os.environ' has all the environment variables we guarantee that
1150 users can use in config files, command-line options, etc. Currently this
1151 includes:
1152
1153 * :envvar:`HOME` - user's home directory (Unix only)
1154 * :envvar:`PLAT` - description of the current platform, including hardware and
1155 OS (see :func:`get_platform`)
1156
1157
1158.. function:: subst_vars(s, local_vars)
1159
1160 Perform shell/Perl-style variable substitution on *s*. Every occurrence of
1161 ``$`` followed by a name is considered a variable, and variable is substituted
1162 by the value found in the *local_vars* dictionary, or in ``os.environ`` if it's
1163 not in *local_vars*. *os.environ* is first checked/augmented to guarantee that
1164 it contains certain values: see :func:`check_environ`. Raise :exc:`ValueError`
1165 for any variables not found in either *local_vars* or ``os.environ``.
1166
1167 Note that this is not a fully-fledged string interpolation function. A valid
1168 ``$variable`` can consist only of upper and lower case letters, numbers and an
1169 underscore. No { } or ( ) style quoting is available.
1170
1171
Georg Brandl116aa622007-08-15 14:28:22 +00001172.. function:: split_quoted(s)
1173
1174 Split a string up according to Unix shell-like rules for quotes and backslashes.
1175 In short: words are delimited by spaces, as long as those spaces are not escaped
1176 by a backslash, or inside a quoted string. Single and double quotes are
1177 equivalent, and the quote characters can be backslash-escaped. The backslash is
1178 stripped from any two-character escape sequence, leaving only the escaped
1179 character. The quote characters are stripped from any quoted string. Returns a
1180 list of words.
1181
1182 .. % Should probably be moved into the standard library.
1183
1184
1185.. function:: execute(func, args[, msg=None, verbose=0, dry_run=0])
1186
1187 Perform some action that affects the outside world (for instance, writing to the
1188 filesystem). Such actions are special because they are disabled by the
1189 *dry_run* flag. This method takes care of all that bureaucracy for you; all
1190 you have to do is supply the function to call and an argument tuple for it (to
1191 embody the "external action" being performed), and an optional message to print.
1192
1193
1194.. function:: strtobool(val)
1195
1196 Convert a string representation of truth to true (1) or false (0).
1197
1198 True values are ``y``, ``yes``, ``t``, ``true``, ``on`` and ``1``; false values
1199 are ``n``, ``no``, ``f``, ``false``, ``off`` and ``0``. Raises
1200 :exc:`ValueError` if *val* is anything else.
1201
1202
1203.. function:: byte_compile(py_files[, optimize=0, force=0, prefix=None, base_dir=None, verbose=1, dry_run=0, direct=None])
1204
Brett Cannonf299abd2015-04-13 14:21:02 -04001205 Byte-compile a collection of Python source files to :file:`.pyc` files in a
1206 :file:`__pycache__` subdirectory (see :pep:`3147` and :pep:`488`).
Éric Araujo47a45212011-10-08 00:34:13 +02001207 *py_files* is a list of files to compile; any files that don't end in
1208 :file:`.py` are silently skipped. *optimize* must be one of the following:
Georg Brandl116aa622007-08-15 14:28:22 +00001209
Brett Cannonf299abd2015-04-13 14:21:02 -04001210 * ``0`` - don't optimize
Georg Brandl116aa622007-08-15 14:28:22 +00001211 * ``1`` - normal optimization (like ``python -O``)
1212 * ``2`` - extra optimization (like ``python -OO``)
1213
1214 If *force* is true, all files are recompiled regardless of timestamps.
1215
Georg Brandl9afde1c2007-11-01 20:32:30 +00001216 The source filename encoded in each :term:`bytecode` file defaults to the filenames
Georg Brandl116aa622007-08-15 14:28:22 +00001217 listed in *py_files*; you can modify these with *prefix* and *basedir*.
1218 *prefix* is a string that will be stripped off of each source filename, and
1219 *base_dir* is a directory name that will be prepended (after *prefix* is
1220 stripped). You can supply either or both (or neither) of *prefix* and
1221 *base_dir*, as you wish.
1222
1223 If *dry_run* is true, doesn't actually do anything that would affect the
1224 filesystem.
1225
1226 Byte-compilation is either done directly in this interpreter process with the
1227 standard :mod:`py_compile` module, or indirectly by writing a temporary script
1228 and executing it. Normally, you should let :func:`byte_compile` figure out to
1229 use direct compilation or not (see the source for details). The *direct* flag
1230 is used by the script generated in indirect mode; unless you know what you're
1231 doing, leave it set to ``None``.
1232
Éric Araujo47a45212011-10-08 00:34:13 +02001233 .. versionchanged:: 3.2.3
Brett Cannonf299abd2015-04-13 14:21:02 -04001234 Create ``.pyc`` files with an :func:`import magic tag
Éric Araujo47a45212011-10-08 00:34:13 +02001235 <imp.get_tag>` in their name, in a :file:`__pycache__` subdirectory
1236 instead of files without tag in the current directory.
1237
Georg Brandl8c16cb92016-02-25 20:17:45 +01001238 .. versionchanged:: 3.5
Brett Cannonf299abd2015-04-13 14:21:02 -04001239 Create ``.pyc`` files according to :pep:`488`.
1240
Georg Brandl116aa622007-08-15 14:28:22 +00001241
1242.. function:: rfc822_escape(header)
1243
1244 Return a version of *header* escaped for inclusion in an :rfc:`822` header, by
1245 ensuring there are 8 spaces space after each newline. Note that it does no other
1246 modification of the string.
1247
1248 .. % this _can_ be replaced
1249
1250.. % \subsection{Distutils objects}
1251
1252
1253:mod:`distutils.dist` --- The Distribution class
1254================================================
1255
1256.. module:: distutils.dist
1257 :synopsis: Provides the Distribution class, which represents the module distribution being
1258 built/installed/distributed
1259
1260
Serhiy Storchaka7880db62013-10-09 14:09:16 +03001261This module provides the :class:`~distutils.core.Distribution` class, which
1262represents the module distribution being built/installed/distributed.
Georg Brandl116aa622007-08-15 14:28:22 +00001263
1264
1265:mod:`distutils.extension` --- The Extension class
1266==================================================
1267
1268.. module:: distutils.extension
1269 :synopsis: Provides the Extension class, used to describe C/C++ extension modules in setup
1270 scripts
1271
1272
1273This module provides the :class:`Extension` class, used to describe C/C++
1274extension modules in setup scripts.
1275
1276.. % \subsection{Ungrouped modules}
1277.. % The following haven't been moved into a more appropriate section yet.
1278
1279
1280:mod:`distutils.debug` --- Distutils debug mode
1281===============================================
1282
1283.. module:: distutils.debug
1284 :synopsis: Provides the debug flag for distutils
1285
1286
1287This module provides the DEBUG flag.
1288
1289
1290:mod:`distutils.errors` --- Distutils exceptions
1291================================================
1292
1293.. module:: distutils.errors
1294 :synopsis: Provides standard distutils exceptions
1295
1296
1297Provides exceptions used by the Distutils modules. Note that Distutils modules
1298may raise standard exceptions; in particular, SystemExit is usually raised for
1299errors that are obviously the end-user's fault (eg. bad command-line arguments).
1300
1301This module is safe to use in ``from ... import *`` mode; it only exports
1302symbols whose names start with ``Distutils`` and end with ``Error``.
1303
1304
1305:mod:`distutils.fancy_getopt` --- Wrapper around the standard getopt module
1306===========================================================================
1307
1308.. module:: distutils.fancy_getopt
1309 :synopsis: Additional getopt functionality
1310
1311
1312This module provides a wrapper around the standard :mod:`getopt` module that
1313provides the following additional features:
1314
1315* short and long options are tied together
1316
1317* options have help strings, so :func:`fancy_getopt` could potentially create a
1318 complete usage summary
1319
1320* options set attributes of a passed-in object
1321
Martin Panter5c679332016-10-30 04:20:17 +00001322* boolean options can have "negative aliases" --- eg. if :option:`!--quiet` is
1323 the "negative alias" of :option:`!--verbose`, then :option:`!--quiet` on the
Georg Brandl116aa622007-08-15 14:28:22 +00001324 command line sets *verbose* to false.
1325
Georg Brandl116aa622007-08-15 14:28:22 +00001326.. function:: fancy_getopt(options, negative_opt, object, args)
1327
1328 Wrapper function. *options* is a list of ``(long_option, short_option,
1329 help_string)`` 3-tuples as described in the constructor for
1330 :class:`FancyGetopt`. *negative_opt* should be a dictionary mapping option names
1331 to option names, both the key and value should be in the *options* list.
1332 *object* is an object which will be used to store values (see the :meth:`getopt`
1333 method of the :class:`FancyGetopt` class). *args* is the argument list. Will use
1334 ``sys.argv[1:]`` if you pass ``None`` as *args*.
1335
1336
1337.. function:: wrap_text(text, width)
1338
1339 Wraps *text* to less than *width* wide.
1340
Georg Brandl116aa622007-08-15 14:28:22 +00001341
1342.. class:: FancyGetopt([option_table=None])
1343
1344 The option_table is a list of 3-tuples: ``(long_option, short_option,
1345 help_string)``
1346
1347 If an option takes an argument, its *long_option* should have ``'='`` appended;
1348 *short_option* should just be a single character, no ``':'`` in any case.
1349 *short_option* should be ``None`` if a *long_option* doesn't have a
1350 corresponding *short_option*. All option tuples must have long options.
1351
1352The :class:`FancyGetopt` class provides the following methods:
1353
1354
1355.. method:: FancyGetopt.getopt([args=None, object=None])
1356
1357 Parse command-line options in args. Store as attributes on *object*.
1358
1359 If *args* is ``None`` or not supplied, uses ``sys.argv[1:]``. If *object* is
1360 ``None`` or not supplied, creates a new :class:`OptionDummy` instance, stores
1361 option values there, and returns a tuple ``(args, object)``. If *object* is
1362 supplied, it is modified in place and :func:`getopt` just returns *args*; in
1363 both cases, the returned *args* is a modified copy of the passed-in *args* list,
1364 which is left untouched.
1365
1366 .. % and args returned are?
1367
1368
1369.. method:: FancyGetopt.get_option_order()
1370
1371 Returns the list of ``(option, value)`` tuples processed by the previous run of
1372 :meth:`getopt` Raises :exc:`RuntimeError` if :meth:`getopt` hasn't been called
1373 yet.
1374
1375
1376.. method:: FancyGetopt.generate_help([header=None])
1377
1378 Generate help text (a list of strings, one per suggested line of output) from
1379 the option table for this :class:`FancyGetopt` object.
1380
1381 If supplied, prints the supplied *header* at the top of the help.
1382
1383
1384:mod:`distutils.filelist` --- The FileList class
1385================================================
1386
1387.. module:: distutils.filelist
Georg Brandl3221dc92009-04-27 16:23:47 +00001388 :synopsis: The FileList class, used for poking about the file system and
1389 building lists of files.
Georg Brandl116aa622007-08-15 14:28:22 +00001390
1391
1392This module provides the :class:`FileList` class, used for poking about the
1393filesystem and building lists of files.
1394
1395
1396:mod:`distutils.log` --- Simple PEP 282-style logging
1397=====================================================
1398
1399.. module:: distutils.log
1400 :synopsis: A simple logging mechanism, 282-style
1401
1402
Georg Brandl116aa622007-08-15 14:28:22 +00001403:mod:`distutils.spawn` --- Spawn a sub-process
1404==============================================
1405
1406.. module:: distutils.spawn
1407 :synopsis: Provides the spawn() function
1408
1409
1410This module provides the :func:`spawn` function, a front-end to various
1411platform-specific functions for launching another program in a sub-process.
1412Also provides :func:`find_executable` to search the path for a given executable
1413name.
1414
1415
1416:mod:`distutils.sysconfig` --- System configuration information
1417===============================================================
1418
1419.. module:: distutils.sysconfig
1420 :synopsis: Low-level access to configuration information of the Python interpreter.
1421.. moduleauthor:: Fred L. Drake, Jr. <fdrake@acm.org>
1422.. moduleauthor:: Greg Ward <gward@python.net>
1423.. sectionauthor:: Fred L. Drake, Jr. <fdrake@acm.org>
1424
1425
1426The :mod:`distutils.sysconfig` module provides access to Python's low-level
1427configuration information. The specific configuration variables available
1428depend heavily on the platform and configuration. The specific variables depend
1429on the build process for the specific version of Python being run; the variables
1430are those found in the :file:`Makefile` and configuration header that are
1431installed with Python on Unix systems. The configuration header is called
1432:file:`pyconfig.h` for Python versions starting with 2.2, and :file:`config.h`
1433for earlier versions of Python.
1434
1435Some additional functions are provided which perform some useful manipulations
1436for other parts of the :mod:`distutils` package.
1437
1438
1439.. data:: PREFIX
1440
1441 The result of ``os.path.normpath(sys.prefix)``.
1442
1443
1444.. data:: EXEC_PREFIX
1445
1446 The result of ``os.path.normpath(sys.exec_prefix)``.
1447
1448
1449.. function:: get_config_var(name)
1450
1451 Return the value of a single variable. This is equivalent to
1452 ``get_config_vars().get(name)``.
1453
1454
1455.. function:: get_config_vars(...)
1456
1457 Return a set of variable definitions. If there are no arguments, this returns a
1458 dictionary mapping names of configuration variables to values. If arguments are
1459 provided, they should be strings, and the return value will be a sequence giving
1460 the associated values. If a given name does not have a corresponding value,
1461 ``None`` will be included for that variable.
1462
1463
1464.. function:: get_config_h_filename()
1465
1466 Return the full path name of the configuration header. For Unix, this will be
1467 the header generated by the :program:`configure` script; for other platforms the
1468 header will have been supplied directly by the Python source distribution. The
1469 file is a platform-specific text file.
1470
1471
1472.. function:: get_makefile_filename()
1473
1474 Return the full path name of the :file:`Makefile` used to build Python. For
1475 Unix, this will be a file generated by the :program:`configure` script; the
1476 meaning for other platforms will vary. The file is a platform-specific text
1477 file, if it exists. This function is only useful on POSIX platforms.
1478
1479
1480.. function:: get_python_inc([plat_specific[, prefix]])
1481
1482 Return the directory for either the general or platform-dependent C include
1483 files. If *plat_specific* is true, the platform-dependent include directory is
1484 returned; if false or omitted, the platform-independent directory is returned.
1485 If *prefix* is given, it is used as either the prefix instead of
1486 :const:`PREFIX`, or as the exec-prefix instead of :const:`EXEC_PREFIX` if
1487 *plat_specific* is true.
1488
1489
1490.. function:: get_python_lib([plat_specific[, standard_lib[, prefix]]])
1491
1492 Return the directory for either the general or platform-dependent library
1493 installation. If *plat_specific* is true, the platform-dependent include
1494 directory is returned; if false or omitted, the platform-independent directory
1495 is returned. If *prefix* is given, it is used as either the prefix instead of
1496 :const:`PREFIX`, or as the exec-prefix instead of :const:`EXEC_PREFIX` if
1497 *plat_specific* is true. If *standard_lib* is true, the directory for the
1498 standard library is returned rather than the directory for the installation of
1499 third-party extensions.
1500
1501The following function is only intended for use within the :mod:`distutils`
1502package.
1503
1504
1505.. function:: customize_compiler(compiler)
1506
1507 Do any platform-specific customization of a
1508 :class:`distutils.ccompiler.CCompiler` instance.
1509
1510 This function is only needed on Unix at this time, but should be called
1511 consistently to support forward-compatibility. It inserts the information that
1512 varies across Unix flavors and is stored in Python's :file:`Makefile`. This
1513 information includes the selected compiler, compiler and linker options, and the
1514 extension used by the linker for shared objects.
1515
1516This function is even more special-purpose, and should only be used from
1517Python's own build procedures.
1518
1519
1520.. function:: set_python_build()
1521
1522 Inform the :mod:`distutils.sysconfig` module that it is being used as part of
1523 the build process for Python. This changes a lot of relative locations for
1524 files, allowing them to be located in the build area rather than in an installed
1525 Python.
1526
1527
1528:mod:`distutils.text_file` --- The TextFile class
1529=================================================
1530
1531.. module:: distutils.text_file
1532 :synopsis: provides the TextFile class, a simple interface to text files
1533
1534
1535This module provides the :class:`TextFile` class, which gives an interface to
1536text files that (optionally) takes care of stripping comments, ignoring blank
1537lines, and joining lines with backslashes.
1538
1539
1540.. class:: TextFile([filename=None, file=None, **options])
1541
1542 This class provides a file-like object that takes care of all the things you
1543 commonly want to do when processing a text file that has some line-by-line
1544 syntax: strip comments (as long as ``#`` is your comment character), skip blank
1545 lines, join adjacent lines by escaping the newline (ie. backslash at end of
1546 line), strip leading and/or trailing whitespace. All of these are optional and
1547 independently controllable.
1548
1549 The class provides a :meth:`warn` method so you can generate warning messages
1550 that report physical line number, even if the logical line in question spans
1551 multiple physical lines. Also provides :meth:`unreadline` for implementing
1552 line-at-a-time lookahead.
1553
1554 :class:`TextFile` instances are create with either *filename*, *file*, or both.
1555 :exc:`RuntimeError` is raised if both are ``None``. *filename* should be a
1556 string, and *file* a file object (or something that provides :meth:`readline`
1557 and :meth:`close` methods). It is recommended that you supply at least
1558 *filename*, so that :class:`TextFile` can include it in warning messages. If
1559 *file* is not supplied, :class:`TextFile` creates its own using the
1560 :func:`open` built-in function.
1561
1562 The options are all boolean, and affect the values returned by :meth:`readline`
1563
Georg Brandl44ea77b2013-03-28 13:28:44 +01001564 .. tabularcolumns:: |l|L|l|
1565
Georg Brandl116aa622007-08-15 14:28:22 +00001566 +------------------+--------------------------------+---------+
1567 | option name | description | default |
1568 +==================+================================+=========+
1569 | *strip_comments* | strip from ``'#'`` to end-of- | true |
1570 | | line, as well as any | |
1571 | | whitespace leading up to the | |
1572 | | ``'#'``\ ---unless it is | |
1573 | | escaped by a backslash | |
1574 +------------------+--------------------------------+---------+
1575 | *lstrip_ws* | strip leading whitespace from | false |
1576 | | each line before returning it | |
1577 +------------------+--------------------------------+---------+
1578 | *rstrip_ws* | strip trailing whitespace | true |
1579 | | (including line terminator!) | |
1580 | | from each line before | |
1581 | | returning it. | |
1582 +------------------+--------------------------------+---------+
1583 | *skip_blanks* | skip lines that are empty | true |
1584 | | \*after\* stripping comments | |
1585 | | and whitespace. (If both | |
1586 | | lstrip_ws and rstrip_ws are | |
1587 | | false, then some lines may | |
1588 | | consist of solely whitespace: | |
1589 | | these will \*not\* be skipped, | |
1590 | | even if *skip_blanks* is | |
1591 | | true.) | |
1592 +------------------+--------------------------------+---------+
1593 | *join_lines* | if a backslash is the last | false |
1594 | | non-newline character on a | |
1595 | | line after stripping comments | |
1596 | | and whitespace, join the | |
1597 | | following line to it to form | |
1598 | | one logical line; if N | |
1599 | | consecutive lines end with a | |
1600 | | backslash, then N+1 physical | |
1601 | | lines will be joined to form | |
1602 | | one logical line. | |
1603 +------------------+--------------------------------+---------+
1604 | *collapse_join* | strip leading whitespace from | false |
1605 | | lines that are joined to their | |
1606 | | predecessor; only matters if | |
1607 | | ``(join_lines and not | |
1608 | | lstrip_ws)`` | |
1609 +------------------+--------------------------------+---------+
1610
1611 Note that since *rstrip_ws* can strip the trailing newline, the semantics of
Georg Brandl22b34312009-07-26 14:54:51 +00001612 :meth:`readline` must differ from those of the built-in file object's
Georg Brandl116aa622007-08-15 14:28:22 +00001613 :meth:`readline` method! In particular, :meth:`readline` returns ``None`` for
1614 end-of-file: an empty string might just be a blank line (or an all-whitespace
1615 line), if *rstrip_ws* is true but *skip_blanks* is not.
1616
1617
1618 .. method:: TextFile.open(filename)
1619
Georg Brandl22b34312009-07-26 14:54:51 +00001620 Open a new file *filename*. This overrides any *file* or *filename*
1621 constructor arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001622
1623
1624 .. method:: TextFile.close()
1625
1626 Close the current file and forget everything we know about it (including the
1627 filename and the current line number).
1628
1629
1630 .. method:: TextFile.warn(msg[,line=None])
1631
1632 Print (to stderr) a warning message tied to the current logical line in the
1633 current file. If the current logical line in the file spans multiple physical
1634 lines, the warning refers to the whole range, such as ``"lines 3-5"``. If
1635 *line* is supplied, it overrides the current line number; it may be a list or
1636 tuple to indicate a range of physical lines, or an integer for a single
1637 physical line.
1638
1639
1640 .. method:: TextFile.readline()
1641
1642 Read and return a single logical line from the current file (or from an internal
1643 buffer if lines have previously been "unread" with :meth:`unreadline`). If the
1644 *join_lines* option is true, this may involve reading multiple physical lines
1645 concatenated into a single string. Updates the current line number, so calling
1646 :meth:`warn` after :meth:`readline` emits a warning about the physical line(s)
1647 just read. Returns ``None`` on end-of-file, since the empty string can occur
1648 if *rstrip_ws* is true but *strip_blanks* is not.
1649
1650
1651 .. method:: TextFile.readlines()
1652
1653 Read and return the list of all logical lines remaining in the current file.
1654 This updates the current line number to the last line of the file.
1655
1656
1657 .. method:: TextFile.unreadline(line)
1658
1659 Push *line* (a string) onto an internal buffer that will be checked by future
1660 :meth:`readline` calls. Handy for implementing a parser with line-at-a-time
1661 lookahead. Note that lines that are "unread" with :meth:`unreadline` are not
1662 subsequently re-cleansed (whitespace stripped, or whatever) when read with
1663 :meth:`readline`. If multiple calls are made to :meth:`unreadline` before a call
1664 to :meth:`readline`, the lines will be returned most in most recent first order.
1665
1666
1667:mod:`distutils.version` --- Version number classes
1668===================================================
1669
1670.. module:: distutils.version
1671 :synopsis: implements classes that represent module version numbers.
1672
1673
1674.. % todo
1675.. % \section{Distutils Commands}
Georg Brandl48310cd2009-01-03 21:18:54 +00001676.. %
Georg Brandl116aa622007-08-15 14:28:22 +00001677.. % This part of Distutils implements the various Distutils commands, such
1678.. % as \code{build}, \code{install} \&c. Each command is implemented as a
1679.. % separate module, with the command name as the name of the module.
1680
1681
1682:mod:`distutils.cmd` --- Abstract base class for Distutils commands
1683===================================================================
1684
1685.. module:: distutils.cmd
Georg Brandl4009c9e2010-10-06 08:26:09 +00001686 :synopsis: This module provides the abstract base class Command. This class
1687 is subclassed by the modules in the distutils.command subpackage.
Georg Brandl116aa622007-08-15 14:28:22 +00001688
1689
1690This module supplies the abstract base class :class:`Command`.
1691
1692
1693.. class:: Command(dist)
1694
1695 Abstract base class for defining command classes, the "worker bees" of the
1696 Distutils. A useful analogy for command classes is to think of them as
Georg Brandl4009c9e2010-10-06 08:26:09 +00001697 subroutines with local variables called *options*. The options are declared
1698 in :meth:`initialize_options` and defined (given their final values) in
1699 :meth:`finalize_options`, both of which must be defined by every command
1700 class. The distinction between the two is necessary because option values
1701 might come from the outside world (command line, config file, ...), and any
1702 options dependent on other options must be computed after these outside
1703 influences have been processed --- hence :meth:`finalize_options`. The body
1704 of the subroutine, where it does all its work based on the values of its
1705 options, is the :meth:`run` method, which must also be implemented by every
1706 command class.
Georg Brandl116aa622007-08-15 14:28:22 +00001707
Serhiy Storchaka7880db62013-10-09 14:09:16 +03001708 The class constructor takes a single argument *dist*, a
1709 :class:`~distutils.core.Distribution` instance.
Georg Brandl116aa622007-08-15 14:28:22 +00001710
1711
Georg Brandl4009c9e2010-10-06 08:26:09 +00001712Creating a new Distutils command
1713================================
1714
1715This section outlines the steps to create a new Distutils command.
1716
1717A new command lives in a module in the :mod:`distutils.command` package. There
1718is a sample template in that directory called :file:`command_template`. Copy
1719this file to a new module with the same name as the new command you're
1720implementing. This module should implement a class with the same name as the
1721module (and the command). So, for instance, to create the command
1722``peel_banana`` (so that users can run ``setup.py peel_banana``), you'd copy
1723:file:`command_template` to :file:`distutils/command/peel_banana.py`, then edit
1724it so that it's implementing the class :class:`peel_banana`, a subclass of
1725:class:`distutils.cmd.Command`.
1726
1727Subclasses of :class:`Command` must define the following methods.
1728
1729.. method:: Command.initialize_options()
1730
1731 Set default values for all the options that this command supports. Note that
1732 these defaults may be overridden by other commands, by the setup script, by
1733 config files, or by the command-line. Thus, this is not the place to code
1734 dependencies between options; generally, :meth:`initialize_options`
1735 implementations are just a bunch of ``self.foo = None`` assignments.
1736
1737
1738.. method:: Command.finalize_options()
1739
1740 Set final values for all the options that this command supports. This is
1741 always called as late as possible, ie. after any option assignments from the
1742 command-line or from other commands have been done. Thus, this is the place
Ezio Melottie130a522011-10-19 10:58:56 +03001743 to code option dependencies: if *foo* depends on *bar*, then it is safe to
Georg Brandl4009c9e2010-10-06 08:26:09 +00001744 set *foo* from *bar* as long as *foo* still has the same value it was
1745 assigned in :meth:`initialize_options`.
1746
1747
1748.. method:: Command.run()
1749
1750 A command's raison d'etre: carry out the action it exists to perform, controlled
1751 by the options initialized in :meth:`initialize_options`, customized by other
1752 commands, the setup script, the command-line, and config files, and finalized in
1753 :meth:`finalize_options`. All terminal output and filesystem interaction should
1754 be done by :meth:`run`.
1755
1756
1757.. attribute:: Command.sub_commands
1758
1759 *sub_commands* formalizes the notion of a "family" of commands,
1760 e.g. ``install`` as the parent with sub-commands ``install_lib``,
1761 ``install_headers``, etc. The parent of a family of commands defines
1762 *sub_commands* as a class attribute; it's a list of 2-tuples ``(command_name,
1763 predicate)``, with *command_name* a string and *predicate* a function, a
1764 string or ``None``. *predicate* is a method of the parent command that
1765 determines whether the corresponding command is applicable in the current
Éric Araujo000893f2011-05-29 00:14:45 +02001766 situation. (E.g. ``install_headers`` is only applicable if we have any C
Georg Brandl4009c9e2010-10-06 08:26:09 +00001767 header files to install.) If *predicate* is ``None``, that command is always
1768 applicable.
1769
1770 *sub_commands* is usually defined at the *end* of a class, because
1771 predicates can be methods of the class, so they must already have been
1772 defined. The canonical example is the :command:`install` command.
1773
1774
Georg Brandl116aa622007-08-15 14:28:22 +00001775:mod:`distutils.command` --- Individual Distutils commands
1776==========================================================
1777
1778.. module:: distutils.command
1779 :synopsis: This subpackage contains one module for each standard Distutils command.
1780
1781
1782.. % \subsubsection{Individual Distutils commands}
1783.. % todo
1784
1785
1786:mod:`distutils.command.bdist` --- Build a binary installer
1787===========================================================
1788
1789.. module:: distutils.command.bdist
1790 :synopsis: Build a binary installer for a package
1791
1792
1793.. % todo
1794
1795
1796:mod:`distutils.command.bdist_packager` --- Abstract base class for packagers
1797=============================================================================
1798
1799.. module:: distutils.command.bdist_packager
1800 :synopsis: Abstract base class for packagers
1801
1802
1803.. % todo
1804
1805
1806:mod:`distutils.command.bdist_dumb` --- Build a "dumb" installer
1807================================================================
1808
1809.. module:: distutils.command.bdist_dumb
1810 :synopsis: Build a "dumb" installer - a simple archive of files
1811
1812
1813.. % todo
1814
1815
1816:mod:`distutils.command.bdist_msi` --- Build a Microsoft Installer binary package
1817=================================================================================
1818
1819.. module:: distutils.command.bdist_msi
1820 :synopsis: Build a binary distribution as a Windows MSI file
1821
Éric Araujo5864b9f2011-05-31 21:50:38 +02001822.. class:: bdist_msi
Georg Brandl116aa622007-08-15 14:28:22 +00001823
Benjamin Petersond23f8222009-04-05 19:13:16 +00001824 Builds a `Windows Installer`_ (.msi) binary package.
1825
Georg Brandl5d941342016-02-26 19:37:12 +01001826 .. _Windows Installer: https://msdn.microsoft.com/en-us/library/cc185688(VS.85).aspx
Benjamin Petersond23f8222009-04-05 19:13:16 +00001827
1828 In most cases, the ``bdist_msi`` installer is a better choice than the
1829 ``bdist_wininst`` installer, because it provides better support for
1830 Win64 platforms, allows administrators to perform non-interactive
1831 installations, and allows installation through group policies.
Georg Brandl116aa622007-08-15 14:28:22 +00001832
1833
1834:mod:`distutils.command.bdist_rpm` --- Build a binary distribution as a Redhat RPM and SRPM
1835===========================================================================================
1836
1837.. module:: distutils.command.bdist_rpm
1838 :synopsis: Build a binary distribution as a Redhat RPM and SRPM
1839
1840
1841.. % todo
1842
1843
1844:mod:`distutils.command.bdist_wininst` --- Build a Windows installer
1845====================================================================
1846
1847.. module:: distutils.command.bdist_wininst
1848 :synopsis: Build a Windows installer
1849
1850
1851.. % todo
1852
1853
1854:mod:`distutils.command.sdist` --- Build a source distribution
1855==============================================================
1856
1857.. module:: distutils.command.sdist
1858 :synopsis: Build a source distribution
1859
1860
1861.. % todo
1862
1863
1864:mod:`distutils.command.build` --- Build all files of a package
1865===============================================================
1866
1867.. module:: distutils.command.build
1868 :synopsis: Build all files of a package
1869
1870
1871.. % todo
1872
1873
1874:mod:`distutils.command.build_clib` --- Build any C libraries in a package
1875==========================================================================
1876
1877.. module:: distutils.command.build_clib
1878 :synopsis: Build any C libraries in a package
1879
1880
1881.. % todo
1882
1883
1884:mod:`distutils.command.build_ext` --- Build any extensions in a package
1885========================================================================
1886
1887.. module:: distutils.command.build_ext
1888 :synopsis: Build any extensions in a package
1889
1890
1891.. % todo
1892
1893
1894:mod:`distutils.command.build_py` --- Build the .py/.pyc files of a package
1895===========================================================================
1896
1897.. module:: distutils.command.build_py
1898 :synopsis: Build the .py/.pyc files of a package
1899
1900
Éric Araujo5864b9f2011-05-31 21:50:38 +02001901.. class:: build_py
Martin v. Löwis73a22f02008-03-22 00:35:10 +00001902
Éric Araujo5864b9f2011-05-31 21:50:38 +02001903.. class:: build_py_2to3
Martin v. Löwis73a22f02008-03-22 00:35:10 +00001904
1905 Alternative implementation of build_py which also runs the
1906 2to3 conversion library on each .py file that is going to be
1907 installed. To use this in a setup.py file for a distribution
1908 that is designed to run with both Python 2.x and 3.x, add::
1909
1910 try:
Serhiy Storchakadba90392016-05-10 12:01:23 +03001911 from distutils.command.build_py import build_py_2to3 as build_py
Martin v. Löwis73a22f02008-03-22 00:35:10 +00001912 except ImportError:
Serhiy Storchakadba90392016-05-10 12:01:23 +03001913 from distutils.command.build_py import build_py
Martin v. Löwis73a22f02008-03-22 00:35:10 +00001914
1915 to your setup.py, and later::
1916
Georg Brandl682d7e02010-10-06 10:26:05 +00001917 cmdclass = {'build_py': build_py}
Martin v. Löwis73a22f02008-03-22 00:35:10 +00001918
1919 to the invocation of setup().
Georg Brandl116aa622007-08-15 14:28:22 +00001920
1921
1922:mod:`distutils.command.build_scripts` --- Build the scripts of a package
1923=========================================================================
1924
1925.. module:: distutils.command.build_scripts
1926 :synopsis: Build the scripts of a package
1927
1928
1929.. % todo
1930
1931
1932:mod:`distutils.command.clean` --- Clean a package build area
1933=============================================================
1934
1935.. module:: distutils.command.clean
1936 :synopsis: Clean a package build area
1937
Larry Hastings3732ed22014-03-15 21:13:56 -07001938This command removes the temporary files created by :command:`build`
1939and its subcommands, like intermediary compiled object files. With
1940the ``--all`` option, the complete build directory will be removed.
Georg Brandl116aa622007-08-15 14:28:22 +00001941
Larry Hastings3732ed22014-03-15 21:13:56 -07001942Extension modules built :ref:`in place <distutils-build-ext-inplace>`
1943will not be cleaned, as they are not in the build directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001944
1945
1946:mod:`distutils.command.config` --- Perform package configuration
1947=================================================================
1948
1949.. module:: distutils.command.config
1950 :synopsis: Perform package configuration
1951
1952
1953.. % todo
1954
1955
1956:mod:`distutils.command.install` --- Install a package
1957======================================================
1958
1959.. module:: distutils.command.install
1960 :synopsis: Install a package
1961
1962
1963.. % todo
1964
1965
1966:mod:`distutils.command.install_data` --- Install data files from a package
1967===========================================================================
1968
1969.. module:: distutils.command.install_data
1970 :synopsis: Install data files from a package
1971
1972
1973.. % todo
1974
1975
1976:mod:`distutils.command.install_headers` --- Install C/C++ header files from a package
1977======================================================================================
1978
1979.. module:: distutils.command.install_headers
1980 :synopsis: Install C/C++ header files from a package
1981
1982
1983.. % todo
1984
1985
1986:mod:`distutils.command.install_lib` --- Install library files from a package
1987=============================================================================
1988
1989.. module:: distutils.command.install_lib
1990 :synopsis: Install library files from a package
1991
1992
1993.. % todo
1994
1995
1996:mod:`distutils.command.install_scripts` --- Install script files from a package
1997================================================================================
1998
1999.. module:: distutils.command.install_scripts
2000 :synopsis: Install script files from a package
2001
2002
2003.. % todo
2004
2005
2006:mod:`distutils.command.register` --- Register a module with the Python Package Index
2007=====================================================================================
2008
2009.. module:: distutils.command.register
2010 :synopsis: Register a module with the Python Package Index
2011
2012
2013The ``register`` command registers the package with the Python Package Index.
2014This is described in more detail in :pep:`301`.
2015
2016.. % todo
Tarek Ziadé96c45a92010-07-31 09:10:51 +00002017
Éric Araujo4b8f6652011-05-29 18:05:53 +02002018
Tarek Ziadé96c45a92010-07-31 09:10:51 +00002019:mod:`distutils.command.check` --- Check the meta-data of a package
2020===================================================================
2021
2022.. module:: distutils.command.check
2023 :synopsis: Check the metadata of a package
2024
2025
2026The ``check`` command performs some tests on the meta-data of a package.
2027For example, it verifies that all required meta-data are provided as
2028the arguments passed to the :func:`setup` function.
2029
2030.. % todo