blob: 0b692b4dec6c95c004ac62703b3e9967dbd41a74 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`subprocess` --- Subprocess management
2===========================================
3
4.. module:: subprocess
5 :synopsis: Subprocess management.
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04006
Georg Brandl116aa622007-08-15 14:28:22 +00007.. moduleauthor:: Peter Åstrand <astrand@lysator.liu.se>
8.. sectionauthor:: Peter Åstrand <astrand@lysator.liu.se>
9
Terry Jan Reedyfa089b92016-06-11 15:02:54 -040010**Source code:** :source:`Lib/subprocess.py`
11
12--------------
Georg Brandl116aa622007-08-15 14:28:22 +000013
Georg Brandl116aa622007-08-15 14:28:22 +000014The :mod:`subprocess` module allows you to spawn new processes, connect to their
15input/output/error pipes, and obtain their return codes. This module intends to
Benjamin Peterson5eea8a72014-03-12 21:41:35 -050016replace several older modules and functions::
Georg Brandl116aa622007-08-15 14:28:22 +000017
18 os.system
19 os.spawn*
Georg Brandl116aa622007-08-15 14:28:22 +000020
21Information about how the :mod:`subprocess` module can be used to replace these
22modules and functions can be found in the following sections.
23
Benjamin Peterson41181742008-07-02 20:22:54 +000024.. seealso::
25
26 :pep:`324` -- PEP proposing the subprocess module
27
Georg Brandl116aa622007-08-15 14:28:22 +000028
Ezio Melotti402f75d2012-11-08 10:07:10 +020029Using the :mod:`subprocess` Module
30----------------------------------
Georg Brandl116aa622007-08-15 14:28:22 +000031
Gregory P. Smith6e730002015-04-14 16:14:25 -070032The recommended approach to invoking subprocesses is to use the :func:`run`
Benjamin Petersonef9ffcb2015-04-14 22:12:14 -040033function for all use cases it can handle. For more advanced use cases, the
34underlying :class:`Popen` interface can be used directly.
Nick Coghlanc29248f2011-11-08 20:49:23 +100035
Gregory P. Smith6e730002015-04-14 16:14:25 -070036The :func:`run` function was added in Python 3.5; if you need to retain
37compatibility with older versions, see the :ref:`call-function-trio` section.
Nick Coghlanc29248f2011-11-08 20:49:23 +100038
Gregory P. Smith6e730002015-04-14 16:14:25 -070039
40.. function:: run(args, *, stdin=None, input=None, stdout=None, stderr=None,\
Andriy Maletsky22d131a2018-08-09 23:01:54 +030041 capture_output=False, shell=False, cwd=None, timeout=None, \
Jakub Stasiak7432f092018-11-12 04:40:42 +010042 check=False, encoding=None, errors=None, text=None, env=None, \
43 universal_newlines=None)
Nick Coghlanc29248f2011-11-08 20:49:23 +100044
45 Run the command described by *args*. Wait for command to complete, then
Gregory P. Smith6e730002015-04-14 16:14:25 -070046 return a :class:`CompletedProcess` instance.
Nick Coghlanc29248f2011-11-08 20:49:23 +100047
48 The arguments shown above are merely the most common ones, described below
Nick Coghlan217f05b2011-11-08 22:11:21 +100049 in :ref:`frequently-used-arguments` (hence the use of keyword-only notation
50 in the abbreviated signature). The full function signature is largely the
Bo Baylesce0f33d2018-01-30 00:40:39 -060051 same as that of the :class:`Popen` constructor - most of the arguments to
52 this function are passed through to that interface. (*timeout*, *input*,
53 *check*, and *capture_output* are not.)
Nick Coghlan217f05b2011-11-08 22:11:21 +100054
Bo Baylesce0f33d2018-01-30 00:40:39 -060055 If *capture_output* is true, stdout and stderr will be captured.
56 When used, the internal :class:`Popen` object is automatically created with
57 ``stdout=PIPE`` and ``stderr=PIPE``. The *stdout* and *stderr* arguments may
Gregory P. Smithe8830912019-05-14 12:33:17 -070058 not be supplied at the same time as *capture_output*. If you wish to capture
59 and combine both streams into one, use ``stdout=PIPE`` and ``stderr=STDOUT``
60 instead of *capture_output*.
Nick Coghlanc29248f2011-11-08 20:49:23 +100061
Gregory P. Smith6e730002015-04-14 16:14:25 -070062 The *timeout* argument is passed to :meth:`Popen.communicate`. If the timeout
63 expires, the child process will be killed and waited for. The
Nick Coghlan217f05b2011-11-08 22:11:21 +100064 :exc:`TimeoutExpired` exception will be re-raised after the child process
65 has terminated.
Nick Coghlanc29248f2011-11-08 20:49:23 +100066
Serhiy Storchakafcd9f222013-04-22 20:20:54 +030067 The *input* argument is passed to :meth:`Popen.communicate` and thus to the
68 subprocess's stdin. If used it must be a byte sequence, or a string if
andyclegg7fed7bd2017-10-23 03:01:19 +010069 *encoding* or *errors* is specified or *text* is true. When
Steve Dower050acae2016-09-06 20:16:17 -070070 used, the internal :class:`Popen` object is automatically created with
71 ``stdin=PIPE``, and the *stdin* argument may not be used as well.
Serhiy Storchakafcd9f222013-04-22 20:20:54 +030072
Serhiy Storchaka4adf01c2016-10-19 18:30:05 +030073 If *check* is true, and the process exits with a non-zero exit code, a
Gregory P. Smith6e730002015-04-14 16:14:25 -070074 :exc:`CalledProcessError` exception will be raised. Attributes of that
75 exception hold the arguments, the exit code, and stdout and stderr if they
76 were captured.
77
andyclegg7fed7bd2017-10-23 03:01:19 +010078 If *encoding* or *errors* are specified, or *text* is true,
Steve Dower050acae2016-09-06 20:16:17 -070079 file objects for stdin, stdout and stderr are opened in text mode using the
80 specified *encoding* and *errors* or the :class:`io.TextIOWrapper` default.
andyclegg7fed7bd2017-10-23 03:01:19 +010081 The *universal_newlines* argument is equivalent to *text* and is provided
82 for backwards compatibility. By default, file objects are opened in binary mode.
Steve Dower050acae2016-09-06 20:16:17 -070083
Tobias Kunzeaf1ec972018-06-05 13:41:42 +020084 If *env* is not ``None``, it must be a mapping that defines the environment
85 variables for the new process; these are used instead of the default
86 behavior of inheriting the current process' environment. It is passed directly
87 to :class:`Popen`.
88
Nick Coghlanc29248f2011-11-08 20:49:23 +100089 Examples::
90
Gregory P. Smith6e730002015-04-14 16:14:25 -070091 >>> subprocess.run(["ls", "-l"]) # doesn't capture output
92 CompletedProcess(args=['ls', '-l'], returncode=0)
Nick Coghlanc29248f2011-11-08 20:49:23 +100093
Gregory P. Smith6e730002015-04-14 16:14:25 -070094 >>> subprocess.run("exit 1", shell=True, check=True)
Nick Coghlanc29248f2011-11-08 20:49:23 +100095 Traceback (most recent call last):
Gregory P. Smith6e730002015-04-14 16:14:25 -070096 ...
Nick Coghlanc29248f2011-11-08 20:49:23 +100097 subprocess.CalledProcessError: Command 'exit 1' returned non-zero exit status 1
98
Bo Baylesce0f33d2018-01-30 00:40:39 -060099 >>> subprocess.run(["ls", "-l", "/dev/null"], capture_output=True)
Gregory P. Smith6e730002015-04-14 16:14:25 -0700100 CompletedProcess(args=['ls', '-l', '/dev/null'], returncode=0,
Bo Baylesce0f33d2018-01-30 00:40:39 -0600101 stdout=b'crw-rw-rw- 1 root root 1, 3 Jan 23 16:23 /dev/null\n', stderr=b'')
Nick Coghlanc29248f2011-11-08 20:49:23 +1000102
Gregory P. Smith6e730002015-04-14 16:14:25 -0700103 .. versionadded:: 3.5
Nick Coghlanc29248f2011-11-08 20:49:23 +1000104
Steve Dower050acae2016-09-06 20:16:17 -0700105 .. versionchanged:: 3.6
106
107 Added *encoding* and *errors* parameters
108
andyclegg7fed7bd2017-10-23 03:01:19 +0100109 .. versionchanged:: 3.7
110
Bo Baylesce0f33d2018-01-30 00:40:39 -0600111 Added the *text* parameter, as a more understandable alias of *universal_newlines*.
112 Added the *capture_output* parameter.
andyclegg7fed7bd2017-10-23 03:01:19 +0100113
Gregory P. Smith6e730002015-04-14 16:14:25 -0700114.. class:: CompletedProcess
Nick Coghlanc29248f2011-11-08 20:49:23 +1000115
Gregory P. Smith6e730002015-04-14 16:14:25 -0700116 The return value from :func:`run`, representing a process that has finished.
Nick Coghlanc29248f2011-11-08 20:49:23 +1000117
Gregory P. Smith6e730002015-04-14 16:14:25 -0700118 .. attribute:: args
Nick Coghlanc29248f2011-11-08 20:49:23 +1000119
Gregory P. Smith6e730002015-04-14 16:14:25 -0700120 The arguments used to launch the process. This may be a list or a string.
Nick Coghlanc29248f2011-11-08 20:49:23 +1000121
Gregory P. Smith6e730002015-04-14 16:14:25 -0700122 .. attribute:: returncode
Serhiy Storchakafcd9f222013-04-22 20:20:54 +0300123
Gregory P. Smith6e730002015-04-14 16:14:25 -0700124 Exit status of the child process. Typically, an exit status of 0 indicates
125 that it ran successfully.
Nick Coghlan217f05b2011-11-08 22:11:21 +1000126
Gregory P. Smith6e730002015-04-14 16:14:25 -0700127 A negative value ``-N`` indicates that the child was terminated by signal
128 ``N`` (POSIX only).
129
130 .. attribute:: stdout
131
132 Captured stdout from the child process. A bytes sequence, or a string if
andyclegg7fed7bd2017-10-23 03:01:19 +0100133 :func:`run` was called with an encoding, errors, or text=True.
134 ``None`` if stdout was not captured.
Gregory P. Smith6e730002015-04-14 16:14:25 -0700135
136 If you ran the process with ``stderr=subprocess.STDOUT``, stdout and
137 stderr will be combined in this attribute, and :attr:`stderr` will be
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300138 ``None``.
Gregory P. Smith6e730002015-04-14 16:14:25 -0700139
140 .. attribute:: stderr
141
142 Captured stderr from the child process. A bytes sequence, or a string if
andyclegg7fed7bd2017-10-23 03:01:19 +0100143 :func:`run` was called with an encoding, errors, or text=True.
144 ``None`` if stderr was not captured.
Gregory P. Smith6e730002015-04-14 16:14:25 -0700145
146 .. method:: check_returncode()
147
148 If :attr:`returncode` is non-zero, raise a :exc:`CalledProcessError`.
149
150 .. versionadded:: 3.5
Nick Coghlan217f05b2011-11-08 22:11:21 +1000151
152.. data:: DEVNULL
153
154 Special value that can be used as the *stdin*, *stdout* or *stderr* argument
155 to :class:`Popen` and indicates that the special file :data:`os.devnull`
156 will be used.
157
158 .. versionadded:: 3.3
159
Nick Coghlanc29248f2011-11-08 20:49:23 +1000160
161.. data:: PIPE
162
163 Special value that can be used as the *stdin*, *stdout* or *stderr* argument
164 to :class:`Popen` and indicates that a pipe to the standard stream should be
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700165 opened. Most useful with :meth:`Popen.communicate`.
Nick Coghlanc29248f2011-11-08 20:49:23 +1000166
167
168.. data:: STDOUT
169
170 Special value that can be used as the *stderr* argument to :class:`Popen` and
171 indicates that standard error should go into the same handle as standard
172 output.
173
174
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300175.. exception:: SubprocessError
176
177 Base class for all other exceptions from this module.
178
179 .. versionadded:: 3.3
180
181
182.. exception:: TimeoutExpired
183
184 Subclass of :exc:`SubprocessError`, raised when a timeout expires
185 while waiting for a child process.
186
187 .. attribute:: cmd
188
189 Command that was used to spawn the child process.
190
191 .. attribute:: timeout
192
193 Timeout in seconds.
194
195 .. attribute:: output
196
Gregory P. Smith6e730002015-04-14 16:14:25 -0700197 Output of the child process if it was captured by :func:`run` or
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300198 :func:`check_output`. Otherwise, ``None``.
199
Gregory P. Smith6e730002015-04-14 16:14:25 -0700200 .. attribute:: stdout
201
202 Alias for output, for symmetry with :attr:`stderr`.
203
204 .. attribute:: stderr
205
206 Stderr output of the child process if it was captured by :func:`run`.
207 Otherwise, ``None``.
208
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300209 .. versionadded:: 3.3
210
Gregory P. Smith6e730002015-04-14 16:14:25 -0700211 .. versionchanged:: 3.5
212 *stdout* and *stderr* attributes added
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300213
214.. exception:: CalledProcessError
215
216 Subclass of :exc:`SubprocessError`, raised when a process run by
217 :func:`check_call` or :func:`check_output` returns a non-zero exit status.
218
219 .. attribute:: returncode
220
Gregory P. Smith ext:(%20%5BGoogle%20Inc.%5D)583a1d62016-06-03 00:31:21 +0000221 Exit status of the child process. If the process exited due to a
222 signal, this will be the negative signal number.
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300223
224 .. attribute:: cmd
225
226 Command that was used to spawn the child process.
227
228 .. attribute:: output
229
Gregory P. Smith6e730002015-04-14 16:14:25 -0700230 Output of the child process if it was captured by :func:`run` or
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300231 :func:`check_output`. Otherwise, ``None``.
232
Gregory P. Smith6e730002015-04-14 16:14:25 -0700233 .. attribute:: stdout
234
235 Alias for output, for symmetry with :attr:`stderr`.
236
237 .. attribute:: stderr
238
239 Stderr output of the child process if it was captured by :func:`run`.
240 Otherwise, ``None``.
241
242 .. versionchanged:: 3.5
243 *stdout* and *stderr* attributes added
Andrew Svetlovb4a09ab2012-08-09 15:11:45 +0300244
245
Nick Coghlanc29248f2011-11-08 20:49:23 +1000246.. _frequently-used-arguments:
247
248Frequently Used Arguments
249^^^^^^^^^^^^^^^^^^^^^^^^^
250
251To support a wide variety of use cases, the :class:`Popen` constructor (and
252the convenience functions) accept a large number of optional arguments. For
253most typical use cases, many of these arguments can be safely left at their
254default values. The arguments that are most commonly needed are:
255
256 *args* is required for all calls and should be a string, or a sequence of
257 program arguments. Providing a sequence of arguments is generally
258 preferred, as it allows the module to take care of any required escaping
259 and quoting of arguments (e.g. to permit spaces in file names). If passing
260 a single string, either *shell* must be :const:`True` (see below) or else
261 the string must simply name the program to be executed without specifying
262 any arguments.
263
264 *stdin*, *stdout* and *stderr* specify the executed program's standard input,
265 standard output and standard error file handles, respectively. Valid values
Nick Coghlan217f05b2011-11-08 22:11:21 +1000266 are :data:`PIPE`, :data:`DEVNULL`, an existing file descriptor (a positive
267 integer), an existing file object, and ``None``. :data:`PIPE` indicates
268 that a new pipe to the child should be created. :data:`DEVNULL` indicates
269 that the special file :data:`os.devnull` will be used. With the default
270 settings of ``None``, no redirection will occur; the child's file handles
271 will be inherited from the parent. Additionally, *stderr* can be
272 :data:`STDOUT`, which indicates that the stderr data from the child
273 process should be captured into the same file handle as for *stdout*.
Nick Coghlanc29248f2011-11-08 20:49:23 +1000274
R David Murray1b00f252012-08-15 10:43:58 -0400275 .. index::
276 single: universal newlines; subprocess module
277
Pablo Galindoe14c0102018-02-11 20:58:23 +0000278 If *encoding* or *errors* are specified, or *text* (also known as
279 *universal_newlines*) is true,
Steve Dower050acae2016-09-06 20:16:17 -0700280 the file objects *stdin*, *stdout* and *stderr* will be opened in text
281 mode using the *encoding* and *errors* specified in the call or the
282 defaults for :class:`io.TextIOWrapper`.
Ronald Oussoren385521c2013-07-07 09:26:45 +0200283
Steve Dower050acae2016-09-06 20:16:17 -0700284 For *stdin*, line ending characters ``'\n'`` in the input will be converted
285 to the default line separator :data:`os.linesep`. For *stdout* and *stderr*,
286 all line endings in the output will be converted to ``'\n'``. For more
287 information see the documentation of the :class:`io.TextIOWrapper` class
288 when the *newline* argument to its constructor is ``None``.
289
290 If text mode is not used, *stdin*, *stdout* and *stderr* will be opened as
291 binary streams. No encoding or line ending conversion is performed.
292
293 .. versionadded:: 3.6
294 Added *encoding* and *errors* parameters.
Nick Coghlanc29248f2011-11-08 20:49:23 +1000295
Pablo Galindoe14c0102018-02-11 20:58:23 +0000296 .. versionadded:: 3.7
297 Added the *text* parameter as an alias for *universal_newlines*.
298
Andrew Svetlov50be4522012-08-13 22:09:04 +0300299 .. note::
300
Gregory P. Smith1f8a40b2013-03-20 18:32:03 -0700301 The newlines attribute of the file objects :attr:`Popen.stdin`,
302 :attr:`Popen.stdout` and :attr:`Popen.stderr` are not updated by
303 the :meth:`Popen.communicate` method.
Andrew Svetlov50be4522012-08-13 22:09:04 +0300304
305 If *shell* is ``True``, the specified command will be executed through
Ezio Melotti186d5232012-09-15 08:34:08 +0300306 the shell. This can be useful if you are using Python primarily for the
Nick Coghlanc29248f2011-11-08 20:49:23 +1000307 enhanced control flow it offers over most system shells and still want
Ezio Melotti186d5232012-09-15 08:34:08 +0300308 convenient access to other shell features such as shell pipes, filename
309 wildcards, environment variable expansion, and expansion of ``~`` to a
310 user's home directory. However, note that Python itself offers
311 implementations of many shell-like features (in particular, :mod:`glob`,
312 :mod:`fnmatch`, :func:`os.walk`, :func:`os.path.expandvars`,
313 :func:`os.path.expanduser`, and :mod:`shutil`).
Nick Coghlanc29248f2011-11-08 20:49:23 +1000314
Andrew Svetlov4805fa82012-08-13 22:11:14 +0300315 .. versionchanged:: 3.3
316 When *universal_newlines* is ``True``, the class uses the encoding
317 :func:`locale.getpreferredencoding(False) <locale.getpreferredencoding>`
318 instead of ``locale.getpreferredencoding()``. See the
319 :class:`io.TextIOWrapper` class for more information on this change.
320
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700321 .. note::
Nick Coghlanc29248f2011-11-08 20:49:23 +1000322
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700323 Read the `Security Considerations`_ section before using ``shell=True``.
Andrew Svetlovc2415eb2012-10-28 11:42:26 +0200324
Nick Coghlanc29248f2011-11-08 20:49:23 +1000325These options, along with all of the other options, are described in more
326detail in the :class:`Popen` constructor documentation.
327
328
Sandro Tosi1526ad12011-12-25 11:27:37 +0100329Popen Constructor
Sandro Tosi3e6c8142011-12-25 17:14:11 +0100330^^^^^^^^^^^^^^^^^
Nick Coghlanc29248f2011-11-08 20:49:23 +1000331
332The underlying process creation and management in this module is handled by
333the :class:`Popen` class. It offers a lot of flexibility so that developers
334are able to handle the less common cases not covered by the convenience
335functions.
Georg Brandl116aa622007-08-15 14:28:22 +0000336
337
Gregory P. Smitha1ed5392013-03-23 11:44:25 -0700338.. class:: Popen(args, bufsize=-1, executable=None, stdin=None, stdout=None, \
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700339 stderr=None, preexec_fn=None, close_fds=True, shell=False, \
Jakub Stasiak7432f092018-11-12 04:40:42 +0100340 cwd=None, env=None, universal_newlines=None, \
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700341 startupinfo=None, creationflags=0, restore_signals=True, \
Steve Dower050acae2016-09-06 20:16:17 -0700342 start_new_session=False, pass_fds=(), *, \
Pablo Galindoe14c0102018-02-11 20:58:23 +0000343 encoding=None, errors=None, text=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000344
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700345 Execute a child program in a new process. On POSIX, the class uses
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700346 :meth:`os.execvp`-like behavior to execute the child program. On Windows,
347 the class uses the Windows ``CreateProcess()`` function. The arguments to
348 :class:`Popen` are as follows.
Georg Brandl116aa622007-08-15 14:28:22 +0000349
Serhiy Storchaka9e3c4522019-05-28 22:49:35 +0300350 *args* should be a sequence of program arguments or else a single string
351 or :term:`path-like object`.
Serhiy Storchakabe50a7b2018-02-28 01:03:46 +0200352 By default, the program to execute is the first item in *args* if *args* is
353 a sequence. If *args* is a string, the interpretation is
354 platform-dependent and described below. See the *shell* and *executable*
355 arguments for additional differences from the default behavior. Unless
356 otherwise stated, it is recommended to pass *args* as a sequence.
Georg Brandl116aa622007-08-15 14:28:22 +0000357
Miss Islington (bot)e6690f62020-02-10 14:57:06 -0800358 An example of passing some arguments to an external program
359 as a sequence is::
360
361 Popen(["/usr/bin/git", "commit", "-m", "Fixes a bug."])
362
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700363 On POSIX, if *args* is a string, the string is interpreted as the name or
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700364 path of the program to execute. However, this can only be done if not
365 passing arguments to the program.
Georg Brandl116aa622007-08-15 14:28:22 +0000366
R. David Murray5973e4d2010-02-04 16:41:57 +0000367 .. note::
368
Miss Islington (bot)e6690f62020-02-10 14:57:06 -0800369 It may not be obvious how to break a shell command into a sequence of arguments,
370 especially in complex cases. :meth:`shlex.split` can illustrate how to
371 determine the correct tokenization for *args*::
R. David Murray5973e4d2010-02-04 16:41:57 +0000372
373 >>> import shlex, subprocess
R. David Murray73bc75b2010-02-05 16:25:12 +0000374 >>> command_line = input()
R. David Murray5973e4d2010-02-04 16:41:57 +0000375 /bin/vikings -input eggs.txt -output "spam spam.txt" -cmd "echo '$MONEY'"
376 >>> args = shlex.split(command_line)
377 >>> print(args)
378 ['/bin/vikings', '-input', 'eggs.txt', '-output', 'spam spam.txt', '-cmd', "echo '$MONEY'"]
379 >>> p = subprocess.Popen(args) # Success!
380
381 Note in particular that options (such as *-input*) and arguments (such
382 as *eggs.txt*) that are separated by whitespace in the shell go in separate
383 list elements, while arguments that need quoting or backslash escaping when
384 used in the shell (such as filenames containing spaces or the *echo* command
385 shown above) are single list elements.
386
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700387 On Windows, if *args* is a sequence, it will be converted to a string in a
388 manner described in :ref:`converting-argument-sequence`. This is because
389 the underlying ``CreateProcess()`` operates on strings.
Chris Jerdonek470ee392012-10-08 23:06:57 -0700390
Serhiy Storchaka9e3c4522019-05-28 22:49:35 +0300391 .. versionchanged:: 3.6
392 *args* parameter accepts a :term:`path-like object` if *shell* is
393 ``False`` and a sequence containing path-like objects on POSIX.
394
395 .. versionchanged:: 3.8
396 *args* parameter accepts a :term:`path-like object` if *shell* is
397 ``False`` and a sequence containing bytes and path-like objects
398 on Windows.
399
Serhiy Storchakaa97cd2e2016-10-19 16:43:42 +0300400 The *shell* argument (which defaults to ``False``) specifies whether to use
401 the shell as the program to execute. If *shell* is ``True``, it is
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700402 recommended to pass *args* as a string rather than as a sequence.
Chris Jerdonek470ee392012-10-08 23:06:57 -0700403
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700404 On POSIX with ``shell=True``, the shell defaults to :file:`/bin/sh`. If
Chris Jerdonek470ee392012-10-08 23:06:57 -0700405 *args* is a string, the string specifies the command
406 to execute through the shell. This means that the string must be
R. David Murray5973e4d2010-02-04 16:41:57 +0000407 formatted exactly as it would be when typed at the shell prompt. This
408 includes, for example, quoting or backslash escaping filenames with spaces in
409 them. If *args* is a sequence, the first item specifies the command string, and
410 any additional items will be treated as additional arguments to the shell
Chris Jerdonek470ee392012-10-08 23:06:57 -0700411 itself. That is to say, :class:`Popen` does the equivalent of::
R. David Murray5973e4d2010-02-04 16:41:57 +0000412
413 Popen(['/bin/sh', '-c', args[0], args[1], ...])
Georg Brandl116aa622007-08-15 14:28:22 +0000414
Chris Jerdonek470ee392012-10-08 23:06:57 -0700415 On Windows with ``shell=True``, the :envvar:`COMSPEC` environment variable
416 specifies the default shell. The only time you need to specify
417 ``shell=True`` on Windows is when the command you wish to execute is built
418 into the shell (e.g. :command:`dir` or :command:`copy`). You do not need
419 ``shell=True`` to run a batch file or console-based executable.
Georg Brandl116aa622007-08-15 14:28:22 +0000420
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700421 .. note::
Chris Jerdonekcc32a682012-10-10 22:52:22 -0700422
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700423 Read the `Security Considerations`_ section before using ``shell=True``.
Chris Jerdonekcc32a682012-10-10 22:52:22 -0700424
Antoine Pitrouafe8d062014-09-21 21:10:56 +0200425 *bufsize* will be supplied as the corresponding argument to the
426 :func:`open` function when creating the stdin/stdout/stderr pipe
427 file objects:
428
429 - :const:`0` means unbuffered (read and write are one
430 system call and can return short)
431 - :const:`1` means line buffered
432 (only usable if ``universal_newlines=True`` i.e., in a text mode)
433 - any other positive value means use a buffer of approximately that
434 size
435 - negative bufsize (the default) means the system default of
436 io.DEFAULT_BUFFER_SIZE will be used.
Georg Brandl116aa622007-08-15 14:28:22 +0000437
Georg Brandl37b70bb2013-11-25 08:48:37 +0100438 .. versionchanged:: 3.3.1
Gregory P. Smitha1ed5392013-03-23 11:44:25 -0700439 *bufsize* now defaults to -1 to enable buffering by default to match the
Georg Brandl37b70bb2013-11-25 08:48:37 +0100440 behavior that most code expects. In versions prior to Python 3.2.4 and
441 3.3.1 it incorrectly defaulted to :const:`0` which was unbuffered
442 and allowed short reads. This was unintentional and did not match the
443 behavior of Python 2 as most code expected.
Antoine Pitrou4b876202010-06-02 17:10:49 +0000444
Chris Jerdonek470ee392012-10-08 23:06:57 -0700445 The *executable* argument specifies a replacement program to execute. It
446 is very seldom needed. When ``shell=False``, *executable* replaces the
Chris Jerdonek4a4a02b2012-10-10 17:46:18 -0700447 program to execute specified by *args*. However, the original *args* is
448 still passed to the program. Most programs treat the program specified
449 by *args* as the command name, which can then be different from the program
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700450 actually executed. On POSIX, the *args* name
Chris Jerdonek470ee392012-10-08 23:06:57 -0700451 becomes the display name for the executable in utilities such as
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700452 :program:`ps`. If ``shell=True``, on POSIX the *executable* argument
Chris Jerdonek470ee392012-10-08 23:06:57 -0700453 specifies a replacement shell for the default :file:`/bin/sh`.
Georg Brandl116aa622007-08-15 14:28:22 +0000454
Serhiy Storchaka9e3c4522019-05-28 22:49:35 +0300455 .. versionchanged:: 3.6
456 *executable* parameter accepts a :term:`path-like object` on POSIX.
457
458 .. versionchanged:: 3.8
459 *executable* parameter accepts a bytes and :term:`path-like object`
460 on Windows.
461
Nick Coghlanc29248f2011-11-08 20:49:23 +1000462 *stdin*, *stdout* and *stderr* specify the executed program's standard input,
Georg Brandlaf265f42008-12-07 15:06:20 +0000463 standard output and standard error file handles, respectively. Valid values
Ross Lagerwallba102ec2011-03-16 18:40:25 +0200464 are :data:`PIPE`, :data:`DEVNULL`, an existing file descriptor (a positive
465 integer), an existing :term:`file object`, and ``None``. :data:`PIPE`
466 indicates that a new pipe to the child should be created. :data:`DEVNULL`
Nick Coghlan217f05b2011-11-08 22:11:21 +1000467 indicates that the special file :data:`os.devnull` will be used. With the
468 default settings of ``None``, no redirection will occur; the child's file
469 handles will be inherited from the parent. Additionally, *stderr* can be
470 :data:`STDOUT`, which indicates that the stderr data from the applications
471 should be captured into the same file handle as for stdout.
Georg Brandl116aa622007-08-15 14:28:22 +0000472
473 If *preexec_fn* is set to a callable object, this object will be called in the
Gregory P. Smithfb94c5f2010-03-14 06:49:55 +0000474 child process just before the child is executed.
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700475 (POSIX only)
Gregory P. Smithfb94c5f2010-03-14 06:49:55 +0000476
477 .. warning::
478
479 The *preexec_fn* parameter is not safe to use in the presence of threads
480 in your application. The child process could deadlock before exec is
481 called.
482 If you must use it, keep it trivial! Minimize the number of libraries
483 you call into.
484
485 .. note::
486
487 If you need to modify the environment for the child use the *env*
488 parameter rather than doing it in a *preexec_fn*.
489 The *start_new_session* parameter can take the place of a previously
490 common use of *preexec_fn* to call os.setsid() in the child.
Georg Brandl116aa622007-08-15 14:28:22 +0000491
Miss Islington (bot)03c52f22019-08-27 14:56:27 -0700492 .. versionchanged:: 3.8
493
494 The *preexec_fn* parameter is no longer supported in subinterpreters.
495 The use of the parameter in a subinterpreter raises
496 :exc:`RuntimeError`. The new restriction may affect applications that
497 are deployed in mod_wsgi, uWSGI, and other embedded environments.
498
Georg Brandl116aa622007-08-15 14:28:22 +0000499 If *close_fds* is true, all file descriptors except :const:`0`, :const:`1` and
Gregory P. Smithdfb6e542018-03-25 10:27:59 -0700500 :const:`2` will be closed before the child process is executed. Otherwise
501 when *close_fds* is false, file descriptors obey their inheritable flag
502 as described in :ref:`fd_inheritance`.
503
Gregory P. Smithd23047b2010-12-04 09:10:44 +0000504 On Windows, if *close_fds* is true then no handles will be inherited by the
Segev Finerb2a60832017-12-18 11:28:19 +0200505 child process unless explicitly passed in the ``handle_list`` element of
506 :attr:`STARTUPINFO.lpAttributeList`, or by standard handle redirection.
Georg Brandl116aa622007-08-15 14:28:22 +0000507
Gregory P. Smith8edd99d2010-12-14 13:43:30 +0000508 .. versionchanged:: 3.2
509 The default for *close_fds* was changed from :const:`False` to
510 what is described above.
511
Segev Finerb2a60832017-12-18 11:28:19 +0200512 .. versionchanged:: 3.7
513 On Windows the default for *close_fds* was changed from :const:`False` to
514 :const:`True` when redirecting the standard handles. It's now possible to
515 set *close_fds* to :const:`True` when redirecting the standard handles.
516
Gregory P. Smith8edd99d2010-12-14 13:43:30 +0000517 *pass_fds* is an optional sequence of file descriptors to keep open
518 between the parent and child. Providing any *pass_fds* forces
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700519 *close_fds* to be :const:`True`. (POSIX only)
Gregory P. Smith8edd99d2010-12-14 13:43:30 +0000520
Sergey Fedoseevf1202882018-07-06 05:01:16 +0500521 .. versionchanged:: 3.2
Gregory P. Smith8edd99d2010-12-14 13:43:30 +0000522 The *pass_fds* parameter was added.
Georg Brandl116aa622007-08-15 14:28:22 +0000523
Chris Jerdonekec3ea942012-09-30 00:10:28 -0700524 If *cwd* is not ``None``, the function changes the working directory to
Serhiy Storchaka9e3c4522019-05-28 22:49:35 +0300525 *cwd* before executing the child. *cwd* can be a string, bytes or
Sayan Chowdhuryd5c11f72017-02-26 22:36:10 +0530526 :term:`path-like <path-like object>` object. In particular, the function
527 looks for *executable* (or for the first item in *args*) relative to *cwd*
528 if the executable path is a relative path.
529
530 .. versionchanged:: 3.6
Serhiy Storchaka9e3c4522019-05-28 22:49:35 +0300531 *cwd* parameter accepts a :term:`path-like object` on POSIX.
532
533 .. versionchanged:: 3.7
534 *cwd* parameter accepts a :term:`path-like object` on Windows.
535
536 .. versionchanged:: 3.8
537 *cwd* parameter accepts a bytes object on Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000538
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200539 If *restore_signals* is true (the default) all signals that Python has set to
Gregory P. Smithfb94c5f2010-03-14 06:49:55 +0000540 SIG_IGN are restored to SIG_DFL in the child process before the exec.
541 Currently this includes the SIGPIPE, SIGXFZ and SIGXFSZ signals.
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700542 (POSIX only)
Gregory P. Smithfb94c5f2010-03-14 06:49:55 +0000543
544 .. versionchanged:: 3.2
545 *restore_signals* was added.
546
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200547 If *start_new_session* is true the setsid() system call will be made in the
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700548 child process prior to the execution of the subprocess. (POSIX only)
Gregory P. Smithfb94c5f2010-03-14 06:49:55 +0000549
550 .. versionchanged:: 3.2
551 *start_new_session* was added.
552
Christian Heimesa342c012008-04-20 21:01:16 +0000553 If *env* is not ``None``, it must be a mapping that defines the environment
Gregory P. Smithfb94c5f2010-03-14 06:49:55 +0000554 variables for the new process; these are used instead of the default
555 behavior of inheriting the current process' environment.
Georg Brandl116aa622007-08-15 14:28:22 +0000556
R. David Murray1055e892009-04-16 18:15:32 +0000557 .. note::
R. David Murrayf4ac1492009-04-15 22:35:15 +0000558
Georg Brandl2708f3a2009-12-20 14:38:23 +0000559 If specified, *env* must provide any variables required for the program to
560 execute. On Windows, in order to run a `side-by-side assembly`_ the
561 specified *env* **must** include a valid :envvar:`SystemRoot`.
R. David Murrayf4ac1492009-04-15 22:35:15 +0000562
Georg Brandl5d941342016-02-26 19:37:12 +0100563 .. _side-by-side assembly: https://en.wikipedia.org/wiki/Side-by-Side_Assembly
R. David Murray1055e892009-04-16 18:15:32 +0000564
Pablo Galindoe14c0102018-02-11 20:58:23 +0000565 If *encoding* or *errors* are specified, or *text* is true, the file objects
566 *stdin*, *stdout* and *stderr* are opened in text mode with the specified
567 encoding and *errors*, as described above in :ref:`frequently-used-arguments`.
568 The *universal_newlines* argument is equivalent to *text* and is provided
569 for backwards compatibility. By default, file objects are opened in binary mode.
Steve Dower050acae2016-09-06 20:16:17 -0700570
571 .. versionadded:: 3.6
572 *encoding* and *errors* were added.
Georg Brandl116aa622007-08-15 14:28:22 +0000573
Pablo Galindoe14c0102018-02-11 20:58:23 +0000574 .. versionadded:: 3.7
575 *text* was added as a more readable alias for *universal_newlines*.
576
Brian Curtine6242d72011-04-29 22:17:51 -0500577 If given, *startupinfo* will be a :class:`STARTUPINFO` object, which is
578 passed to the underlying ``CreateProcess`` function.
Jamesb5d9e082017-11-08 14:18:59 +0000579 *creationflags*, if given, can be one or more of the following flags:
580
581 * :data:`CREATE_NEW_CONSOLE`
582 * :data:`CREATE_NEW_PROCESS_GROUP`
583 * :data:`ABOVE_NORMAL_PRIORITY_CLASS`
584 * :data:`BELOW_NORMAL_PRIORITY_CLASS`
585 * :data:`HIGH_PRIORITY_CLASS`
586 * :data:`IDLE_PRIORITY_CLASS`
587 * :data:`NORMAL_PRIORITY_CLASS`
588 * :data:`REALTIME_PRIORITY_CLASS`
589 * :data:`CREATE_NO_WINDOW`
590 * :data:`DETACHED_PROCESS`
591 * :data:`CREATE_DEFAULT_ERROR_MODE`
592 * :data:`CREATE_BREAKAWAY_FROM_JOB`
Georg Brandl116aa622007-08-15 14:28:22 +0000593
Gregory P. Smith6b657452011-05-11 21:42:08 -0700594 Popen objects are supported as context managers via the :keyword:`with` statement:
595 on exit, standard file descriptors are closed, and the process is waited for.
Brian Curtin79cdb662010-12-03 02:46:02 +0000596 ::
597
598 with Popen(["ifconfig"], stdout=PIPE) as proc:
599 log.write(proc.stdout.read())
600
Miss Islington (bot)4fee28a2019-06-27 11:07:16 -0700601 .. audit-event:: subprocess.Popen executable,args,cwd,env subprocess.Popen
Miss Islington (bot)8763d432019-06-24 09:09:47 -0700602
603 Popen and the other functions in this module that use it raise an
604 :ref:`auditing event <auditing>` ``subprocess.Popen`` with arguments
Jules Lasne (jlasne)305189e2019-11-29 05:47:45 +0100605 ``executable``, ``args``, ``cwd``, and ``env``. The value for ``args``
Miss Islington (bot)8763d432019-06-24 09:09:47 -0700606 may be a single string or a list of strings, depending on platform.
607
Brian Curtin79cdb662010-12-03 02:46:02 +0000608 .. versionchanged:: 3.2
609 Added context manager support.
610
Victor Stinner5a48e212016-05-20 12:11:15 +0200611 .. versionchanged:: 3.6
612 Popen destructor now emits a :exc:`ResourceWarning` warning if the child
613 process is still running.
614
Victor Stinnerd7befad2019-04-25 14:30:16 +0200615 .. versionchanged:: 3.8
616 Popen can use :func:`os.posix_spawn` in some cases for better
617 performance. On Windows Subsystem for Linux and QEMU User Emulation,
618 Popen constructor using :func:`os.posix_spawn` no longer raise an
619 exception on errors like missing program, but the child process fails
620 with a non-zero :attr:`~Popen.returncode`.
621
Georg Brandl116aa622007-08-15 14:28:22 +0000622
Georg Brandl116aa622007-08-15 14:28:22 +0000623Exceptions
624^^^^^^^^^^
625
626Exceptions raised in the child process, before the new program has started to
Harmandeep Singh47a2fce2019-01-04 01:23:56 +0530627execute, will be re-raised in the parent.
Georg Brandl116aa622007-08-15 14:28:22 +0000628
629The most common exception raised is :exc:`OSError`. This occurs, for example,
630when trying to execute a non-existent file. Applications should prepare for
631:exc:`OSError` exceptions.
632
633A :exc:`ValueError` will be raised if :class:`Popen` is called with invalid
634arguments.
635
Nick Coghlanc29248f2011-11-08 20:49:23 +1000636:func:`check_call` and :func:`check_output` will raise
637:exc:`CalledProcessError` if the called process returns a non-zero return
638code.
Georg Brandl116aa622007-08-15 14:28:22 +0000639
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400640All of the functions and methods that accept a *timeout* parameter, such as
641:func:`call` and :meth:`Popen.communicate` will raise :exc:`TimeoutExpired` if
642the timeout expires before the process exits.
643
Ronald Oussorenc1577902011-03-16 10:03:10 -0400644Exceptions defined in this module all inherit from :exc:`SubprocessError`.
Gregory P. Smith54d412e2011-03-14 14:08:43 -0400645
646 .. versionadded:: 3.3
647 The :exc:`SubprocessError` base class was added.
648
Georg Brandl116aa622007-08-15 14:28:22 +0000649
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700650Security Considerations
651-----------------------
Georg Brandl116aa622007-08-15 14:28:22 +0000652
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700653Unlike some other popen functions, this implementation will never
654implicitly call a system shell. This means that all characters,
655including shell metacharacters, can safely be passed to child processes.
656If the shell is invoked explicitly, via ``shell=True``, it is the application's
657responsibility to ensure that all whitespace and metacharacters are
658quoted appropriately to avoid
Georg Brandl5d941342016-02-26 19:37:12 +0100659`shell injection <https://en.wikipedia.org/wiki/Shell_injection#Shell_injection>`_
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700660vulnerabilities.
661
662When using ``shell=True``, the :func:`shlex.quote` function can be
663used to properly escape whitespace and shell metacharacters in strings
664that are going to be used to construct shell commands.
Georg Brandl116aa622007-08-15 14:28:22 +0000665
666
667Popen Objects
668-------------
669
670Instances of the :class:`Popen` class have the following methods:
671
672
673.. method:: Popen.poll()
674
Serhiy Storchaka9e0ae532013-08-24 00:23:38 +0300675 Check if child process has terminated. Set and return
Ivan Chernoff006617f2017-08-29 17:46:24 +0300676 :attr:`~Popen.returncode` attribute. Otherwise, returns ``None``.
Georg Brandl116aa622007-08-15 14:28:22 +0000677
678
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400679.. method:: Popen.wait(timeout=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000680
Serhiy Storchaka9e0ae532013-08-24 00:23:38 +0300681 Wait for child process to terminate. Set and return
682 :attr:`~Popen.returncode` attribute.
Georg Brandl116aa622007-08-15 14:28:22 +0000683
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400684 If the process does not terminate after *timeout* seconds, raise a
685 :exc:`TimeoutExpired` exception. It is safe to catch this exception and
686 retry the wait.
687
Victor Stinner07171242014-02-24 13:18:47 +0100688 .. note::
689
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700690 This will deadlock when using ``stdout=PIPE`` or ``stderr=PIPE``
691 and the child process generates enough output to a pipe such that
692 it blocks waiting for the OS pipe buffer to accept more data.
693 Use :meth:`Popen.communicate` when using pipes to avoid that.
694
695 .. note::
696
Victor Stinner07171242014-02-24 13:18:47 +0100697 The function is implemented using a busy loop (non-blocking call and
698 short sleeps). Use the :mod:`asyncio` module for an asynchronous wait:
699 see :class:`asyncio.create_subprocess_exec`.
700
Reid Kleckner28f13032011-03-14 12:36:53 -0400701 .. versionchanged:: 3.3
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400702 *timeout* was added.
Georg Brandl116aa622007-08-15 14:28:22 +0000703
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400704.. method:: Popen.communicate(input=None, timeout=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000705
706 Interact with process: Send data to stdin. Read data from stdout and stderr,
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400707 until end-of-file is reached. Wait for process to terminate. The optional
Gregory P. Smitha454ef62011-05-22 22:29:49 -0700708 *input* argument should be data to be sent to the child process, or
Steve Dower050acae2016-09-06 20:16:17 -0700709 ``None``, if no data should be sent to the child. If streams were opened in
710 text mode, *input* must be a string. Otherwise, it must be bytes.
Georg Brandl116aa622007-08-15 14:28:22 +0000711
Victor Stinner39892052014-10-14 00:52:07 +0200712 :meth:`communicate` returns a tuple ``(stdout_data, stderr_data)``.
Steve Dower050acae2016-09-06 20:16:17 -0700713 The data will be strings if streams were opened in text mode; otherwise,
714 bytes.
Georg Brandl116aa622007-08-15 14:28:22 +0000715
Guido van Rossum0d3fb8a2007-11-26 23:23:18 +0000716 Note that if you want to send data to the process's stdin, you need to create
717 the Popen object with ``stdin=PIPE``. Similarly, to get anything other than
718 ``None`` in the result tuple, you need to give ``stdout=PIPE`` and/or
719 ``stderr=PIPE`` too.
720
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400721 If the process does not terminate after *timeout* seconds, a
722 :exc:`TimeoutExpired` exception will be raised. Catching this exception and
723 retrying communication will not lose any output.
724
725 The child process is not killed if the timeout expires, so in order to
726 cleanup properly a well-behaved application should kill the child process and
727 finish communication::
728
729 proc = subprocess.Popen(...)
730 try:
731 outs, errs = proc.communicate(timeout=15)
732 except TimeoutExpired:
733 proc.kill()
734 outs, errs = proc.communicate()
735
Christian Heimes7f044312008-01-06 17:05:40 +0000736 .. note::
Georg Brandl116aa622007-08-15 14:28:22 +0000737
Christian Heimes7f044312008-01-06 17:05:40 +0000738 The data read is buffered in memory, so do not use this method if the data
739 size is large or unlimited.
740
Reid Kleckner28f13032011-03-14 12:36:53 -0400741 .. versionchanged:: 3.3
Reid Kleckner31aa7dd2011-03-14 12:02:10 -0400742 *timeout* was added.
743
Georg Brandl116aa622007-08-15 14:28:22 +0000744
Christian Heimesa342c012008-04-20 21:01:16 +0000745.. method:: Popen.send_signal(signal)
746
747 Sends the signal *signal* to the child.
748
749 .. note::
750
Brian Curtineb24d742010-04-12 17:16:38 +0000751 On Windows, SIGTERM is an alias for :meth:`terminate`. CTRL_C_EVENT and
Senthil Kumaran916bd382010-10-15 12:55:19 +0000752 CTRL_BREAK_EVENT can be sent to processes started with a *creationflags*
Brian Curtineb24d742010-04-12 17:16:38 +0000753 parameter which includes `CREATE_NEW_PROCESS_GROUP`.
Christian Heimesa342c012008-04-20 21:01:16 +0000754
Christian Heimesa342c012008-04-20 21:01:16 +0000755
756.. method:: Popen.terminate()
757
Miss Islington (bot)7a3522d2020-05-17 14:37:30 -0700758 Stop the child. On POSIX OSs the method sends SIGTERM to the
Georg Brandl60203b42010-10-06 10:11:56 +0000759 child. On Windows the Win32 API function :c:func:`TerminateProcess` is called
Christian Heimesa342c012008-04-20 21:01:16 +0000760 to stop the child.
761
Christian Heimesa342c012008-04-20 21:01:16 +0000762
763.. method:: Popen.kill()
764
Miss Islington (bot)7a3522d2020-05-17 14:37:30 -0700765 Kills the child. On POSIX OSs the function sends SIGKILL to the child.
Christian Heimesa342c012008-04-20 21:01:16 +0000766 On Windows :meth:`kill` is an alias for :meth:`terminate`.
767
Christian Heimesa342c012008-04-20 21:01:16 +0000768
Georg Brandl116aa622007-08-15 14:28:22 +0000769The following attributes are also available:
770
Gregory P. Smith024c5ee2014-04-29 11:33:23 -0700771.. attribute:: Popen.args
772
773 The *args* argument as it was passed to :class:`Popen` -- a
774 sequence of program arguments or else a single string.
775
776 .. versionadded:: 3.3
Georg Brandl734e2682008-08-12 08:18:18 +0000777
Georg Brandl116aa622007-08-15 14:28:22 +0000778.. attribute:: Popen.stdin
779
Benjamin Peterson3d8814e2014-01-18 00:45:56 -0500780 If the *stdin* argument was :data:`PIPE`, this attribute is a writeable
Steve Dower050acae2016-09-06 20:16:17 -0700781 stream object as returned by :func:`open`. If the *encoding* or *errors*
782 arguments were specified or the *universal_newlines* argument was ``True``,
783 the stream is a text stream, otherwise it is a byte stream. If the *stdin*
784 argument was not :data:`PIPE`, this attribute is ``None``.
Georg Brandl116aa622007-08-15 14:28:22 +0000785
786
787.. attribute:: Popen.stdout
788
Benjamin Peterson3d8814e2014-01-18 00:45:56 -0500789 If the *stdout* argument was :data:`PIPE`, this attribute is a readable
790 stream object as returned by :func:`open`. Reading from the stream provides
Steve Dower050acae2016-09-06 20:16:17 -0700791 output from the child process. If the *encoding* or *errors* arguments were
792 specified or the *universal_newlines* argument was ``True``, the stream is a
793 text stream, otherwise it is a byte stream. If the *stdout* argument was not
794 :data:`PIPE`, this attribute is ``None``.
Benjamin Petersonaf69fe22014-01-18 00:49:04 -0500795
Georg Brandl116aa622007-08-15 14:28:22 +0000796
797.. attribute:: Popen.stderr
798
Benjamin Peterson3d8814e2014-01-18 00:45:56 -0500799 If the *stderr* argument was :data:`PIPE`, this attribute is a readable
800 stream object as returned by :func:`open`. Reading from the stream provides
Steve Dower050acae2016-09-06 20:16:17 -0700801 error output from the child process. If the *encoding* or *errors* arguments
802 were specified or the *universal_newlines* argument was ``True``, the stream
803 is a text stream, otherwise it is a byte stream. If the *stderr* argument was
804 not :data:`PIPE`, this attribute is ``None``.
Georg Brandl116aa622007-08-15 14:28:22 +0000805
Gregory P. Smith6436cba2014-05-11 13:26:21 -0700806.. warning::
807
808 Use :meth:`~Popen.communicate` rather than :attr:`.stdin.write <Popen.stdin>`,
809 :attr:`.stdout.read <Popen.stdout>` or :attr:`.stderr.read <Popen.stderr>` to avoid
810 deadlocks due to any of the other OS pipe buffers filling up and blocking the
811 child process.
812
Georg Brandl116aa622007-08-15 14:28:22 +0000813
814.. attribute:: Popen.pid
815
816 The process ID of the child process.
817
Georg Brandl58bfdca2010-03-21 09:50:49 +0000818 Note that if you set the *shell* argument to ``True``, this is the process ID
819 of the spawned shell.
820
Georg Brandl116aa622007-08-15 14:28:22 +0000821
822.. attribute:: Popen.returncode
823
Christian Heimes7f044312008-01-06 17:05:40 +0000824 The child return code, set by :meth:`poll` and :meth:`wait` (and indirectly
825 by :meth:`communicate`). A ``None`` value indicates that the process
826 hasn't terminated yet.
Georg Brandl48310cd2009-01-03 21:18:54 +0000827
Christian Heimes7f044312008-01-06 17:05:40 +0000828 A negative value ``-N`` indicates that the child was terminated by signal
Gregory P. Smith8e0aa052014-05-11 13:28:35 -0700829 ``N`` (POSIX only).
Georg Brandl116aa622007-08-15 14:28:22 +0000830
831
Brian Curtine6242d72011-04-29 22:17:51 -0500832Windows Popen Helpers
833---------------------
834
835The :class:`STARTUPINFO` class and following constants are only available
836on Windows.
837
Berker Peksagf5184742017-03-01 12:51:55 +0300838.. class:: STARTUPINFO(*, dwFlags=0, hStdInput=None, hStdOutput=None, \
Segev Finerb2a60832017-12-18 11:28:19 +0200839 hStdError=None, wShowWindow=0, lpAttributeList=None)
Brian Curtin73365dd2011-04-29 22:18:33 -0500840
Brian Curtine6242d72011-04-29 22:17:51 -0500841 Partial support of the Windows
Georg Brandl5d941342016-02-26 19:37:12 +0100842 `STARTUPINFO <https://msdn.microsoft.com/en-us/library/ms686331(v=vs.85).aspx>`__
Berker Peksagf5184742017-03-01 12:51:55 +0300843 structure is used for :class:`Popen` creation. The following attributes can
844 be set by passing them as keyword-only arguments.
845
846 .. versionchanged:: 3.7
847 Keyword-only argument support was added.
Brian Curtine6242d72011-04-29 22:17:51 -0500848
849 .. attribute:: dwFlags
850
Senthil Kumarana6bac952011-07-04 11:28:30 -0700851 A bit field that determines whether certain :class:`STARTUPINFO`
852 attributes are used when the process creates a window. ::
Brian Curtine6242d72011-04-29 22:17:51 -0500853
854 si = subprocess.STARTUPINFO()
855 si.dwFlags = subprocess.STARTF_USESTDHANDLES | subprocess.STARTF_USESHOWWINDOW
856
857 .. attribute:: hStdInput
858
Senthil Kumarana6bac952011-07-04 11:28:30 -0700859 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this attribute
860 is the standard input handle for the process. If
861 :data:`STARTF_USESTDHANDLES` is not specified, the default for standard
862 input is the keyboard buffer.
Brian Curtine6242d72011-04-29 22:17:51 -0500863
864 .. attribute:: hStdOutput
865
Senthil Kumarana6bac952011-07-04 11:28:30 -0700866 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this attribute
867 is the standard output handle for the process. Otherwise, this attribute
868 is ignored and the default for standard output is the console window's
Brian Curtine6242d72011-04-29 22:17:51 -0500869 buffer.
870
871 .. attribute:: hStdError
872
Senthil Kumarana6bac952011-07-04 11:28:30 -0700873 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this attribute
874 is the standard error handle for the process. Otherwise, this attribute is
Brian Curtine6242d72011-04-29 22:17:51 -0500875 ignored and the default for standard error is the console window's buffer.
876
877 .. attribute:: wShowWindow
878
Senthil Kumarana6bac952011-07-04 11:28:30 -0700879 If :attr:`dwFlags` specifies :data:`STARTF_USESHOWWINDOW`, this attribute
Brian Curtine6242d72011-04-29 22:17:51 -0500880 can be any of the values that can be specified in the ``nCmdShow``
881 parameter for the
Georg Brandl5d941342016-02-26 19:37:12 +0100882 `ShowWindow <https://msdn.microsoft.com/en-us/library/ms633548(v=vs.85).aspx>`__
Senthil Kumarana6bac952011-07-04 11:28:30 -0700883 function, except for ``SW_SHOWDEFAULT``. Otherwise, this attribute is
Brian Curtine6242d72011-04-29 22:17:51 -0500884 ignored.
Brian Curtin73365dd2011-04-29 22:18:33 -0500885
Brian Curtine6242d72011-04-29 22:17:51 -0500886 :data:`SW_HIDE` is provided for this attribute. It is used when
887 :class:`Popen` is called with ``shell=True``.
888
Segev Finerb2a60832017-12-18 11:28:19 +0200889 .. attribute:: lpAttributeList
890
891 A dictionary of additional attributes for process creation as given in
892 ``STARTUPINFOEX``, see
893 `UpdateProcThreadAttribute <https://msdn.microsoft.com/en-us/library/windows/desktop/ms686880(v=vs.85).aspx>`__.
894
895 Supported attributes:
896
897 **handle_list**
898 Sequence of handles that will be inherited. *close_fds* must be true if
899 non-empty.
900
901 The handles must be temporarily made inheritable by
902 :func:`os.set_handle_inheritable` when passed to the :class:`Popen`
903 constructor, else :class:`OSError` will be raised with Windows error
904 ``ERROR_INVALID_PARAMETER`` (87).
905
906 .. warning::
907
908 In a multithreaded process, use caution to avoid leaking handles
909 that are marked inheritable when combining this feature with
910 concurrent calls to other process creation functions that inherit
911 all handles such as :func:`os.system`. This also applies to
912 standard handle redirection, which temporarily creates inheritable
913 handles.
914
915 .. versionadded:: 3.7
Brian Curtine6242d72011-04-29 22:17:51 -0500916
Jamesb5d9e082017-11-08 14:18:59 +0000917Windows Constants
918^^^^^^^^^^^^^^^^^
Brian Curtine6242d72011-04-29 22:17:51 -0500919
920The :mod:`subprocess` module exposes the following constants.
921
922.. data:: STD_INPUT_HANDLE
923
924 The standard input device. Initially, this is the console input buffer,
925 ``CONIN$``.
926
927.. data:: STD_OUTPUT_HANDLE
928
929 The standard output device. Initially, this is the active console screen
930 buffer, ``CONOUT$``.
931
932.. data:: STD_ERROR_HANDLE
933
934 The standard error device. Initially, this is the active console screen
935 buffer, ``CONOUT$``.
936
937.. data:: SW_HIDE
938
939 Hides the window. Another window will be activated.
940
941.. data:: STARTF_USESTDHANDLES
942
943 Specifies that the :attr:`STARTUPINFO.hStdInput`,
Senthil Kumarana6bac952011-07-04 11:28:30 -0700944 :attr:`STARTUPINFO.hStdOutput`, and :attr:`STARTUPINFO.hStdError` attributes
Brian Curtine6242d72011-04-29 22:17:51 -0500945 contain additional information.
946
947.. data:: STARTF_USESHOWWINDOW
948
Senthil Kumarana6bac952011-07-04 11:28:30 -0700949 Specifies that the :attr:`STARTUPINFO.wShowWindow` attribute contains
Brian Curtine6242d72011-04-29 22:17:51 -0500950 additional information.
951
952.. data:: CREATE_NEW_CONSOLE
953
954 The new process has a new console, instead of inheriting its parent's
955 console (the default).
Brian Curtin73365dd2011-04-29 22:18:33 -0500956
Brian Curtin30401932011-04-29 22:20:57 -0500957.. data:: CREATE_NEW_PROCESS_GROUP
958
959 A :class:`Popen` ``creationflags`` parameter to specify that a new process
960 group will be created. This flag is necessary for using :func:`os.kill`
961 on the subprocess.
962
963 This flag is ignored if :data:`CREATE_NEW_CONSOLE` is specified.
964
Jamesb5d9e082017-11-08 14:18:59 +0000965.. data:: ABOVE_NORMAL_PRIORITY_CLASS
966
967 A :class:`Popen` ``creationflags`` parameter to specify that a new process
968 will have an above average priority.
969
970 .. versionadded:: 3.7
971
972.. data:: BELOW_NORMAL_PRIORITY_CLASS
973
974 A :class:`Popen` ``creationflags`` parameter to specify that a new process
975 will have a below average priority.
976
977 .. versionadded:: 3.7
978
979.. data:: HIGH_PRIORITY_CLASS
980
981 A :class:`Popen` ``creationflags`` parameter to specify that a new process
982 will have a high priority.
983
984 .. versionadded:: 3.7
985
986.. data:: IDLE_PRIORITY_CLASS
987
988 A :class:`Popen` ``creationflags`` parameter to specify that a new process
989 will have an idle (lowest) priority.
990
991 .. versionadded:: 3.7
992
993.. data:: NORMAL_PRIORITY_CLASS
994
995 A :class:`Popen` ``creationflags`` parameter to specify that a new process
996 will have an normal priority. (default)
997
998 .. versionadded:: 3.7
999
1000.. data:: REALTIME_PRIORITY_CLASS
1001
1002 A :class:`Popen` ``creationflags`` parameter to specify that a new process
1003 will have realtime priority.
1004 You should almost never use REALTIME_PRIORITY_CLASS, because this interrupts
1005 system threads that manage mouse input, keyboard input, and background disk
1006 flushing. This class can be appropriate for applications that "talk" directly
1007 to hardware or that perform brief tasks that should have limited interruptions.
1008
1009 .. versionadded:: 3.7
1010
1011.. data:: CREATE_NO_WINDOW
1012
1013 A :class:`Popen` ``creationflags`` parameter to specify that a new process
Jules Lasne (jlasne)7e9ce4c2019-03-04 19:12:04 +01001014 will not create a window.
Jamesb5d9e082017-11-08 14:18:59 +00001015
1016 .. versionadded:: 3.7
1017
1018.. data:: DETACHED_PROCESS
1019
1020 A :class:`Popen` ``creationflags`` parameter to specify that a new process
1021 will not inherit its parent's console.
1022 This value cannot be used with CREATE_NEW_CONSOLE.
1023
1024 .. versionadded:: 3.7
1025
1026.. data:: CREATE_DEFAULT_ERROR_MODE
1027
1028 A :class:`Popen` ``creationflags`` parameter to specify that a new process
1029 does not inherit the error mode of the calling process. Instead, the new
1030 process gets the default error mode.
1031 This feature is particularly useful for multithreaded shell applications
1032 that run with hard errors disabled.
1033
1034 .. versionadded:: 3.7
1035
1036.. data:: CREATE_BREAKAWAY_FROM_JOB
1037
1038 A :class:`Popen` ``creationflags`` parameter to specify that a new process
1039 is not associated with the job.
1040
1041 .. versionadded:: 3.7
1042
Gregory P. Smith6e730002015-04-14 16:14:25 -07001043.. _call-function-trio:
1044
1045Older high-level API
1046--------------------
1047
1048Prior to Python 3.5, these three functions comprised the high level API to
1049subprocess. You can now use :func:`run` in many cases, but lots of existing code
1050calls these functions.
1051
Alex Gaynor368cf1d2017-05-25 22:28:17 -04001052.. function:: call(args, *, stdin=None, stdout=None, stderr=None, shell=False, cwd=None, timeout=None)
Gregory P. Smith6e730002015-04-14 16:14:25 -07001053
1054 Run the command described by *args*. Wait for command to complete, then
Berker Peksagbf1d4b62015-07-25 14:27:07 +03001055 return the :attr:`~Popen.returncode` attribute.
Gregory P. Smith6e730002015-04-14 16:14:25 -07001056
Miss Islington (bot)01ae0e22019-09-11 05:32:16 -07001057 Code needing to capture stdout or stderr should use :func:`run` instead::
Gregory P. Smith6e730002015-04-14 16:14:25 -07001058
1059 run(...).returncode
1060
Gregory P. Smith7a2e84c2019-03-23 00:40:28 -07001061 To suppress stdout or stderr, supply a value of :data:`DEVNULL`.
Gregory P. Smith6e730002015-04-14 16:14:25 -07001062
Gregory P. Smith7a2e84c2019-03-23 00:40:28 -07001063 The arguments shown above are merely some common ones.
1064 The full function signature is the
Berker Peksagbf1d4b62015-07-25 14:27:07 +03001065 same as that of the :class:`Popen` constructor - this function passes all
1066 supplied arguments other than *timeout* directly through to that interface.
1067
Gregory P. Smith6e730002015-04-14 16:14:25 -07001068 .. note::
1069
1070 Do not use ``stdout=PIPE`` or ``stderr=PIPE`` with this
1071 function. The child process will block if it generates enough
1072 output to a pipe to fill up the OS pipe buffer as the pipes are
1073 not being read from.
1074
1075 .. versionchanged:: 3.3
1076 *timeout* was added.
1077
Alex Gaynor368cf1d2017-05-25 22:28:17 -04001078.. function:: check_call(args, *, stdin=None, stdout=None, stderr=None, shell=False, cwd=None, timeout=None)
Gregory P. Smith6e730002015-04-14 16:14:25 -07001079
1080 Run command with arguments. Wait for command to complete. If the return
1081 code was zero then return, otherwise raise :exc:`CalledProcessError`. The
1082 :exc:`CalledProcessError` object will have the return code in the
1083 :attr:`~CalledProcessError.returncode` attribute.
1084
Miss Islington (bot)01ae0e22019-09-11 05:32:16 -07001085 Code needing to capture stdout or stderr should use :func:`run` instead::
Gregory P. Smith6e730002015-04-14 16:14:25 -07001086
1087 run(..., check=True)
1088
Gregory P. Smith7a2e84c2019-03-23 00:40:28 -07001089 To suppress stdout or stderr, supply a value of :data:`DEVNULL`.
Gregory P. Smith6e730002015-04-14 16:14:25 -07001090
Gregory P. Smith7a2e84c2019-03-23 00:40:28 -07001091 The arguments shown above are merely some common ones.
1092 The full function signature is the
Berker Peksagbf1d4b62015-07-25 14:27:07 +03001093 same as that of the :class:`Popen` constructor - this function passes all
1094 supplied arguments other than *timeout* directly through to that interface.
1095
Gregory P. Smith6e730002015-04-14 16:14:25 -07001096 .. note::
1097
1098 Do not use ``stdout=PIPE`` or ``stderr=PIPE`` with this
1099 function. The child process will block if it generates enough
1100 output to a pipe to fill up the OS pipe buffer as the pipes are
1101 not being read from.
1102
1103 .. versionchanged:: 3.3
1104 *timeout* was added.
1105
1106
Steve Dower050acae2016-09-06 20:16:17 -07001107.. function:: check_output(args, *, stdin=None, stderr=None, shell=False, \
Alex Gaynor368cf1d2017-05-25 22:28:17 -04001108 cwd=None, encoding=None, errors=None, \
Jakub Stasiak7432f092018-11-12 04:40:42 +01001109 universal_newlines=None, timeout=None, text=None)
Gregory P. Smith6e730002015-04-14 16:14:25 -07001110
1111 Run command with arguments and return its output.
1112
1113 If the return code was non-zero it raises a :exc:`CalledProcessError`. The
1114 :exc:`CalledProcessError` object will have the return code in the
1115 :attr:`~CalledProcessError.returncode` attribute and any output in the
1116 :attr:`~CalledProcessError.output` attribute.
1117
1118 This is equivalent to::
1119
1120 run(..., check=True, stdout=PIPE).stdout
1121
Gregory P. Smith7a2e84c2019-03-23 00:40:28 -07001122 The arguments shown above are merely some common ones.
Berker Peksagbf1d4b62015-07-25 14:27:07 +03001123 The full function signature is largely the same as that of :func:`run` -
1124 most arguments are passed directly through to that interface.
1125 However, explicitly passing ``input=None`` to inherit the parent's
1126 standard input file handle is not supported.
1127
Gregory P. Smith6e730002015-04-14 16:14:25 -07001128 By default, this function will return the data as encoded bytes. The actual
1129 encoding of the output data may depend on the command being invoked, so the
1130 decoding to text will often need to be handled at the application level.
1131
Gregory P. Smith7a2e84c2019-03-23 00:40:28 -07001132 This behaviour may be overridden by setting *text*, *encoding*, *errors*,
1133 or *universal_newlines* to ``True`` as described in
1134 :ref:`frequently-used-arguments` and :func:`run`.
Gregory P. Smith6e730002015-04-14 16:14:25 -07001135
1136 To also capture standard error in the result, use
1137 ``stderr=subprocess.STDOUT``::
1138
1139 >>> subprocess.check_output(
1140 ... "ls non_existent_file; exit 0",
1141 ... stderr=subprocess.STDOUT,
1142 ... shell=True)
1143 'ls: non_existent_file: No such file or directory\n'
1144
1145 .. versionadded:: 3.1
1146
1147 .. versionchanged:: 3.3
1148 *timeout* was added.
1149
1150 .. versionchanged:: 3.4
Berker Peksagbf1d4b62015-07-25 14:27:07 +03001151 Support for the *input* keyword argument was added.
Brian Curtine6242d72011-04-29 22:17:51 -05001152
Brice Grosfc1ce812018-02-07 01:46:29 +01001153 .. versionchanged:: 3.6
1154 *encoding* and *errors* were added. See :func:`run` for details.
1155
Jakub Stasiak7432f092018-11-12 04:40:42 +01001156 .. versionadded:: 3.7
1157 *text* was added as a more readable alias for *universal_newlines*.
1158
1159
Benjamin Petersondcf97b92008-07-02 17:30:14 +00001160.. _subprocess-replacements:
1161
Ezio Melotti402f75d2012-11-08 10:07:10 +02001162Replacing Older Functions with the :mod:`subprocess` Module
1163-----------------------------------------------------------
Georg Brandl116aa622007-08-15 14:28:22 +00001164
Nick Coghlanc29248f2011-11-08 20:49:23 +10001165In this section, "a becomes b" means that b can be used as a replacement for a.
Georg Brandl116aa622007-08-15 14:28:22 +00001166
1167.. note::
1168
Nick Coghlanc29248f2011-11-08 20:49:23 +10001169 All "a" functions in this section fail (more or less) silently if the
1170 executed program cannot be found; the "b" replacements raise :exc:`OSError`
1171 instead.
Georg Brandl116aa622007-08-15 14:28:22 +00001172
Nick Coghlanc29248f2011-11-08 20:49:23 +10001173 In addition, the replacements using :func:`check_output` will fail with a
1174 :exc:`CalledProcessError` if the requested operation produces a non-zero
Serhiy Storchaka9e0ae532013-08-24 00:23:38 +03001175 return code. The output is still available as the
1176 :attr:`~CalledProcessError.output` attribute of the raised exception.
Nick Coghlanc29248f2011-11-08 20:49:23 +10001177
1178In the following examples, we assume that the relevant functions have already
Ezio Melotti402f75d2012-11-08 10:07:10 +02001179been imported from the :mod:`subprocess` module.
Georg Brandl116aa622007-08-15 14:28:22 +00001180
1181
Miss Islington (bot)86742d42019-07-16 08:05:39 -07001182Replacing :program:`/bin/sh` shell command substitution
1183^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +00001184
Martin Panter1050d2d2016-07-26 11:18:21 +02001185.. code-block:: bash
Georg Brandl116aa622007-08-15 14:28:22 +00001186
Miss Islington (bot)86742d42019-07-16 08:05:39 -07001187 output=$(mycmd myarg)
Georg Brandl116aa622007-08-15 14:28:22 +00001188
Martin Panter1050d2d2016-07-26 11:18:21 +02001189becomes::
1190
1191 output = check_output(["mycmd", "myarg"])
Georg Brandl116aa622007-08-15 14:28:22 +00001192
Benjamin Petersonf10a79a2008-10-11 00:49:57 +00001193Replacing shell pipeline
1194^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +00001195
Martin Panter1050d2d2016-07-26 11:18:21 +02001196.. code-block:: bash
Georg Brandl116aa622007-08-15 14:28:22 +00001197
Miss Islington (bot)86742d42019-07-16 08:05:39 -07001198 output=$(dmesg | grep hda)
Martin Panter1050d2d2016-07-26 11:18:21 +02001199
1200becomes::
1201
Georg Brandl116aa622007-08-15 14:28:22 +00001202 p1 = Popen(["dmesg"], stdout=PIPE)
1203 p2 = Popen(["grep", "hda"], stdin=p1.stdout, stdout=PIPE)
Gregory P. Smithe09d2f12011-02-05 21:47:25 +00001204 p1.stdout.close() # Allow p1 to receive a SIGPIPE if p2 exits.
Georg Brandl116aa622007-08-15 14:28:22 +00001205 output = p2.communicate()[0]
1206
Miss Islington (bot)01ae0e22019-09-11 05:32:16 -07001207The ``p1.stdout.close()`` call after starting the p2 is important in order for
1208p1 to receive a SIGPIPE if p2 exits before p1.
Georg Brandl116aa622007-08-15 14:28:22 +00001209
Nick Coghlanc29248f2011-11-08 20:49:23 +10001210Alternatively, for trusted input, the shell's own pipeline support may still
Martin Panter1050d2d2016-07-26 11:18:21 +02001211be used directly:
1212
1213.. code-block:: bash
Nick Coghlanc29248f2011-11-08 20:49:23 +10001214
Miss Islington (bot)86742d42019-07-16 08:05:39 -07001215 output=$(dmesg | grep hda)
Martin Panter1050d2d2016-07-26 11:18:21 +02001216
1217becomes::
1218
Nick Coghlanc29248f2011-11-08 20:49:23 +10001219 output=check_output("dmesg | grep hda", shell=True)
1220
1221
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001222Replacing :func:`os.system`
1223^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +00001224
1225::
1226
1227 sts = os.system("mycmd" + " myarg")
Nick Coghlanc29248f2011-11-08 20:49:23 +10001228 # becomes
1229 sts = call("mycmd" + " myarg", shell=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001230
1231Notes:
1232
1233* Calling the program through the shell is usually not required.
1234
Georg Brandl116aa622007-08-15 14:28:22 +00001235A more realistic example would look like this::
1236
1237 try:
1238 retcode = call("mycmd" + " myarg", shell=True)
1239 if retcode < 0:
Collin Winterc79461b2007-09-01 23:34:30 +00001240 print("Child was terminated by signal", -retcode, file=sys.stderr)
Georg Brandl116aa622007-08-15 14:28:22 +00001241 else:
Collin Winterc79461b2007-09-01 23:34:30 +00001242 print("Child returned", retcode, file=sys.stderr)
Georg Brandl116aa622007-08-15 14:28:22 +00001243 except OSError as e:
Collin Winterc79461b2007-09-01 23:34:30 +00001244 print("Execution failed:", e, file=sys.stderr)
Georg Brandl116aa622007-08-15 14:28:22 +00001245
1246
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001247Replacing the :func:`os.spawn <os.spawnl>` family
1248^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +00001249
1250P_NOWAIT example::
1251
1252 pid = os.spawnlp(os.P_NOWAIT, "/bin/mycmd", "mycmd", "myarg")
1253 ==>
1254 pid = Popen(["/bin/mycmd", "myarg"]).pid
1255
1256P_WAIT example::
1257
1258 retcode = os.spawnlp(os.P_WAIT, "/bin/mycmd", "mycmd", "myarg")
1259 ==>
1260 retcode = call(["/bin/mycmd", "myarg"])
1261
1262Vector example::
1263
1264 os.spawnvp(os.P_NOWAIT, path, args)
1265 ==>
1266 Popen([path] + args[1:])
1267
1268Environment example::
1269
1270 os.spawnlpe(os.P_NOWAIT, "/bin/mycmd", "mycmd", "myarg", env)
1271 ==>
1272 Popen(["/bin/mycmd", "myarg"], env={"PATH": "/usr/bin"})
1273
1274
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001275
1276Replacing :func:`os.popen`, :func:`os.popen2`, :func:`os.popen3`
1277^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +00001278
1279::
1280
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001281 (child_stdin, child_stdout) = os.popen2(cmd, mode, bufsize)
Georg Brandl116aa622007-08-15 14:28:22 +00001282 ==>
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001283 p = Popen(cmd, shell=True, bufsize=bufsize,
1284 stdin=PIPE, stdout=PIPE, close_fds=True)
1285 (child_stdin, child_stdout) = (p.stdin, p.stdout)
Georg Brandl116aa622007-08-15 14:28:22 +00001286
1287::
1288
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001289 (child_stdin,
1290 child_stdout,
1291 child_stderr) = os.popen3(cmd, mode, bufsize)
Georg Brandl116aa622007-08-15 14:28:22 +00001292 ==>
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001293 p = Popen(cmd, shell=True, bufsize=bufsize,
1294 stdin=PIPE, stdout=PIPE, stderr=PIPE, close_fds=True)
1295 (child_stdin,
1296 child_stdout,
1297 child_stderr) = (p.stdin, p.stdout, p.stderr)
1298
1299::
1300
1301 (child_stdin, child_stdout_and_stderr) = os.popen4(cmd, mode, bufsize)
1302 ==>
1303 p = Popen(cmd, shell=True, bufsize=bufsize,
1304 stdin=PIPE, stdout=PIPE, stderr=STDOUT, close_fds=True)
1305 (child_stdin, child_stdout_and_stderr) = (p.stdin, p.stdout)
1306
1307Return code handling translates as follows::
1308
1309 pipe = os.popen(cmd, 'w')
1310 ...
1311 rc = pipe.close()
Stefan Krahfc9e08d2010-07-14 10:16:11 +00001312 if rc is not None and rc >> 8:
Ezio Melotti985e24d2009-09-13 07:54:02 +00001313 print("There were some errors")
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001314 ==>
R David Murray17227a72015-09-04 10:01:19 -04001315 process = Popen(cmd, stdin=PIPE)
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001316 ...
1317 process.stdin.close()
1318 if process.wait() != 0:
Ezio Melotti985e24d2009-09-13 07:54:02 +00001319 print("There were some errors")
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001320
1321
1322Replacing functions from the :mod:`popen2` module
1323^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1324
1325.. note::
1326
1327 If the cmd argument to popen2 functions is a string, the command is executed
1328 through /bin/sh. If it is a list, the command is directly executed.
1329
1330::
1331
1332 (child_stdout, child_stdin) = popen2.popen2("somestring", bufsize, mode)
1333 ==>
R David Murrayae9d1932014-05-14 10:09:52 -04001334 p = Popen("somestring", shell=True, bufsize=bufsize,
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001335 stdin=PIPE, stdout=PIPE, close_fds=True)
1336 (child_stdout, child_stdin) = (p.stdout, p.stdin)
1337
1338::
1339
1340 (child_stdout, child_stdin) = popen2.popen2(["mycmd", "myarg"], bufsize, mode)
1341 ==>
1342 p = Popen(["mycmd", "myarg"], bufsize=bufsize,
1343 stdin=PIPE, stdout=PIPE, close_fds=True)
1344 (child_stdout, child_stdin) = (p.stdout, p.stdin)
1345
1346:class:`popen2.Popen3` and :class:`popen2.Popen4` basically work as
1347:class:`subprocess.Popen`, except that:
1348
1349* :class:`Popen` raises an exception if the execution fails.
1350
Jules Lasne (jlasne)7e9ce4c2019-03-04 19:12:04 +01001351* The *capturestderr* argument is replaced with the *stderr* argument.
Benjamin Peterson87c8d872009-06-11 22:54:11 +00001352
1353* ``stdin=PIPE`` and ``stdout=PIPE`` must be specified.
1354
1355* popen2 closes all file descriptors by default, but you have to specify
Gregory P. Smithf5604852010-12-13 06:45:02 +00001356 ``close_fds=True`` with :class:`Popen` to guarantee this behavior on
1357 all platforms or past Python versions.
Eli Bendersky046a7642011-04-15 07:23:26 +03001358
Nick Coghlanc29248f2011-11-08 20:49:23 +10001359
Nick Coghlanc29248f2011-11-08 20:49:23 +10001360Legacy Shell Invocation Functions
Nick Coghlan32e4a582011-11-08 21:50:58 +10001361---------------------------------
Nick Coghlanc29248f2011-11-08 20:49:23 +10001362
1363This module also provides the following legacy functions from the 2.x
1364``commands`` module. These operations implicitly invoke the system shell and
1365none of the guarantees described above regarding security and exception
1366handling consistency are valid for these functions.
1367
1368.. function:: getstatusoutput(cmd)
1369
Gregory P. Smith738b7d92017-09-06 17:39:23 -07001370 Return ``(exitcode, output)`` of executing *cmd* in a shell.
Nick Coghlanc29248f2011-11-08 20:49:23 +10001371
Tim Golden60798142013-11-05 12:57:25 +00001372 Execute the string *cmd* in a shell with :meth:`Popen.check_output` and
Gregory P. Smith738b7d92017-09-06 17:39:23 -07001373 return a 2-tuple ``(exitcode, output)``. The locale encoding is used;
Tim Golden60798142013-11-05 12:57:25 +00001374 see the notes on :ref:`frequently-used-arguments` for more details.
Tim Golden3a2abb52013-11-03 18:24:50 +00001375
1376 A trailing newline is stripped from the output.
Gregory P. Smith738b7d92017-09-06 17:39:23 -07001377 The exit code for the command can be interpreted as the return code
1378 of subprocess. Example::
Nick Coghlanc29248f2011-11-08 20:49:23 +10001379
1380 >>> subprocess.getstatusoutput('ls /bin/ls')
1381 (0, '/bin/ls')
1382 >>> subprocess.getstatusoutput('cat /bin/junk')
Gregory P. Smith738b7d92017-09-06 17:39:23 -07001383 (1, 'cat: /bin/junk: No such file or directory')
Nick Coghlanc29248f2011-11-08 20:49:23 +10001384 >>> subprocess.getstatusoutput('/bin/junk')
Gregory P. Smith738b7d92017-09-06 17:39:23 -07001385 (127, 'sh: /bin/junk: not found')
1386 >>> subprocess.getstatusoutput('/bin/kill $$')
1387 (-15, '')
Nick Coghlanc29248f2011-11-08 20:49:23 +10001388
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001389 .. availability:: POSIX & Windows.
R David Murray95b696a2014-03-07 20:04:17 -05001390
1391 .. versionchanged:: 3.3.4
Gregory P. Smith738b7d92017-09-06 17:39:23 -07001392 Windows support was added.
1393
1394 The function now returns (exitcode, output) instead of (status, output)
Xiang Zhang7d161722018-09-22 04:18:20 +08001395 as it did in Python 3.3.3 and earlier. exitcode has the same value as
1396 :attr:`~Popen.returncode`.
Nick Coghlanc29248f2011-11-08 20:49:23 +10001397
1398
1399.. function:: getoutput(cmd)
1400
1401 Return output (stdout and stderr) of executing *cmd* in a shell.
1402
Xiang Zhang7d161722018-09-22 04:18:20 +08001403 Like :func:`getstatusoutput`, except the exit code is ignored and the return
Nick Coghlanc29248f2011-11-08 20:49:23 +10001404 value is a string containing the command's output. Example::
1405
1406 >>> subprocess.getoutput('ls /bin/ls')
1407 '/bin/ls'
1408
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001409 .. availability:: POSIX & Windows.
R David Murray95b696a2014-03-07 20:04:17 -05001410
1411 .. versionchanged:: 3.3.4
1412 Windows support added
Nick Coghlanc29248f2011-11-08 20:49:23 +10001413
Nick Coghlan32e4a582011-11-08 21:50:58 +10001414
Eli Bendersky046a7642011-04-15 07:23:26 +03001415Notes
1416-----
1417
1418.. _converting-argument-sequence:
1419
1420Converting an argument sequence to a string on Windows
1421^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1422
1423On Windows, an *args* sequence is converted to a string that can be parsed
1424using the following rules (which correspond to the rules used by the MS C
1425runtime):
1426
14271. Arguments are delimited by white space, which is either a
1428 space or a tab.
1429
14302. A string surrounded by double quotation marks is
1431 interpreted as a single argument, regardless of white space
1432 contained within. A quoted string can be embedded in an
1433 argument.
1434
14353. A double quotation mark preceded by a backslash is
1436 interpreted as a literal double quotation mark.
1437
14384. Backslashes are interpreted literally, unless they
1439 immediately precede a double quotation mark.
1440
14415. If backslashes immediately precede a double quotation mark,
1442 every pair of backslashes is interpreted as a literal
1443 backslash. If the number of backslashes is odd, the last
1444 backslash escapes the next double quotation mark as
1445 described in rule 3.
1446
Eli Benderskyd2112312011-04-15 07:26:28 +03001447
Éric Araujo9bce3112011-07-27 18:29:31 +02001448.. seealso::
1449
1450 :mod:`shlex`
1451 Module which provides function to parse and escape command lines.