blob: e44e08d3251d9de40bd334998b72398d257a8b20 [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001
2:mod:`subprocess` --- Subprocess management
3===========================================
4
5.. module:: subprocess
6 :synopsis: Subprocess management.
7.. moduleauthor:: Peter Åstrand <astrand@lysator.liu.se>
8.. sectionauthor:: Peter Åstrand <astrand@lysator.liu.se>
9
10
11.. versionadded:: 2.4
12
13The :mod:`subprocess` module allows you to spawn new processes, connect to their
14input/output/error pipes, and obtain their return codes. This module intends to
15replace several other, older modules and functions, such as::
16
17 os.system
18 os.spawn*
19 os.popen*
20 popen2.*
21 commands.*
22
23Information about how the :mod:`subprocess` module can be used to replace these
24modules and functions can be found in the following sections.
25
Georg Brandl68b4e742008-07-01 19:59:00 +000026.. seealso::
27
28 :pep:`324` -- PEP proposing the subprocess module
29
Georg Brandl8ec7f652007-08-15 14:28:01 +000030
31Using the subprocess Module
32---------------------------
33
34This module defines one class called :class:`Popen`:
35
36
37.. class:: Popen(args, bufsize=0, executable=None, stdin=None, stdout=None, stderr=None, preexec_fn=None, close_fds=False, shell=False, cwd=None, env=None, universal_newlines=False, startupinfo=None, creationflags=0)
38
39 Arguments are:
40
Benjamin Petersonfff5cf62008-07-27 15:22:14 +000041 *args* should be a string, or a sequence of program arguments. The program
R. David Murrayfe6e7842009-05-29 19:30:27 +000042 to execute is normally the first item in the args sequence or the string if
43 a string is given, but can be explicitly set by using the *executable*
44 argument. When *executable* is given, the first item in the args sequence
45 is still treated by most programs as the command name, which can then be
46 different from the actual executable name. On Unix, it becomes the display
47 name for the executing program in utilities such as :program:`ps`.
Georg Brandl8ec7f652007-08-15 14:28:01 +000048
49 On Unix, with *shell=False* (default): In this case, the Popen class uses
50 :meth:`os.execvp` to execute the child program. *args* should normally be a
Nick Coghlan7dfc9e12010-02-04 12:43:58 +000051 sequence. If a string is specified for *args*, it will be used as the name
52 or path of the program to execute; this will only work if the program is
53 being given no arguments.
Georg Brandl8ec7f652007-08-15 14:28:01 +000054
Nick Coghlan7dfc9e12010-02-04 12:43:58 +000055 .. note::
56
57 :meth:`shlex.split` can be useful when determining the correct
58 tokenization for *args*, especially in complex cases::
59
60 >>> import shlex, subprocess
61 >>> command_line = raw_input()
62 /bin/vikings -input eggs.txt -output "spam spam.txt" -cmd "echo '$MONEY'"
63 >>> args = shlex.split(command_line)
64 >>> print args
65 ['/bin/vikings', '-input', 'eggs.txt', '-output', 'spam spam.txt', '-cmd', "echo '$MONEY'"]
66 >>> p = subprocess.Popen(args) # Success!
67
68 Note in particular that options (such as *-input*) and arguments (such
69 as *eggs.txt*) that are separated by whitespace in the shell go in separate
70 list elements, while arguments that need quoting or backslash escaping when
71 used in the shell (such as filenames containing spaces or the *echo* command
72 shown above) are single list elements.
73
74 On Unix, with *shell=True*: If args is a string, it specifies the command
75 string to execute through the shell. This means that the string must be
76 formatted exactly as it would be when typed at the shell prompt. This
77 includes, for example, quoting or backslash escaping filenames with spaces in
78 them. If *args* is a sequence, the first item specifies the command string, and
79 any additional items will be treated as additional arguments to the shell
80 itself. That is to say, *Popen* does the equivalent of::
81
82 Popen(['/bin/sh', '-c', args[0], args[1], ...])
Georg Brandl8ec7f652007-08-15 14:28:01 +000083
R. David Murray6e4300c2010-11-12 00:39:09 +000084 .. warning::
85
86 Executing shell commands that incorporate unsanitized input from an
87 untrusted source makes a program vulnerable to `shell injection
88 <http://en.wikipedia.org/wiki/Shell_injection#Shell_injection>`_,
89 a serious security flaw which can result in arbitrary command execution.
90 For this reason, the use of *shell=True* is **strongly discouraged** in cases
91 where the command string is constructed from external input::
92
93 >>> from subprocess import call
94 >>> filename = input("What file would you like to display?\n")
95 What file would you like to display?
96 non_existent; rm -rf / #
97 >>> call("cat " + filename, shell=True) # Uh-oh. This will end badly...
98
99 *shell=False* does not suffer from this vulnerability; the above Note may be
100 helpful in getting code using *shell=False* to work.
101
Georg Brandl8ec7f652007-08-15 14:28:01 +0000102 On Windows: the :class:`Popen` class uses CreateProcess() to execute the child
Eli Bendersky929e2762011-04-15 07:35:06 +0300103 child program, which operates on strings. If *args* is a sequence, it will
104 be converted to a string in a manner described in
105 :ref:`converting-argument-sequence`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000106
107 *bufsize*, if given, has the same meaning as the corresponding argument to the
108 built-in open() function: :const:`0` means unbuffered, :const:`1` means line
109 buffered, any other positive value means use a buffer of (approximately) that
110 size. A negative *bufsize* means to use the system default, which usually means
111 fully buffered. The default value for *bufsize* is :const:`0` (unbuffered).
112
Antoine Pitrouc3955452010-06-02 17:08:47 +0000113 .. note::
114
115 If you experience performance issues, it is recommended that you try to
116 enable buffering by setting *bufsize* to either -1 or a large enough
117 positive value (such as 4096).
118
Georg Brandl8ec7f652007-08-15 14:28:01 +0000119 The *executable* argument specifies the program to execute. It is very seldom
120 needed: Usually, the program to execute is defined by the *args* argument. If
121 ``shell=True``, the *executable* argument specifies which shell to use. On Unix,
122 the default shell is :file:`/bin/sh`. On Windows, the default shell is
Georg Brandl0d8649a2009-06-30 16:17:28 +0000123 specified by the :envvar:`COMSPEC` environment variable. The only reason you
124 would need to specify ``shell=True`` on Windows is where the command you
125 wish to execute is actually built in to the shell, eg ``dir``, ``copy``.
126 You don't need ``shell=True`` to run a batch file, nor to run a console-based
127 executable.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000128
129 *stdin*, *stdout* and *stderr* specify the executed programs' standard input,
Georg Brandlf5d5a662008-12-06 11:57:12 +0000130 standard output and standard error file handles, respectively. Valid values
131 are :data:`PIPE`, an existing file descriptor (a positive integer), an
132 existing file object, and ``None``. :data:`PIPE` indicates that a new pipe
133 to the child should be created. With ``None``, no redirection will occur;
134 the child's file handles will be inherited from the parent. Additionally,
135 *stderr* can be :data:`STDOUT`, which indicates that the stderr data from the
136 applications should be captured into the same file handle as for stdout.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000137
138 If *preexec_fn* is set to a callable object, this object will be called in the
139 child process just before the child is executed. (Unix only)
140
141 If *close_fds* is true, all file descriptors except :const:`0`, :const:`1` and
142 :const:`2` will be closed before the child process is executed. (Unix only).
143 Or, on Windows, if *close_fds* is true then no handles will be inherited by the
144 child process. Note that on Windows, you cannot set *close_fds* to true and
145 also redirect the standard handles by setting *stdin*, *stdout* or *stderr*.
146
147 If *shell* is :const:`True`, the specified command will be executed through the
148 shell.
149
150 If *cwd* is not ``None``, the child's current directory will be changed to *cwd*
151 before it is executed. Note that this directory is not considered when
152 searching the executable, so you can't specify the program's path relative to
153 *cwd*.
154
Georg Brandlf801b0f2008-04-19 16:58:49 +0000155 If *env* is not ``None``, it must be a mapping that defines the environment
156 variables for the new process; these are used instead of inheriting the current
157 process' environment, which is the default behavior.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000158
R. David Murray72030812009-04-16 18:12:53 +0000159 .. note::
R. David Murray6076d392009-04-15 22:33:07 +0000160
R. David Murray72030812009-04-16 18:12:53 +0000161 If specified, *env* must provide any variables required
162 for the program to execute. On Windows, in order to run a
163 `side-by-side assembly`_ the specified *env* **must** include a valid
R. David Murray6076d392009-04-15 22:33:07 +0000164 :envvar:`SystemRoot`.
165
R. David Murray72030812009-04-16 18:12:53 +0000166 .. _side-by-side assembly: http://en.wikipedia.org/wiki/Side-by-Side_Assembly
167
Georg Brandl8ec7f652007-08-15 14:28:01 +0000168 If *universal_newlines* is :const:`True`, the file objects stdout and stderr are
169 opened as text files, but lines may be terminated by any of ``'\n'``, the Unix
Georg Brandl9af94982008-09-13 17:41:16 +0000170 end-of-line convention, ``'\r'``, the old Macintosh convention or ``'\r\n'``, the
Georg Brandl8ec7f652007-08-15 14:28:01 +0000171 Windows convention. All of these external representations are seen as ``'\n'``
172 by the Python program.
173
174 .. note::
175
Georg Brandl6ab5d082009-12-20 14:33:20 +0000176 This feature is only available if Python is built with universal newline
177 support (the default). Also, the newlines attribute of the file objects
178 :attr:`stdout`, :attr:`stdin` and :attr:`stderr` are not updated by the
179 communicate() method.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000180
Brian Curtinbb23bd62011-04-29 22:23:46 -0500181 If given, *startupinfo* will be a :class:`STARTUPINFO` object, which is
182 passed to the underlying ``CreateProcess`` function.
183 *creationflags*, if given, can be :data:`CREATE_NEW_CONSOLE` or
184 :data:`CREATE_NEW_PROCESS_GROUP`. (Windows only)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000185
186
Georg Brandlf5d5a662008-12-06 11:57:12 +0000187.. data:: PIPE
188
189 Special value that can be used as the *stdin*, *stdout* or *stderr* argument
190 to :class:`Popen` and indicates that a pipe to the standard stream should be
191 opened.
192
193
194.. data:: STDOUT
195
196 Special value that can be used as the *stderr* argument to :class:`Popen` and
197 indicates that standard error should go into the same handle as standard
198 output.
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000199
Georg Brandlf5d5a662008-12-06 11:57:12 +0000200
Georg Brandl8ec7f652007-08-15 14:28:01 +0000201Convenience Functions
202^^^^^^^^^^^^^^^^^^^^^
203
Ezio Melottib4923782011-04-19 23:12:37 +0300204This module also defines the following shortcut functions:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000205
206
207.. function:: call(*popenargs, **kwargs)
208
209 Run command with arguments. Wait for command to complete, then return the
210 :attr:`returncode` attribute.
211
R. David Murray6dfe6622010-02-16 17:55:26 +0000212 The arguments are the same as for the :class:`Popen` constructor. Example::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000213
Georg Brandl6ab5d082009-12-20 14:33:20 +0000214 >>> retcode = subprocess.call(["ls", "-l"])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000215
Philip Jenvey739aa362009-05-22 05:35:32 +0000216 .. warning::
217
Philip Jenvey26275532009-12-03 02:25:54 +0000218 Like :meth:`Popen.wait`, this will deadlock when using
219 ``stdout=PIPE`` and/or ``stderr=PIPE`` and the child process
220 generates enough output to a pipe such that it blocks waiting
221 for the OS pipe buffer to accept more data.
Philip Jenvey739aa362009-05-22 05:35:32 +0000222
Georg Brandl8ec7f652007-08-15 14:28:01 +0000223
224.. function:: check_call(*popenargs, **kwargs)
225
226 Run command with arguments. Wait for command to complete. If the exit code was
Andrew M. Kuchlingcad8da82008-09-30 13:01:46 +0000227 zero then return, otherwise raise :exc:`CalledProcessError`. The
Georg Brandl8ec7f652007-08-15 14:28:01 +0000228 :exc:`CalledProcessError` object will have the return code in the
229 :attr:`returncode` attribute.
230
R. David Murray6dfe6622010-02-16 17:55:26 +0000231 The arguments are the same as for the :class:`Popen` constructor. Example::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000232
Georg Brandl6ab5d082009-12-20 14:33:20 +0000233 >>> subprocess.check_call(["ls", "-l"])
234 0
Georg Brandl8ec7f652007-08-15 14:28:01 +0000235
236 .. versionadded:: 2.5
237
Philip Jenvey739aa362009-05-22 05:35:32 +0000238 .. warning::
239
240 See the warning for :func:`call`.
241
Georg Brandl8ec7f652007-08-15 14:28:01 +0000242
Gregory P. Smith26576802008-12-05 02:27:01 +0000243.. function:: check_output(*popenargs, **kwargs)
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000244
245 Run command with arguments and return its output as a byte string.
246
Andrew M. Kuchling42ffbdb2009-01-21 02:16:26 +0000247 If the exit code was non-zero it raises a :exc:`CalledProcessError`. The
248 :exc:`CalledProcessError` object will have the return code in the
249 :attr:`returncode`
250 attribute and output in the :attr:`output` attribute.
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000251
Georg Brandlf6dab952009-04-28 21:48:35 +0000252 The arguments are the same as for the :class:`Popen` constructor. Example::
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000253
Gregory P. Smith26576802008-12-05 02:27:01 +0000254 >>> subprocess.check_output(["ls", "-l", "/dev/null"])
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000255 'crw-rw-rw- 1 root root 1, 3 Oct 18 2007 /dev/null\n'
256
257 The stdout argument is not allowed as it is used internally.
Georg Brandlf6dab952009-04-28 21:48:35 +0000258 To capture standard error in the result, use ``stderr=subprocess.STDOUT``::
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000259
Gregory P. Smith26576802008-12-05 02:27:01 +0000260 >>> subprocess.check_output(
Georg Brandl6ab5d082009-12-20 14:33:20 +0000261 ... ["/bin/sh", "-c", "ls non_existent_file; exit 0"],
262 ... stderr=subprocess.STDOUT)
Mark Dickinson3e4caeb2009-02-21 20:27:01 +0000263 'ls: non_existent_file: No such file or directory\n'
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000264
265 .. versionadded:: 2.7
266
267
Georg Brandl8ec7f652007-08-15 14:28:01 +0000268Exceptions
269^^^^^^^^^^
270
271Exceptions raised in the child process, before the new program has started to
272execute, will be re-raised in the parent. Additionally, the exception object
273will have one extra attribute called :attr:`child_traceback`, which is a string
Georg Brandl21946af2010-10-06 09:28:45 +0000274containing traceback information from the child's point of view.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000275
276The most common exception raised is :exc:`OSError`. This occurs, for example,
277when trying to execute a non-existent file. Applications should prepare for
278:exc:`OSError` exceptions.
279
280A :exc:`ValueError` will be raised if :class:`Popen` is called with invalid
281arguments.
282
283check_call() will raise :exc:`CalledProcessError`, if the called process returns
284a non-zero return code.
285
286
287Security
288^^^^^^^^
289
290Unlike some other popen functions, this implementation will never call /bin/sh
291implicitly. This means that all characters, including shell metacharacters, can
292safely be passed to child processes.
293
294
295Popen Objects
296-------------
297
298Instances of the :class:`Popen` class have the following methods:
299
300
301.. method:: Popen.poll()
302
Georg Brandl2cb103f2008-01-06 16:01:26 +0000303 Check if child process has terminated. Set and return :attr:`returncode`
304 attribute.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000305
306
307.. method:: Popen.wait()
308
Georg Brandl2cb103f2008-01-06 16:01:26 +0000309 Wait for child process to terminate. Set and return :attr:`returncode`
310 attribute.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000311
Georg Brandl143de622008-08-04 06:29:36 +0000312 .. warning::
313
Philip Jenvey26275532009-12-03 02:25:54 +0000314 This will deadlock when using ``stdout=PIPE`` and/or
315 ``stderr=PIPE`` and the child process generates enough output to
316 a pipe such that it blocks waiting for the OS pipe buffer to
317 accept more data. Use :meth:`communicate` to avoid that.
Gregory P. Smith08792502008-08-04 01:03:50 +0000318
Georg Brandl8ec7f652007-08-15 14:28:01 +0000319
320.. method:: Popen.communicate(input=None)
321
322 Interact with process: Send data to stdin. Read data from stdout and stderr,
323 until end-of-file is reached. Wait for process to terminate. The optional
324 *input* argument should be a string to be sent to the child process, or
325 ``None``, if no data should be sent to the child.
326
Georg Brandl17432012008-12-04 21:28:16 +0000327 :meth:`communicate` returns a tuple ``(stdoutdata, stderrdata)``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000328
Georg Brandl439f2502007-11-24 11:31:46 +0000329 Note that if you want to send data to the process's stdin, you need to create
330 the Popen object with ``stdin=PIPE``. Similarly, to get anything other than
331 ``None`` in the result tuple, you need to give ``stdout=PIPE`` and/or
332 ``stderr=PIPE`` too.
333
Georg Brandl2cb103f2008-01-06 16:01:26 +0000334 .. note::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000335
Georg Brandl2cb103f2008-01-06 16:01:26 +0000336 The data read is buffered in memory, so do not use this method if the data
337 size is large or unlimited.
338
Georg Brandl8ec7f652007-08-15 14:28:01 +0000339
Christian Heimese74c8f22008-04-19 02:23:57 +0000340.. method:: Popen.send_signal(signal)
341
342 Sends the signal *signal* to the child.
343
344 .. note::
345
Brian Curtine5aa8862010-04-02 23:26:06 +0000346 On Windows, SIGTERM is an alias for :meth:`terminate`. CTRL_C_EVENT and
Ezio Melotti9ccc5812010-04-05 08:16:41 +0000347 CTRL_BREAK_EVENT can be sent to processes started with a *creationflags*
Brian Curtine5aa8862010-04-02 23:26:06 +0000348 parameter which includes `CREATE_NEW_PROCESS_GROUP`.
Georg Brandl734de682008-04-19 08:23:59 +0000349
350 .. versionadded:: 2.6
Christian Heimese74c8f22008-04-19 02:23:57 +0000351
352
353.. method:: Popen.terminate()
354
355 Stop the child. On Posix OSs the method sends SIGTERM to the
Andrew M. Kuchling64c6a0e2008-04-21 02:08:00 +0000356 child. On Windows the Win32 API function :cfunc:`TerminateProcess` is called
Christian Heimese74c8f22008-04-19 02:23:57 +0000357 to stop the child.
358
Georg Brandl734de682008-04-19 08:23:59 +0000359 .. versionadded:: 2.6
360
Christian Heimese74c8f22008-04-19 02:23:57 +0000361
362.. method:: Popen.kill()
363
364 Kills the child. On Posix OSs the function sends SIGKILL to the child.
Georg Brandl734de682008-04-19 08:23:59 +0000365 On Windows :meth:`kill` is an alias for :meth:`terminate`.
366
367 .. versionadded:: 2.6
Christian Heimese74c8f22008-04-19 02:23:57 +0000368
369
Georg Brandl8ec7f652007-08-15 14:28:01 +0000370The following attributes are also available:
371
Georg Brandl143de622008-08-04 06:29:36 +0000372.. warning::
373
Georg Brandl16a57f62009-04-27 15:29:09 +0000374 Use :meth:`communicate` rather than :attr:`.stdin.write <stdin>`,
375 :attr:`.stdout.read <stdout>` or :attr:`.stderr.read <stderr>` to avoid
376 deadlocks due to any of the other OS pipe buffers filling up and blocking the
377 child process.
Georg Brandl143de622008-08-04 06:29:36 +0000378
379
Georg Brandl8ec7f652007-08-15 14:28:01 +0000380.. attribute:: Popen.stdin
381
Georg Brandlf5d5a662008-12-06 11:57:12 +0000382 If the *stdin* argument was :data:`PIPE`, this attribute is a file object
383 that provides input to the child process. Otherwise, it is ``None``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000384
385
386.. attribute:: Popen.stdout
387
Georg Brandlf5d5a662008-12-06 11:57:12 +0000388 If the *stdout* argument was :data:`PIPE`, this attribute is a file object
389 that provides output from the child process. Otherwise, it is ``None``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000390
391
392.. attribute:: Popen.stderr
393
Georg Brandlf5d5a662008-12-06 11:57:12 +0000394 If the *stderr* argument was :data:`PIPE`, this attribute is a file object
395 that provides error output from the child process. Otherwise, it is
396 ``None``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000397
398
399.. attribute:: Popen.pid
400
401 The process ID of the child process.
402
Georg Brandl0b56ce02010-03-21 09:28:16 +0000403 Note that if you set the *shell* argument to ``True``, this is the process ID
404 of the spawned shell.
405
Georg Brandl8ec7f652007-08-15 14:28:01 +0000406
407.. attribute:: Popen.returncode
408
Georg Brandl2cb103f2008-01-06 16:01:26 +0000409 The child return code, set by :meth:`poll` and :meth:`wait` (and indirectly
410 by :meth:`communicate`). A ``None`` value indicates that the process
411 hasn't terminated yet.
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000412
Georg Brandl2cb103f2008-01-06 16:01:26 +0000413 A negative value ``-N`` indicates that the child was terminated by signal
414 ``N`` (Unix only).
Georg Brandl8ec7f652007-08-15 14:28:01 +0000415
416
Brian Curtinbb23bd62011-04-29 22:23:46 -0500417Windows Popen Helpers
418---------------------
419
420The :class:`STARTUPINFO` class and following constants are only available
421on Windows.
422
423.. class:: STARTUPINFO()
424
425 Partial support of the Windows
426 `STARTUPINFO <http://msdn.microsoft.com/en-us/library/ms686331(v=vs.85).aspx>`__
427 structure is used for :class:`Popen` creation.
428
429 .. attribute:: dwFlags
430
431 A bit field that determines whether certain :class:`STARTUPINFO` members
432 are used when the process creates a window. ::
433
434 si = subprocess.STARTUPINFO()
435 si.dwFlags = subprocess.STARTF_USESTDHANDLES | subprocess.STARTF_USESHOWWINDOW
436
437 .. attribute:: hStdInput
438
439 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this member is
440 the standard input handle for the process. If :data:`STARTF_USESTDHANDLES`
441 is not specified, the default for standard input is the keyboard buffer.
442
443 .. attribute:: hStdOutput
444
445 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this member is
446 the standard output handle for the process. Otherwise, this member is
447 ignored and the default for standard output is the console window's
448 buffer.
449
450 .. attribute:: hStdError
451
452 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this member is
453 the standard error handle for the process. Otherwise, this member is
454 ignored and the default for standard error is the console window's buffer.
455
456 .. attribute:: wShowWindow
457
458 If :attr:`dwFlags` specifies :data:`STARTF_USESHOWWINDOW`, this member
459 can be any of the values that can be specified in the ``nCmdShow``
460 parameter for the
461 `ShowWindow <http://msdn.microsoft.com/en-us/library/ms633548(v=vs.85).aspx>`__
462 function, except for ``SW_SHOWDEFAULT``. Otherwise, this member is
463 ignored.
464
465 :data:`SW_HIDE` is provided for this attribute. It is used when
466 :class:`Popen` is called with ``shell=True``.
467
468
469Constants
470^^^^^^^^^
471
472The :mod:`subprocess` module exposes the following constants.
473
474.. data:: STD_INPUT_HANDLE
475
476 The standard input device. Initially, this is the console input buffer,
477 ``CONIN$``.
478
479.. data:: STD_OUTPUT_HANDLE
480
481 The standard output device. Initially, this is the active console screen
482 buffer, ``CONOUT$``.
483
484.. data:: STD_ERROR_HANDLE
485
486 The standard error device. Initially, this is the active console screen
487 buffer, ``CONOUT$``.
488
489.. data:: SW_HIDE
490
491 Hides the window. Another window will be activated.
492
493.. data:: STARTF_USESTDHANDLES
494
495 Specifies that the :attr:`STARTUPINFO.hStdInput`,
496 :attr:`STARTUPINFO.hStdOutput`, and :attr:`STARTUPINFO.hStdError` members
497 contain additional information.
498
499.. data:: STARTF_USESHOWWINDOW
500
501 Specifies that the :attr:`STARTUPINFO.wShowWindow` member contains
502 additional information.
503
504.. data:: CREATE_NEW_CONSOLE
505
506 The new process has a new console, instead of inheriting its parent's
507 console (the default).
508
509 This flag is always set when :class:`Popen` is created with ``shell=True``.
510
511.. data:: CREATE_NEW_PROCESS_GROUP
512
513 A :class:`Popen` ``creationflags`` parameter to specify that a new process
514 group will be created. This flag is necessary for using :func:`os.kill`
515 on the subprocess.
516
517 This flag is ignored if :data:`CREATE_NEW_CONSOLE` is specified.
518
519
Georg Brandl0ba92b22008-06-22 09:05:29 +0000520.. _subprocess-replacements:
521
Georg Brandl8ec7f652007-08-15 14:28:01 +0000522Replacing Older Functions with the subprocess Module
523----------------------------------------------------
524
525In this section, "a ==> b" means that b can be used as a replacement for a.
526
527.. note::
528
529 All functions in this section fail (more or less) silently if the executed
530 program cannot be found; this module raises an :exc:`OSError` exception.
531
532In the following examples, we assume that the subprocess module is imported with
533"from subprocess import \*".
534
535
536Replacing /bin/sh shell backquote
537^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
538
539::
540
541 output=`mycmd myarg`
542 ==>
543 output = Popen(["mycmd", "myarg"], stdout=PIPE).communicate()[0]
544
545
Benjamin Petersoncae58482008-10-10 20:38:49 +0000546Replacing shell pipeline
547^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000548
549::
550
551 output=`dmesg | grep hda`
552 ==>
553 p1 = Popen(["dmesg"], stdout=PIPE)
554 p2 = Popen(["grep", "hda"], stdin=p1.stdout, stdout=PIPE)
Gregory P. Smithe3e967f2011-02-05 21:49:56 +0000555 p1.stdout.close() # Allow p1 to receive a SIGPIPE if p2 exits.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000556 output = p2.communicate()[0]
557
Gregory P. Smithe3e967f2011-02-05 21:49:56 +0000558The p1.stdout.close() call after starting the p2 is important in order for p1
559to receive a SIGPIPE if p2 exits before p1.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000560
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000561Replacing :func:`os.system`
562^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000563
564::
565
566 sts = os.system("mycmd" + " myarg")
567 ==>
568 p = Popen("mycmd" + " myarg", shell=True)
Georg Brandl2e1285b2009-07-16 07:38:35 +0000569 sts = os.waitpid(p.pid, 0)[1]
Georg Brandl8ec7f652007-08-15 14:28:01 +0000570
571Notes:
572
573* Calling the program through the shell is usually not required.
574
575* It's easier to look at the :attr:`returncode` attribute than the exit status.
576
577A more realistic example would look like this::
578
579 try:
580 retcode = call("mycmd" + " myarg", shell=True)
581 if retcode < 0:
582 print >>sys.stderr, "Child was terminated by signal", -retcode
583 else:
584 print >>sys.stderr, "Child returned", retcode
585 except OSError, e:
586 print >>sys.stderr, "Execution failed:", e
587
588
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000589Replacing the :func:`os.spawn <os.spawnl>` family
590^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000591
592P_NOWAIT example::
593
594 pid = os.spawnlp(os.P_NOWAIT, "/bin/mycmd", "mycmd", "myarg")
595 ==>
596 pid = Popen(["/bin/mycmd", "myarg"]).pid
597
598P_WAIT example::
599
600 retcode = os.spawnlp(os.P_WAIT, "/bin/mycmd", "mycmd", "myarg")
601 ==>
602 retcode = call(["/bin/mycmd", "myarg"])
603
604Vector example::
605
606 os.spawnvp(os.P_NOWAIT, path, args)
607 ==>
608 Popen([path] + args[1:])
609
610Environment example::
611
612 os.spawnlpe(os.P_NOWAIT, "/bin/mycmd", "mycmd", "myarg", env)
613 ==>
614 Popen(["/bin/mycmd", "myarg"], env={"PATH": "/usr/bin"})
615
616
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000617Replacing :func:`os.popen`, :func:`os.popen2`, :func:`os.popen3`
618^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000619
620::
621
Philip Jenvey8b902042009-09-29 19:10:15 +0000622 pipe = os.popen("cmd", 'r', bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000623 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000624 pipe = Popen("cmd", shell=True, bufsize=bufsize, stdout=PIPE).stdout
Georg Brandl8ec7f652007-08-15 14:28:01 +0000625
626::
627
Philip Jenvey8b902042009-09-29 19:10:15 +0000628 pipe = os.popen("cmd", 'w', bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000629 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000630 pipe = Popen("cmd", shell=True, bufsize=bufsize, stdin=PIPE).stdin
Georg Brandl8ec7f652007-08-15 14:28:01 +0000631
632::
633
Philip Jenvey8b902042009-09-29 19:10:15 +0000634 (child_stdin, child_stdout) = os.popen2("cmd", mode, bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000635 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000636 p = Popen("cmd", shell=True, bufsize=bufsize,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000637 stdin=PIPE, stdout=PIPE, close_fds=True)
638 (child_stdin, child_stdout) = (p.stdin, p.stdout)
639
640::
641
642 (child_stdin,
643 child_stdout,
Philip Jenvey8b902042009-09-29 19:10:15 +0000644 child_stderr) = os.popen3("cmd", mode, bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000645 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000646 p = Popen("cmd", shell=True, bufsize=bufsize,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000647 stdin=PIPE, stdout=PIPE, stderr=PIPE, close_fds=True)
648 (child_stdin,
649 child_stdout,
650 child_stderr) = (p.stdin, p.stdout, p.stderr)
651
652::
653
Philip Jenvey8b902042009-09-29 19:10:15 +0000654 (child_stdin, child_stdout_and_stderr) = os.popen4("cmd", mode,
655 bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000656 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000657 p = Popen("cmd", shell=True, bufsize=bufsize,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000658 stdin=PIPE, stdout=PIPE, stderr=STDOUT, close_fds=True)
659 (child_stdin, child_stdout_and_stderr) = (p.stdin, p.stdout)
660
Philip Jenvey8b902042009-09-29 19:10:15 +0000661On Unix, os.popen2, os.popen3 and os.popen4 also accept a sequence as
662the command to execute, in which case arguments will be passed
663directly to the program without shell intervention. This usage can be
664replaced as follows::
665
666 (child_stdin, child_stdout) = os.popen2(["/bin/ls", "-l"], mode,
667 bufsize)
668 ==>
669 p = Popen(["/bin/ls", "-l"], bufsize=bufsize, stdin=PIPE, stdout=PIPE)
670 (child_stdin, child_stdout) = (p.stdin, p.stdout)
671
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000672Return code handling translates as follows::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000673
Philip Jenvey8b902042009-09-29 19:10:15 +0000674 pipe = os.popen("cmd", 'w')
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000675 ...
676 rc = pipe.close()
Stefan Kraha253dc12010-07-14 10:06:07 +0000677 if rc is not None and rc >> 8:
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000678 print "There were some errors"
679 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000680 process = Popen("cmd", 'w', shell=True, stdin=PIPE)
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000681 ...
682 process.stdin.close()
683 if process.wait() != 0:
684 print "There were some errors"
685
686
687Replacing functions from the :mod:`popen2` module
688^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000689
Georg Brandl8ec7f652007-08-15 14:28:01 +0000690::
691
692 (child_stdout, child_stdin) = popen2.popen2("somestring", bufsize, mode)
693 ==>
694 p = Popen(["somestring"], shell=True, bufsize=bufsize,
695 stdin=PIPE, stdout=PIPE, close_fds=True)
696 (child_stdout, child_stdin) = (p.stdout, p.stdin)
697
Philip Jenvey8b902042009-09-29 19:10:15 +0000698On Unix, popen2 also accepts a sequence as the command to execute, in
699which case arguments will be passed directly to the program without
700shell intervention. This usage can be replaced as follows::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000701
Philip Jenvey8b902042009-09-29 19:10:15 +0000702 (child_stdout, child_stdin) = popen2.popen2(["mycmd", "myarg"], bufsize,
703 mode)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000704 ==>
705 p = Popen(["mycmd", "myarg"], bufsize=bufsize,
706 stdin=PIPE, stdout=PIPE, close_fds=True)
707 (child_stdout, child_stdin) = (p.stdout, p.stdin)
708
Georg Brandlf5d5a662008-12-06 11:57:12 +0000709:class:`popen2.Popen3` and :class:`popen2.Popen4` basically work as
710:class:`subprocess.Popen`, except that:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000711
Georg Brandlf5d5a662008-12-06 11:57:12 +0000712* :class:`Popen` raises an exception if the execution fails.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000713
714* the *capturestderr* argument is replaced with the *stderr* argument.
715
Georg Brandlf5d5a662008-12-06 11:57:12 +0000716* ``stdin=PIPE`` and ``stdout=PIPE`` must be specified.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000717
718* popen2 closes all file descriptors by default, but you have to specify
Georg Brandlf5d5a662008-12-06 11:57:12 +0000719 ``close_fds=True`` with :class:`Popen`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000720
Eli Bendersky929e2762011-04-15 07:35:06 +0300721Notes
722-----
723
724.. _converting-argument-sequence:
725
726Converting an argument sequence to a string on Windows
727^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
728
729On Windows, an *args* sequence is converted to a string that can be parsed
730using the following rules (which correspond to the rules used by the MS C
731runtime):
732
7331. Arguments are delimited by white space, which is either a
734 space or a tab.
735
7362. A string surrounded by double quotation marks is
737 interpreted as a single argument, regardless of white space
738 contained within. A quoted string can be embedded in an
739 argument.
740
7413. A double quotation mark preceded by a backslash is
742 interpreted as a literal double quotation mark.
743
7444. Backslashes are interpreted literally, unless they
745 immediately precede a double quotation mark.
746
7475. If backslashes immediately precede a double quotation mark,
748 every pair of backslashes is interpreted as a literal
749 backslash. If the number of backslashes is odd, the last
750 backslash escapes the next double quotation mark as
751 described in rule 3.
752