blob: 997165a2a7ee55b551dbb66e36bca8428d8f0275 [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001
2:mod:`subprocess` --- Subprocess management
3===========================================
4
5.. module:: subprocess
6 :synopsis: Subprocess management.
7.. moduleauthor:: Peter Åstrand <astrand@lysator.liu.se>
8.. sectionauthor:: Peter Åstrand <astrand@lysator.liu.se>
9
10
11.. versionadded:: 2.4
12
13The :mod:`subprocess` module allows you to spawn new processes, connect to their
14input/output/error pipes, and obtain their return codes. This module intends to
15replace several other, older modules and functions, such as::
16
17 os.system
18 os.spawn*
19 os.popen*
20 popen2.*
21 commands.*
22
23Information about how the :mod:`subprocess` module can be used to replace these
24modules and functions can be found in the following sections.
25
Georg Brandl68b4e742008-07-01 19:59:00 +000026.. seealso::
27
28 :pep:`324` -- PEP proposing the subprocess module
29
Georg Brandl8ec7f652007-08-15 14:28:01 +000030
31Using the subprocess Module
32---------------------------
33
34This module defines one class called :class:`Popen`:
35
36
37.. class:: Popen(args, bufsize=0, executable=None, stdin=None, stdout=None, stderr=None, preexec_fn=None, close_fds=False, shell=False, cwd=None, env=None, universal_newlines=False, startupinfo=None, creationflags=0)
38
39 Arguments are:
40
Benjamin Petersonfff5cf62008-07-27 15:22:14 +000041 *args* should be a string, or a sequence of program arguments. The program
R. David Murrayfe6e7842009-05-29 19:30:27 +000042 to execute is normally the first item in the args sequence or the string if
43 a string is given, but can be explicitly set by using the *executable*
44 argument. When *executable* is given, the first item in the args sequence
45 is still treated by most programs as the command name, which can then be
46 different from the actual executable name. On Unix, it becomes the display
47 name for the executing program in utilities such as :program:`ps`.
Georg Brandl8ec7f652007-08-15 14:28:01 +000048
49 On Unix, with *shell=False* (default): In this case, the Popen class uses
50 :meth:`os.execvp` to execute the child program. *args* should normally be a
Nick Coghlan7dfc9e12010-02-04 12:43:58 +000051 sequence. If a string is specified for *args*, it will be used as the name
52 or path of the program to execute; this will only work if the program is
53 being given no arguments.
Georg Brandl8ec7f652007-08-15 14:28:01 +000054
Nick Coghlan7dfc9e12010-02-04 12:43:58 +000055 .. note::
56
57 :meth:`shlex.split` can be useful when determining the correct
58 tokenization for *args*, especially in complex cases::
59
60 >>> import shlex, subprocess
61 >>> command_line = raw_input()
62 /bin/vikings -input eggs.txt -output "spam spam.txt" -cmd "echo '$MONEY'"
63 >>> args = shlex.split(command_line)
64 >>> print args
65 ['/bin/vikings', '-input', 'eggs.txt', '-output', 'spam spam.txt', '-cmd', "echo '$MONEY'"]
66 >>> p = subprocess.Popen(args) # Success!
67
68 Note in particular that options (such as *-input*) and arguments (such
69 as *eggs.txt*) that are separated by whitespace in the shell go in separate
70 list elements, while arguments that need quoting or backslash escaping when
71 used in the shell (such as filenames containing spaces or the *echo* command
72 shown above) are single list elements.
73
74 On Unix, with *shell=True*: If args is a string, it specifies the command
75 string to execute through the shell. This means that the string must be
76 formatted exactly as it would be when typed at the shell prompt. This
77 includes, for example, quoting or backslash escaping filenames with spaces in
78 them. If *args* is a sequence, the first item specifies the command string, and
79 any additional items will be treated as additional arguments to the shell
80 itself. That is to say, *Popen* does the equivalent of::
81
82 Popen(['/bin/sh', '-c', args[0], args[1], ...])
Georg Brandl8ec7f652007-08-15 14:28:01 +000083
R. David Murray6e4300c2010-11-12 00:39:09 +000084 .. warning::
85
86 Executing shell commands that incorporate unsanitized input from an
87 untrusted source makes a program vulnerable to `shell injection
88 <http://en.wikipedia.org/wiki/Shell_injection#Shell_injection>`_,
89 a serious security flaw which can result in arbitrary command execution.
90 For this reason, the use of *shell=True* is **strongly discouraged** in cases
91 where the command string is constructed from external input::
92
93 >>> from subprocess import call
94 >>> filename = input("What file would you like to display?\n")
95 What file would you like to display?
96 non_existent; rm -rf / #
97 >>> call("cat " + filename, shell=True) # Uh-oh. This will end badly...
98
99 *shell=False* does not suffer from this vulnerability; the above Note may be
100 helpful in getting code using *shell=False* to work.
101
Georg Brandl8ec7f652007-08-15 14:28:01 +0000102 On Windows: the :class:`Popen` class uses CreateProcess() to execute the child
Eli Bendersky929e2762011-04-15 07:35:06 +0300103 child program, which operates on strings. If *args* is a sequence, it will
104 be converted to a string in a manner described in
105 :ref:`converting-argument-sequence`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000106
107 *bufsize*, if given, has the same meaning as the corresponding argument to the
108 built-in open() function: :const:`0` means unbuffered, :const:`1` means line
109 buffered, any other positive value means use a buffer of (approximately) that
110 size. A negative *bufsize* means to use the system default, which usually means
111 fully buffered. The default value for *bufsize* is :const:`0` (unbuffered).
112
Antoine Pitrouc3955452010-06-02 17:08:47 +0000113 .. note::
114
115 If you experience performance issues, it is recommended that you try to
116 enable buffering by setting *bufsize* to either -1 or a large enough
117 positive value (such as 4096).
118
Georg Brandl8ec7f652007-08-15 14:28:01 +0000119 The *executable* argument specifies the program to execute. It is very seldom
120 needed: Usually, the program to execute is defined by the *args* argument. If
121 ``shell=True``, the *executable* argument specifies which shell to use. On Unix,
122 the default shell is :file:`/bin/sh`. On Windows, the default shell is
Georg Brandl0d8649a2009-06-30 16:17:28 +0000123 specified by the :envvar:`COMSPEC` environment variable. The only reason you
124 would need to specify ``shell=True`` on Windows is where the command you
125 wish to execute is actually built in to the shell, eg ``dir``, ``copy``.
126 You don't need ``shell=True`` to run a batch file, nor to run a console-based
127 executable.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000128
129 *stdin*, *stdout* and *stderr* specify the executed programs' standard input,
Georg Brandlf5d5a662008-12-06 11:57:12 +0000130 standard output and standard error file handles, respectively. Valid values
131 are :data:`PIPE`, an existing file descriptor (a positive integer), an
132 existing file object, and ``None``. :data:`PIPE` indicates that a new pipe
133 to the child should be created. With ``None``, no redirection will occur;
134 the child's file handles will be inherited from the parent. Additionally,
135 *stderr* can be :data:`STDOUT`, which indicates that the stderr data from the
136 applications should be captured into the same file handle as for stdout.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000137
138 If *preexec_fn* is set to a callable object, this object will be called in the
139 child process just before the child is executed. (Unix only)
140
141 If *close_fds* is true, all file descriptors except :const:`0`, :const:`1` and
142 :const:`2` will be closed before the child process is executed. (Unix only).
143 Or, on Windows, if *close_fds* is true then no handles will be inherited by the
144 child process. Note that on Windows, you cannot set *close_fds* to true and
145 also redirect the standard handles by setting *stdin*, *stdout* or *stderr*.
146
147 If *shell* is :const:`True`, the specified command will be executed through the
148 shell.
149
150 If *cwd* is not ``None``, the child's current directory will be changed to *cwd*
151 before it is executed. Note that this directory is not considered when
152 searching the executable, so you can't specify the program's path relative to
153 *cwd*.
154
Georg Brandlf801b0f2008-04-19 16:58:49 +0000155 If *env* is not ``None``, it must be a mapping that defines the environment
156 variables for the new process; these are used instead of inheriting the current
157 process' environment, which is the default behavior.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000158
R. David Murray72030812009-04-16 18:12:53 +0000159 .. note::
R. David Murray6076d392009-04-15 22:33:07 +0000160
R. David Murray72030812009-04-16 18:12:53 +0000161 If specified, *env* must provide any variables required
162 for the program to execute. On Windows, in order to run a
163 `side-by-side assembly`_ the specified *env* **must** include a valid
R. David Murray6076d392009-04-15 22:33:07 +0000164 :envvar:`SystemRoot`.
165
R. David Murray72030812009-04-16 18:12:53 +0000166 .. _side-by-side assembly: http://en.wikipedia.org/wiki/Side-by-Side_Assembly
167
Georg Brandl8ec7f652007-08-15 14:28:01 +0000168 If *universal_newlines* is :const:`True`, the file objects stdout and stderr are
169 opened as text files, but lines may be terminated by any of ``'\n'``, the Unix
Georg Brandl9af94982008-09-13 17:41:16 +0000170 end-of-line convention, ``'\r'``, the old Macintosh convention or ``'\r\n'``, the
Georg Brandl8ec7f652007-08-15 14:28:01 +0000171 Windows convention. All of these external representations are seen as ``'\n'``
172 by the Python program.
173
174 .. note::
175
Georg Brandl6ab5d082009-12-20 14:33:20 +0000176 This feature is only available if Python is built with universal newline
177 support (the default). Also, the newlines attribute of the file objects
178 :attr:`stdout`, :attr:`stdin` and :attr:`stderr` are not updated by the
179 communicate() method.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000180
Brian Curtinbb23bd62011-04-29 22:23:46 -0500181 If given, *startupinfo* will be a :class:`STARTUPINFO` object, which is
182 passed to the underlying ``CreateProcess`` function.
183 *creationflags*, if given, can be :data:`CREATE_NEW_CONSOLE` or
184 :data:`CREATE_NEW_PROCESS_GROUP`. (Windows only)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000185
186
Georg Brandlf5d5a662008-12-06 11:57:12 +0000187.. data:: PIPE
188
189 Special value that can be used as the *stdin*, *stdout* or *stderr* argument
190 to :class:`Popen` and indicates that a pipe to the standard stream should be
191 opened.
192
193
194.. data:: STDOUT
195
196 Special value that can be used as the *stderr* argument to :class:`Popen` and
197 indicates that standard error should go into the same handle as standard
198 output.
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000199
Georg Brandlf5d5a662008-12-06 11:57:12 +0000200
Georg Brandl8ec7f652007-08-15 14:28:01 +0000201Convenience Functions
202^^^^^^^^^^^^^^^^^^^^^
203
Ezio Melottib4923782011-04-19 23:12:37 +0300204This module also defines the following shortcut functions:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000205
206
207.. function:: call(*popenargs, **kwargs)
208
209 Run command with arguments. Wait for command to complete, then return the
210 :attr:`returncode` attribute.
211
R. David Murray6dfe6622010-02-16 17:55:26 +0000212 The arguments are the same as for the :class:`Popen` constructor. Example::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000213
Georg Brandl6ab5d082009-12-20 14:33:20 +0000214 >>> retcode = subprocess.call(["ls", "-l"])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000215
Philip Jenvey739aa362009-05-22 05:35:32 +0000216 .. warning::
217
Philip Jenvey26275532009-12-03 02:25:54 +0000218 Like :meth:`Popen.wait`, this will deadlock when using
219 ``stdout=PIPE`` and/or ``stderr=PIPE`` and the child process
220 generates enough output to a pipe such that it blocks waiting
221 for the OS pipe buffer to accept more data.
Philip Jenvey739aa362009-05-22 05:35:32 +0000222
Georg Brandl8ec7f652007-08-15 14:28:01 +0000223
224.. function:: check_call(*popenargs, **kwargs)
225
226 Run command with arguments. Wait for command to complete. If the exit code was
Andrew M. Kuchlingcad8da82008-09-30 13:01:46 +0000227 zero then return, otherwise raise :exc:`CalledProcessError`. The
Georg Brandl8ec7f652007-08-15 14:28:01 +0000228 :exc:`CalledProcessError` object will have the return code in the
229 :attr:`returncode` attribute.
230
R. David Murray6dfe6622010-02-16 17:55:26 +0000231 The arguments are the same as for the :class:`Popen` constructor. Example::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000232
Georg Brandl6ab5d082009-12-20 14:33:20 +0000233 >>> subprocess.check_call(["ls", "-l"])
234 0
Georg Brandl8ec7f652007-08-15 14:28:01 +0000235
236 .. versionadded:: 2.5
237
Philip Jenvey739aa362009-05-22 05:35:32 +0000238 .. warning::
239
240 See the warning for :func:`call`.
241
Georg Brandl8ec7f652007-08-15 14:28:01 +0000242
Gregory P. Smith26576802008-12-05 02:27:01 +0000243.. function:: check_output(*popenargs, **kwargs)
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000244
245 Run command with arguments and return its output as a byte string.
246
Andrew M. Kuchling42ffbdb2009-01-21 02:16:26 +0000247 If the exit code was non-zero it raises a :exc:`CalledProcessError`. The
248 :exc:`CalledProcessError` object will have the return code in the
249 :attr:`returncode`
250 attribute and output in the :attr:`output` attribute.
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000251
Georg Brandlf6dab952009-04-28 21:48:35 +0000252 The arguments are the same as for the :class:`Popen` constructor. Example::
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000253
Gregory P. Smith26576802008-12-05 02:27:01 +0000254 >>> subprocess.check_output(["ls", "-l", "/dev/null"])
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000255 'crw-rw-rw- 1 root root 1, 3 Oct 18 2007 /dev/null\n'
256
257 The stdout argument is not allowed as it is used internally.
Georg Brandlf6dab952009-04-28 21:48:35 +0000258 To capture standard error in the result, use ``stderr=subprocess.STDOUT``::
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000259
Gregory P. Smith26576802008-12-05 02:27:01 +0000260 >>> subprocess.check_output(
Georg Brandl6ab5d082009-12-20 14:33:20 +0000261 ... ["/bin/sh", "-c", "ls non_existent_file; exit 0"],
262 ... stderr=subprocess.STDOUT)
Mark Dickinson3e4caeb2009-02-21 20:27:01 +0000263 'ls: non_existent_file: No such file or directory\n'
Gregory P. Smith97f49f42008-12-04 20:21:09 +0000264
265 .. versionadded:: 2.7
266
267
Georg Brandl8ec7f652007-08-15 14:28:01 +0000268Exceptions
269^^^^^^^^^^
270
271Exceptions raised in the child process, before the new program has started to
272execute, will be re-raised in the parent. Additionally, the exception object
273will have one extra attribute called :attr:`child_traceback`, which is a string
Georg Brandl21946af2010-10-06 09:28:45 +0000274containing traceback information from the child's point of view.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000275
276The most common exception raised is :exc:`OSError`. This occurs, for example,
277when trying to execute a non-existent file. Applications should prepare for
278:exc:`OSError` exceptions.
279
280A :exc:`ValueError` will be raised if :class:`Popen` is called with invalid
281arguments.
282
283check_call() will raise :exc:`CalledProcessError`, if the called process returns
284a non-zero return code.
285
286
287Security
288^^^^^^^^
289
290Unlike some other popen functions, this implementation will never call /bin/sh
291implicitly. This means that all characters, including shell metacharacters, can
292safely be passed to child processes.
293
294
295Popen Objects
296-------------
297
298Instances of the :class:`Popen` class have the following methods:
299
300
301.. method:: Popen.poll()
302
Georg Brandl2cb103f2008-01-06 16:01:26 +0000303 Check if child process has terminated. Set and return :attr:`returncode`
304 attribute.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000305
306
307.. method:: Popen.wait()
308
Georg Brandl2cb103f2008-01-06 16:01:26 +0000309 Wait for child process to terminate. Set and return :attr:`returncode`
310 attribute.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000311
Georg Brandl143de622008-08-04 06:29:36 +0000312 .. warning::
313
Philip Jenvey26275532009-12-03 02:25:54 +0000314 This will deadlock when using ``stdout=PIPE`` and/or
315 ``stderr=PIPE`` and the child process generates enough output to
316 a pipe such that it blocks waiting for the OS pipe buffer to
317 accept more data. Use :meth:`communicate` to avoid that.
Gregory P. Smith08792502008-08-04 01:03:50 +0000318
Georg Brandl8ec7f652007-08-15 14:28:01 +0000319
320.. method:: Popen.communicate(input=None)
321
322 Interact with process: Send data to stdin. Read data from stdout and stderr,
323 until end-of-file is reached. Wait for process to terminate. The optional
324 *input* argument should be a string to be sent to the child process, or
325 ``None``, if no data should be sent to the child.
326
Georg Brandl17432012008-12-04 21:28:16 +0000327 :meth:`communicate` returns a tuple ``(stdoutdata, stderrdata)``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000328
Georg Brandl439f2502007-11-24 11:31:46 +0000329 Note that if you want to send data to the process's stdin, you need to create
330 the Popen object with ``stdin=PIPE``. Similarly, to get anything other than
331 ``None`` in the result tuple, you need to give ``stdout=PIPE`` and/or
332 ``stderr=PIPE`` too.
333
Georg Brandl2cb103f2008-01-06 16:01:26 +0000334 .. note::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000335
Georg Brandl2cb103f2008-01-06 16:01:26 +0000336 The data read is buffered in memory, so do not use this method if the data
337 size is large or unlimited.
338
Georg Brandl8ec7f652007-08-15 14:28:01 +0000339
Christian Heimese74c8f22008-04-19 02:23:57 +0000340.. method:: Popen.send_signal(signal)
341
342 Sends the signal *signal* to the child.
343
344 .. note::
345
Brian Curtine5aa8862010-04-02 23:26:06 +0000346 On Windows, SIGTERM is an alias for :meth:`terminate`. CTRL_C_EVENT and
Ezio Melotti9ccc5812010-04-05 08:16:41 +0000347 CTRL_BREAK_EVENT can be sent to processes started with a *creationflags*
Brian Curtine5aa8862010-04-02 23:26:06 +0000348 parameter which includes `CREATE_NEW_PROCESS_GROUP`.
Georg Brandl734de682008-04-19 08:23:59 +0000349
350 .. versionadded:: 2.6
Christian Heimese74c8f22008-04-19 02:23:57 +0000351
352
353.. method:: Popen.terminate()
354
355 Stop the child. On Posix OSs the method sends SIGTERM to the
Andrew M. Kuchling64c6a0e2008-04-21 02:08:00 +0000356 child. On Windows the Win32 API function :cfunc:`TerminateProcess` is called
Christian Heimese74c8f22008-04-19 02:23:57 +0000357 to stop the child.
358
Georg Brandl734de682008-04-19 08:23:59 +0000359 .. versionadded:: 2.6
360
Christian Heimese74c8f22008-04-19 02:23:57 +0000361
362.. method:: Popen.kill()
363
364 Kills the child. On Posix OSs the function sends SIGKILL to the child.
Georg Brandl734de682008-04-19 08:23:59 +0000365 On Windows :meth:`kill` is an alias for :meth:`terminate`.
366
367 .. versionadded:: 2.6
Christian Heimese74c8f22008-04-19 02:23:57 +0000368
369
Georg Brandl8ec7f652007-08-15 14:28:01 +0000370The following attributes are also available:
371
Georg Brandl143de622008-08-04 06:29:36 +0000372.. warning::
373
Georg Brandl16a57f62009-04-27 15:29:09 +0000374 Use :meth:`communicate` rather than :attr:`.stdin.write <stdin>`,
375 :attr:`.stdout.read <stdout>` or :attr:`.stderr.read <stderr>` to avoid
376 deadlocks due to any of the other OS pipe buffers filling up and blocking the
377 child process.
Georg Brandl143de622008-08-04 06:29:36 +0000378
379
Georg Brandl8ec7f652007-08-15 14:28:01 +0000380.. attribute:: Popen.stdin
381
Georg Brandlf5d5a662008-12-06 11:57:12 +0000382 If the *stdin* argument was :data:`PIPE`, this attribute is a file object
383 that provides input to the child process. Otherwise, it is ``None``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000384
385
386.. attribute:: Popen.stdout
387
Georg Brandlf5d5a662008-12-06 11:57:12 +0000388 If the *stdout* argument was :data:`PIPE`, this attribute is a file object
389 that provides output from the child process. Otherwise, it is ``None``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000390
391
392.. attribute:: Popen.stderr
393
Georg Brandlf5d5a662008-12-06 11:57:12 +0000394 If the *stderr* argument was :data:`PIPE`, this attribute is a file object
395 that provides error output from the child process. Otherwise, it is
396 ``None``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000397
398
399.. attribute:: Popen.pid
400
401 The process ID of the child process.
402
Georg Brandl0b56ce02010-03-21 09:28:16 +0000403 Note that if you set the *shell* argument to ``True``, this is the process ID
404 of the spawned shell.
405
Georg Brandl8ec7f652007-08-15 14:28:01 +0000406
407.. attribute:: Popen.returncode
408
Georg Brandl2cb103f2008-01-06 16:01:26 +0000409 The child return code, set by :meth:`poll` and :meth:`wait` (and indirectly
410 by :meth:`communicate`). A ``None`` value indicates that the process
411 hasn't terminated yet.
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000412
Georg Brandl2cb103f2008-01-06 16:01:26 +0000413 A negative value ``-N`` indicates that the child was terminated by signal
414 ``N`` (Unix only).
Georg Brandl8ec7f652007-08-15 14:28:01 +0000415
416
Brian Curtinbb23bd62011-04-29 22:23:46 -0500417Windows Popen Helpers
418---------------------
419
420The :class:`STARTUPINFO` class and following constants are only available
421on Windows.
422
423.. class:: STARTUPINFO()
424
425 Partial support of the Windows
426 `STARTUPINFO <http://msdn.microsoft.com/en-us/library/ms686331(v=vs.85).aspx>`__
427 structure is used for :class:`Popen` creation.
428
429 .. attribute:: dwFlags
430
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700431 A bit field that determines whether certain :class:`STARTUPINFO`
432 attributes are used when the process creates a window. ::
Brian Curtinbb23bd62011-04-29 22:23:46 -0500433
434 si = subprocess.STARTUPINFO()
435 si.dwFlags = subprocess.STARTF_USESTDHANDLES | subprocess.STARTF_USESHOWWINDOW
436
437 .. attribute:: hStdInput
438
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700439 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this attribute
440 is the standard input handle for the process. If
441 :data:`STARTF_USESTDHANDLES` is not specified, the default for standard
442 input is the keyboard buffer.
Brian Curtinbb23bd62011-04-29 22:23:46 -0500443
444 .. attribute:: hStdOutput
445
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700446 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this attribute
447 is the standard output handle for the process. Otherwise, this attribute
448 is ignored and the default for standard output is the console window's
Brian Curtinbb23bd62011-04-29 22:23:46 -0500449 buffer.
450
451 .. attribute:: hStdError
452
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700453 If :attr:`dwFlags` specifies :data:`STARTF_USESTDHANDLES`, this attribute
454 is the standard error handle for the process. Otherwise, this attribute is
Brian Curtinbb23bd62011-04-29 22:23:46 -0500455 ignored and the default for standard error is the console window's buffer.
456
457 .. attribute:: wShowWindow
458
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700459 If :attr:`dwFlags` specifies :data:`STARTF_USESHOWWINDOW`, this attribute
Brian Curtinbb23bd62011-04-29 22:23:46 -0500460 can be any of the values that can be specified in the ``nCmdShow``
461 parameter for the
462 `ShowWindow <http://msdn.microsoft.com/en-us/library/ms633548(v=vs.85).aspx>`__
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700463 function, except for ``SW_SHOWDEFAULT``. Otherwise, this attribute is
Brian Curtinbb23bd62011-04-29 22:23:46 -0500464 ignored.
465
466 :data:`SW_HIDE` is provided for this attribute. It is used when
467 :class:`Popen` is called with ``shell=True``.
468
469
470Constants
471^^^^^^^^^
472
473The :mod:`subprocess` module exposes the following constants.
474
475.. data:: STD_INPUT_HANDLE
476
477 The standard input device. Initially, this is the console input buffer,
478 ``CONIN$``.
479
480.. data:: STD_OUTPUT_HANDLE
481
482 The standard output device. Initially, this is the active console screen
483 buffer, ``CONOUT$``.
484
485.. data:: STD_ERROR_HANDLE
486
487 The standard error device. Initially, this is the active console screen
488 buffer, ``CONOUT$``.
489
490.. data:: SW_HIDE
491
492 Hides the window. Another window will be activated.
493
494.. data:: STARTF_USESTDHANDLES
495
496 Specifies that the :attr:`STARTUPINFO.hStdInput`,
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700497 :attr:`STARTUPINFO.hStdOutput`, and :attr:`STARTUPINFO.hStdError` attributes
Brian Curtinbb23bd62011-04-29 22:23:46 -0500498 contain additional information.
499
500.. data:: STARTF_USESHOWWINDOW
501
Senthil Kumaran6f18b982011-07-04 12:50:02 -0700502 Specifies that the :attr:`STARTUPINFO.wShowWindow` attribute contains
Brian Curtinbb23bd62011-04-29 22:23:46 -0500503 additional information.
504
505.. data:: CREATE_NEW_CONSOLE
506
507 The new process has a new console, instead of inheriting its parent's
508 console (the default).
509
510 This flag is always set when :class:`Popen` is created with ``shell=True``.
511
512.. data:: CREATE_NEW_PROCESS_GROUP
513
514 A :class:`Popen` ``creationflags`` parameter to specify that a new process
515 group will be created. This flag is necessary for using :func:`os.kill`
516 on the subprocess.
517
518 This flag is ignored if :data:`CREATE_NEW_CONSOLE` is specified.
519
520
Georg Brandl0ba92b22008-06-22 09:05:29 +0000521.. _subprocess-replacements:
522
Georg Brandl8ec7f652007-08-15 14:28:01 +0000523Replacing Older Functions with the subprocess Module
524----------------------------------------------------
525
526In this section, "a ==> b" means that b can be used as a replacement for a.
527
528.. note::
529
530 All functions in this section fail (more or less) silently if the executed
531 program cannot be found; this module raises an :exc:`OSError` exception.
532
533In the following examples, we assume that the subprocess module is imported with
534"from subprocess import \*".
535
536
537Replacing /bin/sh shell backquote
538^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
539
540::
541
542 output=`mycmd myarg`
543 ==>
544 output = Popen(["mycmd", "myarg"], stdout=PIPE).communicate()[0]
545
546
Benjamin Petersoncae58482008-10-10 20:38:49 +0000547Replacing shell pipeline
548^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000549
550::
551
552 output=`dmesg | grep hda`
553 ==>
554 p1 = Popen(["dmesg"], stdout=PIPE)
555 p2 = Popen(["grep", "hda"], stdin=p1.stdout, stdout=PIPE)
Gregory P. Smithe3e967f2011-02-05 21:49:56 +0000556 p1.stdout.close() # Allow p1 to receive a SIGPIPE if p2 exits.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000557 output = p2.communicate()[0]
558
Gregory P. Smithe3e967f2011-02-05 21:49:56 +0000559The p1.stdout.close() call after starting the p2 is important in order for p1
560to receive a SIGPIPE if p2 exits before p1.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000561
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000562Replacing :func:`os.system`
563^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000564
565::
566
567 sts = os.system("mycmd" + " myarg")
568 ==>
569 p = Popen("mycmd" + " myarg", shell=True)
Georg Brandl2e1285b2009-07-16 07:38:35 +0000570 sts = os.waitpid(p.pid, 0)[1]
Georg Brandl8ec7f652007-08-15 14:28:01 +0000571
572Notes:
573
574* Calling the program through the shell is usually not required.
575
576* It's easier to look at the :attr:`returncode` attribute than the exit status.
577
578A more realistic example would look like this::
579
580 try:
581 retcode = call("mycmd" + " myarg", shell=True)
582 if retcode < 0:
583 print >>sys.stderr, "Child was terminated by signal", -retcode
584 else:
585 print >>sys.stderr, "Child returned", retcode
586 except OSError, e:
587 print >>sys.stderr, "Execution failed:", e
588
589
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000590Replacing the :func:`os.spawn <os.spawnl>` family
591^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000592
593P_NOWAIT example::
594
595 pid = os.spawnlp(os.P_NOWAIT, "/bin/mycmd", "mycmd", "myarg")
596 ==>
597 pid = Popen(["/bin/mycmd", "myarg"]).pid
598
599P_WAIT example::
600
601 retcode = os.spawnlp(os.P_WAIT, "/bin/mycmd", "mycmd", "myarg")
602 ==>
603 retcode = call(["/bin/mycmd", "myarg"])
604
605Vector example::
606
607 os.spawnvp(os.P_NOWAIT, path, args)
608 ==>
609 Popen([path] + args[1:])
610
611Environment example::
612
613 os.spawnlpe(os.P_NOWAIT, "/bin/mycmd", "mycmd", "myarg", env)
614 ==>
615 Popen(["/bin/mycmd", "myarg"], env={"PATH": "/usr/bin"})
616
617
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000618Replacing :func:`os.popen`, :func:`os.popen2`, :func:`os.popen3`
619^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000620
621::
622
Philip Jenvey8b902042009-09-29 19:10:15 +0000623 pipe = os.popen("cmd", 'r', bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000624 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000625 pipe = Popen("cmd", shell=True, bufsize=bufsize, stdout=PIPE).stdout
Georg Brandl8ec7f652007-08-15 14:28:01 +0000626
627::
628
Philip Jenvey8b902042009-09-29 19:10:15 +0000629 pipe = os.popen("cmd", 'w', bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000630 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000631 pipe = Popen("cmd", shell=True, bufsize=bufsize, stdin=PIPE).stdin
Georg Brandl8ec7f652007-08-15 14:28:01 +0000632
633::
634
Philip Jenvey8b902042009-09-29 19:10:15 +0000635 (child_stdin, child_stdout) = os.popen2("cmd", mode, bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000636 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000637 p = Popen("cmd", shell=True, bufsize=bufsize,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000638 stdin=PIPE, stdout=PIPE, close_fds=True)
639 (child_stdin, child_stdout) = (p.stdin, p.stdout)
640
641::
642
643 (child_stdin,
644 child_stdout,
Philip Jenvey8b902042009-09-29 19:10:15 +0000645 child_stderr) = os.popen3("cmd", mode, bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000646 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000647 p = Popen("cmd", shell=True, bufsize=bufsize,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000648 stdin=PIPE, stdout=PIPE, stderr=PIPE, close_fds=True)
649 (child_stdin,
650 child_stdout,
651 child_stderr) = (p.stdin, p.stdout, p.stderr)
652
653::
654
Philip Jenvey8b902042009-09-29 19:10:15 +0000655 (child_stdin, child_stdout_and_stderr) = os.popen4("cmd", mode,
656 bufsize)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000657 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000658 p = Popen("cmd", shell=True, bufsize=bufsize,
Georg Brandl8ec7f652007-08-15 14:28:01 +0000659 stdin=PIPE, stdout=PIPE, stderr=STDOUT, close_fds=True)
660 (child_stdin, child_stdout_and_stderr) = (p.stdin, p.stdout)
661
Philip Jenvey8b902042009-09-29 19:10:15 +0000662On Unix, os.popen2, os.popen3 and os.popen4 also accept a sequence as
663the command to execute, in which case arguments will be passed
664directly to the program without shell intervention. This usage can be
665replaced as follows::
666
667 (child_stdin, child_stdout) = os.popen2(["/bin/ls", "-l"], mode,
668 bufsize)
669 ==>
670 p = Popen(["/bin/ls", "-l"], bufsize=bufsize, stdin=PIPE, stdout=PIPE)
671 (child_stdin, child_stdout) = (p.stdin, p.stdout)
672
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000673Return code handling translates as follows::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000674
Philip Jenvey8b902042009-09-29 19:10:15 +0000675 pipe = os.popen("cmd", 'w')
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000676 ...
677 rc = pipe.close()
Stefan Kraha253dc12010-07-14 10:06:07 +0000678 if rc is not None and rc >> 8:
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000679 print "There were some errors"
680 ==>
Philip Jenvey8b902042009-09-29 19:10:15 +0000681 process = Popen("cmd", 'w', shell=True, stdin=PIPE)
R. David Murrayccb9d4b2009-06-09 00:44:22 +0000682 ...
683 process.stdin.close()
684 if process.wait() != 0:
685 print "There were some errors"
686
687
688Replacing functions from the :mod:`popen2` module
689^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000690
Georg Brandl8ec7f652007-08-15 14:28:01 +0000691::
692
693 (child_stdout, child_stdin) = popen2.popen2("somestring", bufsize, mode)
694 ==>
695 p = Popen(["somestring"], shell=True, bufsize=bufsize,
696 stdin=PIPE, stdout=PIPE, close_fds=True)
697 (child_stdout, child_stdin) = (p.stdout, p.stdin)
698
Philip Jenvey8b902042009-09-29 19:10:15 +0000699On Unix, popen2 also accepts a sequence as the command to execute, in
700which case arguments will be passed directly to the program without
701shell intervention. This usage can be replaced as follows::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000702
Philip Jenvey8b902042009-09-29 19:10:15 +0000703 (child_stdout, child_stdin) = popen2.popen2(["mycmd", "myarg"], bufsize,
704 mode)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000705 ==>
706 p = Popen(["mycmd", "myarg"], bufsize=bufsize,
707 stdin=PIPE, stdout=PIPE, close_fds=True)
708 (child_stdout, child_stdin) = (p.stdout, p.stdin)
709
Georg Brandlf5d5a662008-12-06 11:57:12 +0000710:class:`popen2.Popen3` and :class:`popen2.Popen4` basically work as
711:class:`subprocess.Popen`, except that:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000712
Georg Brandlf5d5a662008-12-06 11:57:12 +0000713* :class:`Popen` raises an exception if the execution fails.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000714
715* the *capturestderr* argument is replaced with the *stderr* argument.
716
Georg Brandlf5d5a662008-12-06 11:57:12 +0000717* ``stdin=PIPE`` and ``stdout=PIPE`` must be specified.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000718
719* popen2 closes all file descriptors by default, but you have to specify
Georg Brandlf5d5a662008-12-06 11:57:12 +0000720 ``close_fds=True`` with :class:`Popen`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000721
Eli Bendersky929e2762011-04-15 07:35:06 +0300722Notes
723-----
724
725.. _converting-argument-sequence:
726
727Converting an argument sequence to a string on Windows
728^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
729
730On Windows, an *args* sequence is converted to a string that can be parsed
731using the following rules (which correspond to the rules used by the MS C
732runtime):
733
7341. Arguments are delimited by white space, which is either a
735 space or a tab.
736
7372. A string surrounded by double quotation marks is
738 interpreted as a single argument, regardless of white space
739 contained within. A quoted string can be embedded in an
740 argument.
741
7423. A double quotation mark preceded by a backslash is
743 interpreted as a literal double quotation mark.
744
7454. Backslashes are interpreted literally, unless they
746 immediately precede a double quotation mark.
747
7485. If backslashes immediately precede a double quotation mark,
749 every pair of backslashes is interpreted as a literal
750 backslash. If the number of backslashes is odd, the last
751 backslash escapes the next double quotation mark as
752 described in rule 3.
753