blob: ee3c35c2a9987cf4ba15b440cdf0b837fc3539f0 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
pxinwrf2d7ac72019-05-21 18:46:37 +080035* On VxWorks, os.fork, os.execv and os.spawn*p* are not supported.
Benjamin Petersonf650e462010-05-06 23:03:05 +000036
Georg Brandlc575c902008-09-13 17:46:05 +000037.. note::
38
Christian Heimesa62da1d2008-01-12 19:39:10 +000039 All functions in this module raise :exc:`OSError` in the case of invalid or
40 inaccessible file names and paths, or other arguments that have the correct
41 type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000042
Georg Brandl116aa622007-08-15 14:28:22 +000043.. exception:: error
44
Christian Heimesa62da1d2008-01-12 19:39:10 +000045 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000046
47
48.. data:: name
49
Benjamin Peterson1baf4652009-12-31 03:11:23 +000050 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070051 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070052 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000053
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020054 .. seealso::
55 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
56 system-dependent version information.
57
58 The :mod:`platform` module provides detailed checks for the
59 system's identity.
60
Georg Brandl116aa622007-08-15 14:28:22 +000061
Martin v. Löwis011e8422009-05-05 04:43:17 +000062.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020063.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000064
65File Names, Command Line Arguments, and Environment Variables
66-------------------------------------------------------------
67
Georg Brandl67b21b72010-08-17 15:07:14 +000068In Python, file names, command line arguments, and environment variables are
69represented using the string type. On some systems, decoding these strings to
70and from bytes is necessary before passing them to the operating system. Python
71uses the file system encoding to perform this conversion (see
72:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000073
74.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000075 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020076 case, Python uses the :ref:`surrogateescape encoding error handler
77 <surrogateescape>`, which means that undecodable bytes are replaced by a
78 Unicode character U+DCxx on decoding, and these are again translated to the
79 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000080
81
Georg Brandl67b21b72010-08-17 15:07:14 +000082The file system encoding must guarantee to successfully decode all bytes
83below 128. If the file system encoding fails to provide this guarantee, API
84functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000085
86
Georg Brandl116aa622007-08-15 14:28:22 +000087.. _os-procinfo:
88
89Process Parameters
90------------------
91
92These functions and data items provide information and operate on the current
93process and user.
94
95
Georg Brandl8ccadaa2012-06-24 12:50:06 +020096.. function:: ctermid()
97
98 Return the filename corresponding to the controlling terminal of the process.
99
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400100 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200101
102
Georg Brandl116aa622007-08-15 14:28:22 +0000103.. data:: environ
104
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700105 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000106 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
107 and is equivalent to ``getenv("HOME")`` in C.
108
109 This mapping is captured the first time the :mod:`os` module is imported,
110 typically during Python startup as part of processing :file:`site.py`. Changes
111 to the environment made after this time are not reflected in ``os.environ``,
112 except for changes made by modifying ``os.environ`` directly.
113
114 If the platform supports the :func:`putenv` function, this mapping may be used
115 to modify the environment as well as query the environment. :func:`putenv` will
116 be called automatically when the mapping is modified.
117
Victor Stinner84ae1182010-05-06 22:05:07 +0000118 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
119 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
120 to use a different encoding.
121
Georg Brandl116aa622007-08-15 14:28:22 +0000122 .. note::
123
124 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
125 to modify ``os.environ``.
126
127 .. note::
128
Georg Brandlc575c902008-09-13 17:46:05 +0000129 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
130 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000131 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000132
133 If :func:`putenv` is not provided, a modified copy of this mapping may be
134 passed to the appropriate process-creation functions to cause child processes
135 to use a modified environment.
136
Georg Brandl9afde1c2007-11-01 20:32:30 +0000137 If the platform supports the :func:`unsetenv` function, you can delete items in
Georg Brandl116aa622007-08-15 14:28:22 +0000138 this mapping to unset environment variables. :func:`unsetenv` will be called
Georg Brandl9afde1c2007-11-01 20:32:30 +0000139 automatically when an item is deleted from ``os.environ``, and when
140 one of the :meth:`pop` or :meth:`clear` methods is called.
141
Georg Brandl116aa622007-08-15 14:28:22 +0000142
Victor Stinner84ae1182010-05-06 22:05:07 +0000143.. data:: environb
144
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700145 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000146 environment as byte strings. :data:`environ` and :data:`environb` are
147 synchronized (modify :data:`environb` updates :data:`environ`, and vice
148 versa).
149
Victor Stinnerb745a742010-05-18 17:17:23 +0000150 :data:`environb` is only available if :data:`supports_bytes_environ` is
151 True.
Victor Stinner84ae1182010-05-06 22:05:07 +0000152
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000153 .. versionadded:: 3.2
154
Victor Stinner84ae1182010-05-06 22:05:07 +0000155
Georg Brandl116aa622007-08-15 14:28:22 +0000156.. function:: chdir(path)
157 fchdir(fd)
158 getcwd()
159 :noindex:
160
161 These functions are described in :ref:`os-file-dir`.
162
163
Victor Stinnere8d51452010-08-19 01:05:19 +0000164.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000165
Brett Cannonc28592b2016-06-24 12:21:47 -0700166 Encode :term:`path-like <path-like object>` *filename* to the filesystem
167 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
168 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000169
Antoine Pitroua305ca72010-09-25 22:12:00 +0000170 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000171
172 .. versionadded:: 3.2
173
Brett Cannonb08388d2016-06-09 15:58:06 -0700174 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700175 Support added to accept objects implementing the :class:`os.PathLike`
176 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700177
Victor Stinnere8d51452010-08-19 01:05:19 +0000178
179.. function:: fsdecode(filename)
180
Brett Cannonc28592b2016-06-24 12:21:47 -0700181 Decode the :term:`path-like <path-like object>` *filename* from the
182 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
183 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000184
185 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000186
187 .. versionadded:: 3.2
188
Brett Cannonb08388d2016-06-09 15:58:06 -0700189 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700190 Support added to accept objects implementing the :class:`os.PathLike`
191 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700192
Victor Stinner449c4662010-05-08 11:10:09 +0000193
Ethan Furmancdc08792016-06-02 15:06:09 -0700194.. function:: fspath(path)
195
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700196 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700197
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700198 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
199 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
200 returned as long as it is a :class:`str` or :class:`bytes` object.
201 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700202
Brett Cannonb08388d2016-06-09 15:58:06 -0700203 .. versionadded:: 3.6
204
205
206.. class:: PathLike
207
208 An :term:`abstract base class` for objects representing a file system path,
209 e.g. :class:`pathlib.PurePath`.
210
Berker Peksagb18ffb42016-06-10 08:43:54 +0300211 .. versionadded:: 3.6
212
Brett Cannonb08388d2016-06-09 15:58:06 -0700213 .. abstractmethod:: __fspath__()
214
215 Return the file system path representation of the object.
216
217 The method should only return a :class:`str` or :class:`bytes` object,
218 with the preference being for :class:`str`.
219
Ethan Furmancdc08792016-06-02 15:06:09 -0700220
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200221.. function:: getenv(key, default=None)
222
223 Return the value of the environment variable *key* if it exists, or
224 *default* if it doesn't. *key*, *default* and the result are str.
225
226 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
227 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
228 would like to use a different encoding.
229
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400230 .. availability:: most flavors of Unix, Windows.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200231
232
233.. function:: getenvb(key, default=None)
234
235 Return the value of the environment variable *key* if it exists, or
236 *default* if it doesn't. *key*, *default* and the result are bytes.
237
Berker Peksag996e5f92016-09-26 22:44:07 +0300238 :func:`getenvb` is only available if :data:`supports_bytes_environ`
239 is True.
240
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400241 .. availability:: most flavors of Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200242
243 .. versionadded:: 3.2
244
245
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000246.. function:: get_exec_path(env=None)
247
248 Returns the list of directories that will be searched for a named
249 executable, similar to a shell, when launching a process.
250 *env*, when specified, should be an environment variable dictionary
251 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300252 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000253
254 .. versionadded:: 3.2
255
256
Georg Brandl116aa622007-08-15 14:28:22 +0000257.. function:: getegid()
258
259 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000260 "set id" bit on the file being executed in the current process.
261
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400262 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000263
264
265.. function:: geteuid()
266
267 .. index:: single: user; effective id
268
Benjamin Petersonf650e462010-05-06 23:03:05 +0000269 Return the current process's effective user id.
270
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400271 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000272
273
274.. function:: getgid()
275
276 .. index:: single: process; group
277
Benjamin Petersonf650e462010-05-06 23:03:05 +0000278 Return the real group id of the current process.
279
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400280 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000281
282
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200283.. function:: getgrouplist(user, group)
284
285 Return list of group ids that *user* belongs to. If *group* is not in the
286 list, it is included; typically, *group* is specified as the group ID
287 field from the password record for *user*.
288
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400289 .. availability:: Unix.
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200290
291 .. versionadded:: 3.3
292
293
Georg Brandl116aa622007-08-15 14:28:22 +0000294.. function:: getgroups()
295
296 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000297
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400298 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000299
Larry Hastings3732ed22014-03-15 21:13:56 -0700300 .. note::
301
302 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700303 other Unix platforms. If the Python interpreter was built with a
304 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
305 the list of effective group ids associated with the current user process;
306 this list is limited to a system-defined number of entries, typically 16,
307 and may be modified by calls to :func:`setgroups` if suitably privileged.
308 If built with a deployment target greater than :const:`10.5`,
309 :func:`getgroups` returns the current group access list for the user
310 associated with the effective user id of the process; the group access
311 list may change over the lifetime of the process, it is not affected by
312 calls to :func:`setgroups`, and its length is not limited to 16. The
313 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
314 obtained with :func:`sysconfig.get_config_var`.
315
Georg Brandl116aa622007-08-15 14:28:22 +0000316
317.. function:: getlogin()
318
319 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500320 process. For most purposes, it is more useful to use
321 :func:`getpass.getuser` since the latter checks the environment variables
322 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
323 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
324 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000325
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400326 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000327
328
329.. function:: getpgid(pid)
330
331 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000332 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000333
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400334 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
336.. function:: getpgrp()
337
338 .. index:: single: process; group
339
Benjamin Petersonf650e462010-05-06 23:03:05 +0000340 Return the id of the current process group.
341
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400342 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000343
344
345.. function:: getpid()
346
347 .. index:: single: process; id
348
Benjamin Petersonf650e462010-05-06 23:03:05 +0000349 Return the current process id.
350
Georg Brandl116aa622007-08-15 14:28:22 +0000351
352.. function:: getppid()
353
354 .. index:: single: process; id of parent
355
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000356 Return the parent's process id. When the parent process has exited, on Unix
357 the id returned is the one of the init process (1), on Windows it is still
358 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000359
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400360 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000361
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000362 .. versionchanged:: 3.2
363 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000364
Georg Brandl8a5555f2012-06-24 13:29:09 +0200365
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000366.. function:: getpriority(which, who)
367
368 .. index:: single: process; scheduling priority
369
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200370 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000371 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
372 is interpreted relative to *which* (a process identifier for
373 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200374 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000375 (respectively) the calling process, the process group of the calling process,
376 or the real user ID of the calling process.
377
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400378 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000379
380 .. versionadded:: 3.3
381
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200382
383.. data:: PRIO_PROCESS
384 PRIO_PGRP
385 PRIO_USER
386
387 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
388
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400389 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200390
391 .. versionadded:: 3.3
392
393
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000394.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000395
396 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000397 real, effective, and saved user ids.
398
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400399 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000400
Georg Brandl1b83a452009-11-28 11:12:26 +0000401 .. versionadded:: 3.2
402
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000403
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000404.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000405
406 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000407 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000408
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400409 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000410
Georg Brandl1b83a452009-11-28 11:12:26 +0000411 .. versionadded:: 3.2
412
Georg Brandl116aa622007-08-15 14:28:22 +0000413
414.. function:: getuid()
415
416 .. index:: single: user; id
417
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700418 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000419
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400420 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000421
422
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200423.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000424
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200425 Call the system initgroups() to initialize the group access list with all of
426 the groups of which the specified username is a member, plus the specified
427 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000428
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400429 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000430
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200431 .. versionadded:: 3.2
432
Georg Brandl116aa622007-08-15 14:28:22 +0000433
Georg Brandl18244152009-09-02 20:34:52 +0000434.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000435
436 .. index:: single: environment variables; setting
437
Georg Brandl18244152009-09-02 20:34:52 +0000438 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000439 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000440 :func:`popen` or :func:`fork` and :func:`execv`.
441
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400442 .. availability:: most flavors of Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000443
444 .. note::
445
Georg Brandlc575c902008-09-13 17:46:05 +0000446 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
447 cause memory leaks. Refer to the system documentation for putenv.
Georg Brandl116aa622007-08-15 14:28:22 +0000448
449 When :func:`putenv` is supported, assignments to items in ``os.environ`` are
450 automatically translated into corresponding calls to :func:`putenv`; however,
451 calls to :func:`putenv` don't update ``os.environ``, so it is actually
452 preferable to assign to items of ``os.environ``.
453
454
455.. function:: setegid(egid)
456
Benjamin Petersonf650e462010-05-06 23:03:05 +0000457 Set the current process's effective group id.
458
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400459 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000460
461
462.. function:: seteuid(euid)
463
Benjamin Petersonf650e462010-05-06 23:03:05 +0000464 Set the current process's effective user id.
465
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400466 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000467
468
469.. function:: setgid(gid)
470
Benjamin Petersonf650e462010-05-06 23:03:05 +0000471 Set the current process' group id.
472
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400473 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000474
475
476.. function:: setgroups(groups)
477
478 Set the list of supplemental group ids associated with the current process to
479 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000480 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000481
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400482 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000483
Ned Deily2e209682012-04-30 11:14:02 -0700484 .. note:: On Mac OS X, the length of *groups* may not exceed the
485 system-defined maximum number of effective group ids, typically 16.
486 See the documentation for :func:`getgroups` for cases where it may not
487 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000488
489.. function:: setpgrp()
490
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300491 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000492 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000493
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400494 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000495
496
497.. function:: setpgid(pid, pgrp)
498
Georg Brandl60203b42010-10-06 10:11:56 +0000499 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000500 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000501 for the semantics.
502
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400503 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000504
505
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000506.. function:: setpriority(which, who, priority)
507
508 .. index:: single: process; scheduling priority
509
510 Set program scheduling priority. The value *which* is one of
511 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
512 is interpreted relative to *which* (a process identifier for
513 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
514 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
515 (respectively) the calling process, the process group of the calling process,
516 or the real user ID of the calling process.
517 *priority* is a value in the range -20 to 19. The default priority is 0;
518 lower priorities cause more favorable scheduling.
519
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400520 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000521
522 .. versionadded:: 3.3
523
524
Georg Brandl116aa622007-08-15 14:28:22 +0000525.. function:: setregid(rgid, egid)
526
Benjamin Petersonf650e462010-05-06 23:03:05 +0000527 Set the current process's real and effective group ids.
528
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400529 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000530
Georg Brandl1b83a452009-11-28 11:12:26 +0000531
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000532.. function:: setresgid(rgid, egid, sgid)
533
534 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000535
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400536 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000537
Georg Brandl1b83a452009-11-28 11:12:26 +0000538 .. versionadded:: 3.2
539
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000540
541.. function:: setresuid(ruid, euid, suid)
542
543 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000544
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400545 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000546
Georg Brandl1b83a452009-11-28 11:12:26 +0000547 .. versionadded:: 3.2
548
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000549
550.. function:: setreuid(ruid, euid)
551
Benjamin Petersonf650e462010-05-06 23:03:05 +0000552 Set the current process's real and effective user ids.
553
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400554 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000555
Georg Brandl116aa622007-08-15 14:28:22 +0000556
557.. function:: getsid(pid)
558
Georg Brandl60203b42010-10-06 10:11:56 +0000559 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000560
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400561 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000562
Georg Brandl116aa622007-08-15 14:28:22 +0000563
564.. function:: setsid()
565
Georg Brandl60203b42010-10-06 10:11:56 +0000566 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000567
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400568 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000569
570
571.. function:: setuid(uid)
572
573 .. index:: single: user; id, setting
574
Benjamin Petersonf650e462010-05-06 23:03:05 +0000575 Set the current process's user id.
576
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400577 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000578
Georg Brandl116aa622007-08-15 14:28:22 +0000579
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000580.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000581.. function:: strerror(code)
582
583 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000584 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000585 error number, :exc:`ValueError` is raised.
586
Georg Brandl116aa622007-08-15 14:28:22 +0000587
Victor Stinnerb745a742010-05-18 17:17:23 +0000588.. data:: supports_bytes_environ
589
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200590 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000591 Windows).
592
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000593 .. versionadded:: 3.2
594
Victor Stinnerb745a742010-05-18 17:17:23 +0000595
Georg Brandl116aa622007-08-15 14:28:22 +0000596.. function:: umask(mask)
597
Benjamin Petersonf650e462010-05-06 23:03:05 +0000598 Set the current numeric umask and return the previous umask.
599
Georg Brandl116aa622007-08-15 14:28:22 +0000600
601.. function:: uname()
602
603 .. index::
604 single: gethostname() (in module socket)
605 single: gethostbyaddr() (in module socket)
606
Larry Hastings605a62d2012-06-24 04:33:36 -0700607 Returns information identifying the current operating system.
608 The return value is an object with five attributes:
609
610 * :attr:`sysname` - operating system name
611 * :attr:`nodename` - name of machine on network (implementation-defined)
612 * :attr:`release` - operating system release
613 * :attr:`version` - operating system version
614 * :attr:`machine` - hardware identifier
615
616 For backwards compatibility, this object is also iterable, behaving
617 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
618 :attr:`release`, :attr:`version`, and :attr:`machine`
619 in that order.
620
621 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000622 leading component; a better way to get the hostname is
623 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000624 ``socket.gethostbyaddr(socket.gethostname())``.
625
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400626 .. availability:: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000627
Larry Hastings605a62d2012-06-24 04:33:36 -0700628 .. versionchanged:: 3.3
629 Return type changed from a tuple to a tuple-like object
630 with named attributes.
631
Georg Brandl116aa622007-08-15 14:28:22 +0000632
Georg Brandl18244152009-09-02 20:34:52 +0000633.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000634
635 .. index:: single: environment variables; deleting
636
Georg Brandl18244152009-09-02 20:34:52 +0000637 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000638 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000639 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000640
641 When :func:`unsetenv` is supported, deletion of items in ``os.environ`` is
642 automatically translated into a corresponding call to :func:`unsetenv`; however,
643 calls to :func:`unsetenv` don't update ``os.environ``, so it is actually
644 preferable to delete items of ``os.environ``.
645
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400646 .. availability:: most flavors of Unix, Windows.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000647
Georg Brandl116aa622007-08-15 14:28:22 +0000648
649.. _os-newstreams:
650
651File Object Creation
652--------------------
653
Steve Dowerb82e17e2019-05-23 08:45:22 -0700654These functions create new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200655:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300658.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000659
Georg Brandlb2462e22012-06-24 13:24:56 +0200660 Return an open file object connected to the file descriptor *fd*. This is an
661 alias of the :func:`open` built-in function and accepts the same arguments.
662 The only difference is that the first argument of :func:`fdopen` must always
663 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000664
Georg Brandl116aa622007-08-15 14:28:22 +0000665
Georg Brandl116aa622007-08-15 14:28:22 +0000666.. _os-fd-ops:
667
668File Descriptor Operations
669--------------------------
670
671These functions operate on I/O streams referenced using file descriptors.
672
673File descriptors are small integers corresponding to a file that has been opened
674by the current process. For example, standard input is usually file descriptor
6750, standard output is 1, and standard error is 2. Further files opened by a
676process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
677is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
678by file descriptors.
679
Serhiy Storchakadab83542013-10-13 20:12:43 +0300680The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000681associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000682descriptor directly will bypass the file object methods, ignoring aspects such
683as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000684
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000685
Georg Brandl116aa622007-08-15 14:28:22 +0000686.. function:: close(fd)
687
Benjamin Petersonf650e462010-05-06 23:03:05 +0000688 Close file descriptor *fd*.
689
Georg Brandl116aa622007-08-15 14:28:22 +0000690 .. note::
691
692 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000693 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000694 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300695 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000696
697
Christian Heimesfdab48e2008-01-20 09:06:41 +0000698.. function:: closerange(fd_low, fd_high)
699
700 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200701 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000702
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000703 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000704 try:
705 os.close(fd)
706 except OSError:
707 pass
708
Christian Heimesfdab48e2008-01-20 09:06:41 +0000709
Pablo Galindoaac4d032019-05-31 19:39:47 +0100710.. function:: copy_file_range(src, dst, count, offset_src=None, offset_dst=None)
711
712 Copy *count* bytes from file descriptor *src*, starting from offset
713 *offset_src*, to file descriptor *dst*, starting from offset *offset_dst*.
714 If *offset_src* is None, then *src* is read from the current position;
715 respectively for *offset_dst*. The files pointed by *src* and *dst*
716 must reside in the same filesystem, otherwise an :exc:`OSError` is
717 raised with :attr:`~OSError.errno` set to :data:`errno.EXDEV`.
718
719 This copy is done without the additional cost of transferring data
720 from the kernel to user space and then back into the kernel. Additionally,
721 some filesystems could implement extra optimizations. The copy is done as if
722 both files are opened as binary.
723
724 The return value is the amount of bytes copied. This could be less than the
725 amount requested.
726
727 .. availability:: Linux kernel >= 4.5 or glibc >= 2.27.
728
729 .. versionadded:: 3.8
730
731
Georg Brandl81f11302007-12-21 08:45:42 +0000732.. function:: device_encoding(fd)
733
734 Return a string describing the encoding of the device associated with *fd*
735 if it is connected to a terminal; else return :const:`None`.
736
737
Georg Brandl116aa622007-08-15 14:28:22 +0000738.. function:: dup(fd)
739
Victor Stinnerdaf45552013-08-28 00:53:59 +0200740 Return a duplicate of file descriptor *fd*. The new file descriptor is
741 :ref:`non-inheritable <fd_inheritance>`.
742
743 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
744 2: stderr), the new file descriptor is :ref:`inheritable
745 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000746
Victor Stinnerdaf45552013-08-28 00:53:59 +0200747 .. versionchanged:: 3.4
748 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000749
Victor Stinnerdaf45552013-08-28 00:53:59 +0200750
751.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000752
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800753 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
754 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
755 <fd_inheritance>` by default or non-inheritable if *inheritable*
756 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000757
Victor Stinnerdaf45552013-08-28 00:53:59 +0200758 .. versionchanged:: 3.4
759 Add the optional *inheritable* parameter.
760
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800761 .. versionchanged:: 3.7
762 Return *fd2* on success. Previously, ``None`` was always returned.
763
Georg Brandl116aa622007-08-15 14:28:22 +0000764
Christian Heimes4e30a842007-11-30 22:12:06 +0000765.. function:: fchmod(fd, mode)
766
Georg Brandlb9df00c2012-06-24 12:38:14 +0200767 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200768 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200769 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000770
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400771 .. availability:: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000772
773
774.. function:: fchown(fd, uid, gid)
775
776 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200777 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200778 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200779 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000780
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400781 .. availability:: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000782
783
Georg Brandl116aa622007-08-15 14:28:22 +0000784.. function:: fdatasync(fd)
785
786 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000787 metadata.
788
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400789 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000790
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000791 .. note::
792 This function is not available on MacOS.
793
Georg Brandl116aa622007-08-15 14:28:22 +0000794
795.. function:: fpathconf(fd, name)
796
797 Return system configuration information relevant to an open file. *name*
798 specifies the configuration value to retrieve; it may be a string which is the
799 name of a defined system value; these names are specified in a number of
800 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
801 additional names as well. The names known to the host operating system are
802 given in the ``pathconf_names`` dictionary. For configuration variables not
803 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000804
805 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
806 specific value for *name* is not supported by the host system, even if it is
807 included in ``pathconf_names``, an :exc:`OSError` is raised with
808 :const:`errno.EINVAL` for the error number.
809
Georg Brandl4d399a42012-06-25 07:40:32 +0200810 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200811
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400812 .. availability:: Unix.
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700813
Georg Brandl116aa622007-08-15 14:28:22 +0000814
Victor Stinner4195b5c2012-02-08 23:03:19 +0100815.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000816
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200817 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
818 object.
819
820 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
821
822 .. seealso::
823
Berker Peksag2034caa2015-04-27 13:53:28 +0300824 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000825
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200826
Georg Brandl116aa622007-08-15 14:28:22 +0000827.. function:: fstatvfs(fd)
828
Georg Brandlb9df00c2012-06-24 12:38:14 +0200829 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200830 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200831 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000832
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400833 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000834
835
836.. function:: fsync(fd)
837
838 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000839 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000840
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000841 If you're starting with a buffered Python :term:`file object` *f*, first do
842 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
843 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000844
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400845 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000846
847
848.. function:: ftruncate(fd, length)
849
Georg Brandl306336b2012-06-24 12:55:33 +0200850 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200851 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200852 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000853
Steve Dower44f91c32019-06-27 10:47:59 -0700854 .. audit-event:: os.truncate fd,length os.ftruncate
Steve Dowerb82e17e2019-05-23 08:45:22 -0700855
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400856 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000857
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700858 .. versionchanged:: 3.5
859 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000860
Steve Dowerb82e17e2019-05-23 08:45:22 -0700861
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200862.. function:: get_blocking(fd)
863
864 Get the blocking mode of the file descriptor: ``False`` if the
865 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
866
867 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
868
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400869 .. availability:: Unix.
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200870
871 .. versionadded:: 3.5
872
Steve Dowerb82e17e2019-05-23 08:45:22 -0700873
Georg Brandl116aa622007-08-15 14:28:22 +0000874.. function:: isatty(fd)
875
876 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000877 tty(-like) device, else ``False``.
878
Georg Brandl116aa622007-08-15 14:28:22 +0000879
Ross Lagerwall7807c352011-03-17 20:20:30 +0200880.. function:: lockf(fd, cmd, len)
881
882 Apply, test or remove a POSIX lock on an open file descriptor.
883 *fd* is an open file descriptor.
884 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
885 :data:`F_ULOCK` or :data:`F_TEST`.
886 *len* specifies the section of the file to lock.
887
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400888 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +0200889
890 .. versionadded:: 3.3
891
892
893.. data:: F_LOCK
894 F_TLOCK
895 F_ULOCK
896 F_TEST
897
898 Flags that specify what action :func:`lockf` will take.
899
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400900 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +0200901
902 .. versionadded:: 3.3
903
Georg Brandlf62445a2012-06-24 13:31:20 +0200904
Georg Brandl116aa622007-08-15 14:28:22 +0000905.. function:: lseek(fd, pos, how)
906
Christian Heimesfaf2f632008-01-06 16:59:19 +0000907 Set the current position of file descriptor *fd* to position *pos*, modified
908 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
909 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300910 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100911 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000912
Georg Brandl116aa622007-08-15 14:28:22 +0000913
Georg Brandl8569e582010-05-19 20:57:08 +0000914.. data:: SEEK_SET
915 SEEK_CUR
916 SEEK_END
917
918 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200919 respectively.
920
Jesus Cea94363612012-06-22 18:32:07 +0200921 .. versionadded:: 3.3
922 Some operating systems could support additional values, like
923 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
924
Georg Brandl8569e582010-05-19 20:57:08 +0000925
Martin Panterbf19d162015-09-09 01:01:13 +0000926.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000927
Martin Panterbf19d162015-09-09 01:01:13 +0000928 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700929 its mode according to *mode*. When computing *mode*, the current umask value
930 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200931 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000932
933 For a description of the flag and mode values, see the C run-time documentation;
934 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400935 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000936 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000937
Georg Brandl50c40002012-06-24 11:45:20 +0200938 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400939 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700940
Steve Dower44f91c32019-06-27 10:47:59 -0700941 .. audit-event:: open path,mode,flags os.open
Steve Dowerb82e17e2019-05-23 08:45:22 -0700942
Victor Stinnerdaf45552013-08-28 00:53:59 +0200943 .. versionchanged:: 3.4
944 The new file descriptor is now non-inheritable.
945
Georg Brandl116aa622007-08-15 14:28:22 +0000946 .. note::
947
Georg Brandl502d9a52009-07-26 15:02:41 +0000948 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000949 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000950 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000951 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000952
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000953 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700954 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000955
Victor Stinnera766ddf2015-03-26 23:50:57 +0100956 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200957 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100958 exception, the function now retries the system call instead of raising an
959 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
960
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700961 .. versionchanged:: 3.6
962 Accepts a :term:`path-like object`.
963
Andrew Kuchling4921a082013-06-21 11:49:57 -0400964The following constants are options for the *flags* parameter to the
965:func:`~os.open` function. They can be combined using the bitwise OR operator
966``|``. Some of them are not available on all platforms. For descriptions of
967their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100968or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400969
970
971.. data:: O_RDONLY
972 O_WRONLY
973 O_RDWR
974 O_APPEND
975 O_CREAT
976 O_EXCL
977 O_TRUNC
978
Vinay Sajipe4946e72016-09-11 15:15:59 +0100979 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400980
981
982.. data:: O_DSYNC
983 O_RSYNC
984 O_SYNC
985 O_NDELAY
986 O_NONBLOCK
987 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -0400988 O_CLOEXEC
989
Vinay Sajipe4946e72016-09-11 15:15:59 +0100990 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400991
992 .. versionchanged:: 3.3
993 Add :data:`O_CLOEXEC` constant.
994
995.. data:: O_BINARY
996 O_NOINHERIT
997 O_SHORT_LIVED
998 O_TEMPORARY
999 O_RANDOM
1000 O_SEQUENTIAL
1001 O_TEXT
1002
Vinay Sajipe4946e72016-09-11 15:15:59 +01001003 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -04001004
1005
1006.. data:: O_ASYNC
1007 O_DIRECT
1008 O_DIRECTORY
1009 O_NOFOLLOW
1010 O_NOATIME
1011 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +02001012 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +01001013 O_SHLOCK
1014 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -04001015
Vinay Sajipe4946e72016-09-11 15:15:59 +01001016 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -04001017 the C library.
1018
Christian Heimesd88f7352013-08-16 14:37:50 +02001019 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001020 Add :data:`O_PATH` on systems that support it.
1021 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1022 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001023
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001024
Georg Brandl116aa622007-08-15 14:28:22 +00001025.. function:: openpty()
1026
1027 .. index:: module: pty
1028
Victor Stinnerdaf45552013-08-28 00:53:59 +02001029 Open a new pseudo-terminal pair. Return a pair of file descriptors
1030 ``(master, slave)`` for the pty and the tty, respectively. The new file
1031 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1032 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001033
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001034 .. availability:: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001035
Victor Stinnerdaf45552013-08-28 00:53:59 +02001036 .. versionchanged:: 3.4
1037 The new file descriptors are now non-inheritable.
1038
Georg Brandl116aa622007-08-15 14:28:22 +00001039
1040.. function:: pipe()
1041
Victor Stinnerdaf45552013-08-28 00:53:59 +02001042 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001043 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001044 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001045
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001046 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001047
Victor Stinnerdaf45552013-08-28 00:53:59 +02001048 .. versionchanged:: 3.4
1049 The new file descriptors are now non-inheritable.
1050
Georg Brandl116aa622007-08-15 14:28:22 +00001051
Charles-François Natali368f34b2011-06-06 19:49:47 +02001052.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001053
1054 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001055 *flags* can be constructed by ORing together one or more of these values:
1056 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001057 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1058 respectively.
1059
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001060 .. availability:: some flavors of Unix.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001061
1062 .. versionadded:: 3.3
1063
1064
Ross Lagerwall7807c352011-03-17 20:20:30 +02001065.. function:: posix_fallocate(fd, offset, len)
1066
1067 Ensures that enough disk space is allocated for the file specified by *fd*
1068 starting from *offset* and continuing for *len* bytes.
1069
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001070 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001071
1072 .. versionadded:: 3.3
1073
1074
1075.. function:: posix_fadvise(fd, offset, len, advice)
1076
1077 Announces an intention to access data in a specific pattern thus allowing
1078 the kernel to make optimizations.
1079 The advice applies to the region of the file specified by *fd* starting at
1080 *offset* and continuing for *len* bytes.
1081 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1082 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1083 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1084
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001085 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001086
1087 .. versionadded:: 3.3
1088
1089
1090.. data:: POSIX_FADV_NORMAL
1091 POSIX_FADV_SEQUENTIAL
1092 POSIX_FADV_RANDOM
1093 POSIX_FADV_NOREUSE
1094 POSIX_FADV_WILLNEED
1095 POSIX_FADV_DONTNEED
1096
1097 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1098 the access pattern that is likely to be used.
1099
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001100 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001101
1102 .. versionadded:: 3.3
1103
1104
Pablo Galindo02e2a082018-05-31 00:00:04 +01001105.. function:: pread(fd, n, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001106
Pablo Galindo02e2a082018-05-31 00:00:04 +01001107 Read at most *n* bytes from file descriptor *fd* at a position of *offset*,
1108 leaving the file offset unchanged.
1109
1110 Return a bytestring containing the bytes read. If the end of the file
1111 referred to by *fd* has been reached, an empty bytes object is returned.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001112
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001113 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001114
1115 .. versionadded:: 3.3
1116
1117
Pablo Galindo02e2a082018-05-31 00:00:04 +01001118.. function:: preadv(fd, buffers, offset, flags=0)
1119
1120 Read from a file descriptor *fd* at a position of *offset* into mutable
1121 :term:`bytes-like objects <bytes-like object>` *buffers*, leaving the file
1122 offset unchanged. Transfer data into each buffer until it is full and then
1123 move on to the next buffer in the sequence to hold the rest of the data.
1124
1125 The flags argument contains a bitwise OR of zero or more of the following
1126 flags:
1127
1128 - :data:`RWF_HIPRI`
1129 - :data:`RWF_NOWAIT`
1130
1131 Return the total number of bytes actually read which can be less than the
1132 total capacity of all the objects.
1133
1134 The operating system may set a limit (:func:`sysconf` value
1135 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1136
1137 Combine the functionality of :func:`os.readv` and :func:`os.pread`.
1138
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001139 .. availability:: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
1140 OpenBSD 2.7 and newer. Using flags requires Linux 4.6 or newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001141
1142 .. versionadded:: 3.7
1143
1144
1145.. data:: RWF_NOWAIT
1146
1147 Do not wait for data which is not immediately available. If this flag is
1148 specified, the system call will return instantly if it would have to read
1149 data from the backing storage or wait for a lock.
1150
1151 If some data was successfully read, it will return the number of bytes read.
1152 If no bytes were read, it will return ``-1`` and set errno to
1153 :data:`errno.EAGAIN`.
1154
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001155 .. availability:: Linux 4.14 and newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001156
1157 .. versionadded:: 3.7
1158
1159
1160.. data:: RWF_HIPRI
1161
1162 High priority read/write. Allows block-based filesystems to use polling
1163 of the device, which provides lower latency, but may use additional
1164 resources.
1165
1166 Currently, on Linux, this feature is usable only on a file descriptor opened
1167 using the :data:`O_DIRECT` flag.
1168
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001169 .. availability:: Linux 4.6 and newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001170
1171 .. versionadded:: 3.7
1172
1173
Jesus Cea67503c52014-10-20 16:18:24 +02001174.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001175
Pablo Galindo02e2a082018-05-31 00:00:04 +01001176 Write the bytestring in *str* to file descriptor *fd* at position of
1177 *offset*, leaving the file offset unchanged.
1178
1179 Return the number of bytes actually written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001180
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001181 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001182
1183 .. versionadded:: 3.3
1184
1185
Pablo Galindo4defba32018-01-27 16:16:37 +00001186.. function:: pwritev(fd, buffers, offset, flags=0)
1187
Pablo Galindo02e2a082018-05-31 00:00:04 +01001188 Write the *buffers* contents to file descriptor *fd* at a offset *offset*,
1189 leaving the file offset unchanged. *buffers* must be a sequence of
1190 :term:`bytes-like objects <bytes-like object>`. Buffers are processed in
1191 array order. Entire contents of the first buffer is written before
1192 proceeding to the second, and so on.
Pablo Galindo4defba32018-01-27 16:16:37 +00001193
Pablo Galindo02e2a082018-05-31 00:00:04 +01001194 The flags argument contains a bitwise OR of zero or more of the following
Pablo Galindo4defba32018-01-27 16:16:37 +00001195 flags:
1196
Pablo Galindo02e2a082018-05-31 00:00:04 +01001197 - :data:`RWF_DSYNC`
1198 - :data:`RWF_SYNC`
Pablo Galindo4defba32018-01-27 16:16:37 +00001199
Pablo Galindo02e2a082018-05-31 00:00:04 +01001200 Return the total number of bytes actually written.
Pablo Galindo4defba32018-01-27 16:16:37 +00001201
Pablo Galindo02e2a082018-05-31 00:00:04 +01001202 The operating system may set a limit (:func:`sysconf` value
1203 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1204
1205 Combine the functionality of :func:`os.writev` and :func:`os.pwrite`.
1206
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001207 .. availability:: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
1208 OpenBSD 2.7 and newer. Using flags requires Linux 4.7 or newer.
Pablo Galindo4defba32018-01-27 16:16:37 +00001209
1210 .. versionadded:: 3.7
1211
Pablo Galindo02e2a082018-05-31 00:00:04 +01001212
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001213.. data:: RWF_DSYNC
1214
Pablo Galindo02e2a082018-05-31 00:00:04 +01001215 Provide a per-write equivalent of the :data:`O_DSYNC` ``open(2)`` flag. This
1216 flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001217
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001218 .. availability:: Linux 4.7 and newer.
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001219
Pablo Galindo4defba32018-01-27 16:16:37 +00001220 .. versionadded:: 3.7
1221
Pablo Galindo02e2a082018-05-31 00:00:04 +01001222
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001223.. data:: RWF_SYNC
1224
Pablo Galindo02e2a082018-05-31 00:00:04 +01001225 Provide a per-write equivalent of the :data:`O_SYNC` ``open(2)`` flag. This
1226 flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001227
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001228 .. availability:: Linux 4.7 and newer.
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001229
Pablo Galindo4defba32018-01-27 16:16:37 +00001230 .. versionadded:: 3.7
1231
1232
Georg Brandl116aa622007-08-15 14:28:22 +00001233.. function:: read(fd, n)
1234
Pablo Galindo02e2a082018-05-31 00:00:04 +01001235 Read at most *n* bytes from file descriptor *fd*.
1236
1237 Return a bytestring containing the bytes read. If the end of the file
1238 referred to by *fd* has been reached, an empty bytes object is returned.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001239
Georg Brandl116aa622007-08-15 14:28:22 +00001240 .. note::
1241
1242 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001243 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1244 "file object" returned by the built-in function :func:`open` or by
1245 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1246 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001247
Victor Stinnera766ddf2015-03-26 23:50:57 +01001248 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001249 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001250 exception, the function now retries the system call instead of raising an
1251 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1252
Georg Brandl116aa622007-08-15 14:28:22 +00001253
Martin Panterbf19d162015-09-09 01:01:13 +00001254.. function:: sendfile(out, in, offset, count)
Martin Panter94994132015-09-09 05:29:24 +00001255 sendfile(out, in, offset, count, [headers], [trailers], flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001256
Martin Panterbf19d162015-09-09 01:01:13 +00001257 Copy *count* bytes from file descriptor *in* to file descriptor *out*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001258 starting at *offset*.
1259 Return the number of bytes sent. When EOF is reached return 0.
1260
1261 The first function notation is supported by all platforms that define
1262 :func:`sendfile`.
1263
1264 On Linux, if *offset* is given as ``None``, the bytes are read from the
1265 current position of *in* and the position of *in* is updated.
1266
1267 The second case may be used on Mac OS X and FreeBSD where *headers* and
1268 *trailers* are arbitrary sequences of buffers that are written before and
1269 after the data from *in* is written. It returns the same as the first case.
1270
Martin Panterbf19d162015-09-09 01:01:13 +00001271 On Mac OS X and FreeBSD, a value of 0 for *count* specifies to send until
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001272 the end of *in* is reached.
1273
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001274 All platforms support sockets as *out* file descriptor, and some platforms
1275 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001276
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001277 Cross-platform applications should not use *headers*, *trailers* and *flags*
1278 arguments.
1279
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001280 .. availability:: Unix.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001281
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001282 .. note::
1283
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001284 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001285 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001286
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001287 .. versionadded:: 3.3
1288
1289
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001290.. function:: set_blocking(fd, blocking)
1291
1292 Set the blocking mode of the specified file descriptor. Set the
1293 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1294
1295 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1296
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001297 .. availability:: Unix.
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001298
1299 .. versionadded:: 3.5
1300
1301
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001302.. data:: SF_NODISKIO
1303 SF_MNOWAIT
1304 SF_SYNC
1305
1306 Parameters to the :func:`sendfile` function, if the implementation supports
1307 them.
1308
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001309 .. availability:: Unix.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001310
1311 .. versionadded:: 3.3
1312
1313
Ross Lagerwall7807c352011-03-17 20:20:30 +02001314.. function:: readv(fd, buffers)
1315
Benjamin Petersone83ed432014-01-18 22:54:59 -05001316 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
Pablo Galindo02e2a082018-05-31 00:00:04 +01001317 objects <bytes-like object>` *buffers*. Transfer data into each buffer until
1318 it is full and then move on to the next buffer in the sequence to hold the
1319 rest of the data.
1320
1321 Return the total number of bytes actually read which can be less than the
1322 total capacity of all the objects.
1323
1324 The operating system may set a limit (:func:`sysconf` value
1325 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001326
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001327 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001328
1329 .. versionadded:: 3.3
1330
1331
Georg Brandl116aa622007-08-15 14:28:22 +00001332.. function:: tcgetpgrp(fd)
1333
1334 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001335 file descriptor as returned by :func:`os.open`).
1336
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001337 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001338
1339
1340.. function:: tcsetpgrp(fd, pg)
1341
1342 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001343 descriptor as returned by :func:`os.open`) to *pg*.
1344
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001345 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001346
1347
1348.. function:: ttyname(fd)
1349
1350 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001351 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001352 exception is raised.
1353
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001354 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001355
1356
1357.. function:: write(fd, str)
1358
Pablo Galindo02e2a082018-05-31 00:00:04 +01001359 Write the bytestring in *str* to file descriptor *fd*.
1360
1361 Return the number of bytes actually written.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001362
Georg Brandl116aa622007-08-15 14:28:22 +00001363 .. note::
1364
1365 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001366 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001367 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001368 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1369 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001370
Victor Stinnera766ddf2015-03-26 23:50:57 +01001371 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001372 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001373 exception, the function now retries the system call instead of raising an
1374 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1375
Georg Brandl8569e582010-05-19 20:57:08 +00001376
Ross Lagerwall7807c352011-03-17 20:20:30 +02001377.. function:: writev(fd, buffers)
1378
Pablo Galindo02e2a082018-05-31 00:00:04 +01001379 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be
1380 a sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1381 processed in array order. Entire contents of the first buffer is written
1382 before proceeding to the second, and so on.
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001383
Pablo Galindo02e2a082018-05-31 00:00:04 +01001384 Returns the total number of bytes actually written.
1385
1386 The operating system may set a limit (:func:`sysconf` value
1387 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001388
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001389 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001390
1391 .. versionadded:: 3.3
1392
1393
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001394.. _terminal-size:
1395
1396Querying the size of a terminal
1397~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1398
1399.. versionadded:: 3.3
1400
1401.. function:: get_terminal_size(fd=STDOUT_FILENO)
1402
1403 Return the size of the terminal window as ``(columns, lines)``,
1404 tuple of type :class:`terminal_size`.
1405
1406 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1407 output) specifies which file descriptor should be queried.
1408
1409 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001410 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001411
1412 :func:`shutil.get_terminal_size` is the high-level function which
1413 should normally be used, ``os.get_terminal_size`` is the low-level
1414 implementation.
1415
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001416 .. availability:: Unix, Windows.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001417
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001418.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001419
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001420 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001421
1422 .. attribute:: columns
1423
1424 Width of the terminal window in characters.
1425
1426 .. attribute:: lines
1427
1428 Height of the terminal window in characters.
1429
1430
Victor Stinnerdaf45552013-08-28 00:53:59 +02001431.. _fd_inheritance:
1432
1433Inheritance of File Descriptors
1434~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1435
Georg Brandl5642ff92013-09-15 10:37:57 +02001436.. versionadded:: 3.4
1437
1438A file descriptor has an "inheritable" flag which indicates if the file descriptor
1439can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001440created by Python are non-inheritable by default.
1441
1442On UNIX, non-inheritable file descriptors are closed in child processes at the
1443execution of a new program, other file descriptors are inherited.
1444
1445On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001446processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001447and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001448all inheritable handles and all inheritable file descriptors are inherited.
1449Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001450streams are closed, and inheritable handles are only inherited if the
1451*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001452
1453.. function:: get_inheritable(fd)
1454
Georg Brandl5642ff92013-09-15 10:37:57 +02001455 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001456
1457.. function:: set_inheritable(fd, inheritable)
1458
Georg Brandl5642ff92013-09-15 10:37:57 +02001459 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001460
1461.. function:: get_handle_inheritable(handle)
1462
Georg Brandl5642ff92013-09-15 10:37:57 +02001463 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001464
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001465 .. availability:: Windows.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001466
1467.. function:: set_handle_inheritable(handle, inheritable)
1468
Georg Brandl5642ff92013-09-15 10:37:57 +02001469 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001470
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001471 .. availability:: Windows.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001472
1473
Georg Brandl116aa622007-08-15 14:28:22 +00001474.. _os-file-dir:
1475
1476Files and Directories
1477---------------------
1478
Georg Brandl50c40002012-06-24 11:45:20 +02001479On some Unix platforms, many of these functions support one or more of these
1480features:
1481
1482.. _path_fd:
1483
Larry Hastings77892dc2012-06-25 03:27:33 -07001484* **specifying a file descriptor:**
Cheryl Sabellae1521692019-05-06 08:39:13 -04001485 Normally the *path* argument provided to functions in the :mod:`os` module
1486 must be a string specifying a file path. However, some functions now
1487 alternatively accept an open file descriptor for their *path* argument.
1488 The function will then operate on the file referred to by the descriptor.
1489 (For POSIX systems, Python will call the variant of the function prefixed
1490 with ``f`` (e.g. call ``fchdir`` instead of ``chdir``).)
Georg Brandl50c40002012-06-24 11:45:20 +02001491
Cheryl Sabellae1521692019-05-06 08:39:13 -04001492 You can check whether or not *path* can be specified as a file descriptor
1493 for a particular function on your platform using :data:`os.supports_fd`.
1494 If this functionality is unavailable, using it will raise a
1495 :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001496
Cheryl Sabellae1521692019-05-06 08:39:13 -04001497 If the function also supports *dir_fd* or *follow_symlinks* arguments, it's
Georg Brandl50c40002012-06-24 11:45:20 +02001498 an error to specify one of those when supplying *path* as a file descriptor.
1499
1500.. _dir_fd:
1501
Larry Hastings77892dc2012-06-25 03:27:33 -07001502* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001503 should be a file descriptor referring to a directory, and the path to operate
1504 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001505 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Cheryl Sabellae1521692019-05-06 08:39:13 -04001506 the variant of the function with an ``at`` suffix and possibly prefixed with
1507 ``f`` (e.g. call ``faccessat`` instead of ``access``).
Georg Brandl50c40002012-06-24 11:45:20 +02001508
Cheryl Sabellae1521692019-05-06 08:39:13 -04001509 You can check whether or not *dir_fd* is supported for a particular function
1510 on your platform using :data:`os.supports_dir_fd`. If it's unavailable,
1511 using it will raise a :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001512
1513.. _follow_symlinks:
1514
Larry Hastings77892dc2012-06-25 03:27:33 -07001515* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001516 ``False``, and the last element of the path to operate on is a symbolic link,
Cheryl Sabellae1521692019-05-06 08:39:13 -04001517 the function will operate on the symbolic link itself rather than the file
1518 pointed to by the link. (For POSIX systems, Python will call the ``l...``
1519 variant of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001520
Cheryl Sabellae1521692019-05-06 08:39:13 -04001521 You can check whether or not *follow_symlinks* is supported for a particular
1522 function on your platform using :data:`os.supports_follow_symlinks`.
1523 If it's unavailable, using it will raise a :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001524
1525
1526
Larry Hastings9cf065c2012-06-22 16:30:09 -07001527.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001528
1529 Use the real uid/gid to test for access to *path*. Note that most operations
1530 will use the effective uid/gid, therefore this routine can be used in a
1531 suid/sgid environment to test if the invoking user has the specified access to
1532 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1533 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1534 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1535 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001536 information.
1537
Georg Brandl50c40002012-06-24 11:45:20 +02001538 This function can support specifying :ref:`paths relative to directory
1539 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001540
1541 If *effective_ids* is ``True``, :func:`access` will perform its access
1542 checks using the effective uid/gid instead of the real uid/gid.
1543 *effective_ids* may not be supported on your platform; you can check whether
1544 or not it is available using :data:`os.supports_effective_ids`. If it is
1545 unavailable, using it will raise a :exc:`NotImplementedError`.
1546
Georg Brandl116aa622007-08-15 14:28:22 +00001547 .. note::
1548
Georg Brandl502d9a52009-07-26 15:02:41 +00001549 Using :func:`access` to check if a user is authorized to e.g. open a file
1550 before actually doing so using :func:`open` creates a security hole,
1551 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001552 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1553 techniques. For example::
1554
1555 if os.access("myfile", os.R_OK):
1556 with open("myfile") as fp:
1557 return fp.read()
1558 return "some default data"
1559
1560 is better written as::
1561
1562 try:
1563 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001564 except PermissionError:
1565 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001566 else:
1567 with fp:
1568 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001569
1570 .. note::
1571
1572 I/O operations may fail even when :func:`access` indicates that they would
1573 succeed, particularly for operations on network filesystems which may have
1574 permissions semantics beyond the usual POSIX permission-bit model.
1575
Larry Hastings9cf065c2012-06-22 16:30:09 -07001576 .. versionchanged:: 3.3
1577 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1578
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001579 .. versionchanged:: 3.6
1580 Accepts a :term:`path-like object`.
1581
Georg Brandl116aa622007-08-15 14:28:22 +00001582
1583.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001584 R_OK
1585 W_OK
1586 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001587
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001588 Values to pass as the *mode* parameter of :func:`access` to test the
1589 existence, readability, writability and executability of *path*,
1590 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001591
1592
1593.. function:: chdir(path)
1594
1595 .. index:: single: directory; changing
1596
Benjamin Petersonf650e462010-05-06 23:03:05 +00001597 Change the current working directory to *path*.
1598
Larry Hastings77892dc2012-06-25 03:27:33 -07001599 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001600 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001601
Larry Hastings9cf065c2012-06-22 16:30:09 -07001602 .. versionadded:: 3.3
1603 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001604 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001605
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001606 .. versionchanged:: 3.6
1607 Accepts a :term:`path-like object`.
1608
Georg Brandl116aa622007-08-15 14:28:22 +00001609
Larry Hastings9cf065c2012-06-22 16:30:09 -07001610.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001611
1612 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1613 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1614
R David Murray30178062011-03-10 17:18:33 -05001615 * :data:`stat.UF_NODUMP`
1616 * :data:`stat.UF_IMMUTABLE`
1617 * :data:`stat.UF_APPEND`
1618 * :data:`stat.UF_OPAQUE`
1619 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001620 * :data:`stat.UF_COMPRESSED`
1621 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001622 * :data:`stat.SF_ARCHIVED`
1623 * :data:`stat.SF_IMMUTABLE`
1624 * :data:`stat.SF_APPEND`
1625 * :data:`stat.SF_NOUNLINK`
1626 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001627
Georg Brandl50c40002012-06-24 11:45:20 +02001628 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001629
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001630 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001631
Larry Hastings9cf065c2012-06-22 16:30:09 -07001632 .. versionadded:: 3.3
1633 The *follow_symlinks* argument.
1634
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001635 .. versionchanged:: 3.6
1636 Accepts a :term:`path-like object`.
1637
Georg Brandl116aa622007-08-15 14:28:22 +00001638
Larry Hastings9cf065c2012-06-22 16:30:09 -07001639.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001640
1641 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001642 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001643 combinations of them:
1644
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001645 * :data:`stat.S_ISUID`
1646 * :data:`stat.S_ISGID`
1647 * :data:`stat.S_ENFMT`
1648 * :data:`stat.S_ISVTX`
1649 * :data:`stat.S_IREAD`
1650 * :data:`stat.S_IWRITE`
1651 * :data:`stat.S_IEXEC`
1652 * :data:`stat.S_IRWXU`
1653 * :data:`stat.S_IRUSR`
1654 * :data:`stat.S_IWUSR`
1655 * :data:`stat.S_IXUSR`
1656 * :data:`stat.S_IRWXG`
1657 * :data:`stat.S_IRGRP`
1658 * :data:`stat.S_IWGRP`
1659 * :data:`stat.S_IXGRP`
1660 * :data:`stat.S_IRWXO`
1661 * :data:`stat.S_IROTH`
1662 * :data:`stat.S_IWOTH`
1663 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001664
Georg Brandl50c40002012-06-24 11:45:20 +02001665 This function can support :ref:`specifying a file descriptor <path_fd>`,
1666 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1667 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001668
Georg Brandl116aa622007-08-15 14:28:22 +00001669 .. note::
1670
Georg Brandl50c40002012-06-24 11:45:20 +02001671 Although Windows supports :func:`chmod`, you can only set the file's
1672 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1673 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001674
Larry Hastings9cf065c2012-06-22 16:30:09 -07001675 .. versionadded:: 3.3
1676 Added support for specifying *path* as an open file descriptor,
1677 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001678
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001679 .. versionchanged:: 3.6
1680 Accepts a :term:`path-like object`.
1681
Larry Hastings9cf065c2012-06-22 16:30:09 -07001682
1683.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001684
Georg Brandl50c40002012-06-24 11:45:20 +02001685 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1686 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001687
Georg Brandl50c40002012-06-24 11:45:20 +02001688 This function can support :ref:`specifying a file descriptor <path_fd>`,
1689 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1690 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001691
Sandro Tosid902a142011-08-22 23:28:27 +02001692 See :func:`shutil.chown` for a higher-level function that accepts names in
1693 addition to numeric ids.
1694
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001695 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001696
Larry Hastings9cf065c2012-06-22 16:30:09 -07001697 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04001698 Added support for specifying *path* as an open file descriptor,
Larry Hastings9cf065c2012-06-22 16:30:09 -07001699 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001700
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001701 .. versionchanged:: 3.6
1702 Supports a :term:`path-like object`.
1703
Benjamin Peterson799bd802011-08-31 22:15:17 -04001704
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001705.. function:: chroot(path)
1706
Georg Brandl8a5555f2012-06-24 13:29:09 +02001707 Change the root directory of the current process to *path*.
1708
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001709 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001710
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001711 .. versionchanged:: 3.6
1712 Accepts a :term:`path-like object`.
1713
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001714
1715.. function:: fchdir(fd)
1716
1717 Change the current working directory to the directory represented by the file
1718 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001719 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001720
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001721 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001722
1723
1724.. function:: getcwd()
1725
1726 Return a string representing the current working directory.
1727
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001728
1729.. function:: getcwdb()
1730
1731 Return a bytestring representing the current working directory.
1732
Victor Stinner689830e2019-06-26 17:31:12 +02001733 .. versionchanged:: 3.8
1734 The function now uses the UTF-8 encoding on Windows, rather than the ANSI
1735 code page: see :pep:`529` for the rationale. The function is no longer
1736 deprecated on Windows.
1737
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001738
Georg Brandl116aa622007-08-15 14:28:22 +00001739.. function:: lchflags(path, flags)
1740
Georg Brandl50c40002012-06-24 11:45:20 +02001741 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001742 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001743 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001744
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001745 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001746
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001747 .. versionchanged:: 3.6
1748 Accepts a :term:`path-like object`.
1749
Georg Brandl116aa622007-08-15 14:28:22 +00001750
Christian Heimes93852662007-12-01 12:22:32 +00001751.. function:: lchmod(path, mode)
1752
1753 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001754 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001755 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001756 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001757
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001758 .. availability:: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001759
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001760 .. versionchanged:: 3.6
1761 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001762
Georg Brandl116aa622007-08-15 14:28:22 +00001763.. function:: lchown(path, uid, gid)
1764
Georg Brandl50c40002012-06-24 11:45:20 +02001765 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001766 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001767 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001768
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001769 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001770
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001771 .. versionchanged:: 3.6
1772 Accepts a :term:`path-like object`.
1773
Georg Brandl116aa622007-08-15 14:28:22 +00001774
Larry Hastings9cf065c2012-06-22 16:30:09 -07001775.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001776
Larry Hastings9cf065c2012-06-22 16:30:09 -07001777 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001778
Georg Brandlaceaf902012-06-25 08:33:56 +02001779 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1780 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1781 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001782
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001783 .. availability:: Unix, Windows.
Brian Curtin1b9df392010-11-24 20:24:31 +00001784
1785 .. versionchanged:: 3.2
1786 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001787
Larry Hastings9cf065c2012-06-22 16:30:09 -07001788 .. versionadded:: 3.3
1789 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1790
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001791 .. versionchanged:: 3.6
1792 Accepts a :term:`path-like object` for *src* and *dst*.
1793
Georg Brandl116aa622007-08-15 14:28:22 +00001794
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001795.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001796
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001797 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001798 *path*. The list is in arbitrary order, and does not include the special
1799 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001800
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001801 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1802 (directly or indirectly through the :class:`PathLike` interface),
1803 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001804 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001805
Larry Hastings77892dc2012-06-25 03:27:33 -07001806 This function can also support :ref:`specifying a file descriptor
1807 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001808
Steve Dower44f91c32019-06-27 10:47:59 -07001809 .. audit-event:: os.listdir path os.listdir
Steve Dower60419a72019-06-24 08:42:54 -07001810
Larry Hastingsfdaea062012-06-25 04:42:23 -07001811 .. note::
1812 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1813
Victor Stinner6036e442015-03-08 01:58:04 +01001814 .. seealso::
1815
Victor Stinner51b58322015-05-15 09:12:58 +02001816 The :func:`scandir` function returns directory entries along with
1817 file attribute information, giving better performance for many
1818 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001819
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001820 .. versionchanged:: 3.2
1821 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001822
Larry Hastings9cf065c2012-06-22 16:30:09 -07001823 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04001824 Added support for specifying *path* as an open file descriptor.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001825
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001826 .. versionchanged:: 3.6
1827 Accepts a :term:`path-like object`.
1828
Georg Brandl50c40002012-06-24 11:45:20 +02001829
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001830.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001831
R. David Murray7b1aae92011-01-24 19:34:58 +00001832 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001833 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1834 :class:`stat_result` object.
1835
1836 On platforms that do not support symbolic links, this is an alias for
1837 :func:`~os.stat`.
1838
1839 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1840 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001841
Georg Brandl50c40002012-06-24 11:45:20 +02001842 This function can also support :ref:`paths relative to directory descriptors
1843 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001844
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001845 .. seealso::
1846
Berker Peksag2034caa2015-04-27 13:53:28 +03001847 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001848
Georg Brandlb3823372010-07-10 08:58:37 +00001849 .. versionchanged:: 3.2
1850 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001851
Larry Hastings9cf065c2012-06-22 16:30:09 -07001852 .. versionchanged:: 3.3
1853 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001854
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001855 .. versionchanged:: 3.6
1856 Accepts a :term:`path-like object` for *src* and *dst*.
1857
Ross Lagerwall7807c352011-03-17 20:20:30 +02001858
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001859.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1860
1861 Create a directory named *path* with numeric mode *mode*.
1862
Tommy Beadle63b91e52016-06-02 15:41:20 -04001863 If the directory already exists, :exc:`FileExistsError` is raised.
1864
1865 .. _mkdir_modebits:
1866
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001867 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001868 value is first masked out. If bits other than the last 9 (i.e. the last 3
1869 digits of the octal representation of the *mode*) are set, their meaning is
1870 platform-dependent. On some platforms, they are ignored and you should call
1871 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001872
1873 This function can also support :ref:`paths relative to directory descriptors
1874 <dir_fd>`.
1875
1876 It is also possible to create temporary directories; see the
1877 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1878
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001879 .. versionadded:: 3.3
1880 The *dir_fd* argument.
1881
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001882 .. versionchanged:: 3.6
1883 Accepts a :term:`path-like object`.
1884
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001885
Zachary Warea22ae212014-03-20 09:42:01 -05001886.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001887
1888 .. index::
1889 single: directory; creating
1890 single: UNC paths; and os.makedirs()
1891
1892 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001893 intermediate-level directories needed to contain the leaf directory.
1894
Serhiy Storchakae304e332017-03-24 13:27:42 +02001895 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1896 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1897 is interpreted. To set the file permission bits of any newly-created parent
1898 directories you can set the umask before invoking :func:`makedirs`. The
1899 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001900
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001901 If *exist_ok* is ``False`` (the default), an :exc:`OSError` is raised if the
1902 target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001903
1904 .. note::
1905
1906 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001907 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001908
1909 This function handles UNC paths correctly.
1910
1911 .. versionadded:: 3.2
1912 The *exist_ok* parameter.
1913
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001914 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001915
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001916 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001917 :func:`makedirs` would still raise an error if *mode* did not match the
1918 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001919 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001920
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001921 .. versionchanged:: 3.6
1922 Accepts a :term:`path-like object`.
1923
Serhiy Storchakae304e332017-03-24 13:27:42 +02001924 .. versionchanged:: 3.7
1925 The *mode* argument no longer affects the file permission bits of
1926 newly-created intermediate-level directories.
1927
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001928
Larry Hastings9cf065c2012-06-22 16:30:09 -07001929.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001930
Larry Hastings9cf065c2012-06-22 16:30:09 -07001931 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1932 The current umask value is first masked out from the mode.
1933
Georg Brandl50c40002012-06-24 11:45:20 +02001934 This function can also support :ref:`paths relative to directory descriptors
1935 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001936
1937 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1938 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1939 rendezvous between "client" and "server" type processes: the server opens the
1940 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1941 doesn't open the FIFO --- it just creates the rendezvous point.
1942
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001943 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001944
Larry Hastings9cf065c2012-06-22 16:30:09 -07001945 .. versionadded:: 3.3
1946 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001947
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001948 .. versionchanged:: 3.6
1949 Accepts a :term:`path-like object`.
1950
Larry Hastings9cf065c2012-06-22 16:30:09 -07001951
Martin Panterbf19d162015-09-09 01:01:13 +00001952.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001953
1954 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00001955 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00001956 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
1957 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
1958 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
1959 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00001960 :func:`os.makedev`), otherwise it is ignored.
1961
Georg Brandl50c40002012-06-24 11:45:20 +02001962 This function can also support :ref:`paths relative to directory descriptors
1963 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001964
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001965 .. availability:: Unix.
Berker Peksag6129e142016-09-26 22:50:11 +03001966
Larry Hastings9cf065c2012-06-22 16:30:09 -07001967 .. versionadded:: 3.3
1968 The *dir_fd* argument.
1969
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001970 .. versionchanged:: 3.6
1971 Accepts a :term:`path-like object`.
1972
Georg Brandl116aa622007-08-15 14:28:22 +00001973
1974.. function:: major(device)
1975
Christian Heimesfaf2f632008-01-06 16:59:19 +00001976 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001977 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001978
Georg Brandl116aa622007-08-15 14:28:22 +00001979
1980.. function:: minor(device)
1981
Christian Heimesfaf2f632008-01-06 16:59:19 +00001982 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001983 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001984
Georg Brandl116aa622007-08-15 14:28:22 +00001985
1986.. function:: makedev(major, minor)
1987
Christian Heimesfaf2f632008-01-06 16:59:19 +00001988 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001989
Georg Brandl116aa622007-08-15 14:28:22 +00001990
Georg Brandl116aa622007-08-15 14:28:22 +00001991.. function:: pathconf(path, name)
1992
1993 Return system configuration information relevant to a named file. *name*
1994 specifies the configuration value to retrieve; it may be a string which is the
1995 name of a defined system value; these names are specified in a number of
1996 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
1997 additional names as well. The names known to the host operating system are
1998 given in the ``pathconf_names`` dictionary. For configuration variables not
1999 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00002000
2001 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
2002 specific value for *name* is not supported by the host system, even if it is
2003 included in ``pathconf_names``, an :exc:`OSError` is raised with
2004 :const:`errno.EINVAL` for the error number.
2005
Larry Hastings77892dc2012-06-25 03:27:33 -07002006 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02002007 <path_fd>`.
2008
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002009 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002010
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002011 .. versionchanged:: 3.6
2012 Accepts a :term:`path-like object`.
2013
Georg Brandl116aa622007-08-15 14:28:22 +00002014
2015.. data:: pathconf_names
2016
2017 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
2018 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02002019 can be used to determine the set of names known to the system.
2020
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002021 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00002022
2023
Larry Hastings9cf065c2012-06-22 16:30:09 -07002024.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002025
2026 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02002027 result may be either an absolute or relative pathname; if it is relative, it
2028 may be converted to an absolute pathname using
2029 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00002030
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002031 If the *path* is a string object (directly or indirectly through a
2032 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00002033 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002034 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00002035
Georg Brandl50c40002012-06-24 11:45:20 +02002036 This function can also support :ref:`paths relative to directory descriptors
2037 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002038
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002039 .. availability:: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002040
Georg Brandlb3823372010-07-10 08:58:37 +00002041 .. versionchanged:: 3.2
2042 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002043
Larry Hastings9cf065c2012-06-22 16:30:09 -07002044 .. versionadded:: 3.3
2045 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00002046
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002047 .. versionchanged:: 3.6
Berker Peksage0b5b202018-08-15 13:03:41 +03002048 Accepts a :term:`path-like object` on Unix.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002049
Berker Peksage0b5b202018-08-15 13:03:41 +03002050 .. versionchanged:: 3.8
2051 Accepts a :term:`path-like object` and a bytes object on Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00002052
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002053.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002054
Georg Brandl50c40002012-06-24 11:45:20 +02002055 Remove (delete) the file *path*. If *path* is a directory, :exc:`OSError` is
2056 raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002057
Georg Brandl50c40002012-06-24 11:45:20 +02002058 This function can support :ref:`paths relative to directory descriptors
2059 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002060
2061 On Windows, attempting to remove a file that is in use causes an exception to
2062 be raised; on Unix, the directory entry is removed but the storage allocated
2063 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002064
Brett Cannon05039172015-12-28 17:28:19 -08002065 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002066
Larry Hastings9cf065c2012-06-22 16:30:09 -07002067 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002068 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002069
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002070 .. versionchanged:: 3.6
2071 Accepts a :term:`path-like object`.
2072
Georg Brandl116aa622007-08-15 14:28:22 +00002073
Zachary Warea22ae212014-03-20 09:42:01 -05002074.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00002075
2076 .. index:: single: directory; deleting
2077
Christian Heimesfaf2f632008-01-06 16:59:19 +00002078 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00002079 leaf directory is successfully removed, :func:`removedirs` tries to
2080 successively remove every parent directory mentioned in *path* until an error
2081 is raised (which is ignored, because it generally means that a parent directory
2082 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
2083 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
2084 they are empty. Raises :exc:`OSError` if the leaf directory could not be
2085 successfully removed.
2086
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002087 .. versionchanged:: 3.6
2088 Accepts a :term:`path-like object`.
2089
Georg Brandl116aa622007-08-15 14:28:22 +00002090
Larry Hastings9cf065c2012-06-22 16:30:09 -07002091.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002092
2093 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2094 :exc:`OSError` will be raised. On Unix, if *dst* exists and is a file, it will
Christian Heimesfaf2f632008-01-06 16:59:19 +00002095 be replaced silently if the user has permission. The operation may fail on some
Georg Brandl116aa622007-08-15 14:28:22 +00002096 Unix flavors if *src* and *dst* are on different filesystems. If successful,
2097 the renaming will be an atomic operation (this is a POSIX requirement). On
2098 Windows, if *dst* already exists, :exc:`OSError` will be raised even if it is a
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002099 file.
2100
Georg Brandlaceaf902012-06-25 08:33:56 +02002101 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2102 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002103
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002104 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002105
Larry Hastings9cf065c2012-06-22 16:30:09 -07002106 .. versionadded:: 3.3
2107 The *src_dir_fd* and *dst_dir_fd* arguments.
2108
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002109 .. versionchanged:: 3.6
2110 Accepts a :term:`path-like object` for *src* and *dst*.
2111
Georg Brandl116aa622007-08-15 14:28:22 +00002112
2113.. function:: renames(old, new)
2114
2115 Recursive directory or file renaming function. Works like :func:`rename`, except
2116 creation of any intermediate directories needed to make the new pathname good is
2117 attempted first. After the rename, directories corresponding to rightmost path
2118 segments of the old name will be pruned away using :func:`removedirs`.
2119
Georg Brandl116aa622007-08-15 14:28:22 +00002120 .. note::
2121
2122 This function can fail with the new directory structure made if you lack
2123 permissions needed to remove the leaf directory or file.
2124
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002125 .. versionchanged:: 3.6
2126 Accepts a :term:`path-like object` for *old* and *new*.
2127
Georg Brandl116aa622007-08-15 14:28:22 +00002128
Larry Hastings9cf065c2012-06-22 16:30:09 -07002129.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002130
2131 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2132 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
2133 be replaced silently if the user has permission. The operation may fail
2134 if *src* and *dst* are on different filesystems. If successful,
2135 the renaming will be an atomic operation (this is a POSIX requirement).
2136
Georg Brandlaceaf902012-06-25 08:33:56 +02002137 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2138 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002139
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002140 .. versionadded:: 3.3
2141
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002142 .. versionchanged:: 3.6
2143 Accepts a :term:`path-like object` for *src* and *dst*.
2144
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002145
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002146.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002147
Georg Brandla6053b42009-09-01 08:11:14 +00002148 Remove (delete) the directory *path*. Only works when the directory is
2149 empty, otherwise, :exc:`OSError` is raised. In order to remove whole
Benjamin Petersonf650e462010-05-06 23:03:05 +00002150 directory trees, :func:`shutil.rmtree` can be used.
2151
Georg Brandl50c40002012-06-24 11:45:20 +02002152 This function can support :ref:`paths relative to directory descriptors
2153 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002154
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002155 .. versionadded:: 3.3
2156 The *dir_fd* parameter.
2157
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002158 .. versionchanged:: 3.6
2159 Accepts a :term:`path-like object`.
2160
Georg Brandl116aa622007-08-15 14:28:22 +00002161
Victor Stinner6036e442015-03-08 01:58:04 +01002162.. function:: scandir(path='.')
2163
Brett Cannona32c4d02016-06-24 14:14:44 -07002164 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2165 entries in the directory given by *path*. The entries are yielded in
2166 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2167 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002168
Victor Stinner51b58322015-05-15 09:12:58 +02002169 Using :func:`scandir` instead of :func:`listdir` can significantly
2170 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002171 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002172 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002173 All :class:`os.DirEntry` methods may perform a system call, but
2174 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2175 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002176 always requires a system call on Unix but only requires one for
2177 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002178
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002179 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2180 (directly or indirectly through the :class:`PathLike` interface),
2181 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2182 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2183 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002184
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002185 This function can also support :ref:`specifying a file descriptor
2186 <path_fd>`; the file descriptor must refer to a directory.
2187
Steve Dower44f91c32019-06-27 10:47:59 -07002188 .. audit-event:: os.scandir path os.scandir
Steve Dower60419a72019-06-24 08:42:54 -07002189
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002190 The :func:`scandir` iterator supports the :term:`context manager` protocol
2191 and has the following method:
2192
2193 .. method:: scandir.close()
2194
2195 Close the iterator and free acquired resources.
2196
2197 This is called automatically when the iterator is exhausted or garbage
2198 collected, or when an error happens during iterating. However it
2199 is advisable to call it explicitly or use the :keyword:`with`
2200 statement.
2201
2202 .. versionadded:: 3.6
2203
Victor Stinner6036e442015-03-08 01:58:04 +01002204 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002205 the files (excluding directories) in the given *path* that don't start with
2206 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2207 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002208
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002209 with os.scandir(path) as it:
2210 for entry in it:
2211 if not entry.name.startswith('.') and entry.is_file():
2212 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002213
2214 .. note::
2215
2216 On Unix-based systems, :func:`scandir` uses the system's
2217 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2218 and
2219 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2220 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002221 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002222 and
Georg Brandl5d941342016-02-26 19:37:12 +01002223 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002224 functions.
2225
Victor Stinner6036e442015-03-08 01:58:04 +01002226 .. versionadded:: 3.5
2227
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002228 .. versionadded:: 3.6
2229 Added support for the :term:`context manager` protocol and the
2230 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2231 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2232 in its destructor.
2233
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002234 The function accepts a :term:`path-like object`.
2235
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002236 .. versionchanged:: 3.7
2237 Added support for :ref:`file descriptors <path_fd>` on Unix.
2238
Victor Stinner6036e442015-03-08 01:58:04 +01002239
2240.. class:: DirEntry
2241
2242 Object yielded by :func:`scandir` to expose the file path and other file
2243 attributes of a directory entry.
2244
2245 :func:`scandir` will provide as much of this information as possible without
2246 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002247 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002248
Brett Cannona32c4d02016-06-24 14:14:44 -07002249 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002250 structures; if you know the file metadata has changed or if a long time has
2251 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2252 up-to-date information.
2253
Brett Cannona32c4d02016-06-24 14:14:44 -07002254 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002255 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002256 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002257 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002258
Brett Cannona32c4d02016-06-24 14:14:44 -07002259 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002260 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002261
Brett Cannona32c4d02016-06-24 14:14:44 -07002262 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002263
2264 .. attribute:: name
2265
2266 The entry's base filename, relative to the :func:`scandir` *path*
2267 argument.
2268
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002269 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2270 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002271 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002272
2273 .. attribute:: path
2274
2275 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2276 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2277 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002278 argument was absolute. If the :func:`scandir` *path*
2279 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2280 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002281
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002282 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2283 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002284 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002285
2286 .. method:: inode()
2287
2288 Return the inode number of the entry.
2289
Brett Cannona32c4d02016-06-24 14:14:44 -07002290 The result is cached on the ``os.DirEntry`` object. Use
2291 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2292 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002293
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002294 On the first, uncached call, a system call is required on Windows but
2295 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002296
2297 .. method:: is_dir(\*, follow_symlinks=True)
2298
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002299 Return ``True`` if this entry is a directory or a symbolic link pointing
2300 to a directory; return ``False`` if the entry is or points to any other
2301 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002302
2303 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002304 is a directory (without following symlinks); return ``False`` if the
2305 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002306
Brett Cannona32c4d02016-06-24 14:14:44 -07002307 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002308 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2309 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2310
2311 On the first, uncached call, no system call is required in most cases.
2312 Specifically, for non-symlinks, neither Windows or Unix require a system
2313 call, except on certain Unix file systems, such as network file systems,
2314 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2315 a system call will be required to follow the symlink unless
2316 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002317
Victor Stinner51b58322015-05-15 09:12:58 +02002318 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2319 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002320
Victor Stinner6036e442015-03-08 01:58:04 +01002321 .. method:: is_file(\*, follow_symlinks=True)
2322
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002323 Return ``True`` if this entry is a file or a symbolic link pointing to a
2324 file; return ``False`` if the entry is or points to a directory or other
2325 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002326
2327 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002328 is a file (without following symlinks); return ``False`` if the entry is
2329 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002330
Brett Cannona32c4d02016-06-24 14:14:44 -07002331 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2332 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002333
2334 .. method:: is_symlink()
2335
Victor Stinner51b58322015-05-15 09:12:58 +02002336 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002337 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002338 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002339
Brett Cannona32c4d02016-06-24 14:14:44 -07002340 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002341 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002342
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002343 On the first, uncached call, no system call is required in most cases.
2344 Specifically, neither Windows or Unix require a system call, except on
2345 certain Unix file systems, such as network file systems, that return
2346 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002347
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002348 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2349 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002350
2351 .. method:: stat(\*, follow_symlinks=True)
2352
Victor Stinner51b58322015-05-15 09:12:58 +02002353 Return a :class:`stat_result` object for this entry. This method
2354 follows symbolic links by default; to stat a symbolic link add the
2355 ``follow_symlinks=False`` argument.
2356
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002357 On Unix, this method always requires a system call. On Windows, it
2358 only requires a system call if *follow_symlinks* is ``True`` and the
2359 entry is a symbolic link.
Victor Stinner6036e442015-03-08 01:58:04 +01002360
2361 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2362 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2363 get these attributes.
2364
Brett Cannona32c4d02016-06-24 14:14:44 -07002365 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002366 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2367 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002368
Guido van Rossum1469d742016-01-06 11:36:03 -08002369 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002370 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002371 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002372 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2373 and ``stat()`` methods.
2374
Victor Stinner6036e442015-03-08 01:58:04 +01002375 .. versionadded:: 3.5
2376
Brett Cannon96881cd2016-06-10 14:37:21 -07002377 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002378 Added support for the :class:`~os.PathLike` interface. Added support
2379 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002380
Victor Stinner6036e442015-03-08 01:58:04 +01002381
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002382.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002383
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002384 Get the status of a file or a file descriptor. Perform the equivalent of a
2385 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002386 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002387 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002388 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002389
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002390 This function normally follows symlinks; to stat a symlink add the argument
2391 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002392
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002393 This function can support :ref:`specifying a file descriptor <path_fd>` and
2394 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002395
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002396 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002397
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002398 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002399
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002400 >>> import os
2401 >>> statinfo = os.stat('somefile.txt')
2402 >>> statinfo
2403 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2404 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2405 st_mtime=1297230027, st_ctime=1297230027)
2406 >>> statinfo.st_size
2407 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002408
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002409 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002410
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002411 :func:`fstat` and :func:`lstat` functions.
2412
2413 .. versionadded:: 3.3
2414 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2415 descriptor instead of a path.
2416
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002417 .. versionchanged:: 3.6
2418 Accepts a :term:`path-like object`.
2419
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002420
2421.. class:: stat_result
2422
2423 Object whose attributes correspond roughly to the members of the
2424 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2425 :func:`os.fstat` and :func:`os.lstat`.
2426
2427 Attributes:
2428
2429 .. attribute:: st_mode
2430
2431 File mode: file type and file mode bits (permissions).
2432
2433 .. attribute:: st_ino
2434
Steve Dower3e51a3d2018-05-28 17:24:36 -07002435 Platform dependent, but if non-zero, uniquely identifies the
2436 file for a given value of ``st_dev``. Typically:
2437
2438 * the inode number on Unix,
2439 * the `file index
2440 <https://msdn.microsoft.com/en-us/library/aa363788>`_ on
2441 Windows
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002442
2443 .. attribute:: st_dev
2444
2445 Identifier of the device on which this file resides.
2446
2447 .. attribute:: st_nlink
2448
2449 Number of hard links.
2450
2451 .. attribute:: st_uid
2452
2453 User identifier of the file owner.
2454
2455 .. attribute:: st_gid
2456
2457 Group identifier of the file owner.
2458
2459 .. attribute:: st_size
2460
2461 Size of the file in bytes, if it is a regular file or a symbolic link.
2462 The size of a symbolic link is the length of the pathname it contains,
2463 without a terminating null byte.
2464
2465 Timestamps:
2466
2467 .. attribute:: st_atime
2468
2469 Time of most recent access expressed in seconds.
2470
2471 .. attribute:: st_mtime
2472
2473 Time of most recent content modification expressed in seconds.
2474
2475 .. attribute:: st_ctime
2476
2477 Platform dependent:
2478
2479 * the time of most recent metadata change on Unix,
2480 * the time of creation on Windows, expressed in seconds.
2481
2482 .. attribute:: st_atime_ns
2483
2484 Time of most recent access expressed in nanoseconds as an integer.
2485
2486 .. attribute:: st_mtime_ns
2487
2488 Time of most recent content modification expressed in nanoseconds as an
2489 integer.
2490
2491 .. attribute:: st_ctime_ns
2492
2493 Platform dependent:
2494
2495 * the time of most recent metadata change on Unix,
2496 * the time of creation on Windows, expressed in nanoseconds as an
2497 integer.
2498
Georg Brandl116aa622007-08-15 14:28:22 +00002499 .. note::
2500
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002501 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002502 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2503 system and the file system. For example, on Windows systems using the FAT
2504 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2505 :attr:`st_atime` has only 1-day resolution. See your operating system
2506 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002507
Larry Hastings6fe20b32012-04-19 15:07:49 -07002508 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2509 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2510 systems do not provide nanosecond precision. On systems that do
2511 provide nanosecond precision, the floating-point object used to
2512 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2513 cannot preserve all of it, and as such will be slightly inexact.
2514 If you need the exact timestamps you should always use
2515 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002516
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002517 On some Unix systems (such as Linux), the following attributes may also be
2518 available:
2519
2520 .. attribute:: st_blocks
2521
2522 Number of 512-byte blocks allocated for file.
2523 This may be smaller than :attr:`st_size`/512 when the file has holes.
2524
2525 .. attribute:: st_blksize
2526
2527 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2528 smaller chunks may cause an inefficient read-modify-rewrite.
2529
2530 .. attribute:: st_rdev
2531
2532 Type of device if an inode device.
2533
2534 .. attribute:: st_flags
2535
2536 User defined flags for file.
2537
2538 On other Unix systems (such as FreeBSD), the following attributes may be
2539 available (but may be only filled out if root tries to use them):
2540
2541 .. attribute:: st_gen
2542
2543 File generation number.
2544
2545 .. attribute:: st_birthtime
2546
2547 Time of file creation.
2548
jcea6c51d512018-01-28 14:00:08 +01002549 On Solaris and derivatives, the following attributes may also be
2550 available:
2551
2552 .. attribute:: st_fstype
2553
2554 String that uniquely identifies the type of the filesystem that
2555 contains the file.
2556
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002557 On Mac OS systems, the following attributes may also be available:
2558
2559 .. attribute:: st_rsize
2560
2561 Real size of the file.
2562
2563 .. attribute:: st_creator
2564
2565 Creator of the file.
2566
2567 .. attribute:: st_type
2568
2569 File type.
2570
Victor Stinnere1d24f72014-07-24 12:44:07 +02002571 On Windows systems, the following attribute is also available:
2572
2573 .. attribute:: st_file_attributes
2574
2575 Windows file attributes: ``dwFileAttributes`` member of the
2576 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2577 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2578 constants in the :mod:`stat` module.
2579
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002580 The standard module :mod:`stat` defines functions and constants that are
2581 useful for extracting information from a :c:type:`stat` structure. (On
2582 Windows, some items are filled with dummy values.)
2583
2584 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002585 accessible as a tuple of at least 10 integers giving the most important (and
2586 portable) members of the :c:type:`stat` structure, in the order
2587 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2588 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2589 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002590 some implementations. For compatibility with older Python versions,
2591 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002592
Larry Hastings6fe20b32012-04-19 15:07:49 -07002593 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002594 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2595 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002596
Zachary Ware63f277b2014-06-19 09:46:37 -05002597 .. versionadded:: 3.5
2598 Added the :attr:`st_file_attributes` member on Windows.
2599
Steve Dower3e51a3d2018-05-28 17:24:36 -07002600 .. versionchanged:: 3.5
2601 Windows now returns the file index as :attr:`st_ino` when
2602 available.
2603
jcea6c51d512018-01-28 14:00:08 +01002604 .. versionadded:: 3.7
2605 Added the :attr:`st_fstype` member to Solaris/derivatives.
Georg Brandl116aa622007-08-15 14:28:22 +00002606
Georg Brandl116aa622007-08-15 14:28:22 +00002607.. function:: statvfs(path)
2608
Georg Brandl60203b42010-10-06 10:11:56 +00002609 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002610 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002611 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002612 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2613 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002614 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002615
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002616 Two module-level constants are defined for the :attr:`f_flag` attribute's
2617 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2618 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2619 setuid/setgid bits are disabled or not supported.
2620
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002621 Additional module-level constants are defined for GNU/glibc based systems.
2622 These are :const:`ST_NODEV` (disallow access to device special files),
2623 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2624 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2625 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2626 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2627 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2628 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2629
Georg Brandl50c40002012-06-24 11:45:20 +02002630 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002631
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002632 .. availability:: Unix.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002633
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002634 .. versionchanged:: 3.2
2635 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2636
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002637 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04002638 Added support for specifying *path* as an open file descriptor.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002639
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002640 .. versionchanged:: 3.4
2641 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2642 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2643 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2644 and :const:`ST_RELATIME` constants were added.
2645
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002646 .. versionchanged:: 3.6
2647 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002648
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002649 .. versionadded:: 3.7
2650 Added :attr:`f_fsid`.
2651
Larry Hastings9cf065c2012-06-22 16:30:09 -07002652
2653.. data:: supports_dir_fd
2654
Cheryl Sabellae1521692019-05-06 08:39:13 -04002655 A :class:`set` object indicating which functions in the :mod:`os`
2656 module accept an open file descriptor for their *dir_fd* parameter.
2657 Different platforms provide different features, and the underlying
2658 functionality Python uses to implement the *dir_fd* parameter is not
2659 available on all platforms Python supports. For consistency's sake,
2660 functions that may support *dir_fd* always allow specifying the
2661 parameter, but will throw an exception if the functionality is used
2662 when it's not locally available. (Specifying ``None`` for *dir_fd*
2663 is always supported on all platforms.)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002664
Cheryl Sabellae1521692019-05-06 08:39:13 -04002665 To check whether a particular function accepts an open file descriptor
2666 for its *dir_fd* parameter, use the ``in`` operator on ``supports_dir_fd``.
2667 As an example, this expression evaluates to ``True`` if :func:`os.stat`
2668 accepts open file descriptors for *dir_fd* on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002669
2670 os.stat in os.supports_dir_fd
2671
Cheryl Sabellae1521692019-05-06 08:39:13 -04002672 Currently *dir_fd* parameters only work on Unix platforms;
2673 none of them work on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002674
2675 .. versionadded:: 3.3
2676
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002677
Larry Hastings9cf065c2012-06-22 16:30:09 -07002678.. data:: supports_effective_ids
2679
Cheryl Sabellae1521692019-05-06 08:39:13 -04002680 A :class:`set` object indicating whether :func:`os.access` permits
2681 specifying ``True`` for its *effective_ids* parameter on the local platform.
2682 (Specifying ``False`` for *effective_ids* is always supported on all
2683 platforms.) If the local platform supports it, the collection will contain
2684 :func:`os.access`; otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002685
Cheryl Sabellae1521692019-05-06 08:39:13 -04002686 This expression evaluates to ``True`` if :func:`os.access` supports
2687 ``effective_ids=True`` on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002688
2689 os.access in os.supports_effective_ids
2690
Cheryl Sabellae1521692019-05-06 08:39:13 -04002691 Currently *effective_ids* is only supported on Unix platforms;
2692 it does not work on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002693
2694 .. versionadded:: 3.3
2695
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002696
Larry Hastings9cf065c2012-06-22 16:30:09 -07002697.. data:: supports_fd
2698
Cheryl Sabellae1521692019-05-06 08:39:13 -04002699 A :class:`set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002700 :mod:`os` module permit specifying their *path* parameter as an open file
Cheryl Sabellae1521692019-05-06 08:39:13 -04002701 descriptor on the local platform. Different platforms provide different
2702 features, and the underlying functionality Python uses to accept open file
2703 descriptors as *path* arguments is not available on all platforms Python
2704 supports.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002705
Cheryl Sabellae1521692019-05-06 08:39:13 -04002706 To determine whether a particular function permits specifying an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002707 descriptor for its *path* parameter, use the ``in`` operator on
Cheryl Sabellae1521692019-05-06 08:39:13 -04002708 ``supports_fd``. As an example, this expression evaluates to ``True`` if
2709 :func:`os.chdir` accepts open file descriptors for *path* on your local
Larry Hastings9cf065c2012-06-22 16:30:09 -07002710 platform::
2711
2712 os.chdir in os.supports_fd
2713
2714 .. versionadded:: 3.3
2715
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002716
Larry Hastings9cf065c2012-06-22 16:30:09 -07002717.. data:: supports_follow_symlinks
2718
Cheryl Sabellae1521692019-05-06 08:39:13 -04002719 A :class:`set` object indicating which functions in the :mod:`os` module
2720 accept ``False`` for their *follow_symlinks* parameter on the local platform.
2721 Different platforms provide different features, and the underlying
2722 functionality Python uses to implement *follow_symlinks* is not available
2723 on all platforms Python supports. For consistency's sake, functions that
2724 may support *follow_symlinks* always allow specifying the parameter, but
2725 will throw an exception if the functionality is used when it's not locally
2726 available. (Specifying ``True`` for *follow_symlinks* is always supported
2727 on all platforms.)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002728
Cheryl Sabellae1521692019-05-06 08:39:13 -04002729 To check whether a particular function accepts ``False`` for its
2730 *follow_symlinks* parameter, use the ``in`` operator on
2731 ``supports_follow_symlinks``. As an example, this expression evaluates
2732 to ``True`` if you may specify ``follow_symlinks=False`` when calling
2733 :func:`os.stat` on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002734
2735 os.stat in os.supports_follow_symlinks
2736
2737 .. versionadded:: 3.3
2738
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002739
Martin Panterbf19d162015-09-09 01:01:13 +00002740.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002741
Martin Panterbf19d162015-09-09 01:01:13 +00002742 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002743
Larry Hastings9cf065c2012-06-22 16:30:09 -07002744 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002745 morph to the target dynamically. If the target is present, the type of the
2746 symlink will be created to match. Otherwise, the symlink will be created
2747 as a directory if *target_is_directory* is ``True`` or a file symlink (the
l-n-sdaeb3c42018-11-14 00:13:12 +00002748 default) otherwise. On non-Windows platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002749
Georg Brandl50c40002012-06-24 11:45:20 +02002750 This function can support :ref:`paths relative to directory descriptors
2751 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002752
Brian Curtin52173d42010-12-02 18:29:18 +00002753 .. note::
2754
Vidar Tonaas Fauske0e107662019-04-09 20:19:46 +02002755 On newer versions of Windows 10, unprivileged accounts can create symlinks
2756 if Developer Mode is enabled. When Developer Mode is not available/enabled,
2757 the *SeCreateSymbolicLinkPrivilege* privilege is required, or the process
2758 must be run as an administrator.
Brian Curtin96245592010-12-28 17:08:22 +00002759
Jason R. Coombs3a092862013-05-27 23:21:28 -04002760
Brian Curtin96245592010-12-28 17:08:22 +00002761 :exc:`OSError` is raised when the function is called by an unprivileged
2762 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002763
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002764 .. availability:: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002765
Georg Brandlb3823372010-07-10 08:58:37 +00002766 .. versionchanged:: 3.2
2767 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002768
Larry Hastings9cf065c2012-06-22 16:30:09 -07002769 .. versionadded:: 3.3
2770 Added the *dir_fd* argument, and now allow *target_is_directory*
2771 on non-Windows platforms.
2772
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002773 .. versionchanged:: 3.6
2774 Accepts a :term:`path-like object` for *src* and *dst*.
2775
Vidar Tonaas Fauske0e107662019-04-09 20:19:46 +02002776 .. versionchanged:: 3.8
2777 Added support for unelevated symlinks on Windows with Developer Mode.
2778
Georg Brandl116aa622007-08-15 14:28:22 +00002779
Ross Lagerwall7807c352011-03-17 20:20:30 +02002780.. function:: sync()
2781
2782 Force write of everything to disk.
2783
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002784 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002785
2786 .. versionadded:: 3.3
2787
2788
2789.. function:: truncate(path, length)
2790
2791 Truncate the file corresponding to *path*, so that it is at most
2792 *length* bytes in size.
2793
Georg Brandl306336b2012-06-24 12:55:33 +02002794 This function can support :ref:`specifying a file descriptor <path_fd>`.
2795
Steve Dower44f91c32019-06-27 10:47:59 -07002796 .. audit-event:: os.truncate path,length os.truncate
Steve Dowerb82e17e2019-05-23 08:45:22 -07002797
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002798 .. availability:: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002799
2800 .. versionadded:: 3.3
2801
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002802 .. versionchanged:: 3.5
2803 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002804
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002805 .. versionchanged:: 3.6
2806 Accepts a :term:`path-like object`.
2807
2808
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002809.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002810
Brett Cannon05039172015-12-28 17:28:19 -08002811 Remove (delete) the file *path*. This function is semantically
2812 identical to :func:`remove`; the ``unlink`` name is its
2813 traditional Unix name. Please see the documentation for
2814 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002815
Larry Hastings9cf065c2012-06-22 16:30:09 -07002816 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002817 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002818
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002819 .. versionchanged:: 3.6
2820 Accepts a :term:`path-like object`.
2821
Larry Hastings9cf065c2012-06-22 16:30:09 -07002822
Martin Panterbf19d162015-09-09 01:01:13 +00002823.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002824
Larry Hastings76ad59b2012-05-03 00:30:07 -07002825 Set the access and modified times of the file specified by *path*.
2826
2827 :func:`utime` takes two optional parameters, *times* and *ns*.
2828 These specify the times set on *path* and are used as follows:
2829
Martin Panterbf19d162015-09-09 01:01:13 +00002830 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002831 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2832 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002833 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002834 it must be a 2-tuple of the form ``(atime, mtime)``
2835 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002836 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002837 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002838 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002839
Larry Hastings9cf065c2012-06-22 16:30:09 -07002840 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002841
Stéphane Wirtel7508a542018-05-01 12:02:26 +02002842 Note that the exact times you set here may not be returned by a subsequent
2843 :func:`~os.stat` call, depending on the resolution with which your operating
2844 system records access and modification times; see :func:`~os.stat`. The best
2845 way to preserve exact times is to use the *st_atime_ns* and *st_mtime_ns*
2846 fields from the :func:`os.stat` result object with the *ns* parameter to
2847 `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002848
Georg Brandl50c40002012-06-24 11:45:20 +02002849 This function can support :ref:`specifying a file descriptor <path_fd>`,
2850 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2851 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002852
Larry Hastings76ad59b2012-05-03 00:30:07 -07002853 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04002854 Added support for specifying *path* as an open file descriptor,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002855 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002856
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002857 .. versionchanged:: 3.6
2858 Accepts a :term:`path-like object`.
2859
Georg Brandl116aa622007-08-15 14:28:22 +00002860
Georg Brandl18244152009-09-02 20:34:52 +00002861.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002862
2863 .. index::
2864 single: directory; walking
2865 single: directory; traversal
2866
Christian Heimesfaf2f632008-01-06 16:59:19 +00002867 Generate the file names in a directory tree by walking the tree
2868 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002869 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2870 filenames)``.
2871
2872 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2873 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2874 *filenames* is a list of the names of the non-directory files in *dirpath*.
2875 Note that the names in the lists contain no path components. To get a full path
2876 (which begins with *top*) to a file or directory in *dirpath*, do
2877 ``os.path.join(dirpath, name)``.
2878
Christian Heimesfaf2f632008-01-06 16:59:19 +00002879 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00002880 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07002881 (directories are generated top-down). If *topdown* is ``False``, the triple
2882 for a directory is generated after the triples for all of its subdirectories
2883 (directories are generated bottom-up). No matter the value of *topdown*, the
2884 list of subdirectories is retrieved before the tuples for the directory and
2885 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002886
Christian Heimesfaf2f632008-01-06 16:59:19 +00002887 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00002888 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
2889 recurse into the subdirectories whose names remain in *dirnames*; this can be
2890 used to prune the search, impose a specific order of visiting, or even to inform
2891 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02002892 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
2893 no effect on the behavior of the walk, because in bottom-up mode the directories
2894 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002895
Andrés Delfinobadb8942018-04-02 23:48:54 -03002896 By default, errors from the :func:`scandir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00002897 argument *onerror* is specified, it should be a function; it will be called with
2898 one argument, an :exc:`OSError` instance. It can report the error to continue
2899 with the walk, or raise the exception to abort the walk. Note that the filename
2900 is available as the ``filename`` attribute of the exception object.
2901
2902 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00002903 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00002904 symlinks, on systems that support them.
2905
Georg Brandl116aa622007-08-15 14:28:22 +00002906 .. note::
2907
Georg Brandl50c40002012-06-24 11:45:20 +02002908 Be aware that setting *followlinks* to ``True`` can lead to infinite
2909 recursion if a link points to a parent directory of itself. :func:`walk`
2910 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00002911
2912 .. note::
2913
2914 If you pass a relative pathname, don't change the current working directory
2915 between resumptions of :func:`walk`. :func:`walk` never changes the current
2916 directory, and assumes that its caller doesn't either.
2917
2918 This example displays the number of bytes taken by non-directory files in each
2919 directory under the starting directory, except that it doesn't look under any
2920 CVS subdirectory::
2921
2922 import os
2923 from os.path import join, getsize
2924 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00002925 print(root, "consumes", end=" ")
2926 print(sum(getsize(join(root, name)) for name in files), end=" ")
2927 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00002928 if 'CVS' in dirs:
2929 dirs.remove('CVS') # don't visit CVS directories
2930
Victor Stinner47c41b42015-03-10 13:31:47 +01002931 In the next example (simple implementation of :func:`shutil.rmtree`),
2932 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
2933 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00002934
Christian Heimesfaf2f632008-01-06 16:59:19 +00002935 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00002936 # assuming there are no symbolic links.
2937 # CAUTION: This is dangerous! For example, if top == '/', it
2938 # could delete all your disk files.
2939 import os
2940 for root, dirs, files in os.walk(top, topdown=False):
2941 for name in files:
2942 os.remove(os.path.join(root, name))
2943 for name in dirs:
2944 os.rmdir(os.path.join(root, name))
2945
Victor Stinner524a5ba2015-03-10 13:20:34 +01002946 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02002947 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
2948 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01002949
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002950 .. versionchanged:: 3.6
2951 Accepts a :term:`path-like object`.
2952
Georg Brandl116aa622007-08-15 14:28:22 +00002953
Larry Hastingsb4038062012-07-15 10:57:38 -07002954.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01002955
2956 .. index::
2957 single: directory; walking
2958 single: directory; traversal
2959
Eli Benderskyd049d5c2012-02-11 09:52:29 +02002960 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07002961 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01002962
2963 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
2964 and *dirfd* is a file descriptor referring to the directory *dirpath*.
2965
Larry Hastingsc48fe982012-06-25 04:49:05 -07002966 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07002967 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07002968 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07002969 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07002970
Charles-François Natali7372b062012-02-05 15:15:38 +01002971 .. note::
2972
2973 Since :func:`fwalk` yields file descriptors, those are only valid until
2974 the next iteration step, so you should duplicate them (e.g. with
2975 :func:`dup`) if you want to keep them longer.
2976
2977 This example displays the number of bytes taken by non-directory files in each
2978 directory under the starting directory, except that it doesn't look under any
2979 CVS subdirectory::
2980
2981 import os
2982 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
2983 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02002984 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01002985 end="")
2986 print("bytes in", len(files), "non-directory files")
2987 if 'CVS' in dirs:
2988 dirs.remove('CVS') # don't visit CVS directories
2989
2990 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002991 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01002992 empty::
2993
2994 # Delete everything reachable from the directory named in "top",
2995 # assuming there are no symbolic links.
2996 # CAUTION: This is dangerous! For example, if top == '/', it
2997 # could delete all your disk files.
2998 import os
2999 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
3000 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003001 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01003002 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003003 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01003004
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003005 .. availability:: Unix.
Charles-François Natali7372b062012-02-05 15:15:38 +01003006
3007 .. versionadded:: 3.3
3008
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003009 .. versionchanged:: 3.6
3010 Accepts a :term:`path-like object`.
3011
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02003012 .. versionchanged:: 3.7
3013 Added support for :class:`bytes` paths.
3014
Charles-François Natali7372b062012-02-05 15:15:38 +01003015
Zackery Spytz43fdbd22019-05-29 13:57:07 -06003016.. function:: memfd_create(name[, flags=os.MFD_CLOEXEC])
3017
3018 Create an anonymous file and return a file descriptor that refers to it.
3019 *flags* must be one of the ``os.MFD_*`` constants available on the system
3020 (or a bitwise ORed combination of them). By default, the new file
3021 descriptor is :ref:`non-inheritable <fd_inheritance>`.
3022
Victor Stinnerccf0efb2019-06-05 12:24:52 +02003023 The name supplied in *name* is used as a filename and will be displayed as
3024 the target of the corresponding symbolic link in the directory
3025 ``/proc/self/fd/``. The displayed name is always prefixed with ``memfd:``
3026 and serves only for debugging purposes. Names do not affect the behavior of
3027 the file descriptor, and as such multiple files can have the same name
3028 without any side effects.
3029
Zackery Spytz43fdbd22019-05-29 13:57:07 -06003030 .. availability:: Linux 3.17 or newer with glibc 2.27 or newer.
3031
3032 .. versionadded:: 3.8
3033
3034
3035.. data:: MFD_CLOEXEC
3036 MFD_ALLOW_SEALING
3037 MFD_HUGETLB
3038 MFD_HUGE_SHIFT
3039 MFD_HUGE_MASK
3040 MFD_HUGE_64KB
3041 MFD_HUGE_512KB
3042 MFD_HUGE_1MB
3043 MFD_HUGE_2MB
3044 MFD_HUGE_8MB
3045 MFD_HUGE_16MB
3046 MFD_HUGE_32MB
3047 MFD_HUGE_256MB
3048 MFD_HUGE_512MB
3049 MFD_HUGE_1GB
3050 MFD_HUGE_2GB
3051 MFD_HUGE_16GB
3052
3053 These flags can be passed to :func:`memfd_create`.
3054
3055 .. availability:: Linux 3.17 or newer with glibc 2.27 or newer. The
3056 ``MFD_HUGE*`` flags are only available since Linux 4.14.
3057
3058 .. versionadded:: 3.8
3059
3060
Georg Brandlb9831ab2012-06-24 11:57:07 +02003061Linux extended attributes
3062~~~~~~~~~~~~~~~~~~~~~~~~~
3063
3064.. versionadded:: 3.3
3065
3066These functions are all available on Linux only.
3067
3068.. function:: getxattr(path, attribute, *, follow_symlinks=True)
3069
3070 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003071 *path*. *attribute* can be bytes or str (directly or indirectly through the
3072 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
3073 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003074
3075 This function can support :ref:`specifying a file descriptor <path_fd>` and
3076 :ref:`not following symlinks <follow_symlinks>`.
3077
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003078 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03003079 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003080
Georg Brandlb9831ab2012-06-24 11:57:07 +02003081
3082.. function:: listxattr(path=None, *, follow_symlinks=True)
3083
3084 Return a list of the extended filesystem attributes on *path*. The
3085 attributes in the list are represented as strings decoded with the filesystem
3086 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
3087 directory.
3088
3089 This function can support :ref:`specifying a file descriptor <path_fd>` and
3090 :ref:`not following symlinks <follow_symlinks>`.
3091
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003092 .. versionchanged:: 3.6
3093 Accepts a :term:`path-like object`.
3094
Georg Brandlb9831ab2012-06-24 11:57:07 +02003095
3096.. function:: removexattr(path, attribute, *, follow_symlinks=True)
3097
3098 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003099 *attribute* should be bytes or str (directly or indirectly through the
3100 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02003101 with the filesystem encoding.
3102
3103 This function can support :ref:`specifying a file descriptor <path_fd>` and
3104 :ref:`not following symlinks <follow_symlinks>`.
3105
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003106 .. versionchanged:: 3.6
3107 Accepts a :term:`path-like object` for *path* and *attribute*.
3108
Georg Brandlb9831ab2012-06-24 11:57:07 +02003109
3110.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
3111
3112 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003113 *attribute* must be a bytes or str with no embedded NULs (directly or
3114 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02003115 it is encoded with the filesystem encoding. *flags* may be
3116 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
3117 given and the attribute does not exist, ``EEXISTS`` will be raised.
3118 If :data:`XATTR_CREATE` is given and the attribute already exists, the
3119 attribute will not be created and ``ENODATA`` will be raised.
3120
3121 This function can support :ref:`specifying a file descriptor <path_fd>` and
3122 :ref:`not following symlinks <follow_symlinks>`.
3123
3124 .. note::
3125
3126 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
3127 to be ignored on some filesystems.
3128
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003129 .. versionchanged:: 3.6
3130 Accepts a :term:`path-like object` for *path* and *attribute*.
3131
Georg Brandlb9831ab2012-06-24 11:57:07 +02003132
3133.. data:: XATTR_SIZE_MAX
3134
3135 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02003136 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003137
3138
3139.. data:: XATTR_CREATE
3140
3141 This is a possible value for the flags argument in :func:`setxattr`. It
3142 indicates the operation must create an attribute.
3143
3144
3145.. data:: XATTR_REPLACE
3146
3147 This is a possible value for the flags argument in :func:`setxattr`. It
3148 indicates the operation must replace an existing attribute.
3149
3150
Georg Brandl116aa622007-08-15 14:28:22 +00003151.. _os-process:
3152
3153Process Management
3154------------------
3155
3156These functions may be used to create and manage processes.
3157
Serhiy Storchakadab83542013-10-13 20:12:43 +03003158The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00003159program loaded into the process. In each case, the first of these arguments is
3160passed to the new program as its own name rather than as an argument a user may
3161have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00003162passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00003163['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
3164to be ignored.
3165
3166
3167.. function:: abort()
3168
3169 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
3170 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02003171 an exit code of ``3``. Be aware that calling this function will not call the
3172 Python signal handler registered for :const:`SIGABRT` with
3173 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003174
Georg Brandl116aa622007-08-15 14:28:22 +00003175
Steve Dower2438cdf2019-03-29 16:37:16 -07003176.. function:: add_dll_directory(path)
3177
3178 Add a path to the DLL search path.
3179
3180 This search path is used when resolving dependencies for imported
3181 extension modules (the module itself is resolved through sys.path),
3182 and also by :mod:`ctypes`.
3183
3184 Remove the directory by calling **close()** on the returned object
3185 or using it in a :keyword:`with` statement.
3186
3187 See the `Microsoft documentation
3188 <https://msdn.microsoft.com/44228cf2-6306-466c-8f16-f513cd3ba8b5>`_
3189 for more information about how DLLs are loaded.
3190
3191 .. availability:: Windows.
3192
3193 .. versionadded:: 3.8
3194 Previous versions of CPython would resolve DLLs using the default
3195 behavior for the current process. This led to inconsistencies,
3196 such as only sometimes searching :envvar:`PATH` or the current
3197 working directory, and OS functions such as ``AddDllDirectory``
3198 having no effect.
3199
3200 In 3.8, the two primary ways DLLs are loaded now explicitly
3201 override the process-wide behavior to ensure consistency. See the
3202 :ref:`porting notes <bpo-36085-whatsnew>` for information on
3203 updating libraries.
3204
3205
Georg Brandl116aa622007-08-15 14:28:22 +00003206.. function:: execl(path, arg0, arg1, ...)
3207 execle(path, arg0, arg1, ..., env)
3208 execlp(file, arg0, arg1, ...)
3209 execlpe(file, arg0, arg1, ..., env)
3210 execv(path, args)
3211 execve(path, args, env)
3212 execvp(file, args)
3213 execvpe(file, args, env)
3214
3215 These functions all execute a new program, replacing the current process; they
3216 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00003217 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00003218 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003219
3220 The current process is replaced immediately. Open file objects and
3221 descriptors are not flushed, so if there may be data buffered
3222 on these open files, you should flush them using
3223 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03003224 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00003225
Serhiy Storchakadab83542013-10-13 20:12:43 +03003226 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003227 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003228 to work with if the number of parameters is fixed when the code is written; the
3229 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003230 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00003231 variable, with the arguments being passed in a list or tuple as the *args*
3232 parameter. In either case, the arguments to the child process should start with
3233 the name of the command being run, but this is not enforced.
3234
Christian Heimesfaf2f632008-01-06 16:59:19 +00003235 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003236 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
3237 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003238 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003239 discussed in the next paragraph), the new environment is used as the source of
3240 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
3241 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
3242 locate the executable; *path* must contain an appropriate absolute or relative
3243 path.
3244
3245 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00003246 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00003247 used to define the environment variables for the new process (these are used
3248 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00003249 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003250 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003251
Larry Hastings9cf065c2012-06-22 16:30:09 -07003252 For :func:`execve` on some platforms, *path* may also be specified as an open
3253 file descriptor. This functionality may not be supported on your platform;
3254 you can check whether or not it is available using :data:`os.supports_fd`.
3255 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3256
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003257 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003258
Larry Hastings9cf065c2012-06-22 16:30:09 -07003259 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04003260 Added support for specifying *path* as an open file descriptor
Larry Hastings9cf065c2012-06-22 16:30:09 -07003261 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003262
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003263 .. versionchanged:: 3.6
3264 Accepts a :term:`path-like object`.
3265
Georg Brandl116aa622007-08-15 14:28:22 +00003266.. function:: _exit(n)
3267
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003268 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003269 stdio buffers, etc.
3270
Georg Brandl116aa622007-08-15 14:28:22 +00003271 .. note::
3272
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003273 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3274 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003275
Christian Heimesfaf2f632008-01-06 16:59:19 +00003276The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003277although they are not required. These are typically used for system programs
3278written in Python, such as a mail server's external command delivery program.
3279
3280.. note::
3281
3282 Some of these may not be available on all Unix platforms, since there is some
3283 variation. These constants are defined where they are defined by the underlying
3284 platform.
3285
3286
3287.. data:: EX_OK
3288
Benjamin Petersonf650e462010-05-06 23:03:05 +00003289 Exit code that means no error occurred.
3290
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003291 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003292
Georg Brandl116aa622007-08-15 14:28:22 +00003293
3294.. data:: EX_USAGE
3295
3296 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003297 number of arguments are given.
3298
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003299 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003300
Georg Brandl116aa622007-08-15 14:28:22 +00003301
3302.. data:: EX_DATAERR
3303
Benjamin Petersonf650e462010-05-06 23:03:05 +00003304 Exit code that means the input data was incorrect.
3305
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003306 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003307
Georg Brandl116aa622007-08-15 14:28:22 +00003308
3309.. data:: EX_NOINPUT
3310
3311 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003312
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003313 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003314
Georg Brandl116aa622007-08-15 14:28:22 +00003315
3316.. data:: EX_NOUSER
3317
Benjamin Petersonf650e462010-05-06 23:03:05 +00003318 Exit code that means a specified user did not exist.
3319
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003320 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003321
Georg Brandl116aa622007-08-15 14:28:22 +00003322
3323.. data:: EX_NOHOST
3324
Benjamin Petersonf650e462010-05-06 23:03:05 +00003325 Exit code that means a specified host did not exist.
3326
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003327 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003328
Georg Brandl116aa622007-08-15 14:28:22 +00003329
3330.. data:: EX_UNAVAILABLE
3331
Benjamin Petersonf650e462010-05-06 23:03:05 +00003332 Exit code that means that a required service is unavailable.
3333
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003334 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003335
Georg Brandl116aa622007-08-15 14:28:22 +00003336
3337.. data:: EX_SOFTWARE
3338
Benjamin Petersonf650e462010-05-06 23:03:05 +00003339 Exit code that means an internal software error was detected.
3340
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003341 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003342
Georg Brandl116aa622007-08-15 14:28:22 +00003343
3344.. data:: EX_OSERR
3345
3346 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003347 inability to fork or create a pipe.
3348
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003349 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003350
Georg Brandl116aa622007-08-15 14:28:22 +00003351
3352.. data:: EX_OSFILE
3353
3354 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003355 some other kind of error.
3356
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003357 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003358
Georg Brandl116aa622007-08-15 14:28:22 +00003359
3360.. data:: EX_CANTCREAT
3361
3362 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003363
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003364 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003365
Georg Brandl116aa622007-08-15 14:28:22 +00003366
3367.. data:: EX_IOERR
3368
3369 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003370
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003371 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003372
Georg Brandl116aa622007-08-15 14:28:22 +00003373
3374.. data:: EX_TEMPFAIL
3375
3376 Exit code that means a temporary failure occurred. This indicates something
3377 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003378 made during a retryable operation.
3379
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003380 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003381
Georg Brandl116aa622007-08-15 14:28:22 +00003382
3383.. data:: EX_PROTOCOL
3384
3385 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003386 understood.
3387
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003388 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003389
Georg Brandl116aa622007-08-15 14:28:22 +00003390
3391.. data:: EX_NOPERM
3392
3393 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003394 operation (but not intended for file system problems).
3395
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003396 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003397
Georg Brandl116aa622007-08-15 14:28:22 +00003398
3399.. data:: EX_CONFIG
3400
3401 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003402
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003403 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003404
Georg Brandl116aa622007-08-15 14:28:22 +00003405
3406.. data:: EX_NOTFOUND
3407
Benjamin Petersonf650e462010-05-06 23:03:05 +00003408 Exit code that means something like "an entry was not found".
3409
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003410 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003411
Georg Brandl116aa622007-08-15 14:28:22 +00003412
3413.. function:: fork()
3414
Christian Heimesfaf2f632008-01-06 16:59:19 +00003415 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003416 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003417
Larry Hastings3732ed22014-03-15 21:13:56 -07003418 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003419 known issues when using fork() from a thread.
3420
Christian Heimes3046fe42013-10-29 21:08:56 +01003421 .. warning::
3422
3423 See :mod:`ssl` for applications that use the SSL module with fork().
3424
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003425 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003426
3427
3428.. function:: forkpty()
3429
3430 Fork a child process, using a new pseudo-terminal as the child's controlling
3431 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3432 new child's process id in the parent, and *fd* is the file descriptor of the
3433 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003434 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003435
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003436 .. availability:: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003437
3438
3439.. function:: kill(pid, sig)
3440
3441 .. index::
3442 single: process; killing
3443 single: process; signalling
3444
3445 Send signal *sig* to the process *pid*. Constants for the specific signals
3446 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003447
3448 Windows: The :data:`signal.CTRL_C_EVENT` and
3449 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3450 only be sent to console processes which share a common console window,
3451 e.g., some subprocesses. Any other value for *sig* will cause the process
3452 to be unconditionally killed by the TerminateProcess API, and the exit code
3453 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3454 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003455
Victor Stinnerb3e72192011-05-08 01:46:11 +02003456 See also :func:`signal.pthread_kill`.
3457
Georg Brandl67b21b72010-08-17 15:07:14 +00003458 .. versionadded:: 3.2
3459 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003460
Georg Brandl116aa622007-08-15 14:28:22 +00003461
3462.. function:: killpg(pgid, sig)
3463
3464 .. index::
3465 single: process; killing
3466 single: process; signalling
3467
Benjamin Petersonf650e462010-05-06 23:03:05 +00003468 Send the signal *sig* to the process group *pgid*.
3469
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003470 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003471
Georg Brandl116aa622007-08-15 14:28:22 +00003472
3473.. function:: nice(increment)
3474
3475 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003476
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003477 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003478
3479
3480.. function:: plock(op)
3481
3482 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003483 ``<sys/lock.h>``) determines which segments are locked.
3484
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003485 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003486
3487
Martin Panterbf19d162015-09-09 01:01:13 +00003488.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003489
Martin Panterbf19d162015-09-09 01:01:13 +00003490 Open a pipe to or from command *cmd*.
3491 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003492 connected to the pipe, which can be read or written depending on whether *mode*
3493 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3494 the corresponding argument to the built-in :func:`open` function. The
3495 returned file object reads or writes text strings rather than bytes.
3496
3497 The ``close`` method returns :const:`None` if the subprocess exited
3498 successfully, or the subprocess's return code if there was an
3499 error. On POSIX systems, if the return code is positive it
3500 represents the return value of the process left-shifted by one
3501 byte. If the return code is negative, the process was terminated
3502 by the signal given by the negated value of the return code. (For
3503 example, the return value might be ``- signal.SIGKILL`` if the
3504 subprocess was killed.) On Windows systems, the return value
3505 contains the signed integer return code from the child process.
3506
3507 This is implemented using :class:`subprocess.Popen`; see that class's
3508 documentation for more powerful ways to manage and communicate with
3509 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003510
3511
Serhiy Storchakad700f972018-09-08 14:48:18 +03003512.. function:: posix_spawn(path, argv, env, *, file_actions=None, \
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003513 setpgroup=None, resetids=False, setsid=False, setsigmask=(), \
Pablo Galindo254a4662018-09-07 16:44:24 +01003514 setsigdef=(), scheduler=None)
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003515
Serhiy Storchakaef347532018-05-01 16:45:04 +03003516 Wraps the :c:func:`posix_spawn` C library API for use from Python.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003517
Serhiy Storchakaef347532018-05-01 16:45:04 +03003518 Most users should use :func:`subprocess.run` instead of :func:`posix_spawn`.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003519
Serhiy Storchakad700f972018-09-08 14:48:18 +03003520 The positional-only arguments *path*, *args*, and *env* are similar to
3521 :func:`execve`.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003522
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003523 The *path* parameter is the path to the executable file.The *path* should
3524 contain a directory.Use :func:`posix_spawnp` to pass an executable file
3525 without directory.
3526
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003527 The *file_actions* argument may be a sequence of tuples describing actions
3528 to take on specific file descriptors in the child process between the C
Serhiy Storchakaef347532018-05-01 16:45:04 +03003529 library implementation's :c:func:`fork` and :c:func:`exec` steps.
3530 The first item in each tuple must be one of the three type indicator
3531 listed below describing the remaining tuple elements:
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003532
Serhiy Storchakaef347532018-05-01 16:45:04 +03003533 .. data:: POSIX_SPAWN_OPEN
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003534
Serhiy Storchakaef347532018-05-01 16:45:04 +03003535 (``os.POSIX_SPAWN_OPEN``, *fd*, *path*, *flags*, *mode*)
3536
3537 Performs ``os.dup2(os.open(path, flags, mode), fd)``.
3538
3539 .. data:: POSIX_SPAWN_CLOSE
3540
3541 (``os.POSIX_SPAWN_CLOSE``, *fd*)
3542
3543 Performs ``os.close(fd)``.
3544
3545 .. data:: POSIX_SPAWN_DUP2
3546
3547 (``os.POSIX_SPAWN_DUP2``, *fd*, *new_fd*)
3548
3549 Performs ``os.dup2(fd, new_fd)``.
3550
3551 These tuples correspond to the C library
3552 :c:func:`posix_spawn_file_actions_addopen`,
3553 :c:func:`posix_spawn_file_actions_addclose`, and
3554 :c:func:`posix_spawn_file_actions_adddup2` API calls used to prepare
3555 for the :c:func:`posix_spawn` call itself.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003556
Pablo Galindo254a4662018-09-07 16:44:24 +01003557 The *setpgroup* argument will set the process group of the child to the value
3558 specified. If the value specified is 0, the child's process group ID will be
3559 made the same as its process ID. If the value of *setpgroup* is not set, the
3560 child will inherit the parent's process group ID. This argument corresponds
3561 to the C library :c:data:`POSIX_SPAWN_SETPGROUP` flag.
3562
3563 If the *resetids* argument is ``True`` it will reset the effective UID and
3564 GID of the child to the real UID and GID of the parent process. If the
3565 argument is ``False``, then the child retains the effective UID and GID of
3566 the parent. In either case, if the set-user-ID and set-group-ID permission
3567 bits are enabled on the executable file, their effect will override the
3568 setting of the effective UID and GID. This argument corresponds to the C
3569 library :c:data:`POSIX_SPAWN_RESETIDS` flag.
3570
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003571 If the *setsid* argument is ``True``, it will create a new session ID
3572 for `posix_spawn`. *setsid* requires :c:data:`POSIX_SPAWN_SETSID`
3573 or :c:data:`POSIX_SPAWN_SETSID_NP` flag. Otherwise, :exc:`NotImplementedError`
3574 is raised.
3575
Pablo Galindo254a4662018-09-07 16:44:24 +01003576 The *setsigmask* argument will set the signal mask to the signal set
3577 specified. If the parameter is not used, then the child inherits the
3578 parent's signal mask. This argument corresponds to the C library
3579 :c:data:`POSIX_SPAWN_SETSIGMASK` flag.
3580
3581 The *sigdef* argument will reset the disposition of all signals in the set
3582 specified. This argument corresponds to the C library
3583 :c:data:`POSIX_SPAWN_SETSIGDEF` flag.
3584
3585 The *scheduler* argument must be a tuple containing the (optional) scheduler
3586 policy and an instance of :class:`sched_param` with the scheduler parameters.
3587 A value of ``None`` in the place of the scheduler policy indicates that is
3588 not being provided. This argument is a combination of the C library
3589 :c:data:`POSIX_SPAWN_SETSCHEDPARAM` and :c:data:`POSIX_SPAWN_SETSCHEDULER`
3590 flags.
3591
Mark Williams8b504002019-03-03 09:42:25 -08003592 .. versionadded:: 3.8
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003593
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003594 .. availability:: Unix.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003595
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003596.. function:: posix_spawnp(path, argv, env, *, file_actions=None, \
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003597 setpgroup=None, resetids=False, setsid=False, setsigmask=(), \
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003598 setsigdef=(), scheduler=None)
3599
3600 Wraps the :c:func:`posix_spawnp` C library API for use from Python.
3601
3602 Similar to :func:`posix_spawn` except that the system searches
3603 for the *executable* file in the list of directories specified by the
3604 :envvar:`PATH` environment variable (in the same way as for ``execvp(3)``).
3605
3606 .. versionadded:: 3.8
3607
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003608 .. availability:: See :func:`posix_spawn` documentation.
3609
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003610
Gregory P. Smith163468a2017-05-29 10:03:41 -07003611.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3612 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003613
Gregory P. Smith163468a2017-05-29 10:03:41 -07003614 Register callables to be executed when a new child process is forked
3615 using :func:`os.fork` or similar process cloning APIs.
3616 The parameters are optional and keyword-only.
3617 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003618
Gregory P. Smith163468a2017-05-29 10:03:41 -07003619 * *before* is a function called before forking a child process.
3620 * *after_in_parent* is a function called from the parent process
3621 after forking a child process.
3622 * *after_in_child* is a function called from the child process.
3623
3624 These calls are only made if control is expected to return to the
3625 Python interpreter. A typical :mod:`subprocess` launch will not
3626 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003627
3628 Functions registered for execution before forking are called in
3629 reverse registration order. Functions registered for execution
3630 after forking (either in the parent or in the child) are called
3631 in registration order.
3632
3633 Note that :c:func:`fork` calls made by third-party C code may not
3634 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3635 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3636
Gregory P. Smith163468a2017-05-29 10:03:41 -07003637 There is no way to unregister a function.
3638
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003639 .. availability:: Unix.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003640
3641 .. versionadded:: 3.7
3642
3643
Georg Brandl116aa622007-08-15 14:28:22 +00003644.. function:: spawnl(mode, path, ...)
3645 spawnle(mode, path, ..., env)
3646 spawnlp(mode, file, ...)
3647 spawnlpe(mode, file, ..., env)
3648 spawnv(mode, path, args)
3649 spawnve(mode, path, args, env)
3650 spawnvp(mode, file, args)
3651 spawnvpe(mode, file, args, env)
3652
3653 Execute the program *path* in a new process.
3654
3655 (Note that the :mod:`subprocess` module provides more powerful facilities for
3656 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003657 preferable to using these functions. Check especially the
3658 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003659
Christian Heimesfaf2f632008-01-06 16:59:19 +00003660 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003661 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3662 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003663 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003664 be used with the :func:`waitpid` function.
3665
pxinwrf2d7ac72019-05-21 18:46:37 +08003666 Note on VxWorks, this function doesn't return ``-signal`` when the new process is
3667 killed. Instead it raises OSError exception.
3668
Serhiy Storchakadab83542013-10-13 20:12:43 +03003669 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003670 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003671 to work with if the number of parameters is fixed when the code is written; the
3672 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003673 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003674 parameters is variable, with the arguments being passed in a list or tuple as
3675 the *args* parameter. In either case, the arguments to the child process must
3676 start with the name of the command being run.
3677
Christian Heimesfaf2f632008-01-06 16:59:19 +00003678 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003679 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3680 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003681 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003682 discussed in the next paragraph), the new environment is used as the source of
3683 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3684 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3685 :envvar:`PATH` variable to locate the executable; *path* must contain an
3686 appropriate absolute or relative path.
3687
3688 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003689 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003690 which is used to define the environment variables for the new process (they are
3691 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003692 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003693 the new process to inherit the environment of the current process. Note that
3694 keys and values in the *env* dictionary must be strings; invalid keys or
3695 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003696
3697 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3698 equivalent::
3699
3700 import os
3701 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3702
3703 L = ['cp', 'index.html', '/dev/null']
3704 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3705
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003706 .. availability:: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
3707 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3708 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3709 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003710
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003711 .. versionchanged:: 3.6
3712 Accepts a :term:`path-like object`.
3713
Georg Brandl116aa622007-08-15 14:28:22 +00003714
3715.. data:: P_NOWAIT
3716 P_NOWAITO
3717
Serhiy Storchakadab83542013-10-13 20:12:43 +03003718 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003719 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003720 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003721 the return value.
3722
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003723 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003724
Georg Brandl116aa622007-08-15 14:28:22 +00003725
3726.. data:: P_WAIT
3727
Serhiy Storchakadab83542013-10-13 20:12:43 +03003728 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003729 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3730 return until the new process has run to completion and will return the exit code
3731 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003732 process.
3733
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003734 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003735
Georg Brandl116aa622007-08-15 14:28:22 +00003736
3737.. data:: P_DETACH
3738 P_OVERLAY
3739
Serhiy Storchakadab83542013-10-13 20:12:43 +03003740 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003741 functions. These are less portable than those listed above. :const:`P_DETACH`
3742 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3743 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003744 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003745
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003746 .. availability:: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003747
Georg Brandl116aa622007-08-15 14:28:22 +00003748
3749.. function:: startfile(path[, operation])
3750
3751 Start a file with its associated application.
3752
3753 When *operation* is not specified or ``'open'``, this acts like double-clicking
3754 the file in Windows Explorer, or giving the file name as an argument to the
3755 :program:`start` command from the interactive command shell: the file is opened
3756 with whatever application (if any) its extension is associated.
3757
3758 When another *operation* is given, it must be a "command verb" that specifies
3759 what should be done with the file. Common verbs documented by Microsoft are
3760 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3761 ``'find'`` (to be used on directories).
3762
3763 :func:`startfile` returns as soon as the associated application is launched.
3764 There is no option to wait for the application to close, and no way to retrieve
3765 the application's exit status. The *path* parameter is relative to the current
3766 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003767 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003768 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003769 the path is properly encoded for Win32.
3770
Steve Dower7d0e0c92015-01-24 08:18:24 -08003771 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3772 function is not resolved until this function is first called. If the function
3773 cannot be resolved, :exc:`NotImplementedError` will be raised.
3774
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003775 .. availability:: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003776
Georg Brandl116aa622007-08-15 14:28:22 +00003777
3778.. function:: system(command)
3779
3780 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003781 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003782 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3783 the executed command. If *command* generates any output, it will be sent to
3784 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003785
3786 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003787 format specified for :func:`wait`. Note that POSIX does not specify the
3788 meaning of the return value of the C :c:func:`system` function, so the return
3789 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003790
Georg Brandl8f7b4272010-10-14 06:35:53 +00003791 On Windows, the return value is that returned by the system shell after
3792 running *command*. The shell is given by the Windows environment variable
3793 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3794 status of the command run; on systems using a non-native shell, consult your
3795 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003796
Georg Brandl8f7b4272010-10-14 06:35:53 +00003797 The :mod:`subprocess` module provides more powerful facilities for spawning
3798 new processes and retrieving their results; using that module is preferable
3799 to using this function. See the :ref:`subprocess-replacements` section in
3800 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003801
Steve Dower44f91c32019-06-27 10:47:59 -07003802 .. audit-event:: os.system command os.system
Steve Dowerb82e17e2019-05-23 08:45:22 -07003803
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003804 .. availability:: Unix, Windows.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003805
Georg Brandl116aa622007-08-15 14:28:22 +00003806
3807.. function:: times()
3808
Larry Hastings605a62d2012-06-24 04:33:36 -07003809 Returns the current global process times.
3810 The return value is an object with five attributes:
3811
3812 * :attr:`user` - user time
3813 * :attr:`system` - system time
3814 * :attr:`children_user` - user time of all child processes
3815 * :attr:`children_system` - system time of all child processes
3816 * :attr:`elapsed` - elapsed real time since a fixed point in the past
3817
3818 For backwards compatibility, this object also behaves like a five-tuple
3819 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
3820 :attr:`children_system`, and :attr:`elapsed` in that order.
3821
3822 See the Unix manual page
Benjamin Petersonf650e462010-05-06 23:03:05 +00003823 :manpage:`times(2)` or the corresponding Windows Platform API documentation.
Larry Hastings605a62d2012-06-24 04:33:36 -07003824 On Windows, only :attr:`user` and :attr:`system` are known; the other
3825 attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003826
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003827 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003828
Larry Hastings605a62d2012-06-24 04:33:36 -07003829 .. versionchanged:: 3.3
3830 Return type changed from a tuple to a tuple-like object
3831 with named attributes.
3832
Georg Brandl116aa622007-08-15 14:28:22 +00003833
3834.. function:: wait()
3835
3836 Wait for completion of a child process, and return a tuple containing its pid
3837 and exit status indication: a 16-bit number, whose low byte is the signal number
3838 that killed the process, and whose high byte is the exit status (if the signal
3839 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003840 produced.
3841
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003842 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003843
Ross Lagerwall7807c352011-03-17 20:20:30 +02003844.. function:: waitid(idtype, id, options)
3845
3846 Wait for the completion of one or more child processes.
3847 *idtype* can be :data:`P_PID`, :data:`P_PGID` or :data:`P_ALL`.
3848 *id* specifies the pid to wait on.
3849 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
3850 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
3851 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
3852 representing the data contained in the :c:type:`siginfo_t` structure, namely:
3853 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
3854 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
3855 children in a waitable state.
3856
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003857 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02003858
3859 .. versionadded:: 3.3
3860
3861.. data:: P_PID
3862 P_PGID
3863 P_ALL
3864
3865 These are the possible values for *idtype* in :func:`waitid`. They affect
3866 how *id* is interpreted.
3867
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003868 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02003869
3870 .. versionadded:: 3.3
3871
3872.. data:: WEXITED
3873 WSTOPPED
3874 WNOWAIT
3875
3876 Flags that can be used in *options* in :func:`waitid` that specify what
3877 child signal to wait for.
3878
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003879 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02003880
3881 .. versionadded:: 3.3
3882
3883
3884.. data:: CLD_EXITED
3885 CLD_DUMPED
3886 CLD_TRAPPED
3887 CLD_CONTINUED
3888
3889 These are the possible values for :attr:`si_code` in the result returned by
3890 :func:`waitid`.
3891
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003892 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02003893
3894 .. versionadded:: 3.3
3895
Georg Brandl116aa622007-08-15 14:28:22 +00003896
3897.. function:: waitpid(pid, options)
3898
3899 The details of this function differ on Unix and Windows.
3900
3901 On Unix: Wait for completion of a child process given by process id *pid*, and
3902 return a tuple containing its process id and exit status indication (encoded as
3903 for :func:`wait`). The semantics of the call are affected by the value of the
3904 integer *options*, which should be ``0`` for normal operation.
3905
3906 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
3907 that specific process. If *pid* is ``0``, the request is for the status of any
3908 child in the process group of the current process. If *pid* is ``-1``, the
3909 request pertains to any child of the current process. If *pid* is less than
3910 ``-1``, status is requested for any process in the process group ``-pid`` (the
3911 absolute value of *pid*).
3912
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00003913 An :exc:`OSError` is raised with the value of errno when the syscall
3914 returns -1.
3915
Georg Brandl116aa622007-08-15 14:28:22 +00003916 On Windows: Wait for completion of a process given by process handle *pid*, and
3917 return a tuple containing *pid*, and its exit status shifted left by 8 bits
3918 (shifting makes cross-platform use of the function easier). A *pid* less than or
3919 equal to ``0`` has no special meaning on Windows, and raises an exception. The
3920 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03003921 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
3922 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00003923
Victor Stinnera766ddf2015-03-26 23:50:57 +01003924 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02003925 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01003926 exception, the function now retries the system call instead of raising an
3927 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
3928
Georg Brandl116aa622007-08-15 14:28:22 +00003929
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02003930.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00003931
3932 Similar to :func:`waitpid`, except no process id argument is given and a
Serhiy Storchaka3f819ca2018-10-31 02:26:06 +02003933 3-element tuple containing the child's process id, exit status indication,
3934 and resource usage information is returned. Refer to
3935 :mod:`resource`.\ :func:`~resource.getrusage` for details on resource usage
3936 information. The option argument is the same as that provided to
3937 :func:`waitpid` and :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003938
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003939 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003940
Georg Brandl116aa622007-08-15 14:28:22 +00003941
Victor Stinner4195b5c2012-02-08 23:03:19 +01003942.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00003943
3944 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
3945 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03003946 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
3947 resource usage information. The arguments to :func:`wait4` are the same
3948 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003949
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003950 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003951
Georg Brandl116aa622007-08-15 14:28:22 +00003952
3953.. data:: WNOHANG
3954
3955 The option for :func:`waitpid` to return immediately if no child process status
3956 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003957
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003958 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003959
3960
3961.. data:: WCONTINUED
3962
3963 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00003964 from a job control stop since their status was last reported.
3965
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003966 .. availability:: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00003967
Georg Brandl116aa622007-08-15 14:28:22 +00003968
3969.. data:: WUNTRACED
3970
3971 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00003972 their current state has not been reported since they were stopped.
3973
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003974 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003975
Georg Brandl116aa622007-08-15 14:28:22 +00003976
3977The following functions take a process status code as returned by
3978:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
3979used to determine the disposition of a process.
3980
Georg Brandl116aa622007-08-15 14:28:22 +00003981.. function:: WCOREDUMP(status)
3982
Christian Heimesfaf2f632008-01-06 16:59:19 +00003983 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00003984 return ``False``.
3985
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003986 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003987
Georg Brandl116aa622007-08-15 14:28:22 +00003988
3989.. function:: WIFCONTINUED(status)
3990
Christian Heimesfaf2f632008-01-06 16:59:19 +00003991 Return ``True`` if the process has been continued from a job control stop,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003992 otherwise return ``False``.
3993
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003994 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003995
Georg Brandl116aa622007-08-15 14:28:22 +00003996
3997.. function:: WIFSTOPPED(status)
3998
Christian Heimesfaf2f632008-01-06 16:59:19 +00003999 Return ``True`` if the process has been stopped, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00004000 ``False``.
4001
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004002 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004003
4004
4005.. function:: WIFSIGNALED(status)
4006
Christian Heimesfaf2f632008-01-06 16:59:19 +00004007 Return ``True`` if the process exited due to a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00004008 ``False``.
4009
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004010 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004011
4012
4013.. function:: WIFEXITED(status)
4014
Christian Heimesfaf2f632008-01-06 16:59:19 +00004015 Return ``True`` if the process exited using the :manpage:`exit(2)` system call,
Benjamin Petersonf650e462010-05-06 23:03:05 +00004016 otherwise return ``False``.
4017
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004018 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004019
4020
4021.. function:: WEXITSTATUS(status)
4022
4023 If ``WIFEXITED(status)`` is true, return the integer parameter to the
4024 :manpage:`exit(2)` system call. Otherwise, the return value is meaningless.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004025
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004026 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004027
4028
4029.. function:: WSTOPSIG(status)
4030
Benjamin Petersonf650e462010-05-06 23:03:05 +00004031 Return the signal which caused the process to stop.
4032
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004033 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004034
4035
4036.. function:: WTERMSIG(status)
4037
Benjamin Petersonf650e462010-05-06 23:03:05 +00004038 Return the signal which caused the process to exit.
4039
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004040 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004041
4042
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004043Interface to the scheduler
4044--------------------------
4045
4046These functions control how a process is allocated CPU time by the operating
4047system. They are only available on some Unix platforms. For more detailed
4048information, consult your Unix manpages.
4049
4050.. versionadded:: 3.3
4051
Andrew Kuchling4921a082013-06-21 11:49:57 -04004052The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004053operating system.
4054
4055.. data:: SCHED_OTHER
4056
4057 The default scheduling policy.
4058
4059.. data:: SCHED_BATCH
4060
4061 Scheduling policy for CPU-intensive processes that tries to preserve
4062 interactivity on the rest of the computer.
4063
4064.. data:: SCHED_IDLE
4065
4066 Scheduling policy for extremely low priority background tasks.
4067
4068.. data:: SCHED_SPORADIC
4069
4070 Scheduling policy for sporadic server programs.
4071
4072.. data:: SCHED_FIFO
4073
4074 A First In First Out scheduling policy.
4075
4076.. data:: SCHED_RR
4077
4078 A round-robin scheduling policy.
4079
4080.. data:: SCHED_RESET_ON_FORK
4081
Martin Panter8d56c022016-05-29 04:13:35 +00004082 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004083 this flag set forks, its child's scheduling policy and priority are reset to
4084 the default.
4085
4086
4087.. class:: sched_param(sched_priority)
4088
4089 This class represents tunable scheduling parameters used in
4090 :func:`sched_setparam`, :func:`sched_setscheduler`, and
4091 :func:`sched_getparam`. It is immutable.
4092
4093 At the moment, there is only one possible parameter:
4094
4095 .. attribute:: sched_priority
4096
4097 The scheduling priority for a scheduling policy.
4098
4099
4100.. function:: sched_get_priority_min(policy)
4101
4102 Get the minimum priority value for *policy*. *policy* is one of the
4103 scheduling policy constants above.
4104
4105
4106.. function:: sched_get_priority_max(policy)
4107
4108 Get the maximum priority value for *policy*. *policy* is one of the
4109 scheduling policy constants above.
4110
4111
4112.. function:: sched_setscheduler(pid, policy, param)
4113
4114 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
4115 the calling process. *policy* is one of the scheduling policy constants
4116 above. *param* is a :class:`sched_param` instance.
4117
4118
4119.. function:: sched_getscheduler(pid)
4120
4121 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
4122 means the calling process. The result is one of the scheduling policy
4123 constants above.
4124
4125
4126.. function:: sched_setparam(pid, param)
4127
4128 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
4129 the calling process. *param* is a :class:`sched_param` instance.
4130
4131
4132.. function:: sched_getparam(pid)
4133
4134 Return the scheduling parameters as a :class:`sched_param` instance for the
4135 process with PID *pid*. A *pid* of 0 means the calling process.
4136
4137
4138.. function:: sched_rr_get_interval(pid)
4139
4140 Return the round-robin quantum in seconds for the process with PID *pid*. A
4141 *pid* of 0 means the calling process.
4142
4143
4144.. function:: sched_yield()
4145
4146 Voluntarily relinquish the CPU.
4147
4148
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004149.. function:: sched_setaffinity(pid, mask)
4150
Antoine Pitrou84869872012-08-04 16:16:35 +02004151 Restrict the process with PID *pid* (or the current process if zero) to a
4152 set of CPUs. *mask* is an iterable of integers representing the set of
4153 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004154
4155
Antoine Pitrou84869872012-08-04 16:16:35 +02004156.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004157
Antoine Pitrou84869872012-08-04 16:16:35 +02004158 Return the set of CPUs the process with PID *pid* (or the current process
4159 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004160
4161
Georg Brandl116aa622007-08-15 14:28:22 +00004162.. _os-path:
4163
4164Miscellaneous System Information
4165--------------------------------
4166
4167
4168.. function:: confstr(name)
4169
4170 Return string-valued system configuration values. *name* specifies the
4171 configuration value to retrieve; it may be a string which is the name of a
4172 defined system value; these names are specified in a number of standards (POSIX,
4173 Unix 95, Unix 98, and others). Some platforms define additional names as well.
4174 The names known to the host operating system are given as the keys of the
4175 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00004176 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00004177
4178 If the configuration value specified by *name* isn't defined, ``None`` is
4179 returned.
4180
4181 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
4182 specific value for *name* is not supported by the host system, even if it is
4183 included in ``confstr_names``, an :exc:`OSError` is raised with
4184 :const:`errno.EINVAL` for the error number.
4185
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004186 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004187
Georg Brandl116aa622007-08-15 14:28:22 +00004188
4189.. data:: confstr_names
4190
4191 Dictionary mapping names accepted by :func:`confstr` to the integer values
4192 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004193 determine the set of names known to the system.
4194
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004195 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004196
4197
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004198.. function:: cpu_count()
4199
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03004200 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004201
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01004202 This number is not equivalent to the number of CPUs the current process can
4203 use. The number of usable CPUs can be obtained with
4204 ``len(os.sched_getaffinity(0))``
4205
4206
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004207 .. versionadded:: 3.4
4208
4209
Georg Brandl116aa622007-08-15 14:28:22 +00004210.. function:: getloadavg()
4211
Christian Heimesa62da1d2008-01-12 19:39:10 +00004212 Return the number of processes in the system run queue averaged over the last
4213 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00004214 unobtainable.
4215
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004216 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004217
Georg Brandl116aa622007-08-15 14:28:22 +00004218
4219.. function:: sysconf(name)
4220
4221 Return integer-valued system configuration values. If the configuration value
4222 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
4223 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
4224 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004225
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004226 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004227
4228
4229.. data:: sysconf_names
4230
4231 Dictionary mapping names accepted by :func:`sysconf` to the integer values
4232 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004233 determine the set of names known to the system.
4234
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004235 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004236
Christian Heimesfaf2f632008-01-06 16:59:19 +00004237The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00004238are defined for all platforms.
4239
4240Higher-level operations on pathnames are defined in the :mod:`os.path` module.
4241
4242
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004243.. index:: single: . (dot); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004244.. data:: curdir
4245
4246 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00004247 directory. This is ``'.'`` for Windows and POSIX. Also available via
4248 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004249
4250
Serhiy Storchakaddb961d2018-10-26 09:00:49 +03004251.. index:: single: ..; in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004252.. data:: pardir
4253
4254 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00004255 directory. This is ``'..'`` for Windows and POSIX. Also available via
4256 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004257
4258
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004259.. index:: single: / (slash); in pathnames
4260.. index:: single: \ (backslash); in pathnames (Windows)
Georg Brandl116aa622007-08-15 14:28:22 +00004261.. data:: sep
4262
Georg Brandlc575c902008-09-13 17:46:05 +00004263 The character used by the operating system to separate pathname components.
4264 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
4265 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00004266 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
4267 useful. Also available via :mod:`os.path`.
4268
4269
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004270.. index:: single: / (slash); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004271.. data:: altsep
4272
4273 An alternative character used by the operating system to separate pathname
4274 components, or ``None`` if only one separator character exists. This is set to
4275 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
4276 :mod:`os.path`.
4277
4278
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004279.. index:: single: . (dot); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004280.. data:: extsep
4281
4282 The character which separates the base filename from the extension; for example,
4283 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
4284
Georg Brandl116aa622007-08-15 14:28:22 +00004285
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004286.. index:: single: : (colon); path separator (POSIX)
4287 single: ; (semicolon)
Georg Brandl116aa622007-08-15 14:28:22 +00004288.. data:: pathsep
4289
4290 The character conventionally used by the operating system to separate search
4291 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
4292 Windows. Also available via :mod:`os.path`.
4293
4294
4295.. data:: defpath
4296
Serhiy Storchakadab83542013-10-13 20:12:43 +03004297 The default search path used by :func:`exec\*p\* <execl>` and
4298 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
4299 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004300
4301
4302.. data:: linesep
4303
4304 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00004305 platform. This may be a single character, such as ``'\n'`` for POSIX, or
4306 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
4307 *os.linesep* as a line terminator when writing files opened in text mode (the
4308 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00004309
4310
4311.. data:: devnull
4312
Georg Brandl850a9902010-05-21 22:04:32 +00004313 The file path of the null device. For example: ``'/dev/null'`` for
4314 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004315
Andrew Kuchling4921a082013-06-21 11:49:57 -04004316.. data:: RTLD_LAZY
4317 RTLD_NOW
4318 RTLD_GLOBAL
4319 RTLD_LOCAL
4320 RTLD_NODELETE
4321 RTLD_NOLOAD
4322 RTLD_DEEPBIND
4323
4324 Flags for use with the :func:`~sys.setdlopenflags` and
4325 :func:`~sys.getdlopenflags` functions. See the Unix manual page
4326 :manpage:`dlopen(3)` for what the different flags mean.
4327
4328 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00004329
Georg Brandl116aa622007-08-15 14:28:22 +00004330
Victor Stinner9b1f4742016-09-06 16:18:52 -07004331Random numbers
4332--------------
Georg Brandl116aa622007-08-15 14:28:22 +00004333
4334
Victor Stinner9b1f4742016-09-06 16:18:52 -07004335.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00004336
Victor Stinner9b1f4742016-09-06 16:18:52 -07004337 Get up to *size* random bytes. The function can return less bytes than
4338 requested.
4339
4340 These bytes can be used to seed user-space random number generators or for
4341 cryptographic purposes.
4342
4343 ``getrandom()`` relies on entropy gathered from device drivers and other
4344 sources of environmental noise. Unnecessarily reading large quantities of
4345 data will have a negative impact on other users of the ``/dev/random`` and
4346 ``/dev/urandom`` devices.
4347
4348 The flags argument is a bit mask that can contain zero or more of the
4349 following values ORed together: :py:data:`os.GRND_RANDOM` and
4350 :py:data:`GRND_NONBLOCK`.
4351
4352 See also the `Linux getrandom() manual page
4353 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
4354
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004355 .. availability:: Linux 3.17 and newer.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004356
4357 .. versionadded:: 3.6
4358
4359.. function:: urandom(size)
4360
4361 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004362
4363 This function returns random bytes from an OS-specific randomness source. The
4364 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004365 though its exact quality depends on the OS implementation.
4366
Victor Stinnere66987e2016-09-06 16:33:52 -07004367 On Linux, if the ``getrandom()`` syscall is available, it is used in
4368 blocking mode: block until the system urandom entropy pool is initialized
4369 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4370 the rationale. On Linux, the :func:`getrandom` function can be used to get
4371 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4372 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004373
Victor Stinnere66987e2016-09-06 16:33:52 -07004374 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4375 device. If the ``/dev/urandom`` device is not available or not readable, the
4376 :exc:`NotImplementedError` exception is raised.
4377
4378 On Windows, it will use ``CryptGenRandom()``.
4379
4380 .. seealso::
4381 The :mod:`secrets` module provides higher level functions. For an
4382 easy-to-use interface to the random number generator provided by your
4383 platform, please see :class:`random.SystemRandom`.
4384
4385 .. versionchanged:: 3.6.0
4386 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4387 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004388
Victor Stinnerdddf4842016-06-07 11:21:42 +02004389 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004390 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4391 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004392
Victor Stinnerace88482015-07-29 02:28:32 +02004393 .. versionchanged:: 3.5
4394 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4395 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4396 function is now used. These functions avoid the usage of an internal file
4397 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004398
4399.. data:: GRND_NONBLOCK
4400
4401 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4402 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4403 if the entropy pool has not yet been initialized.
4404
4405 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4406 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4407
4408 .. versionadded:: 3.6
4409
4410.. data:: GRND_RANDOM
4411
4412 If this bit is set, then random bytes are drawn from the
4413 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4414
4415 .. versionadded:: 3.6