blob: 64bc73589f62594c04c6e89ff44950a1b0d720dc [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
pxinwrf2d7ac72019-05-21 18:46:37 +080035* On VxWorks, os.fork, os.execv and os.spawn*p* are not supported.
Benjamin Petersonf650e462010-05-06 23:03:05 +000036
Georg Brandlc575c902008-09-13 17:46:05 +000037.. note::
38
Tim Hoffmanna55f75a2019-07-05 10:41:35 +020039 All functions in this module raise :exc:`OSError` (or subclasses thereof) in
40 the case of invalid or inaccessible file names and paths, or other arguments
41 that have the correct type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000042
Georg Brandl116aa622007-08-15 14:28:22 +000043.. exception:: error
44
Christian Heimesa62da1d2008-01-12 19:39:10 +000045 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000046
47
48.. data:: name
49
Benjamin Peterson1baf4652009-12-31 03:11:23 +000050 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070051 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070052 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000053
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020054 .. seealso::
55 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
56 system-dependent version information.
57
58 The :mod:`platform` module provides detailed checks for the
59 system's identity.
60
Georg Brandl116aa622007-08-15 14:28:22 +000061
Martin v. Löwis011e8422009-05-05 04:43:17 +000062.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020063.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000064
65File Names, Command Line Arguments, and Environment Variables
66-------------------------------------------------------------
67
Georg Brandl67b21b72010-08-17 15:07:14 +000068In Python, file names, command line arguments, and environment variables are
69represented using the string type. On some systems, decoding these strings to
70and from bytes is necessary before passing them to the operating system. Python
71uses the file system encoding to perform this conversion (see
72:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000073
74.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000075 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020076 case, Python uses the :ref:`surrogateescape encoding error handler
77 <surrogateescape>`, which means that undecodable bytes are replaced by a
78 Unicode character U+DCxx on decoding, and these are again translated to the
79 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000080
81
Georg Brandl67b21b72010-08-17 15:07:14 +000082The file system encoding must guarantee to successfully decode all bytes
83below 128. If the file system encoding fails to provide this guarantee, API
84functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000085
86
Georg Brandl116aa622007-08-15 14:28:22 +000087.. _os-procinfo:
88
89Process Parameters
90------------------
91
92These functions and data items provide information and operate on the current
93process and user.
94
95
Georg Brandl8ccadaa2012-06-24 12:50:06 +020096.. function:: ctermid()
97
98 Return the filename corresponding to the controlling terminal of the process.
99
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400100 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200101
102
Georg Brandl116aa622007-08-15 14:28:22 +0000103.. data:: environ
104
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700105 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000106 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
107 and is equivalent to ``getenv("HOME")`` in C.
108
109 This mapping is captured the first time the :mod:`os` module is imported,
110 typically during Python startup as part of processing :file:`site.py`. Changes
111 to the environment made after this time are not reflected in ``os.environ``,
112 except for changes made by modifying ``os.environ`` directly.
113
Victor Stinnerb8d12622020-01-24 14:05:48 +0100114 This mapping may be used to modify the environment as well as query the
115 environment. :func:`putenv` will be called automatically when the mapping
116 is modified.
Georg Brandl116aa622007-08-15 14:28:22 +0000117
Victor Stinner84ae1182010-05-06 22:05:07 +0000118 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
119 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
120 to use a different encoding.
121
Georg Brandl116aa622007-08-15 14:28:22 +0000122 .. note::
123
124 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
125 to modify ``os.environ``.
126
127 .. note::
128
Georg Brandlc575c902008-09-13 17:46:05 +0000129 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
130 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000131 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000132
Victor Stinnerb8d12622020-01-24 14:05:48 +0100133 You can delete items in this mapping to unset environment variables.
134 :func:`unsetenv` will be called automatically when an item is deleted from
135 ``os.environ``, and when one of the :meth:`pop` or :meth:`clear` methods is
136 called.
Georg Brandl9afde1c2007-11-01 20:32:30 +0000137
Charles Burklandd648ef12020-03-13 09:04:43 -0700138 .. versionchanged:: 3.9
139 Updated to support :pep:`584`'s merge (``|``) and update (``|=``) operators.
140
Georg Brandl116aa622007-08-15 14:28:22 +0000141
Victor Stinner84ae1182010-05-06 22:05:07 +0000142.. data:: environb
143
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700144 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000145 environment as byte strings. :data:`environ` and :data:`environb` are
146 synchronized (modify :data:`environb` updates :data:`environ`, and vice
147 versa).
148
Victor Stinnerb745a742010-05-18 17:17:23 +0000149 :data:`environb` is only available if :data:`supports_bytes_environ` is
Serhiy Storchaka138ccbb2019-11-12 16:57:03 +0200150 ``True``.
Victor Stinner84ae1182010-05-06 22:05:07 +0000151
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000152 .. versionadded:: 3.2
153
Charles Burklandd648ef12020-03-13 09:04:43 -0700154 .. versionchanged:: 3.9
155 Updated to support :pep:`584`'s merge (``|``) and update (``|=``) operators.
156
Victor Stinner84ae1182010-05-06 22:05:07 +0000157
Georg Brandl116aa622007-08-15 14:28:22 +0000158.. function:: chdir(path)
159 fchdir(fd)
160 getcwd()
161 :noindex:
162
163 These functions are described in :ref:`os-file-dir`.
164
165
Victor Stinnere8d51452010-08-19 01:05:19 +0000166.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000167
Brett Cannonc28592b2016-06-24 12:21:47 -0700168 Encode :term:`path-like <path-like object>` *filename* to the filesystem
169 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
170 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000171
Antoine Pitroua305ca72010-09-25 22:12:00 +0000172 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000173
174 .. versionadded:: 3.2
175
Brett Cannonb08388d2016-06-09 15:58:06 -0700176 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700177 Support added to accept objects implementing the :class:`os.PathLike`
178 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700179
Victor Stinnere8d51452010-08-19 01:05:19 +0000180
181.. function:: fsdecode(filename)
182
Brett Cannonc28592b2016-06-24 12:21:47 -0700183 Decode the :term:`path-like <path-like object>` *filename* from the
184 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
185 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000188
189 .. versionadded:: 3.2
190
Brett Cannonb08388d2016-06-09 15:58:06 -0700191 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700192 Support added to accept objects implementing the :class:`os.PathLike`
193 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700194
Victor Stinner449c4662010-05-08 11:10:09 +0000195
Ethan Furmancdc08792016-06-02 15:06:09 -0700196.. function:: fspath(path)
197
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700198 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700199
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700200 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
201 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
202 returned as long as it is a :class:`str` or :class:`bytes` object.
203 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700204
Brett Cannonb08388d2016-06-09 15:58:06 -0700205 .. versionadded:: 3.6
206
207
208.. class:: PathLike
209
210 An :term:`abstract base class` for objects representing a file system path,
211 e.g. :class:`pathlib.PurePath`.
212
Berker Peksagb18ffb42016-06-10 08:43:54 +0300213 .. versionadded:: 3.6
214
Brett Cannonb08388d2016-06-09 15:58:06 -0700215 .. abstractmethod:: __fspath__()
216
217 Return the file system path representation of the object.
218
219 The method should only return a :class:`str` or :class:`bytes` object,
220 with the preference being for :class:`str`.
221
Ethan Furmancdc08792016-06-02 15:06:09 -0700222
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200223.. function:: getenv(key, default=None)
224
225 Return the value of the environment variable *key* if it exists, or
226 *default* if it doesn't. *key*, *default* and the result are str.
227
228 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
229 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
230 would like to use a different encoding.
231
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400232 .. availability:: most flavors of Unix, Windows.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200233
234
235.. function:: getenvb(key, default=None)
236
237 Return the value of the environment variable *key* if it exists, or
238 *default* if it doesn't. *key*, *default* and the result are bytes.
239
Berker Peksag996e5f92016-09-26 22:44:07 +0300240 :func:`getenvb` is only available if :data:`supports_bytes_environ`
Serhiy Storchaka138ccbb2019-11-12 16:57:03 +0200241 is ``True``.
Berker Peksag996e5f92016-09-26 22:44:07 +0300242
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400243 .. availability:: most flavors of Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200244
245 .. versionadded:: 3.2
246
247
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000248.. function:: get_exec_path(env=None)
249
250 Returns the list of directories that will be searched for a named
251 executable, similar to a shell, when launching a process.
252 *env*, when specified, should be an environment variable dictionary
253 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300254 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000255
256 .. versionadded:: 3.2
257
258
Georg Brandl116aa622007-08-15 14:28:22 +0000259.. function:: getegid()
260
261 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000262 "set id" bit on the file being executed in the current process.
263
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400264 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000265
266
267.. function:: geteuid()
268
269 .. index:: single: user; effective id
270
Benjamin Petersonf650e462010-05-06 23:03:05 +0000271 Return the current process's effective user id.
272
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400273 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000274
275
276.. function:: getgid()
277
278 .. index:: single: process; group
279
Benjamin Petersonf650e462010-05-06 23:03:05 +0000280 Return the real group id of the current process.
281
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400282 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000283
284
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200285.. function:: getgrouplist(user, group)
286
287 Return list of group ids that *user* belongs to. If *group* is not in the
288 list, it is included; typically, *group* is specified as the group ID
289 field from the password record for *user*.
290
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400291 .. availability:: Unix.
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200292
293 .. versionadded:: 3.3
294
295
Georg Brandl116aa622007-08-15 14:28:22 +0000296.. function:: getgroups()
297
298 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000299
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400300 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000301
Larry Hastings3732ed22014-03-15 21:13:56 -0700302 .. note::
303
304 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700305 other Unix platforms. If the Python interpreter was built with a
306 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
307 the list of effective group ids associated with the current user process;
308 this list is limited to a system-defined number of entries, typically 16,
309 and may be modified by calls to :func:`setgroups` if suitably privileged.
310 If built with a deployment target greater than :const:`10.5`,
311 :func:`getgroups` returns the current group access list for the user
312 associated with the effective user id of the process; the group access
313 list may change over the lifetime of the process, it is not affected by
314 calls to :func:`setgroups`, and its length is not limited to 16. The
315 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
316 obtained with :func:`sysconfig.get_config_var`.
317
Georg Brandl116aa622007-08-15 14:28:22 +0000318
319.. function:: getlogin()
320
321 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500322 process. For most purposes, it is more useful to use
323 :func:`getpass.getuser` since the latter checks the environment variables
324 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
325 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
326 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000327
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400328 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000329
330
331.. function:: getpgid(pid)
332
333 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000334 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400336 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000337
338.. function:: getpgrp()
339
340 .. index:: single: process; group
341
Benjamin Petersonf650e462010-05-06 23:03:05 +0000342 Return the id of the current process group.
343
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400344 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000345
346
347.. function:: getpid()
348
349 .. index:: single: process; id
350
Benjamin Petersonf650e462010-05-06 23:03:05 +0000351 Return the current process id.
352
Georg Brandl116aa622007-08-15 14:28:22 +0000353
354.. function:: getppid()
355
356 .. index:: single: process; id of parent
357
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000358 Return the parent's process id. When the parent process has exited, on Unix
359 the id returned is the one of the init process (1), on Windows it is still
360 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000361
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400362 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000363
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000364 .. versionchanged:: 3.2
365 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000366
Georg Brandl8a5555f2012-06-24 13:29:09 +0200367
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000368.. function:: getpriority(which, who)
369
370 .. index:: single: process; scheduling priority
371
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200372 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000373 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
374 is interpreted relative to *which* (a process identifier for
375 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200376 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000377 (respectively) the calling process, the process group of the calling process,
378 or the real user ID of the calling process.
379
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400380 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000381
382 .. versionadded:: 3.3
383
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200384
385.. data:: PRIO_PROCESS
386 PRIO_PGRP
387 PRIO_USER
388
389 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
390
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400391 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200392
393 .. versionadded:: 3.3
394
395
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000396.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000397
398 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000399 real, effective, and saved user ids.
400
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400401 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000402
Georg Brandl1b83a452009-11-28 11:12:26 +0000403 .. versionadded:: 3.2
404
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000405
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000406.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000407
408 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000409 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000410
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400411 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000412
Georg Brandl1b83a452009-11-28 11:12:26 +0000413 .. versionadded:: 3.2
414
Georg Brandl116aa622007-08-15 14:28:22 +0000415
416.. function:: getuid()
417
418 .. index:: single: user; id
419
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700420 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000421
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400422 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000423
424
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200425.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000426
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200427 Call the system initgroups() to initialize the group access list with all of
428 the groups of which the specified username is a member, plus the specified
429 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000430
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400431 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000432
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200433 .. versionadded:: 3.2
434
Georg Brandl116aa622007-08-15 14:28:22 +0000435
Georg Brandl18244152009-09-02 20:34:52 +0000436.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000437
438 .. index:: single: environment variables; setting
439
Georg Brandl18244152009-09-02 20:34:52 +0000440 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000441 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000442 :func:`popen` or :func:`fork` and :func:`execv`.
443
Victor Stinnerb8d12622020-01-24 14:05:48 +0100444 Assignments to items in ``os.environ`` are automatically translated into
445 corresponding calls to :func:`putenv`; however, calls to :func:`putenv`
446 don't update ``os.environ``, so it is actually preferable to assign to items
447 of ``os.environ``.
Georg Brandl116aa622007-08-15 14:28:22 +0000448
449 .. note::
450
Georg Brandlc575c902008-09-13 17:46:05 +0000451 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
Victor Stinnerb8d12622020-01-24 14:05:48 +0100452 cause memory leaks. Refer to the system documentation for :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000453
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800454 .. audit-event:: os.putenv key,value os.putenv
455
Victor Stinnerb8d12622020-01-24 14:05:48 +0100456 .. versionchanged:: 3.9
457 The function is now always available.
Georg Brandl116aa622007-08-15 14:28:22 +0000458
459
460.. function:: setegid(egid)
461
Benjamin Petersonf650e462010-05-06 23:03:05 +0000462 Set the current process's effective group id.
463
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400464 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000465
466
467.. function:: seteuid(euid)
468
Benjamin Petersonf650e462010-05-06 23:03:05 +0000469 Set the current process's effective user id.
470
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400471 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000472
473
474.. function:: setgid(gid)
475
Benjamin Petersonf650e462010-05-06 23:03:05 +0000476 Set the current process' group id.
477
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400478 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000479
480
481.. function:: setgroups(groups)
482
483 Set the list of supplemental group ids associated with the current process to
484 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000485 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000486
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400487 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000488
Ned Deily2e209682012-04-30 11:14:02 -0700489 .. note:: On Mac OS X, the length of *groups* may not exceed the
490 system-defined maximum number of effective group ids, typically 16.
491 See the documentation for :func:`getgroups` for cases where it may not
492 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000493
494.. function:: setpgrp()
495
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300496 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000497 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000498
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400499 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000500
501
502.. function:: setpgid(pid, pgrp)
503
Georg Brandl60203b42010-10-06 10:11:56 +0000504 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000505 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000506 for the semantics.
507
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400508 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000509
510
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000511.. function:: setpriority(which, who, priority)
512
513 .. index:: single: process; scheduling priority
514
515 Set program scheduling priority. The value *which* is one of
516 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
517 is interpreted relative to *which* (a process identifier for
518 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
519 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
520 (respectively) the calling process, the process group of the calling process,
521 or the real user ID of the calling process.
522 *priority* is a value in the range -20 to 19. The default priority is 0;
523 lower priorities cause more favorable scheduling.
524
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400525 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000526
527 .. versionadded:: 3.3
528
529
Georg Brandl116aa622007-08-15 14:28:22 +0000530.. function:: setregid(rgid, egid)
531
Benjamin Petersonf650e462010-05-06 23:03:05 +0000532 Set the current process's real and effective group ids.
533
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400534 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000535
Georg Brandl1b83a452009-11-28 11:12:26 +0000536
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000537.. function:: setresgid(rgid, egid, sgid)
538
539 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000540
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400541 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000542
Georg Brandl1b83a452009-11-28 11:12:26 +0000543 .. versionadded:: 3.2
544
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000545
546.. function:: setresuid(ruid, euid, suid)
547
548 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000549
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400550 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000551
Georg Brandl1b83a452009-11-28 11:12:26 +0000552 .. versionadded:: 3.2
553
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000554
555.. function:: setreuid(ruid, euid)
556
Benjamin Petersonf650e462010-05-06 23:03:05 +0000557 Set the current process's real and effective user ids.
558
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400559 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000560
Georg Brandl116aa622007-08-15 14:28:22 +0000561
562.. function:: getsid(pid)
563
Georg Brandl60203b42010-10-06 10:11:56 +0000564 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000565
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400566 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000567
Georg Brandl116aa622007-08-15 14:28:22 +0000568
569.. function:: setsid()
570
Georg Brandl60203b42010-10-06 10:11:56 +0000571 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000572
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400573 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000574
575
576.. function:: setuid(uid)
577
578 .. index:: single: user; id, setting
579
Benjamin Petersonf650e462010-05-06 23:03:05 +0000580 Set the current process's user id.
581
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400582 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000583
Georg Brandl116aa622007-08-15 14:28:22 +0000584
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000585.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000586.. function:: strerror(code)
587
588 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000589 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000590 error number, :exc:`ValueError` is raised.
591
Georg Brandl116aa622007-08-15 14:28:22 +0000592
Victor Stinnerb745a742010-05-18 17:17:23 +0000593.. data:: supports_bytes_environ
594
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200595 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000596 Windows).
597
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000598 .. versionadded:: 3.2
599
Victor Stinnerb745a742010-05-18 17:17:23 +0000600
Georg Brandl116aa622007-08-15 14:28:22 +0000601.. function:: umask(mask)
602
Benjamin Petersonf650e462010-05-06 23:03:05 +0000603 Set the current numeric umask and return the previous umask.
604
Georg Brandl116aa622007-08-15 14:28:22 +0000605
606.. function:: uname()
607
608 .. index::
609 single: gethostname() (in module socket)
610 single: gethostbyaddr() (in module socket)
611
Larry Hastings605a62d2012-06-24 04:33:36 -0700612 Returns information identifying the current operating system.
613 The return value is an object with five attributes:
614
615 * :attr:`sysname` - operating system name
616 * :attr:`nodename` - name of machine on network (implementation-defined)
617 * :attr:`release` - operating system release
618 * :attr:`version` - operating system version
619 * :attr:`machine` - hardware identifier
620
621 For backwards compatibility, this object is also iterable, behaving
622 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
623 :attr:`release`, :attr:`version`, and :attr:`machine`
624 in that order.
625
626 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000627 leading component; a better way to get the hostname is
628 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000629 ``socket.gethostbyaddr(socket.gethostname())``.
630
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400631 .. availability:: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000632
Larry Hastings605a62d2012-06-24 04:33:36 -0700633 .. versionchanged:: 3.3
634 Return type changed from a tuple to a tuple-like object
635 with named attributes.
636
Georg Brandl116aa622007-08-15 14:28:22 +0000637
Georg Brandl18244152009-09-02 20:34:52 +0000638.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000639
640 .. index:: single: environment variables; deleting
641
Georg Brandl18244152009-09-02 20:34:52 +0000642 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000643 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000644 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000645
Victor Stinnerb8d12622020-01-24 14:05:48 +0100646 Deletion of items in ``os.environ`` is automatically translated into a
647 corresponding call to :func:`unsetenv`; however, calls to :func:`unsetenv`
648 don't update ``os.environ``, so it is actually preferable to delete items of
649 ``os.environ``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000650
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800651 .. audit-event:: os.unsetenv key os.unsetenv
652
Victor Stinner161e7b32020-01-24 11:53:44 +0100653 .. versionchanged:: 3.9
Victor Stinnerb8d12622020-01-24 14:05:48 +0100654 The function is now always available and is also available on Windows.
Victor Stinner161e7b32020-01-24 11:53:44 +0100655
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657.. _os-newstreams:
658
659File Object Creation
660--------------------
661
Steve Dowerb82e17e2019-05-23 08:45:22 -0700662These functions create new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200663:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000664
665
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300666.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandlb2462e22012-06-24 13:24:56 +0200668 Return an open file object connected to the file descriptor *fd*. This is an
669 alias of the :func:`open` built-in function and accepts the same arguments.
670 The only difference is that the first argument of :func:`fdopen` must always
671 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673
Georg Brandl116aa622007-08-15 14:28:22 +0000674.. _os-fd-ops:
675
676File Descriptor Operations
677--------------------------
678
679These functions operate on I/O streams referenced using file descriptors.
680
681File descriptors are small integers corresponding to a file that has been opened
682by the current process. For example, standard input is usually file descriptor
6830, standard output is 1, and standard error is 2. Further files opened by a
684process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
685is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
686by file descriptors.
687
Serhiy Storchakadab83542013-10-13 20:12:43 +0300688The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000689associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000690descriptor directly will bypass the file object methods, ignoring aspects such
691as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000692
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000693
Georg Brandl116aa622007-08-15 14:28:22 +0000694.. function:: close(fd)
695
Benjamin Petersonf650e462010-05-06 23:03:05 +0000696 Close file descriptor *fd*.
697
Georg Brandl116aa622007-08-15 14:28:22 +0000698 .. note::
699
700 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000701 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000702 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300703 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
705
Christian Heimesfdab48e2008-01-20 09:06:41 +0000706.. function:: closerange(fd_low, fd_high)
707
708 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200709 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000710
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000711 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000712 try:
713 os.close(fd)
714 except OSError:
715 pass
716
Christian Heimesfdab48e2008-01-20 09:06:41 +0000717
Pablo Galindoaac4d032019-05-31 19:39:47 +0100718.. function:: copy_file_range(src, dst, count, offset_src=None, offset_dst=None)
719
720 Copy *count* bytes from file descriptor *src*, starting from offset
721 *offset_src*, to file descriptor *dst*, starting from offset *offset_dst*.
722 If *offset_src* is None, then *src* is read from the current position;
723 respectively for *offset_dst*. The files pointed by *src* and *dst*
724 must reside in the same filesystem, otherwise an :exc:`OSError` is
725 raised with :attr:`~OSError.errno` set to :data:`errno.EXDEV`.
726
727 This copy is done without the additional cost of transferring data
728 from the kernel to user space and then back into the kernel. Additionally,
729 some filesystems could implement extra optimizations. The copy is done as if
730 both files are opened as binary.
731
732 The return value is the amount of bytes copied. This could be less than the
733 amount requested.
734
735 .. availability:: Linux kernel >= 4.5 or glibc >= 2.27.
736
737 .. versionadded:: 3.8
738
739
Georg Brandl81f11302007-12-21 08:45:42 +0000740.. function:: device_encoding(fd)
741
742 Return a string describing the encoding of the device associated with *fd*
743 if it is connected to a terminal; else return :const:`None`.
744
745
Georg Brandl116aa622007-08-15 14:28:22 +0000746.. function:: dup(fd)
747
Victor Stinnerdaf45552013-08-28 00:53:59 +0200748 Return a duplicate of file descriptor *fd*. The new file descriptor is
749 :ref:`non-inheritable <fd_inheritance>`.
750
751 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
752 2: stderr), the new file descriptor is :ref:`inheritable
753 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000754
Victor Stinnerdaf45552013-08-28 00:53:59 +0200755 .. versionchanged:: 3.4
756 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000757
Victor Stinnerdaf45552013-08-28 00:53:59 +0200758
759.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000760
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800761 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
762 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
763 <fd_inheritance>` by default or non-inheritable if *inheritable*
764 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000765
Victor Stinnerdaf45552013-08-28 00:53:59 +0200766 .. versionchanged:: 3.4
767 Add the optional *inheritable* parameter.
768
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800769 .. versionchanged:: 3.7
770 Return *fd2* on success. Previously, ``None`` was always returned.
771
Georg Brandl116aa622007-08-15 14:28:22 +0000772
Christian Heimes4e30a842007-11-30 22:12:06 +0000773.. function:: fchmod(fd, mode)
774
Georg Brandlb9df00c2012-06-24 12:38:14 +0200775 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200776 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200777 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000778
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800779 .. audit-event:: os.chmod path,mode,dir_fd os.fchmod
780
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400781 .. availability:: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000782
783
784.. function:: fchown(fd, uid, gid)
785
786 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200787 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200788 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200789 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000790
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800791 .. audit-event:: os.chown path,uid,gid,dir_fd os.fchown
792
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400793 .. availability:: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000794
795
Georg Brandl116aa622007-08-15 14:28:22 +0000796.. function:: fdatasync(fd)
797
798 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000799 metadata.
800
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400801 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000802
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000803 .. note::
804 This function is not available on MacOS.
805
Georg Brandl116aa622007-08-15 14:28:22 +0000806
807.. function:: fpathconf(fd, name)
808
809 Return system configuration information relevant to an open file. *name*
810 specifies the configuration value to retrieve; it may be a string which is the
811 name of a defined system value; these names are specified in a number of
812 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
813 additional names as well. The names known to the host operating system are
814 given in the ``pathconf_names`` dictionary. For configuration variables not
815 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000816
817 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
818 specific value for *name* is not supported by the host system, even if it is
819 included in ``pathconf_names``, an :exc:`OSError` is raised with
820 :const:`errno.EINVAL` for the error number.
821
Georg Brandl4d399a42012-06-25 07:40:32 +0200822 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200823
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400824 .. availability:: Unix.
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700825
Georg Brandl116aa622007-08-15 14:28:22 +0000826
Victor Stinner4195b5c2012-02-08 23:03:19 +0100827.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000828
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200829 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
830 object.
831
832 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
833
834 .. seealso::
835
Berker Peksag2034caa2015-04-27 13:53:28 +0300836 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000837
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200838
Georg Brandl116aa622007-08-15 14:28:22 +0000839.. function:: fstatvfs(fd)
840
Georg Brandlb9df00c2012-06-24 12:38:14 +0200841 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200842 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200843 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000844
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400845 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000846
847
848.. function:: fsync(fd)
849
850 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000851 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000852
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000853 If you're starting with a buffered Python :term:`file object` *f*, first do
854 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
855 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000856
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400857 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000858
859
860.. function:: ftruncate(fd, length)
861
Georg Brandl306336b2012-06-24 12:55:33 +0200862 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200863 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200864 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000865
Steve Dower44f91c32019-06-27 10:47:59 -0700866 .. audit-event:: os.truncate fd,length os.ftruncate
Steve Dowerb82e17e2019-05-23 08:45:22 -0700867
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400868 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000869
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700870 .. versionchanged:: 3.5
871 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000872
Steve Dowerb82e17e2019-05-23 08:45:22 -0700873
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200874.. function:: get_blocking(fd)
875
876 Get the blocking mode of the file descriptor: ``False`` if the
877 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
878
879 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
880
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400881 .. availability:: Unix.
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200882
883 .. versionadded:: 3.5
884
Steve Dowerb82e17e2019-05-23 08:45:22 -0700885
Georg Brandl116aa622007-08-15 14:28:22 +0000886.. function:: isatty(fd)
887
888 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000889 tty(-like) device, else ``False``.
890
Georg Brandl116aa622007-08-15 14:28:22 +0000891
Ross Lagerwall7807c352011-03-17 20:20:30 +0200892.. function:: lockf(fd, cmd, len)
893
894 Apply, test or remove a POSIX lock on an open file descriptor.
895 *fd* is an open file descriptor.
896 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
897 :data:`F_ULOCK` or :data:`F_TEST`.
898 *len* specifies the section of the file to lock.
899
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800900 .. audit-event:: os.lockf fd,cmd,len os.lockf
901
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400902 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +0200903
904 .. versionadded:: 3.3
905
906
907.. data:: F_LOCK
908 F_TLOCK
909 F_ULOCK
910 F_TEST
911
912 Flags that specify what action :func:`lockf` will take.
913
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400914 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +0200915
916 .. versionadded:: 3.3
917
Georg Brandlf62445a2012-06-24 13:31:20 +0200918
Georg Brandl116aa622007-08-15 14:28:22 +0000919.. function:: lseek(fd, pos, how)
920
Christian Heimesfaf2f632008-01-06 16:59:19 +0000921 Set the current position of file descriptor *fd* to position *pos*, modified
922 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
923 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300924 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100925 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000926
Georg Brandl116aa622007-08-15 14:28:22 +0000927
Georg Brandl8569e582010-05-19 20:57:08 +0000928.. data:: SEEK_SET
929 SEEK_CUR
930 SEEK_END
931
932 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200933 respectively.
934
Jesus Cea94363612012-06-22 18:32:07 +0200935 .. versionadded:: 3.3
936 Some operating systems could support additional values, like
937 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
938
Georg Brandl8569e582010-05-19 20:57:08 +0000939
Martin Panterbf19d162015-09-09 01:01:13 +0000940.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000941
Martin Panterbf19d162015-09-09 01:01:13 +0000942 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700943 its mode according to *mode*. When computing *mode*, the current umask value
944 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200945 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000946
947 For a description of the flag and mode values, see the C run-time documentation;
948 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400949 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000950 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000951
Georg Brandl50c40002012-06-24 11:45:20 +0200952 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400953 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700954
Steve Dower44f91c32019-06-27 10:47:59 -0700955 .. audit-event:: open path,mode,flags os.open
Steve Dowerb82e17e2019-05-23 08:45:22 -0700956
Victor Stinnerdaf45552013-08-28 00:53:59 +0200957 .. versionchanged:: 3.4
958 The new file descriptor is now non-inheritable.
959
Georg Brandl116aa622007-08-15 14:28:22 +0000960 .. note::
961
Georg Brandl502d9a52009-07-26 15:02:41 +0000962 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000963 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000964 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000965 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000966
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000967 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700968 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000969
Victor Stinnera766ddf2015-03-26 23:50:57 +0100970 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200971 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100972 exception, the function now retries the system call instead of raising an
973 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
974
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700975 .. versionchanged:: 3.6
976 Accepts a :term:`path-like object`.
977
Andrew Kuchling4921a082013-06-21 11:49:57 -0400978The following constants are options for the *flags* parameter to the
979:func:`~os.open` function. They can be combined using the bitwise OR operator
980``|``. Some of them are not available on all platforms. For descriptions of
981their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100982or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400983
984
985.. data:: O_RDONLY
986 O_WRONLY
987 O_RDWR
988 O_APPEND
989 O_CREAT
990 O_EXCL
991 O_TRUNC
992
Vinay Sajipe4946e72016-09-11 15:15:59 +0100993 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400994
995
996.. data:: O_DSYNC
997 O_RSYNC
998 O_SYNC
999 O_NDELAY
1000 O_NONBLOCK
1001 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -04001002 O_CLOEXEC
1003
Vinay Sajipe4946e72016-09-11 15:15:59 +01001004 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -04001005
1006 .. versionchanged:: 3.3
1007 Add :data:`O_CLOEXEC` constant.
1008
1009.. data:: O_BINARY
1010 O_NOINHERIT
1011 O_SHORT_LIVED
1012 O_TEMPORARY
1013 O_RANDOM
1014 O_SEQUENTIAL
1015 O_TEXT
1016
Vinay Sajipe4946e72016-09-11 15:15:59 +01001017 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -04001018
1019
1020.. data:: O_ASYNC
1021 O_DIRECT
1022 O_DIRECTORY
1023 O_NOFOLLOW
1024 O_NOATIME
1025 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +02001026 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +01001027 O_SHLOCK
1028 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -04001029
Vinay Sajipe4946e72016-09-11 15:15:59 +01001030 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -04001031 the C library.
1032
Christian Heimesd88f7352013-08-16 14:37:50 +02001033 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001034 Add :data:`O_PATH` on systems that support it.
1035 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1036 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001037
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001038
Georg Brandl116aa622007-08-15 14:28:22 +00001039.. function:: openpty()
1040
1041 .. index:: module: pty
1042
Victor Stinnerdaf45552013-08-28 00:53:59 +02001043 Open a new pseudo-terminal pair. Return a pair of file descriptors
1044 ``(master, slave)`` for the pty and the tty, respectively. The new file
1045 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1046 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001047
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001048 .. availability:: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001049
Victor Stinnerdaf45552013-08-28 00:53:59 +02001050 .. versionchanged:: 3.4
1051 The new file descriptors are now non-inheritable.
1052
Georg Brandl116aa622007-08-15 14:28:22 +00001053
1054.. function:: pipe()
1055
Victor Stinnerdaf45552013-08-28 00:53:59 +02001056 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001057 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001058 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001059
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001060 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001061
Victor Stinnerdaf45552013-08-28 00:53:59 +02001062 .. versionchanged:: 3.4
1063 The new file descriptors are now non-inheritable.
1064
Georg Brandl116aa622007-08-15 14:28:22 +00001065
Charles-François Natali368f34b2011-06-06 19:49:47 +02001066.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001067
1068 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001069 *flags* can be constructed by ORing together one or more of these values:
1070 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001071 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1072 respectively.
1073
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001074 .. availability:: some flavors of Unix.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001075
1076 .. versionadded:: 3.3
1077
1078
Ross Lagerwall7807c352011-03-17 20:20:30 +02001079.. function:: posix_fallocate(fd, offset, len)
1080
1081 Ensures that enough disk space is allocated for the file specified by *fd*
1082 starting from *offset* and continuing for *len* bytes.
1083
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001084 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001085
1086 .. versionadded:: 3.3
1087
1088
1089.. function:: posix_fadvise(fd, offset, len, advice)
1090
1091 Announces an intention to access data in a specific pattern thus allowing
1092 the kernel to make optimizations.
1093 The advice applies to the region of the file specified by *fd* starting at
1094 *offset* and continuing for *len* bytes.
1095 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1096 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1097 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1098
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001099 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001100
1101 .. versionadded:: 3.3
1102
1103
1104.. data:: POSIX_FADV_NORMAL
1105 POSIX_FADV_SEQUENTIAL
1106 POSIX_FADV_RANDOM
1107 POSIX_FADV_NOREUSE
1108 POSIX_FADV_WILLNEED
1109 POSIX_FADV_DONTNEED
1110
1111 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1112 the access pattern that is likely to be used.
1113
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001114 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001115
1116 .. versionadded:: 3.3
1117
1118
Pablo Galindo02e2a082018-05-31 00:00:04 +01001119.. function:: pread(fd, n, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001120
Pablo Galindo02e2a082018-05-31 00:00:04 +01001121 Read at most *n* bytes from file descriptor *fd* at a position of *offset*,
1122 leaving the file offset unchanged.
1123
1124 Return a bytestring containing the bytes read. If the end of the file
1125 referred to by *fd* has been reached, an empty bytes object is returned.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001126
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001127 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001128
1129 .. versionadded:: 3.3
1130
1131
Pablo Galindo02e2a082018-05-31 00:00:04 +01001132.. function:: preadv(fd, buffers, offset, flags=0)
1133
1134 Read from a file descriptor *fd* at a position of *offset* into mutable
1135 :term:`bytes-like objects <bytes-like object>` *buffers*, leaving the file
1136 offset unchanged. Transfer data into each buffer until it is full and then
1137 move on to the next buffer in the sequence to hold the rest of the data.
1138
1139 The flags argument contains a bitwise OR of zero or more of the following
1140 flags:
1141
1142 - :data:`RWF_HIPRI`
1143 - :data:`RWF_NOWAIT`
1144
1145 Return the total number of bytes actually read which can be less than the
1146 total capacity of all the objects.
1147
1148 The operating system may set a limit (:func:`sysconf` value
1149 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1150
1151 Combine the functionality of :func:`os.readv` and :func:`os.pread`.
1152
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001153 .. availability:: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
Batuhan Taskayacae22752020-05-17 01:36:40 +03001154 OpenBSD 2.7 and newer, AIX 7.1 and newer. Using flags requires
1155 Linux 4.6 or newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001156
1157 .. versionadded:: 3.7
1158
1159
1160.. data:: RWF_NOWAIT
1161
1162 Do not wait for data which is not immediately available. If this flag is
1163 specified, the system call will return instantly if it would have to read
1164 data from the backing storage or wait for a lock.
1165
1166 If some data was successfully read, it will return the number of bytes read.
1167 If no bytes were read, it will return ``-1`` and set errno to
1168 :data:`errno.EAGAIN`.
1169
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001170 .. availability:: Linux 4.14 and newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001171
1172 .. versionadded:: 3.7
1173
1174
1175.. data:: RWF_HIPRI
1176
1177 High priority read/write. Allows block-based filesystems to use polling
1178 of the device, which provides lower latency, but may use additional
1179 resources.
1180
1181 Currently, on Linux, this feature is usable only on a file descriptor opened
1182 using the :data:`O_DIRECT` flag.
1183
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001184 .. availability:: Linux 4.6 and newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001185
1186 .. versionadded:: 3.7
1187
1188
Jesus Cea67503c52014-10-20 16:18:24 +02001189.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001190
Pablo Galindo02e2a082018-05-31 00:00:04 +01001191 Write the bytestring in *str* to file descriptor *fd* at position of
1192 *offset*, leaving the file offset unchanged.
1193
1194 Return the number of bytes actually written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001195
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001196 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001197
1198 .. versionadded:: 3.3
1199
1200
Pablo Galindo4defba32018-01-27 16:16:37 +00001201.. function:: pwritev(fd, buffers, offset, flags=0)
1202
Pablo Galindo02e2a082018-05-31 00:00:04 +01001203 Write the *buffers* contents to file descriptor *fd* at a offset *offset*,
1204 leaving the file offset unchanged. *buffers* must be a sequence of
1205 :term:`bytes-like objects <bytes-like object>`. Buffers are processed in
1206 array order. Entire contents of the first buffer is written before
1207 proceeding to the second, and so on.
Pablo Galindo4defba32018-01-27 16:16:37 +00001208
Pablo Galindo02e2a082018-05-31 00:00:04 +01001209 The flags argument contains a bitwise OR of zero or more of the following
Pablo Galindo4defba32018-01-27 16:16:37 +00001210 flags:
1211
Pablo Galindo02e2a082018-05-31 00:00:04 +01001212 - :data:`RWF_DSYNC`
1213 - :data:`RWF_SYNC`
Pablo Galindo4defba32018-01-27 16:16:37 +00001214
Pablo Galindo02e2a082018-05-31 00:00:04 +01001215 Return the total number of bytes actually written.
Pablo Galindo4defba32018-01-27 16:16:37 +00001216
Pablo Galindo02e2a082018-05-31 00:00:04 +01001217 The operating system may set a limit (:func:`sysconf` value
1218 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1219
1220 Combine the functionality of :func:`os.writev` and :func:`os.pwrite`.
1221
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001222 .. availability:: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
Batuhan Taskayacae22752020-05-17 01:36:40 +03001223 OpenBSD 2.7 and newer, AIX 7.1 and newer. Using flags requires
1224 Linux 4.7 or newer.
Pablo Galindo4defba32018-01-27 16:16:37 +00001225
1226 .. versionadded:: 3.7
1227
Pablo Galindo02e2a082018-05-31 00:00:04 +01001228
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001229.. data:: RWF_DSYNC
1230
Pablo Galindo02e2a082018-05-31 00:00:04 +01001231 Provide a per-write equivalent of the :data:`O_DSYNC` ``open(2)`` flag. This
1232 flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001233
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001234 .. availability:: Linux 4.7 and newer.
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001235
Pablo Galindo4defba32018-01-27 16:16:37 +00001236 .. versionadded:: 3.7
1237
Pablo Galindo02e2a082018-05-31 00:00:04 +01001238
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001239.. data:: RWF_SYNC
1240
Pablo Galindo02e2a082018-05-31 00:00:04 +01001241 Provide a per-write equivalent of the :data:`O_SYNC` ``open(2)`` flag. This
1242 flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001243
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001244 .. availability:: Linux 4.7 and newer.
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001245
Pablo Galindo4defba32018-01-27 16:16:37 +00001246 .. versionadded:: 3.7
1247
1248
Georg Brandl116aa622007-08-15 14:28:22 +00001249.. function:: read(fd, n)
1250
Pablo Galindo02e2a082018-05-31 00:00:04 +01001251 Read at most *n* bytes from file descriptor *fd*.
1252
1253 Return a bytestring containing the bytes read. If the end of the file
1254 referred to by *fd* has been reached, an empty bytes object is returned.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001255
Georg Brandl116aa622007-08-15 14:28:22 +00001256 .. note::
1257
1258 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001259 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1260 "file object" returned by the built-in function :func:`open` or by
1261 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1262 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001263
Victor Stinnera766ddf2015-03-26 23:50:57 +01001264 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001265 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001266 exception, the function now retries the system call instead of raising an
1267 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1268
Georg Brandl116aa622007-08-15 14:28:22 +00001269
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001270.. function:: sendfile(out_fd, in_fd, offset, count)
Serhiy Storchaka2b560312020-04-18 19:14:10 +03001271 sendfile(out_fd, in_fd, offset, count, headers=(), trailers=(), flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001272
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001273 Copy *count* bytes from file descriptor *in_fd* to file descriptor *out_fd*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001274 starting at *offset*.
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001275 Return the number of bytes sent. When EOF is reached return ``0``.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001276
1277 The first function notation is supported by all platforms that define
1278 :func:`sendfile`.
1279
1280 On Linux, if *offset* is given as ``None``, the bytes are read from the
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001281 current position of *in_fd* and the position of *in_fd* is updated.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001282
1283 The second case may be used on Mac OS X and FreeBSD where *headers* and
1284 *trailers* are arbitrary sequences of buffers that are written before and
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001285 after the data from *in_fd* is written. It returns the same as the first case.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001286
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001287 On Mac OS X and FreeBSD, a value of ``0`` for *count* specifies to send until
1288 the end of *in_fd* is reached.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001289
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001290 All platforms support sockets as *out_fd* file descriptor, and some platforms
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001291 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001292
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001293 Cross-platform applications should not use *headers*, *trailers* and *flags*
1294 arguments.
1295
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001296 .. availability:: Unix.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001297
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001298 .. note::
1299
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001300 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001301 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001302
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001303 .. versionadded:: 3.3
1304
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001305 .. versionchanged:: 3.9
1306 Parameters *out* and *in* was renamed to *out_fd* and *in_fd*.
1307
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001308
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001309.. function:: set_blocking(fd, blocking)
1310
1311 Set the blocking mode of the specified file descriptor. Set the
1312 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1313
1314 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1315
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001316 .. availability:: Unix.
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001317
1318 .. versionadded:: 3.5
1319
1320
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001321.. data:: SF_NODISKIO
1322 SF_MNOWAIT
1323 SF_SYNC
1324
1325 Parameters to the :func:`sendfile` function, if the implementation supports
1326 them.
1327
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001328 .. availability:: Unix.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001329
1330 .. versionadded:: 3.3
1331
1332
Ross Lagerwall7807c352011-03-17 20:20:30 +02001333.. function:: readv(fd, buffers)
1334
Benjamin Petersone83ed432014-01-18 22:54:59 -05001335 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
Pablo Galindo02e2a082018-05-31 00:00:04 +01001336 objects <bytes-like object>` *buffers*. Transfer data into each buffer until
1337 it is full and then move on to the next buffer in the sequence to hold the
1338 rest of the data.
1339
1340 Return the total number of bytes actually read which can be less than the
1341 total capacity of all the objects.
1342
1343 The operating system may set a limit (:func:`sysconf` value
1344 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001345
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001346 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001347
1348 .. versionadded:: 3.3
1349
1350
Georg Brandl116aa622007-08-15 14:28:22 +00001351.. function:: tcgetpgrp(fd)
1352
1353 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001354 file descriptor as returned by :func:`os.open`).
1355
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001356 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001357
1358
1359.. function:: tcsetpgrp(fd, pg)
1360
1361 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001362 descriptor as returned by :func:`os.open`) to *pg*.
1363
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001364 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001365
1366
1367.. function:: ttyname(fd)
1368
1369 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001370 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001371 exception is raised.
1372
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001373 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001374
1375
1376.. function:: write(fd, str)
1377
Pablo Galindo02e2a082018-05-31 00:00:04 +01001378 Write the bytestring in *str* to file descriptor *fd*.
1379
1380 Return the number of bytes actually written.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001381
Georg Brandl116aa622007-08-15 14:28:22 +00001382 .. note::
1383
1384 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001385 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001386 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001387 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1388 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001389
Victor Stinnera766ddf2015-03-26 23:50:57 +01001390 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001391 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001392 exception, the function now retries the system call instead of raising an
1393 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1394
Georg Brandl8569e582010-05-19 20:57:08 +00001395
Ross Lagerwall7807c352011-03-17 20:20:30 +02001396.. function:: writev(fd, buffers)
1397
Pablo Galindo02e2a082018-05-31 00:00:04 +01001398 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be
1399 a sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1400 processed in array order. Entire contents of the first buffer is written
1401 before proceeding to the second, and so on.
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001402
Pablo Galindo02e2a082018-05-31 00:00:04 +01001403 Returns the total number of bytes actually written.
1404
1405 The operating system may set a limit (:func:`sysconf` value
1406 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001407
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001408 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001409
1410 .. versionadded:: 3.3
1411
1412
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001413.. _terminal-size:
1414
1415Querying the size of a terminal
1416~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1417
1418.. versionadded:: 3.3
1419
1420.. function:: get_terminal_size(fd=STDOUT_FILENO)
1421
1422 Return the size of the terminal window as ``(columns, lines)``,
1423 tuple of type :class:`terminal_size`.
1424
1425 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1426 output) specifies which file descriptor should be queried.
1427
1428 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001429 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001430
1431 :func:`shutil.get_terminal_size` is the high-level function which
1432 should normally be used, ``os.get_terminal_size`` is the low-level
1433 implementation.
1434
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001435 .. availability:: Unix, Windows.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001436
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001437.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001438
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001439 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001440
1441 .. attribute:: columns
1442
1443 Width of the terminal window in characters.
1444
1445 .. attribute:: lines
1446
1447 Height of the terminal window in characters.
1448
1449
Victor Stinnerdaf45552013-08-28 00:53:59 +02001450.. _fd_inheritance:
1451
1452Inheritance of File Descriptors
1453~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1454
Georg Brandl5642ff92013-09-15 10:37:57 +02001455.. versionadded:: 3.4
1456
1457A file descriptor has an "inheritable" flag which indicates if the file descriptor
1458can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001459created by Python are non-inheritable by default.
1460
1461On UNIX, non-inheritable file descriptors are closed in child processes at the
1462execution of a new program, other file descriptors are inherited.
1463
1464On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001465processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001466and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001467all inheritable handles and all inheritable file descriptors are inherited.
1468Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001469streams are closed, and inheritable handles are only inherited if the
1470*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001471
1472.. function:: get_inheritable(fd)
1473
Georg Brandl5642ff92013-09-15 10:37:57 +02001474 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001475
1476.. function:: set_inheritable(fd, inheritable)
1477
Georg Brandl5642ff92013-09-15 10:37:57 +02001478 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001479
1480.. function:: get_handle_inheritable(handle)
1481
Georg Brandl5642ff92013-09-15 10:37:57 +02001482 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001483
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001484 .. availability:: Windows.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001485
1486.. function:: set_handle_inheritable(handle, inheritable)
1487
Georg Brandl5642ff92013-09-15 10:37:57 +02001488 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001489
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001490 .. availability:: Windows.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001491
1492
Georg Brandl116aa622007-08-15 14:28:22 +00001493.. _os-file-dir:
1494
1495Files and Directories
1496---------------------
1497
Georg Brandl50c40002012-06-24 11:45:20 +02001498On some Unix platforms, many of these functions support one or more of these
1499features:
1500
1501.. _path_fd:
1502
Larry Hastings77892dc2012-06-25 03:27:33 -07001503* **specifying a file descriptor:**
Cheryl Sabellae1521692019-05-06 08:39:13 -04001504 Normally the *path* argument provided to functions in the :mod:`os` module
1505 must be a string specifying a file path. However, some functions now
1506 alternatively accept an open file descriptor for their *path* argument.
1507 The function will then operate on the file referred to by the descriptor.
1508 (For POSIX systems, Python will call the variant of the function prefixed
1509 with ``f`` (e.g. call ``fchdir`` instead of ``chdir``).)
Georg Brandl50c40002012-06-24 11:45:20 +02001510
Cheryl Sabellae1521692019-05-06 08:39:13 -04001511 You can check whether or not *path* can be specified as a file descriptor
1512 for a particular function on your platform using :data:`os.supports_fd`.
1513 If this functionality is unavailable, using it will raise a
1514 :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001515
Cheryl Sabellae1521692019-05-06 08:39:13 -04001516 If the function also supports *dir_fd* or *follow_symlinks* arguments, it's
Georg Brandl50c40002012-06-24 11:45:20 +02001517 an error to specify one of those when supplying *path* as a file descriptor.
1518
1519.. _dir_fd:
1520
Larry Hastings77892dc2012-06-25 03:27:33 -07001521* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001522 should be a file descriptor referring to a directory, and the path to operate
1523 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001524 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Cheryl Sabellae1521692019-05-06 08:39:13 -04001525 the variant of the function with an ``at`` suffix and possibly prefixed with
1526 ``f`` (e.g. call ``faccessat`` instead of ``access``).
Georg Brandl50c40002012-06-24 11:45:20 +02001527
Cheryl Sabellae1521692019-05-06 08:39:13 -04001528 You can check whether or not *dir_fd* is supported for a particular function
1529 on your platform using :data:`os.supports_dir_fd`. If it's unavailable,
1530 using it will raise a :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001531
1532.. _follow_symlinks:
1533
Larry Hastings77892dc2012-06-25 03:27:33 -07001534* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001535 ``False``, and the last element of the path to operate on is a symbolic link,
Cheryl Sabellae1521692019-05-06 08:39:13 -04001536 the function will operate on the symbolic link itself rather than the file
1537 pointed to by the link. (For POSIX systems, Python will call the ``l...``
1538 variant of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001539
Cheryl Sabellae1521692019-05-06 08:39:13 -04001540 You can check whether or not *follow_symlinks* is supported for a particular
1541 function on your platform using :data:`os.supports_follow_symlinks`.
1542 If it's unavailable, using it will raise a :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001543
1544
1545
Larry Hastings9cf065c2012-06-22 16:30:09 -07001546.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001547
1548 Use the real uid/gid to test for access to *path*. Note that most operations
1549 will use the effective uid/gid, therefore this routine can be used in a
1550 suid/sgid environment to test if the invoking user has the specified access to
1551 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1552 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1553 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1554 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001555 information.
1556
Georg Brandl50c40002012-06-24 11:45:20 +02001557 This function can support specifying :ref:`paths relative to directory
1558 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001559
1560 If *effective_ids* is ``True``, :func:`access` will perform its access
1561 checks using the effective uid/gid instead of the real uid/gid.
1562 *effective_ids* may not be supported on your platform; you can check whether
1563 or not it is available using :data:`os.supports_effective_ids`. If it is
1564 unavailable, using it will raise a :exc:`NotImplementedError`.
1565
Georg Brandl116aa622007-08-15 14:28:22 +00001566 .. note::
1567
Georg Brandl502d9a52009-07-26 15:02:41 +00001568 Using :func:`access` to check if a user is authorized to e.g. open a file
1569 before actually doing so using :func:`open` creates a security hole,
1570 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001571 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1572 techniques. For example::
1573
1574 if os.access("myfile", os.R_OK):
1575 with open("myfile") as fp:
1576 return fp.read()
1577 return "some default data"
1578
1579 is better written as::
1580
1581 try:
1582 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001583 except PermissionError:
1584 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001585 else:
1586 with fp:
1587 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001588
1589 .. note::
1590
1591 I/O operations may fail even when :func:`access` indicates that they would
1592 succeed, particularly for operations on network filesystems which may have
1593 permissions semantics beyond the usual POSIX permission-bit model.
1594
Larry Hastings9cf065c2012-06-22 16:30:09 -07001595 .. versionchanged:: 3.3
1596 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1597
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001598 .. versionchanged:: 3.6
1599 Accepts a :term:`path-like object`.
1600
Georg Brandl116aa622007-08-15 14:28:22 +00001601
1602.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001603 R_OK
1604 W_OK
1605 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001606
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001607 Values to pass as the *mode* parameter of :func:`access` to test the
1608 existence, readability, writability and executability of *path*,
1609 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001610
1611
1612.. function:: chdir(path)
1613
1614 .. index:: single: directory; changing
1615
Benjamin Petersonf650e462010-05-06 23:03:05 +00001616 Change the current working directory to *path*.
1617
Larry Hastings77892dc2012-06-25 03:27:33 -07001618 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001619 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001620
Terry Jan Reedya9b40e42019-07-06 22:44:01 -04001621 This function can raise :exc:`OSError` and subclasses such as
Kyle Stanley0717b4d2019-07-06 21:20:15 -04001622 :exc:`FileNotFoundError`, :exc:`PermissionError`, and :exc:`NotADirectoryError`.
1623
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001624 .. audit-event:: os.chdir path os.chdir
1625
Larry Hastings9cf065c2012-06-22 16:30:09 -07001626 .. versionadded:: 3.3
1627 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001628 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001629
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001630 .. versionchanged:: 3.6
1631 Accepts a :term:`path-like object`.
1632
Georg Brandl116aa622007-08-15 14:28:22 +00001633
Larry Hastings9cf065c2012-06-22 16:30:09 -07001634.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001635
1636 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1637 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1638
R David Murray30178062011-03-10 17:18:33 -05001639 * :data:`stat.UF_NODUMP`
1640 * :data:`stat.UF_IMMUTABLE`
1641 * :data:`stat.UF_APPEND`
1642 * :data:`stat.UF_OPAQUE`
1643 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001644 * :data:`stat.UF_COMPRESSED`
1645 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001646 * :data:`stat.SF_ARCHIVED`
1647 * :data:`stat.SF_IMMUTABLE`
1648 * :data:`stat.SF_APPEND`
1649 * :data:`stat.SF_NOUNLINK`
1650 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001651
Georg Brandl50c40002012-06-24 11:45:20 +02001652 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001653
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001654 .. audit-event:: os.chflags path,flags os.chflags
1655
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001656 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001657
Larry Hastings9cf065c2012-06-22 16:30:09 -07001658 .. versionadded:: 3.3
1659 The *follow_symlinks* argument.
1660
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001661 .. versionchanged:: 3.6
1662 Accepts a :term:`path-like object`.
1663
Georg Brandl116aa622007-08-15 14:28:22 +00001664
Larry Hastings9cf065c2012-06-22 16:30:09 -07001665.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001666
1667 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001668 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001669 combinations of them:
1670
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001671 * :data:`stat.S_ISUID`
1672 * :data:`stat.S_ISGID`
1673 * :data:`stat.S_ENFMT`
1674 * :data:`stat.S_ISVTX`
1675 * :data:`stat.S_IREAD`
1676 * :data:`stat.S_IWRITE`
1677 * :data:`stat.S_IEXEC`
1678 * :data:`stat.S_IRWXU`
1679 * :data:`stat.S_IRUSR`
1680 * :data:`stat.S_IWUSR`
1681 * :data:`stat.S_IXUSR`
1682 * :data:`stat.S_IRWXG`
1683 * :data:`stat.S_IRGRP`
1684 * :data:`stat.S_IWGRP`
1685 * :data:`stat.S_IXGRP`
1686 * :data:`stat.S_IRWXO`
1687 * :data:`stat.S_IROTH`
1688 * :data:`stat.S_IWOTH`
1689 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001690
Georg Brandl50c40002012-06-24 11:45:20 +02001691 This function can support :ref:`specifying a file descriptor <path_fd>`,
1692 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1693 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001694
Georg Brandl116aa622007-08-15 14:28:22 +00001695 .. note::
1696
Georg Brandl50c40002012-06-24 11:45:20 +02001697 Although Windows supports :func:`chmod`, you can only set the file's
1698 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1699 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001700
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001701 .. audit-event:: os.chmod path,mode,dir_fd os.chmod
1702
Larry Hastings9cf065c2012-06-22 16:30:09 -07001703 .. versionadded:: 3.3
1704 Added support for specifying *path* as an open file descriptor,
1705 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001706
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001707 .. versionchanged:: 3.6
1708 Accepts a :term:`path-like object`.
1709
Larry Hastings9cf065c2012-06-22 16:30:09 -07001710
1711.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001712
Georg Brandl50c40002012-06-24 11:45:20 +02001713 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1714 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001715
Georg Brandl50c40002012-06-24 11:45:20 +02001716 This function can support :ref:`specifying a file descriptor <path_fd>`,
1717 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1718 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001719
Sandro Tosid902a142011-08-22 23:28:27 +02001720 See :func:`shutil.chown` for a higher-level function that accepts names in
1721 addition to numeric ids.
1722
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001723 .. audit-event:: os.chown path,uid,gid,dir_fd os.chown
1724
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001725 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001726
Larry Hastings9cf065c2012-06-22 16:30:09 -07001727 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04001728 Added support for specifying *path* as an open file descriptor,
Larry Hastings9cf065c2012-06-22 16:30:09 -07001729 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001730
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001731 .. versionchanged:: 3.6
1732 Supports a :term:`path-like object`.
1733
Benjamin Peterson799bd802011-08-31 22:15:17 -04001734
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001735.. function:: chroot(path)
1736
Georg Brandl8a5555f2012-06-24 13:29:09 +02001737 Change the root directory of the current process to *path*.
1738
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001739 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001740
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001741 .. versionchanged:: 3.6
1742 Accepts a :term:`path-like object`.
1743
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001744
1745.. function:: fchdir(fd)
1746
1747 Change the current working directory to the directory represented by the file
1748 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001749 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001750
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001751 .. audit-event:: os.chdir path os.fchdir
1752
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001753 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001754
1755
1756.. function:: getcwd()
1757
1758 Return a string representing the current working directory.
1759
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001760
1761.. function:: getcwdb()
1762
1763 Return a bytestring representing the current working directory.
1764
Victor Stinner689830e2019-06-26 17:31:12 +02001765 .. versionchanged:: 3.8
1766 The function now uses the UTF-8 encoding on Windows, rather than the ANSI
1767 code page: see :pep:`529` for the rationale. The function is no longer
1768 deprecated on Windows.
1769
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001770
Georg Brandl116aa622007-08-15 14:28:22 +00001771.. function:: lchflags(path, flags)
1772
Georg Brandl50c40002012-06-24 11:45:20 +02001773 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001774 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001775 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001776
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001777 .. audit-event:: os.chflags path,flags os.lchflags
1778
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001779 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001780
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001781 .. versionchanged:: 3.6
1782 Accepts a :term:`path-like object`.
1783
Georg Brandl116aa622007-08-15 14:28:22 +00001784
Christian Heimes93852662007-12-01 12:22:32 +00001785.. function:: lchmod(path, mode)
1786
1787 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001788 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001789 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001790 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001791
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001792 .. audit-event:: os.chmod path,mode,dir_fd os.lchmod
1793
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001794 .. availability:: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001795
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001796 .. versionchanged:: 3.6
1797 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001798
Georg Brandl116aa622007-08-15 14:28:22 +00001799.. function:: lchown(path, uid, gid)
1800
Georg Brandl50c40002012-06-24 11:45:20 +02001801 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001802 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001803 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001804
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001805 .. audit-event:: os.chown path,uid,gid,dir_fd os.lchown
1806
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001807 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001808
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001809 .. versionchanged:: 3.6
1810 Accepts a :term:`path-like object`.
1811
Georg Brandl116aa622007-08-15 14:28:22 +00001812
Larry Hastings9cf065c2012-06-22 16:30:09 -07001813.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001814
Larry Hastings9cf065c2012-06-22 16:30:09 -07001815 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001816
Georg Brandlaceaf902012-06-25 08:33:56 +02001817 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1818 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1819 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001820
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001821 .. audit-event:: os.link src,dst,src_dir_fd,dst_dir_fd os.link
1822
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001823 .. availability:: Unix, Windows.
Brian Curtin1b9df392010-11-24 20:24:31 +00001824
1825 .. versionchanged:: 3.2
1826 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001827
Larry Hastings9cf065c2012-06-22 16:30:09 -07001828 .. versionadded:: 3.3
1829 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1830
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001831 .. versionchanged:: 3.6
1832 Accepts a :term:`path-like object` for *src* and *dst*.
1833
Georg Brandl116aa622007-08-15 14:28:22 +00001834
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001835.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001836
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001837 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001838 *path*. The list is in arbitrary order, and does not include the special
1839 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Miss Islington (bot)bd078df2020-09-04 15:29:06 -07001840 If a file is removed from or added to the directory during the call of
1841 this function, whether a name for that file be included is unspecified.
Georg Brandl116aa622007-08-15 14:28:22 +00001842
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001843 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1844 (directly or indirectly through the :class:`PathLike` interface),
1845 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001846 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001847
Larry Hastings77892dc2012-06-25 03:27:33 -07001848 This function can also support :ref:`specifying a file descriptor
1849 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001850
Steve Dower44f91c32019-06-27 10:47:59 -07001851 .. audit-event:: os.listdir path os.listdir
Steve Dower60419a72019-06-24 08:42:54 -07001852
Larry Hastingsfdaea062012-06-25 04:42:23 -07001853 .. note::
1854 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1855
Victor Stinner6036e442015-03-08 01:58:04 +01001856 .. seealso::
1857
Victor Stinner51b58322015-05-15 09:12:58 +02001858 The :func:`scandir` function returns directory entries along with
1859 file attribute information, giving better performance for many
1860 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001861
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001862 .. versionchanged:: 3.2
1863 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001864
Larry Hastings9cf065c2012-06-22 16:30:09 -07001865 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04001866 Added support for specifying *path* as an open file descriptor.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001867
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001868 .. versionchanged:: 3.6
1869 Accepts a :term:`path-like object`.
1870
Georg Brandl50c40002012-06-24 11:45:20 +02001871
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001872.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001873
R. David Murray7b1aae92011-01-24 19:34:58 +00001874 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001875 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1876 :class:`stat_result` object.
1877
1878 On platforms that do not support symbolic links, this is an alias for
1879 :func:`~os.stat`.
1880
1881 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1882 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001883
Georg Brandl50c40002012-06-24 11:45:20 +02001884 This function can also support :ref:`paths relative to directory descriptors
1885 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001886
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001887 .. seealso::
1888
Berker Peksag2034caa2015-04-27 13:53:28 +03001889 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001890
Georg Brandlb3823372010-07-10 08:58:37 +00001891 .. versionchanged:: 3.2
1892 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001893
Larry Hastings9cf065c2012-06-22 16:30:09 -07001894 .. versionchanged:: 3.3
1895 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001896
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001897 .. versionchanged:: 3.6
1898 Accepts a :term:`path-like object` for *src* and *dst*.
1899
Steve Dowerdf2d4a62019-08-21 15:27:33 -07001900 .. versionchanged:: 3.8
1901 On Windows, now opens reparse points that represent another path
1902 (name surrogates), including symbolic links and directory junctions.
1903 Other kinds of reparse points are resolved by the operating system as
1904 for :func:`~os.stat`.
1905
Ross Lagerwall7807c352011-03-17 20:20:30 +02001906
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001907.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1908
1909 Create a directory named *path* with numeric mode *mode*.
1910
Tommy Beadle63b91e52016-06-02 15:41:20 -04001911 If the directory already exists, :exc:`FileExistsError` is raised.
1912
1913 .. _mkdir_modebits:
1914
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001915 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001916 value is first masked out. If bits other than the last 9 (i.e. the last 3
1917 digits of the octal representation of the *mode*) are set, their meaning is
1918 platform-dependent. On some platforms, they are ignored and you should call
1919 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001920
1921 This function can also support :ref:`paths relative to directory descriptors
1922 <dir_fd>`.
1923
1924 It is also possible to create temporary directories; see the
1925 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1926
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001927 .. audit-event:: os.mkdir path,mode,dir_fd os.mkdir
1928
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001929 .. versionadded:: 3.3
1930 The *dir_fd* argument.
1931
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001932 .. versionchanged:: 3.6
1933 Accepts a :term:`path-like object`.
1934
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001935
Zachary Warea22ae212014-03-20 09:42:01 -05001936.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001937
1938 .. index::
1939 single: directory; creating
1940 single: UNC paths; and os.makedirs()
1941
1942 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001943 intermediate-level directories needed to contain the leaf directory.
1944
Serhiy Storchakae304e332017-03-24 13:27:42 +02001945 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1946 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1947 is interpreted. To set the file permission bits of any newly-created parent
1948 directories you can set the umask before invoking :func:`makedirs`. The
1949 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001950
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02001951 If *exist_ok* is ``False`` (the default), an :exc:`FileExistsError` is
1952 raised if the target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001953
1954 .. note::
1955
1956 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001957 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001958
1959 This function handles UNC paths correctly.
1960
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001961 .. audit-event:: os.mkdir path,mode,dir_fd os.makedirs
1962
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001963 .. versionadded:: 3.2
1964 The *exist_ok* parameter.
1965
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001966 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001967
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001968 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001969 :func:`makedirs` would still raise an error if *mode* did not match the
1970 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001971 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001972
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001973 .. versionchanged:: 3.6
1974 Accepts a :term:`path-like object`.
1975
Serhiy Storchakae304e332017-03-24 13:27:42 +02001976 .. versionchanged:: 3.7
1977 The *mode* argument no longer affects the file permission bits of
1978 newly-created intermediate-level directories.
1979
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001980
Larry Hastings9cf065c2012-06-22 16:30:09 -07001981.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001982
Larry Hastings9cf065c2012-06-22 16:30:09 -07001983 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1984 The current umask value is first masked out from the mode.
1985
Georg Brandl50c40002012-06-24 11:45:20 +02001986 This function can also support :ref:`paths relative to directory descriptors
1987 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001988
1989 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1990 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1991 rendezvous between "client" and "server" type processes: the server opens the
1992 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1993 doesn't open the FIFO --- it just creates the rendezvous point.
1994
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001995 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001996
Larry Hastings9cf065c2012-06-22 16:30:09 -07001997 .. versionadded:: 3.3
1998 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001999
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002000 .. versionchanged:: 3.6
2001 Accepts a :term:`path-like object`.
2002
Larry Hastings9cf065c2012-06-22 16:30:09 -07002003
Martin Panterbf19d162015-09-09 01:01:13 +00002004.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002005
2006 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00002007 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00002008 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
2009 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
2010 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
2011 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00002012 :func:`os.makedev`), otherwise it is ignored.
2013
Georg Brandl50c40002012-06-24 11:45:20 +02002014 This function can also support :ref:`paths relative to directory descriptors
2015 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002016
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002017 .. availability:: Unix.
Berker Peksag6129e142016-09-26 22:50:11 +03002018
Larry Hastings9cf065c2012-06-22 16:30:09 -07002019 .. versionadded:: 3.3
2020 The *dir_fd* argument.
2021
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002022 .. versionchanged:: 3.6
2023 Accepts a :term:`path-like object`.
2024
Georg Brandl116aa622007-08-15 14:28:22 +00002025
2026.. function:: major(device)
2027
Christian Heimesfaf2f632008-01-06 16:59:19 +00002028 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00002029 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00002030
Georg Brandl116aa622007-08-15 14:28:22 +00002031
2032.. function:: minor(device)
2033
Christian Heimesfaf2f632008-01-06 16:59:19 +00002034 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00002035 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00002036
Georg Brandl116aa622007-08-15 14:28:22 +00002037
2038.. function:: makedev(major, minor)
2039
Christian Heimesfaf2f632008-01-06 16:59:19 +00002040 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00002041
Georg Brandl116aa622007-08-15 14:28:22 +00002042
Georg Brandl116aa622007-08-15 14:28:22 +00002043.. function:: pathconf(path, name)
2044
2045 Return system configuration information relevant to a named file. *name*
2046 specifies the configuration value to retrieve; it may be a string which is the
2047 name of a defined system value; these names are specified in a number of
2048 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
2049 additional names as well. The names known to the host operating system are
2050 given in the ``pathconf_names`` dictionary. For configuration variables not
2051 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00002052
2053 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
2054 specific value for *name* is not supported by the host system, even if it is
2055 included in ``pathconf_names``, an :exc:`OSError` is raised with
2056 :const:`errno.EINVAL` for the error number.
2057
Larry Hastings77892dc2012-06-25 03:27:33 -07002058 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02002059 <path_fd>`.
2060
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002061 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002062
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002063 .. versionchanged:: 3.6
2064 Accepts a :term:`path-like object`.
2065
Georg Brandl116aa622007-08-15 14:28:22 +00002066
2067.. data:: pathconf_names
2068
2069 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
2070 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02002071 can be used to determine the set of names known to the system.
2072
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002073 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00002074
2075
Larry Hastings9cf065c2012-06-22 16:30:09 -07002076.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002077
2078 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02002079 result may be either an absolute or relative pathname; if it is relative, it
2080 may be converted to an absolute pathname using
2081 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00002082
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002083 If the *path* is a string object (directly or indirectly through a
2084 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00002085 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002086 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00002087
Georg Brandl50c40002012-06-24 11:45:20 +02002088 This function can also support :ref:`paths relative to directory descriptors
2089 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002090
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002091 When trying to resolve a path that may contain links, use
2092 :func:`~os.path.realpath` to properly handle recursion and platform
2093 differences.
2094
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002095 .. availability:: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002096
Georg Brandlb3823372010-07-10 08:58:37 +00002097 .. versionchanged:: 3.2
2098 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002099
Larry Hastings9cf065c2012-06-22 16:30:09 -07002100 .. versionadded:: 3.3
2101 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00002102
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002103 .. versionchanged:: 3.6
Berker Peksage0b5b202018-08-15 13:03:41 +03002104 Accepts a :term:`path-like object` on Unix.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002105
Berker Peksage0b5b202018-08-15 13:03:41 +03002106 .. versionchanged:: 3.8
2107 Accepts a :term:`path-like object` and a bytes object on Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00002108
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002109 .. versionchanged:: 3.8
2110 Added support for directory junctions, and changed to return the
2111 substitution path (which typically includes ``\\?\`` prefix) rather
2112 than the optional "print name" field that was previously returned.
2113
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002114.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002115
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002116 Remove (delete) the file *path*. If *path* is a directory, an
2117 :exc:`IsADirectoryError` is raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002118
Georg Brandl50c40002012-06-24 11:45:20 +02002119 This function can support :ref:`paths relative to directory descriptors
2120 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002121
2122 On Windows, attempting to remove a file that is in use causes an exception to
2123 be raised; on Unix, the directory entry is removed but the storage allocated
2124 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002125
Brett Cannon05039172015-12-28 17:28:19 -08002126 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002127
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002128 .. audit-event:: os.remove path,dir_fd os.remove
2129
Larry Hastings9cf065c2012-06-22 16:30:09 -07002130 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002131 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002132
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002133 .. versionchanged:: 3.6
2134 Accepts a :term:`path-like object`.
2135
Georg Brandl116aa622007-08-15 14:28:22 +00002136
Zachary Warea22ae212014-03-20 09:42:01 -05002137.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00002138
2139 .. index:: single: directory; deleting
2140
Christian Heimesfaf2f632008-01-06 16:59:19 +00002141 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00002142 leaf directory is successfully removed, :func:`removedirs` tries to
2143 successively remove every parent directory mentioned in *path* until an error
2144 is raised (which is ignored, because it generally means that a parent directory
2145 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
2146 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
2147 they are empty. Raises :exc:`OSError` if the leaf directory could not be
2148 successfully removed.
2149
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002150 .. audit-event:: os.remove path,dir_fd os.removedirs
2151
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002152 .. versionchanged:: 3.6
2153 Accepts a :term:`path-like object`.
2154
Georg Brandl116aa622007-08-15 14:28:22 +00002155
Larry Hastings9cf065c2012-06-22 16:30:09 -07002156.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002157
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002158 Rename the file or directory *src* to *dst*. If *dst* exists, the operation
2159 will fail with an :exc:`OSError` subclass in a number of cases:
2160
2161 On Windows, if *dst* exists a :exc:`FileExistsError` is always raised.
2162
Mariatta7cbef722019-07-11 10:31:19 -07002163 On Unix, if *src* is a file and *dst* is a directory or vice-versa, an
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002164 :exc:`IsADirectoryError` or a :exc:`NotADirectoryError` will be raised
2165 respectively. If both are directories and *dst* is empty, *dst* will be
2166 silently replaced. If *dst* is a non-empty directory, an :exc:`OSError`
2167 is raised. If both are files, *dst* it will be replaced silently if the user
2168 has permission. The operation may fail on some Unix flavors if *src* and
2169 *dst* are on different filesystems. If successful, the renaming will be an
2170 atomic operation (this is a POSIX requirement).
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002171
Georg Brandlaceaf902012-06-25 08:33:56 +02002172 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2173 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002174
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002175 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002176
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002177 .. audit-event:: os.rename src,dst,src_dir_fd,dst_dir_fd os.rename
2178
Larry Hastings9cf065c2012-06-22 16:30:09 -07002179 .. versionadded:: 3.3
2180 The *src_dir_fd* and *dst_dir_fd* arguments.
2181
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002182 .. versionchanged:: 3.6
2183 Accepts a :term:`path-like object` for *src* and *dst*.
2184
Georg Brandl116aa622007-08-15 14:28:22 +00002185
2186.. function:: renames(old, new)
2187
2188 Recursive directory or file renaming function. Works like :func:`rename`, except
2189 creation of any intermediate directories needed to make the new pathname good is
2190 attempted first. After the rename, directories corresponding to rightmost path
2191 segments of the old name will be pruned away using :func:`removedirs`.
2192
Georg Brandl116aa622007-08-15 14:28:22 +00002193 .. note::
2194
2195 This function can fail with the new directory structure made if you lack
2196 permissions needed to remove the leaf directory or file.
2197
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002198 .. audit-event:: os.rename src,dst,src_dir_fd,dst_dir_fd os.renames
2199
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002200 .. versionchanged:: 3.6
2201 Accepts a :term:`path-like object` for *old* and *new*.
2202
Georg Brandl116aa622007-08-15 14:28:22 +00002203
Larry Hastings9cf065c2012-06-22 16:30:09 -07002204.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002205
2206 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2207 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
2208 be replaced silently if the user has permission. The operation may fail
2209 if *src* and *dst* are on different filesystems. If successful,
2210 the renaming will be an atomic operation (this is a POSIX requirement).
2211
Georg Brandlaceaf902012-06-25 08:33:56 +02002212 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2213 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002214
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002215 .. audit-event:: os.rename src,dst,src_dir_fd,dst_dir_fd os.replace
2216
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002217 .. versionadded:: 3.3
2218
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002219 .. versionchanged:: 3.6
2220 Accepts a :term:`path-like object` for *src* and *dst*.
2221
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002222
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002223.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002224
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002225 Remove (delete) the directory *path*. If the directory does not exist or is
2226 not empty, an :exc:`FileNotFoundError` or an :exc:`OSError` is raised
2227 respectively. In order to remove whole directory trees,
2228 :func:`shutil.rmtree` can be used.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002229
Georg Brandl50c40002012-06-24 11:45:20 +02002230 This function can support :ref:`paths relative to directory descriptors
2231 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002232
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002233 .. audit-event:: os.rmdir path,dir_fd os.rmdir
2234
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002235 .. versionadded:: 3.3
2236 The *dir_fd* parameter.
2237
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002238 .. versionchanged:: 3.6
2239 Accepts a :term:`path-like object`.
2240
Georg Brandl116aa622007-08-15 14:28:22 +00002241
Victor Stinner6036e442015-03-08 01:58:04 +01002242.. function:: scandir(path='.')
2243
Brett Cannona32c4d02016-06-24 14:14:44 -07002244 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2245 entries in the directory given by *path*. The entries are yielded in
2246 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
Miss Islington (bot)bd078df2020-09-04 15:29:06 -07002247 included. If a file is removed from or added to the directory after
2248 creating the iterator, whether an entry for that file be included is
2249 unspecified.
Victor Stinner6036e442015-03-08 01:58:04 +01002250
Victor Stinner51b58322015-05-15 09:12:58 +02002251 Using :func:`scandir` instead of :func:`listdir` can significantly
2252 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002253 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002254 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002255 All :class:`os.DirEntry` methods may perform a system call, but
2256 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2257 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002258 always requires a system call on Unix but only requires one for
2259 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002260
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002261 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2262 (directly or indirectly through the :class:`PathLike` interface),
2263 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2264 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2265 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002266
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002267 This function can also support :ref:`specifying a file descriptor
2268 <path_fd>`; the file descriptor must refer to a directory.
2269
Steve Dower44f91c32019-06-27 10:47:59 -07002270 .. audit-event:: os.scandir path os.scandir
Steve Dower60419a72019-06-24 08:42:54 -07002271
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002272 The :func:`scandir` iterator supports the :term:`context manager` protocol
2273 and has the following method:
2274
2275 .. method:: scandir.close()
2276
2277 Close the iterator and free acquired resources.
2278
2279 This is called automatically when the iterator is exhausted or garbage
2280 collected, or when an error happens during iterating. However it
2281 is advisable to call it explicitly or use the :keyword:`with`
2282 statement.
2283
2284 .. versionadded:: 3.6
2285
Victor Stinner6036e442015-03-08 01:58:04 +01002286 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002287 the files (excluding directories) in the given *path* that don't start with
2288 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2289 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002290
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002291 with os.scandir(path) as it:
2292 for entry in it:
2293 if not entry.name.startswith('.') and entry.is_file():
2294 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002295
2296 .. note::
2297
2298 On Unix-based systems, :func:`scandir` uses the system's
2299 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2300 and
2301 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2302 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002303 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002304 and
Georg Brandl5d941342016-02-26 19:37:12 +01002305 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002306 functions.
2307
Victor Stinner6036e442015-03-08 01:58:04 +01002308 .. versionadded:: 3.5
2309
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002310 .. versionadded:: 3.6
2311 Added support for the :term:`context manager` protocol and the
2312 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2313 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2314 in its destructor.
2315
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002316 The function accepts a :term:`path-like object`.
2317
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002318 .. versionchanged:: 3.7
2319 Added support for :ref:`file descriptors <path_fd>` on Unix.
2320
Victor Stinner6036e442015-03-08 01:58:04 +01002321
2322.. class:: DirEntry
2323
2324 Object yielded by :func:`scandir` to expose the file path and other file
2325 attributes of a directory entry.
2326
2327 :func:`scandir` will provide as much of this information as possible without
2328 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002329 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002330
Brett Cannona32c4d02016-06-24 14:14:44 -07002331 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002332 structures; if you know the file metadata has changed or if a long time has
2333 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2334 up-to-date information.
2335
Brett Cannona32c4d02016-06-24 14:14:44 -07002336 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002337 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002338 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002339 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002340
Brett Cannona32c4d02016-06-24 14:14:44 -07002341 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002342 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002343
Brett Cannona32c4d02016-06-24 14:14:44 -07002344 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002345
2346 .. attribute:: name
2347
2348 The entry's base filename, relative to the :func:`scandir` *path*
2349 argument.
2350
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002351 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2352 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002353 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002354
2355 .. attribute:: path
2356
2357 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2358 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2359 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002360 argument was absolute. If the :func:`scandir` *path*
2361 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2362 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002363
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002364 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2365 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002366 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002367
2368 .. method:: inode()
2369
2370 Return the inode number of the entry.
2371
Brett Cannona32c4d02016-06-24 14:14:44 -07002372 The result is cached on the ``os.DirEntry`` object. Use
2373 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2374 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002375
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002376 On the first, uncached call, a system call is required on Windows but
2377 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002378
2379 .. method:: is_dir(\*, follow_symlinks=True)
2380
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002381 Return ``True`` if this entry is a directory or a symbolic link pointing
2382 to a directory; return ``False`` if the entry is or points to any other
2383 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002384
2385 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002386 is a directory (without following symlinks); return ``False`` if the
2387 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002388
Brett Cannona32c4d02016-06-24 14:14:44 -07002389 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002390 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2391 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2392
2393 On the first, uncached call, no system call is required in most cases.
2394 Specifically, for non-symlinks, neither Windows or Unix require a system
2395 call, except on certain Unix file systems, such as network file systems,
2396 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2397 a system call will be required to follow the symlink unless
2398 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002399
Victor Stinner51b58322015-05-15 09:12:58 +02002400 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2401 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002402
Victor Stinner6036e442015-03-08 01:58:04 +01002403 .. method:: is_file(\*, follow_symlinks=True)
2404
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002405 Return ``True`` if this entry is a file or a symbolic link pointing to a
2406 file; return ``False`` if the entry is or points to a directory or other
2407 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002408
2409 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002410 is a file (without following symlinks); return ``False`` if the entry is
2411 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002412
Brett Cannona32c4d02016-06-24 14:14:44 -07002413 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2414 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002415
2416 .. method:: is_symlink()
2417
Victor Stinner51b58322015-05-15 09:12:58 +02002418 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002419 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002420 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002421
Brett Cannona32c4d02016-06-24 14:14:44 -07002422 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002423 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002424
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002425 On the first, uncached call, no system call is required in most cases.
2426 Specifically, neither Windows or Unix require a system call, except on
2427 certain Unix file systems, such as network file systems, that return
2428 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002429
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002430 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2431 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002432
2433 .. method:: stat(\*, follow_symlinks=True)
2434
Victor Stinner51b58322015-05-15 09:12:58 +02002435 Return a :class:`stat_result` object for this entry. This method
2436 follows symbolic links by default; to stat a symbolic link add the
2437 ``follow_symlinks=False`` argument.
2438
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002439 On Unix, this method always requires a system call. On Windows, it
2440 only requires a system call if *follow_symlinks* is ``True`` and the
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002441 entry is a reparse point (for example, a symbolic link or directory
2442 junction).
Victor Stinner6036e442015-03-08 01:58:04 +01002443
2444 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2445 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2446 get these attributes.
2447
Brett Cannona32c4d02016-06-24 14:14:44 -07002448 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002449 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2450 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002451
Guido van Rossum1469d742016-01-06 11:36:03 -08002452 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002453 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002454 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002455 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2456 and ``stat()`` methods.
2457
Victor Stinner6036e442015-03-08 01:58:04 +01002458 .. versionadded:: 3.5
2459
Brett Cannon96881cd2016-06-10 14:37:21 -07002460 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002461 Added support for the :class:`~os.PathLike` interface. Added support
2462 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002463
Victor Stinner6036e442015-03-08 01:58:04 +01002464
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002465.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002466
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002467 Get the status of a file or a file descriptor. Perform the equivalent of a
2468 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002469 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002470 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002471 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002472
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002473 This function normally follows symlinks; to stat a symlink add the argument
2474 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002475
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002476 This function can support :ref:`specifying a file descriptor <path_fd>` and
2477 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002478
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002479 On Windows, passing ``follow_symlinks=False`` will disable following all
2480 name-surrogate reparse points, which includes symlinks and directory
2481 junctions. Other types of reparse points that do not resemble links or that
2482 the operating system is unable to follow will be opened directly. When
2483 following a chain of multiple links, this may result in the original link
2484 being returned instead of the non-link that prevented full traversal. To
2485 obtain stat results for the final path in this case, use the
2486 :func:`os.path.realpath` function to resolve the path name as far as
2487 possible and call :func:`lstat` on the result. This does not apply to
2488 dangling symlinks or junction points, which will raise the usual exceptions.
2489
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002490 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002491
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002492 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002493
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002494 >>> import os
2495 >>> statinfo = os.stat('somefile.txt')
2496 >>> statinfo
2497 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2498 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2499 st_mtime=1297230027, st_ctime=1297230027)
2500 >>> statinfo.st_size
2501 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002502
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002503 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002504
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002505 :func:`fstat` and :func:`lstat` functions.
2506
2507 .. versionadded:: 3.3
2508 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2509 descriptor instead of a path.
2510
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002511 .. versionchanged:: 3.6
2512 Accepts a :term:`path-like object`.
2513
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002514 .. versionchanged:: 3.8
2515 On Windows, all reparse points that can be resolved by the operating
2516 system are now followed, and passing ``follow_symlinks=False``
2517 disables following all name surrogate reparse points. If the operating
2518 system reaches a reparse point that it is not able to follow, *stat* now
2519 returns the information for the original path as if
2520 ``follow_symlinks=False`` had been specified instead of raising an error.
2521
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002522
2523.. class:: stat_result
2524
2525 Object whose attributes correspond roughly to the members of the
2526 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2527 :func:`os.fstat` and :func:`os.lstat`.
2528
2529 Attributes:
2530
2531 .. attribute:: st_mode
2532
2533 File mode: file type and file mode bits (permissions).
2534
2535 .. attribute:: st_ino
2536
Steve Dower3e51a3d2018-05-28 17:24:36 -07002537 Platform dependent, but if non-zero, uniquely identifies the
2538 file for a given value of ``st_dev``. Typically:
2539
2540 * the inode number on Unix,
2541 * the `file index
2542 <https://msdn.microsoft.com/en-us/library/aa363788>`_ on
2543 Windows
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002544
2545 .. attribute:: st_dev
2546
2547 Identifier of the device on which this file resides.
2548
2549 .. attribute:: st_nlink
2550
2551 Number of hard links.
2552
2553 .. attribute:: st_uid
2554
2555 User identifier of the file owner.
2556
2557 .. attribute:: st_gid
2558
2559 Group identifier of the file owner.
2560
2561 .. attribute:: st_size
2562
2563 Size of the file in bytes, if it is a regular file or a symbolic link.
2564 The size of a symbolic link is the length of the pathname it contains,
2565 without a terminating null byte.
2566
2567 Timestamps:
2568
2569 .. attribute:: st_atime
2570
2571 Time of most recent access expressed in seconds.
2572
2573 .. attribute:: st_mtime
2574
2575 Time of most recent content modification expressed in seconds.
2576
2577 .. attribute:: st_ctime
2578
2579 Platform dependent:
2580
2581 * the time of most recent metadata change on Unix,
2582 * the time of creation on Windows, expressed in seconds.
2583
2584 .. attribute:: st_atime_ns
2585
2586 Time of most recent access expressed in nanoseconds as an integer.
2587
2588 .. attribute:: st_mtime_ns
2589
2590 Time of most recent content modification expressed in nanoseconds as an
2591 integer.
2592
2593 .. attribute:: st_ctime_ns
2594
2595 Platform dependent:
2596
2597 * the time of most recent metadata change on Unix,
2598 * the time of creation on Windows, expressed in nanoseconds as an
2599 integer.
2600
Georg Brandl116aa622007-08-15 14:28:22 +00002601 .. note::
2602
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002603 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002604 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2605 system and the file system. For example, on Windows systems using the FAT
2606 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2607 :attr:`st_atime` has only 1-day resolution. See your operating system
2608 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002609
Larry Hastings6fe20b32012-04-19 15:07:49 -07002610 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2611 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2612 systems do not provide nanosecond precision. On systems that do
2613 provide nanosecond precision, the floating-point object used to
2614 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2615 cannot preserve all of it, and as such will be slightly inexact.
2616 If you need the exact timestamps you should always use
2617 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002618
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002619 On some Unix systems (such as Linux), the following attributes may also be
2620 available:
2621
2622 .. attribute:: st_blocks
2623
2624 Number of 512-byte blocks allocated for file.
2625 This may be smaller than :attr:`st_size`/512 when the file has holes.
2626
2627 .. attribute:: st_blksize
2628
2629 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2630 smaller chunks may cause an inefficient read-modify-rewrite.
2631
2632 .. attribute:: st_rdev
2633
2634 Type of device if an inode device.
2635
2636 .. attribute:: st_flags
2637
2638 User defined flags for file.
2639
2640 On other Unix systems (such as FreeBSD), the following attributes may be
2641 available (but may be only filled out if root tries to use them):
2642
2643 .. attribute:: st_gen
2644
2645 File generation number.
2646
2647 .. attribute:: st_birthtime
2648
2649 Time of file creation.
2650
jcea6c51d512018-01-28 14:00:08 +01002651 On Solaris and derivatives, the following attributes may also be
2652 available:
2653
2654 .. attribute:: st_fstype
2655
2656 String that uniquely identifies the type of the filesystem that
2657 contains the file.
2658
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002659 On Mac OS systems, the following attributes may also be available:
2660
2661 .. attribute:: st_rsize
2662
2663 Real size of the file.
2664
2665 .. attribute:: st_creator
2666
2667 Creator of the file.
2668
2669 .. attribute:: st_type
2670
2671 File type.
2672
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002673 On Windows systems, the following attributes are also available:
Victor Stinnere1d24f72014-07-24 12:44:07 +02002674
2675 .. attribute:: st_file_attributes
2676
2677 Windows file attributes: ``dwFileAttributes`` member of the
2678 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2679 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2680 constants in the :mod:`stat` module.
2681
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002682 .. attribute:: st_reparse_tag
2683
2684 When :attr:`st_file_attributes` has the ``FILE_ATTRIBUTE_REPARSE_POINT``
2685 set, this field contains the tag identifying the type of reparse point.
2686 See the ``IO_REPARSE_TAG_*`` constants in the :mod:`stat` module.
2687
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002688 The standard module :mod:`stat` defines functions and constants that are
2689 useful for extracting information from a :c:type:`stat` structure. (On
2690 Windows, some items are filled with dummy values.)
2691
2692 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002693 accessible as a tuple of at least 10 integers giving the most important (and
2694 portable) members of the :c:type:`stat` structure, in the order
2695 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2696 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2697 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002698 some implementations. For compatibility with older Python versions,
2699 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002700
Larry Hastings6fe20b32012-04-19 15:07:49 -07002701 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002702 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2703 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002704
Zachary Ware63f277b2014-06-19 09:46:37 -05002705 .. versionadded:: 3.5
2706 Added the :attr:`st_file_attributes` member on Windows.
2707
Steve Dower3e51a3d2018-05-28 17:24:36 -07002708 .. versionchanged:: 3.5
2709 Windows now returns the file index as :attr:`st_ino` when
2710 available.
2711
jcea6c51d512018-01-28 14:00:08 +01002712 .. versionadded:: 3.7
2713 Added the :attr:`st_fstype` member to Solaris/derivatives.
Georg Brandl116aa622007-08-15 14:28:22 +00002714
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002715 .. versionadded:: 3.8
2716 Added the :attr:`st_reparse_tag` member on Windows.
2717
2718 .. versionchanged:: 3.8
2719 On Windows, the :attr:`st_mode` member now identifies special
2720 files as :const:`S_IFCHR`, :const:`S_IFIFO` or :const:`S_IFBLK`
2721 as appropriate.
2722
Georg Brandl116aa622007-08-15 14:28:22 +00002723.. function:: statvfs(path)
2724
Georg Brandl60203b42010-10-06 10:11:56 +00002725 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002726 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002727 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002728 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2729 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002730 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002731
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002732 Two module-level constants are defined for the :attr:`f_flag` attribute's
2733 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2734 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2735 setuid/setgid bits are disabled or not supported.
2736
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002737 Additional module-level constants are defined for GNU/glibc based systems.
2738 These are :const:`ST_NODEV` (disallow access to device special files),
2739 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2740 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2741 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2742 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2743 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2744 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2745
Georg Brandl50c40002012-06-24 11:45:20 +02002746 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002747
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002748 .. availability:: Unix.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002749
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002750 .. versionchanged:: 3.2
2751 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2752
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002753 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04002754 Added support for specifying *path* as an open file descriptor.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002755
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002756 .. versionchanged:: 3.4
2757 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2758 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2759 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2760 and :const:`ST_RELATIME` constants were added.
2761
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002762 .. versionchanged:: 3.6
2763 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002764
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002765 .. versionadded:: 3.7
2766 Added :attr:`f_fsid`.
2767
Larry Hastings9cf065c2012-06-22 16:30:09 -07002768
2769.. data:: supports_dir_fd
2770
Cheryl Sabellae1521692019-05-06 08:39:13 -04002771 A :class:`set` object indicating which functions in the :mod:`os`
2772 module accept an open file descriptor for their *dir_fd* parameter.
2773 Different platforms provide different features, and the underlying
2774 functionality Python uses to implement the *dir_fd* parameter is not
2775 available on all platforms Python supports. For consistency's sake,
2776 functions that may support *dir_fd* always allow specifying the
2777 parameter, but will throw an exception if the functionality is used
2778 when it's not locally available. (Specifying ``None`` for *dir_fd*
2779 is always supported on all platforms.)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002780
Cheryl Sabellae1521692019-05-06 08:39:13 -04002781 To check whether a particular function accepts an open file descriptor
2782 for its *dir_fd* parameter, use the ``in`` operator on ``supports_dir_fd``.
2783 As an example, this expression evaluates to ``True`` if :func:`os.stat`
2784 accepts open file descriptors for *dir_fd* on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002785
2786 os.stat in os.supports_dir_fd
2787
Cheryl Sabellae1521692019-05-06 08:39:13 -04002788 Currently *dir_fd* parameters only work on Unix platforms;
2789 none of them work on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002790
2791 .. versionadded:: 3.3
2792
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002793
Larry Hastings9cf065c2012-06-22 16:30:09 -07002794.. data:: supports_effective_ids
2795
Cheryl Sabellae1521692019-05-06 08:39:13 -04002796 A :class:`set` object indicating whether :func:`os.access` permits
2797 specifying ``True`` for its *effective_ids* parameter on the local platform.
2798 (Specifying ``False`` for *effective_ids* is always supported on all
2799 platforms.) If the local platform supports it, the collection will contain
2800 :func:`os.access`; otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002801
Cheryl Sabellae1521692019-05-06 08:39:13 -04002802 This expression evaluates to ``True`` if :func:`os.access` supports
2803 ``effective_ids=True`` on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002804
2805 os.access in os.supports_effective_ids
2806
Cheryl Sabellae1521692019-05-06 08:39:13 -04002807 Currently *effective_ids* is only supported on Unix platforms;
2808 it does not work on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002809
2810 .. versionadded:: 3.3
2811
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002812
Larry Hastings9cf065c2012-06-22 16:30:09 -07002813.. data:: supports_fd
2814
Cheryl Sabellae1521692019-05-06 08:39:13 -04002815 A :class:`set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002816 :mod:`os` module permit specifying their *path* parameter as an open file
Cheryl Sabellae1521692019-05-06 08:39:13 -04002817 descriptor on the local platform. Different platforms provide different
2818 features, and the underlying functionality Python uses to accept open file
2819 descriptors as *path* arguments is not available on all platforms Python
2820 supports.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002821
Cheryl Sabellae1521692019-05-06 08:39:13 -04002822 To determine whether a particular function permits specifying an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002823 descriptor for its *path* parameter, use the ``in`` operator on
Cheryl Sabellae1521692019-05-06 08:39:13 -04002824 ``supports_fd``. As an example, this expression evaluates to ``True`` if
2825 :func:`os.chdir` accepts open file descriptors for *path* on your local
Larry Hastings9cf065c2012-06-22 16:30:09 -07002826 platform::
2827
2828 os.chdir in os.supports_fd
2829
2830 .. versionadded:: 3.3
2831
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002832
Larry Hastings9cf065c2012-06-22 16:30:09 -07002833.. data:: supports_follow_symlinks
2834
Cheryl Sabellae1521692019-05-06 08:39:13 -04002835 A :class:`set` object indicating which functions in the :mod:`os` module
2836 accept ``False`` for their *follow_symlinks* parameter on the local platform.
2837 Different platforms provide different features, and the underlying
2838 functionality Python uses to implement *follow_symlinks* is not available
2839 on all platforms Python supports. For consistency's sake, functions that
2840 may support *follow_symlinks* always allow specifying the parameter, but
2841 will throw an exception if the functionality is used when it's not locally
2842 available. (Specifying ``True`` for *follow_symlinks* is always supported
2843 on all platforms.)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002844
Cheryl Sabellae1521692019-05-06 08:39:13 -04002845 To check whether a particular function accepts ``False`` for its
2846 *follow_symlinks* parameter, use the ``in`` operator on
2847 ``supports_follow_symlinks``. As an example, this expression evaluates
2848 to ``True`` if you may specify ``follow_symlinks=False`` when calling
2849 :func:`os.stat` on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002850
2851 os.stat in os.supports_follow_symlinks
2852
2853 .. versionadded:: 3.3
2854
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002855
Martin Panterbf19d162015-09-09 01:01:13 +00002856.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002857
Martin Panterbf19d162015-09-09 01:01:13 +00002858 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002859
Larry Hastings9cf065c2012-06-22 16:30:09 -07002860 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002861 morph to the target dynamically. If the target is present, the type of the
2862 symlink will be created to match. Otherwise, the symlink will be created
2863 as a directory if *target_is_directory* is ``True`` or a file symlink (the
l-n-sdaeb3c42018-11-14 00:13:12 +00002864 default) otherwise. On non-Windows platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002865
Georg Brandl50c40002012-06-24 11:45:20 +02002866 This function can support :ref:`paths relative to directory descriptors
2867 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002868
Brian Curtin52173d42010-12-02 18:29:18 +00002869 .. note::
2870
Vidar Tonaas Fauske0e107662019-04-09 20:19:46 +02002871 On newer versions of Windows 10, unprivileged accounts can create symlinks
2872 if Developer Mode is enabled. When Developer Mode is not available/enabled,
2873 the *SeCreateSymbolicLinkPrivilege* privilege is required, or the process
2874 must be run as an administrator.
Brian Curtin96245592010-12-28 17:08:22 +00002875
Jason R. Coombs3a092862013-05-27 23:21:28 -04002876
Brian Curtin96245592010-12-28 17:08:22 +00002877 :exc:`OSError` is raised when the function is called by an unprivileged
2878 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002879
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002880 .. audit-event:: os.symlink src,dst,dir_fd os.symlink
2881
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002882 .. availability:: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002883
Georg Brandlb3823372010-07-10 08:58:37 +00002884 .. versionchanged:: 3.2
2885 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002886
Larry Hastings9cf065c2012-06-22 16:30:09 -07002887 .. versionadded:: 3.3
2888 Added the *dir_fd* argument, and now allow *target_is_directory*
2889 on non-Windows platforms.
2890
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002891 .. versionchanged:: 3.6
2892 Accepts a :term:`path-like object` for *src* and *dst*.
2893
Vidar Tonaas Fauske0e107662019-04-09 20:19:46 +02002894 .. versionchanged:: 3.8
2895 Added support for unelevated symlinks on Windows with Developer Mode.
2896
Georg Brandl116aa622007-08-15 14:28:22 +00002897
Ross Lagerwall7807c352011-03-17 20:20:30 +02002898.. function:: sync()
2899
2900 Force write of everything to disk.
2901
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002902 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002903
2904 .. versionadded:: 3.3
2905
2906
2907.. function:: truncate(path, length)
2908
2909 Truncate the file corresponding to *path*, so that it is at most
2910 *length* bytes in size.
2911
Georg Brandl306336b2012-06-24 12:55:33 +02002912 This function can support :ref:`specifying a file descriptor <path_fd>`.
2913
Steve Dower44f91c32019-06-27 10:47:59 -07002914 .. audit-event:: os.truncate path,length os.truncate
Steve Dowerb82e17e2019-05-23 08:45:22 -07002915
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002916 .. availability:: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002917
2918 .. versionadded:: 3.3
2919
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002920 .. versionchanged:: 3.5
2921 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002922
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002923 .. versionchanged:: 3.6
2924 Accepts a :term:`path-like object`.
2925
2926
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002927.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002928
Brett Cannon05039172015-12-28 17:28:19 -08002929 Remove (delete) the file *path*. This function is semantically
2930 identical to :func:`remove`; the ``unlink`` name is its
2931 traditional Unix name. Please see the documentation for
2932 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002933
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002934 .. audit-event:: os.remove path,dir_fd os.unlink
2935
Larry Hastings9cf065c2012-06-22 16:30:09 -07002936 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002937 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002938
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002939 .. versionchanged:: 3.6
2940 Accepts a :term:`path-like object`.
2941
Larry Hastings9cf065c2012-06-22 16:30:09 -07002942
Martin Panterbf19d162015-09-09 01:01:13 +00002943.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002944
Larry Hastings76ad59b2012-05-03 00:30:07 -07002945 Set the access and modified times of the file specified by *path*.
2946
2947 :func:`utime` takes two optional parameters, *times* and *ns*.
2948 These specify the times set on *path* and are used as follows:
2949
Martin Panterbf19d162015-09-09 01:01:13 +00002950 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002951 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2952 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002953 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002954 it must be a 2-tuple of the form ``(atime, mtime)``
2955 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002956 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002957 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002958 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002959
Larry Hastings9cf065c2012-06-22 16:30:09 -07002960 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002961
Stéphane Wirtel7508a542018-05-01 12:02:26 +02002962 Note that the exact times you set here may not be returned by a subsequent
2963 :func:`~os.stat` call, depending on the resolution with which your operating
2964 system records access and modification times; see :func:`~os.stat`. The best
2965 way to preserve exact times is to use the *st_atime_ns* and *st_mtime_ns*
2966 fields from the :func:`os.stat` result object with the *ns* parameter to
2967 `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002968
Georg Brandl50c40002012-06-24 11:45:20 +02002969 This function can support :ref:`specifying a file descriptor <path_fd>`,
2970 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2971 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002972
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002973 .. audit-event:: os.utime path,times,ns,dir_fd os.utime
2974
Larry Hastings76ad59b2012-05-03 00:30:07 -07002975 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04002976 Added support for specifying *path* as an open file descriptor,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002977 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002978
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002979 .. versionchanged:: 3.6
2980 Accepts a :term:`path-like object`.
2981
Georg Brandl116aa622007-08-15 14:28:22 +00002982
Georg Brandl18244152009-09-02 20:34:52 +00002983.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002984
2985 .. index::
2986 single: directory; walking
2987 single: directory; traversal
2988
Christian Heimesfaf2f632008-01-06 16:59:19 +00002989 Generate the file names in a directory tree by walking the tree
2990 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002991 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2992 filenames)``.
2993
2994 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2995 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2996 *filenames* is a list of the names of the non-directory files in *dirpath*.
2997 Note that the names in the lists contain no path components. To get a full path
2998 (which begins with *top*) to a file or directory in *dirpath*, do
Miss Islington (bot)bd078df2020-09-04 15:29:06 -07002999 ``os.path.join(dirpath, name)``. Whether or not the lists are sorted
3000 depends on the file system. If a file is removed from or added to the
3001 *dirpath* directory during generating the lists, whether a name for that
3002 file be included is unspecified.
Georg Brandl116aa622007-08-15 14:28:22 +00003003
Christian Heimesfaf2f632008-01-06 16:59:19 +00003004 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00003005 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07003006 (directories are generated top-down). If *topdown* is ``False``, the triple
3007 for a directory is generated after the triples for all of its subdirectories
3008 (directories are generated bottom-up). No matter the value of *topdown*, the
3009 list of subdirectories is retrieved before the tuples for the directory and
3010 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00003011
Christian Heimesfaf2f632008-01-06 16:59:19 +00003012 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00003013 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
3014 recurse into the subdirectories whose names remain in *dirnames*; this can be
3015 used to prune the search, impose a specific order of visiting, or even to inform
3016 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02003017 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
3018 no effect on the behavior of the walk, because in bottom-up mode the directories
3019 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00003020
Andrés Delfinobadb8942018-04-02 23:48:54 -03003021 By default, errors from the :func:`scandir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00003022 argument *onerror* is specified, it should be a function; it will be called with
3023 one argument, an :exc:`OSError` instance. It can report the error to continue
3024 with the walk, or raise the exception to abort the walk. Note that the filename
3025 is available as the ``filename`` attribute of the exception object.
3026
3027 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00003028 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00003029 symlinks, on systems that support them.
3030
Georg Brandl116aa622007-08-15 14:28:22 +00003031 .. note::
3032
Georg Brandl50c40002012-06-24 11:45:20 +02003033 Be aware that setting *followlinks* to ``True`` can lead to infinite
3034 recursion if a link points to a parent directory of itself. :func:`walk`
3035 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00003036
3037 .. note::
3038
3039 If you pass a relative pathname, don't change the current working directory
3040 between resumptions of :func:`walk`. :func:`walk` never changes the current
3041 directory, and assumes that its caller doesn't either.
3042
3043 This example displays the number of bytes taken by non-directory files in each
3044 directory under the starting directory, except that it doesn't look under any
3045 CVS subdirectory::
3046
3047 import os
3048 from os.path import join, getsize
3049 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00003050 print(root, "consumes", end=" ")
3051 print(sum(getsize(join(root, name)) for name in files), end=" ")
3052 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00003053 if 'CVS' in dirs:
3054 dirs.remove('CVS') # don't visit CVS directories
3055
Victor Stinner47c41b42015-03-10 13:31:47 +01003056 In the next example (simple implementation of :func:`shutil.rmtree`),
3057 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
3058 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00003059
Christian Heimesfaf2f632008-01-06 16:59:19 +00003060 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00003061 # assuming there are no symbolic links.
3062 # CAUTION: This is dangerous! For example, if top == '/', it
3063 # could delete all your disk files.
3064 import os
3065 for root, dirs, files in os.walk(top, topdown=False):
3066 for name in files:
3067 os.remove(os.path.join(root, name))
3068 for name in dirs:
3069 os.rmdir(os.path.join(root, name))
3070
Serhiy Storchakadb283b32020-03-08 14:31:47 +02003071 .. audit-event:: os.walk top,topdown,onerror,followlinks os.walk
3072
Victor Stinner524a5ba2015-03-10 13:20:34 +01003073 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02003074 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
3075 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01003076
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003077 .. versionchanged:: 3.6
3078 Accepts a :term:`path-like object`.
3079
Georg Brandl116aa622007-08-15 14:28:22 +00003080
Larry Hastingsb4038062012-07-15 10:57:38 -07003081.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01003082
3083 .. index::
3084 single: directory; walking
3085 single: directory; traversal
3086
Eli Benderskyd049d5c2012-02-11 09:52:29 +02003087 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07003088 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01003089
3090 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
3091 and *dirfd* is a file descriptor referring to the directory *dirpath*.
3092
Larry Hastingsc48fe982012-06-25 04:49:05 -07003093 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07003094 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07003095 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07003096 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07003097
Charles-François Natali7372b062012-02-05 15:15:38 +01003098 .. note::
3099
3100 Since :func:`fwalk` yields file descriptors, those are only valid until
3101 the next iteration step, so you should duplicate them (e.g. with
3102 :func:`dup`) if you want to keep them longer.
3103
3104 This example displays the number of bytes taken by non-directory files in each
3105 directory under the starting directory, except that it doesn't look under any
3106 CVS subdirectory::
3107
3108 import os
3109 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
3110 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02003111 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01003112 end="")
3113 print("bytes in", len(files), "non-directory files")
3114 if 'CVS' in dirs:
3115 dirs.remove('CVS') # don't visit CVS directories
3116
3117 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003118 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01003119 empty::
3120
3121 # Delete everything reachable from the directory named in "top",
3122 # assuming there are no symbolic links.
3123 # CAUTION: This is dangerous! For example, if top == '/', it
3124 # could delete all your disk files.
3125 import os
3126 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
3127 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003128 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01003129 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003130 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01003131
Serhiy Storchakadb283b32020-03-08 14:31:47 +02003132 .. audit-event:: os.fwalk top,topdown,onerror,follow_symlinks,dir_fd os.fwalk
3133
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003134 .. availability:: Unix.
Charles-François Natali7372b062012-02-05 15:15:38 +01003135
3136 .. versionadded:: 3.3
3137
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003138 .. versionchanged:: 3.6
3139 Accepts a :term:`path-like object`.
3140
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02003141 .. versionchanged:: 3.7
3142 Added support for :class:`bytes` paths.
3143
Charles-François Natali7372b062012-02-05 15:15:38 +01003144
Zackery Spytz43fdbd22019-05-29 13:57:07 -06003145.. function:: memfd_create(name[, flags=os.MFD_CLOEXEC])
3146
3147 Create an anonymous file and return a file descriptor that refers to it.
3148 *flags* must be one of the ``os.MFD_*`` constants available on the system
3149 (or a bitwise ORed combination of them). By default, the new file
3150 descriptor is :ref:`non-inheritable <fd_inheritance>`.
3151
Victor Stinnerccf0efb2019-06-05 12:24:52 +02003152 The name supplied in *name* is used as a filename and will be displayed as
3153 the target of the corresponding symbolic link in the directory
3154 ``/proc/self/fd/``. The displayed name is always prefixed with ``memfd:``
3155 and serves only for debugging purposes. Names do not affect the behavior of
3156 the file descriptor, and as such multiple files can have the same name
3157 without any side effects.
3158
Zackery Spytz43fdbd22019-05-29 13:57:07 -06003159 .. availability:: Linux 3.17 or newer with glibc 2.27 or newer.
3160
3161 .. versionadded:: 3.8
3162
3163
3164.. data:: MFD_CLOEXEC
3165 MFD_ALLOW_SEALING
3166 MFD_HUGETLB
3167 MFD_HUGE_SHIFT
3168 MFD_HUGE_MASK
3169 MFD_HUGE_64KB
3170 MFD_HUGE_512KB
3171 MFD_HUGE_1MB
3172 MFD_HUGE_2MB
3173 MFD_HUGE_8MB
3174 MFD_HUGE_16MB
3175 MFD_HUGE_32MB
3176 MFD_HUGE_256MB
3177 MFD_HUGE_512MB
3178 MFD_HUGE_1GB
3179 MFD_HUGE_2GB
3180 MFD_HUGE_16GB
3181
3182 These flags can be passed to :func:`memfd_create`.
3183
3184 .. availability:: Linux 3.17 or newer with glibc 2.27 or newer. The
3185 ``MFD_HUGE*`` flags are only available since Linux 4.14.
3186
3187 .. versionadded:: 3.8
3188
3189
Georg Brandlb9831ab2012-06-24 11:57:07 +02003190Linux extended attributes
3191~~~~~~~~~~~~~~~~~~~~~~~~~
3192
3193.. versionadded:: 3.3
3194
3195These functions are all available on Linux only.
3196
3197.. function:: getxattr(path, attribute, *, follow_symlinks=True)
3198
3199 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003200 *path*. *attribute* can be bytes or str (directly or indirectly through the
3201 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
3202 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003203
3204 This function can support :ref:`specifying a file descriptor <path_fd>` and
3205 :ref:`not following symlinks <follow_symlinks>`.
3206
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003207 .. audit-event:: os.getxattr path,attribute os.getxattr
3208
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003209 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03003210 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003211
Georg Brandlb9831ab2012-06-24 11:57:07 +02003212
3213.. function:: listxattr(path=None, *, follow_symlinks=True)
3214
3215 Return a list of the extended filesystem attributes on *path*. The
3216 attributes in the list are represented as strings decoded with the filesystem
3217 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
3218 directory.
3219
3220 This function can support :ref:`specifying a file descriptor <path_fd>` and
3221 :ref:`not following symlinks <follow_symlinks>`.
3222
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003223 .. audit-event:: os.listxattr path os.listxattr
3224
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003225 .. versionchanged:: 3.6
3226 Accepts a :term:`path-like object`.
3227
Georg Brandlb9831ab2012-06-24 11:57:07 +02003228
3229.. function:: removexattr(path, attribute, *, follow_symlinks=True)
3230
3231 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003232 *attribute* should be bytes or str (directly or indirectly through the
3233 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02003234 with the filesystem encoding.
3235
3236 This function can support :ref:`specifying a file descriptor <path_fd>` and
3237 :ref:`not following symlinks <follow_symlinks>`.
3238
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003239 .. audit-event:: os.removexattr path,attribute os.removexattr
3240
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003241 .. versionchanged:: 3.6
3242 Accepts a :term:`path-like object` for *path* and *attribute*.
3243
Georg Brandlb9831ab2012-06-24 11:57:07 +02003244
3245.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
3246
3247 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003248 *attribute* must be a bytes or str with no embedded NULs (directly or
3249 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02003250 it is encoded with the filesystem encoding. *flags* may be
3251 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
3252 given and the attribute does not exist, ``EEXISTS`` will be raised.
3253 If :data:`XATTR_CREATE` is given and the attribute already exists, the
3254 attribute will not be created and ``ENODATA`` will be raised.
3255
3256 This function can support :ref:`specifying a file descriptor <path_fd>` and
3257 :ref:`not following symlinks <follow_symlinks>`.
3258
3259 .. note::
3260
3261 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
3262 to be ignored on some filesystems.
3263
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003264 .. audit-event:: os.setxattr path,attribute,value,flags os.setxattr
3265
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003266 .. versionchanged:: 3.6
3267 Accepts a :term:`path-like object` for *path* and *attribute*.
3268
Georg Brandlb9831ab2012-06-24 11:57:07 +02003269
3270.. data:: XATTR_SIZE_MAX
3271
3272 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02003273 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003274
3275
3276.. data:: XATTR_CREATE
3277
3278 This is a possible value for the flags argument in :func:`setxattr`. It
3279 indicates the operation must create an attribute.
3280
3281
3282.. data:: XATTR_REPLACE
3283
3284 This is a possible value for the flags argument in :func:`setxattr`. It
3285 indicates the operation must replace an existing attribute.
3286
3287
Georg Brandl116aa622007-08-15 14:28:22 +00003288.. _os-process:
3289
3290Process Management
3291------------------
3292
3293These functions may be used to create and manage processes.
3294
Serhiy Storchakadab83542013-10-13 20:12:43 +03003295The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00003296program loaded into the process. In each case, the first of these arguments is
3297passed to the new program as its own name rather than as an argument a user may
3298have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00003299passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00003300['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
3301to be ignored.
3302
3303
3304.. function:: abort()
3305
3306 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
3307 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02003308 an exit code of ``3``. Be aware that calling this function will not call the
3309 Python signal handler registered for :const:`SIGABRT` with
3310 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003311
Georg Brandl116aa622007-08-15 14:28:22 +00003312
Steve Dower2438cdf2019-03-29 16:37:16 -07003313.. function:: add_dll_directory(path)
3314
3315 Add a path to the DLL search path.
3316
3317 This search path is used when resolving dependencies for imported
3318 extension modules (the module itself is resolved through sys.path),
3319 and also by :mod:`ctypes`.
3320
3321 Remove the directory by calling **close()** on the returned object
3322 or using it in a :keyword:`with` statement.
3323
3324 See the `Microsoft documentation
3325 <https://msdn.microsoft.com/44228cf2-6306-466c-8f16-f513cd3ba8b5>`_
3326 for more information about how DLLs are loaded.
3327
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003328 .. audit-event:: os.add_dll_directory path os.add_dll_directory
3329
Steve Dower2438cdf2019-03-29 16:37:16 -07003330 .. availability:: Windows.
3331
3332 .. versionadded:: 3.8
3333 Previous versions of CPython would resolve DLLs using the default
3334 behavior for the current process. This led to inconsistencies,
3335 such as only sometimes searching :envvar:`PATH` or the current
3336 working directory, and OS functions such as ``AddDllDirectory``
3337 having no effect.
3338
3339 In 3.8, the two primary ways DLLs are loaded now explicitly
3340 override the process-wide behavior to ensure consistency. See the
3341 :ref:`porting notes <bpo-36085-whatsnew>` for information on
3342 updating libraries.
3343
3344
Georg Brandl116aa622007-08-15 14:28:22 +00003345.. function:: execl(path, arg0, arg1, ...)
3346 execle(path, arg0, arg1, ..., env)
3347 execlp(file, arg0, arg1, ...)
3348 execlpe(file, arg0, arg1, ..., env)
3349 execv(path, args)
3350 execve(path, args, env)
3351 execvp(file, args)
3352 execvpe(file, args, env)
3353
3354 These functions all execute a new program, replacing the current process; they
3355 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00003356 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00003357 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003358
3359 The current process is replaced immediately. Open file objects and
3360 descriptors are not flushed, so if there may be data buffered
3361 on these open files, you should flush them using
3362 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03003363 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00003364
Serhiy Storchakadab83542013-10-13 20:12:43 +03003365 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003366 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003367 to work with if the number of parameters is fixed when the code is written; the
3368 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003369 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00003370 variable, with the arguments being passed in a list or tuple as the *args*
3371 parameter. In either case, the arguments to the child process should start with
3372 the name of the command being run, but this is not enforced.
3373
Christian Heimesfaf2f632008-01-06 16:59:19 +00003374 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003375 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
3376 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003377 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003378 discussed in the next paragraph), the new environment is used as the source of
3379 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
3380 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
3381 locate the executable; *path* must contain an appropriate absolute or relative
3382 path.
3383
3384 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00003385 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00003386 used to define the environment variables for the new process (these are used
3387 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00003388 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003389 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003390
Larry Hastings9cf065c2012-06-22 16:30:09 -07003391 For :func:`execve` on some platforms, *path* may also be specified as an open
3392 file descriptor. This functionality may not be supported on your platform;
3393 you can check whether or not it is available using :data:`os.supports_fd`.
3394 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3395
Saiyang Gou95f60012020-02-04 16:15:00 -08003396 .. audit-event:: os.exec path,args,env os.execl
3397
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003398 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003399
Larry Hastings9cf065c2012-06-22 16:30:09 -07003400 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04003401 Added support for specifying *path* as an open file descriptor
Larry Hastings9cf065c2012-06-22 16:30:09 -07003402 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003403
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003404 .. versionchanged:: 3.6
3405 Accepts a :term:`path-like object`.
3406
Georg Brandl116aa622007-08-15 14:28:22 +00003407.. function:: _exit(n)
3408
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003409 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003410 stdio buffers, etc.
3411
Georg Brandl116aa622007-08-15 14:28:22 +00003412 .. note::
3413
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003414 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3415 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003416
Christian Heimesfaf2f632008-01-06 16:59:19 +00003417The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003418although they are not required. These are typically used for system programs
3419written in Python, such as a mail server's external command delivery program.
3420
3421.. note::
3422
3423 Some of these may not be available on all Unix platforms, since there is some
3424 variation. These constants are defined where they are defined by the underlying
3425 platform.
3426
3427
3428.. data:: EX_OK
3429
Benjamin Petersonf650e462010-05-06 23:03:05 +00003430 Exit code that means no error occurred.
3431
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003432 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003433
Georg Brandl116aa622007-08-15 14:28:22 +00003434
3435.. data:: EX_USAGE
3436
3437 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003438 number of arguments are given.
3439
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003440 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003441
Georg Brandl116aa622007-08-15 14:28:22 +00003442
3443.. data:: EX_DATAERR
3444
Benjamin Petersonf650e462010-05-06 23:03:05 +00003445 Exit code that means the input data was incorrect.
3446
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003447 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003448
Georg Brandl116aa622007-08-15 14:28:22 +00003449
3450.. data:: EX_NOINPUT
3451
3452 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003453
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003454 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003455
Georg Brandl116aa622007-08-15 14:28:22 +00003456
3457.. data:: EX_NOUSER
3458
Benjamin Petersonf650e462010-05-06 23:03:05 +00003459 Exit code that means a specified user did not exist.
3460
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003461 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003462
Georg Brandl116aa622007-08-15 14:28:22 +00003463
3464.. data:: EX_NOHOST
3465
Benjamin Petersonf650e462010-05-06 23:03:05 +00003466 Exit code that means a specified host did not exist.
3467
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003468 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003469
Georg Brandl116aa622007-08-15 14:28:22 +00003470
3471.. data:: EX_UNAVAILABLE
3472
Benjamin Petersonf650e462010-05-06 23:03:05 +00003473 Exit code that means that a required service is unavailable.
3474
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003475 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003476
Georg Brandl116aa622007-08-15 14:28:22 +00003477
3478.. data:: EX_SOFTWARE
3479
Benjamin Petersonf650e462010-05-06 23:03:05 +00003480 Exit code that means an internal software error was detected.
3481
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003482 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003483
Georg Brandl116aa622007-08-15 14:28:22 +00003484
3485.. data:: EX_OSERR
3486
3487 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003488 inability to fork or create a pipe.
3489
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003490 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003491
Georg Brandl116aa622007-08-15 14:28:22 +00003492
3493.. data:: EX_OSFILE
3494
3495 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003496 some other kind of error.
3497
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003498 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003499
Georg Brandl116aa622007-08-15 14:28:22 +00003500
3501.. data:: EX_CANTCREAT
3502
3503 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003504
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003505 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003506
Georg Brandl116aa622007-08-15 14:28:22 +00003507
3508.. data:: EX_IOERR
3509
3510 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003511
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003512 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003513
Georg Brandl116aa622007-08-15 14:28:22 +00003514
3515.. data:: EX_TEMPFAIL
3516
3517 Exit code that means a temporary failure occurred. This indicates something
3518 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003519 made during a retryable operation.
3520
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003521 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003522
Georg Brandl116aa622007-08-15 14:28:22 +00003523
3524.. data:: EX_PROTOCOL
3525
3526 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003527 understood.
3528
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003529 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003530
Georg Brandl116aa622007-08-15 14:28:22 +00003531
3532.. data:: EX_NOPERM
3533
3534 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003535 operation (but not intended for file system problems).
3536
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003537 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003538
Georg Brandl116aa622007-08-15 14:28:22 +00003539
3540.. data:: EX_CONFIG
3541
3542 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003543
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003544 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003545
Georg Brandl116aa622007-08-15 14:28:22 +00003546
3547.. data:: EX_NOTFOUND
3548
Benjamin Petersonf650e462010-05-06 23:03:05 +00003549 Exit code that means something like "an entry was not found".
3550
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003551 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003552
Georg Brandl116aa622007-08-15 14:28:22 +00003553
3554.. function:: fork()
3555
Christian Heimesfaf2f632008-01-06 16:59:19 +00003556 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003557 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003558
Larry Hastings3732ed22014-03-15 21:13:56 -07003559 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Phil Connellb2203002019-11-15 16:56:03 +00003560 known issues when using ``fork()`` from a thread.
3561
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003562 .. audit-event:: os.fork "" os.fork
3563
Phil Connellb2203002019-11-15 16:56:03 +00003564 .. versionchanged:: 3.8
3565 Calling ``fork()`` in a subinterpreter is no longer supported
3566 (:exc:`RuntimeError` is raised).
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003567
Christian Heimes3046fe42013-10-29 21:08:56 +01003568 .. warning::
3569
3570 See :mod:`ssl` for applications that use the SSL module with fork().
3571
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003572 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003573
3574
3575.. function:: forkpty()
3576
3577 Fork a child process, using a new pseudo-terminal as the child's controlling
3578 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3579 new child's process id in the parent, and *fd* is the file descriptor of the
3580 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003581 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003582
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003583 .. audit-event:: os.forkpty "" os.forkpty
3584
Phil Connellb2203002019-11-15 16:56:03 +00003585 .. versionchanged:: 3.8
3586 Calling ``forkpty()`` in a subinterpreter is no longer supported
3587 (:exc:`RuntimeError` is raised).
3588
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003589 .. availability:: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003590
3591
3592.. function:: kill(pid, sig)
3593
3594 .. index::
3595 single: process; killing
3596 single: process; signalling
3597
3598 Send signal *sig* to the process *pid*. Constants for the specific signals
3599 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003600
3601 Windows: The :data:`signal.CTRL_C_EVENT` and
3602 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3603 only be sent to console processes which share a common console window,
3604 e.g., some subprocesses. Any other value for *sig* will cause the process
3605 to be unconditionally killed by the TerminateProcess API, and the exit code
3606 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3607 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003608
Victor Stinnerb3e72192011-05-08 01:46:11 +02003609 See also :func:`signal.pthread_kill`.
3610
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003611 .. audit-event:: os.kill pid,sig os.kill
3612
Georg Brandl67b21b72010-08-17 15:07:14 +00003613 .. versionadded:: 3.2
3614 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003615
Georg Brandl116aa622007-08-15 14:28:22 +00003616
3617.. function:: killpg(pgid, sig)
3618
3619 .. index::
3620 single: process; killing
3621 single: process; signalling
3622
Benjamin Petersonf650e462010-05-06 23:03:05 +00003623 Send the signal *sig* to the process group *pgid*.
3624
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003625 .. audit-event:: os.killpg pgid,sig os.killpg
3626
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003627 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003628
Georg Brandl116aa622007-08-15 14:28:22 +00003629
3630.. function:: nice(increment)
3631
3632 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003633
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003634 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003635
3636
Benjamin Peterson6c4c45e2019-11-05 19:21:29 -08003637.. function:: pidfd_open(pid, flags=0)
3638
3639 Return a file descriptor referring to the process *pid*. This descriptor can
3640 be used to perform process management without races and signals. The *flags*
3641 argument is provided for future extensions; no flag values are currently
3642 defined.
3643
3644 See the :manpage:`pidfd_open(2)` man page for more details.
3645
3646 .. availability:: Linux 5.3+
3647 .. versionadded:: 3.9
3648
3649
Georg Brandl116aa622007-08-15 14:28:22 +00003650.. function:: plock(op)
3651
3652 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003653 ``<sys/lock.h>``) determines which segments are locked.
3654
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003655 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003656
3657
Martin Panterbf19d162015-09-09 01:01:13 +00003658.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003659
Martin Panterbf19d162015-09-09 01:01:13 +00003660 Open a pipe to or from command *cmd*.
3661 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003662 connected to the pipe, which can be read or written depending on whether *mode*
3663 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3664 the corresponding argument to the built-in :func:`open` function. The
3665 returned file object reads or writes text strings rather than bytes.
3666
3667 The ``close`` method returns :const:`None` if the subprocess exited
3668 successfully, or the subprocess's return code if there was an
3669 error. On POSIX systems, if the return code is positive it
3670 represents the return value of the process left-shifted by one
3671 byte. If the return code is negative, the process was terminated
3672 by the signal given by the negated value of the return code. (For
3673 example, the return value might be ``- signal.SIGKILL`` if the
3674 subprocess was killed.) On Windows systems, the return value
3675 contains the signed integer return code from the child process.
3676
Victor Stinner65a796e2020-04-01 18:49:29 +02003677 On Unix, :func:`waitstatus_to_exitcode` can be used to convert the ``close``
3678 method result (exit status) into an exit code if it is not ``None``. On
3679 Windows, the ``close`` method result is directly the exit code
3680 (or ``None``).
3681
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003682 This is implemented using :class:`subprocess.Popen`; see that class's
3683 documentation for more powerful ways to manage and communicate with
3684 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003685
3686
Serhiy Storchakad700f972018-09-08 14:48:18 +03003687.. function:: posix_spawn(path, argv, env, *, file_actions=None, \
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003688 setpgroup=None, resetids=False, setsid=False, setsigmask=(), \
Pablo Galindo254a4662018-09-07 16:44:24 +01003689 setsigdef=(), scheduler=None)
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003690
Serhiy Storchakaef347532018-05-01 16:45:04 +03003691 Wraps the :c:func:`posix_spawn` C library API for use from Python.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003692
Serhiy Storchakaef347532018-05-01 16:45:04 +03003693 Most users should use :func:`subprocess.run` instead of :func:`posix_spawn`.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003694
Serhiy Storchakad700f972018-09-08 14:48:18 +03003695 The positional-only arguments *path*, *args*, and *env* are similar to
3696 :func:`execve`.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003697
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003698 The *path* parameter is the path to the executable file.The *path* should
3699 contain a directory.Use :func:`posix_spawnp` to pass an executable file
3700 without directory.
3701
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003702 The *file_actions* argument may be a sequence of tuples describing actions
3703 to take on specific file descriptors in the child process between the C
Serhiy Storchakaef347532018-05-01 16:45:04 +03003704 library implementation's :c:func:`fork` and :c:func:`exec` steps.
3705 The first item in each tuple must be one of the three type indicator
3706 listed below describing the remaining tuple elements:
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003707
Serhiy Storchakaef347532018-05-01 16:45:04 +03003708 .. data:: POSIX_SPAWN_OPEN
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003709
Serhiy Storchakaef347532018-05-01 16:45:04 +03003710 (``os.POSIX_SPAWN_OPEN``, *fd*, *path*, *flags*, *mode*)
3711
3712 Performs ``os.dup2(os.open(path, flags, mode), fd)``.
3713
3714 .. data:: POSIX_SPAWN_CLOSE
3715
3716 (``os.POSIX_SPAWN_CLOSE``, *fd*)
3717
3718 Performs ``os.close(fd)``.
3719
3720 .. data:: POSIX_SPAWN_DUP2
3721
3722 (``os.POSIX_SPAWN_DUP2``, *fd*, *new_fd*)
3723
3724 Performs ``os.dup2(fd, new_fd)``.
3725
3726 These tuples correspond to the C library
3727 :c:func:`posix_spawn_file_actions_addopen`,
3728 :c:func:`posix_spawn_file_actions_addclose`, and
3729 :c:func:`posix_spawn_file_actions_adddup2` API calls used to prepare
3730 for the :c:func:`posix_spawn` call itself.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003731
Pablo Galindo254a4662018-09-07 16:44:24 +01003732 The *setpgroup* argument will set the process group of the child to the value
3733 specified. If the value specified is 0, the child's process group ID will be
3734 made the same as its process ID. If the value of *setpgroup* is not set, the
3735 child will inherit the parent's process group ID. This argument corresponds
3736 to the C library :c:data:`POSIX_SPAWN_SETPGROUP` flag.
3737
3738 If the *resetids* argument is ``True`` it will reset the effective UID and
3739 GID of the child to the real UID and GID of the parent process. If the
3740 argument is ``False``, then the child retains the effective UID and GID of
3741 the parent. In either case, if the set-user-ID and set-group-ID permission
3742 bits are enabled on the executable file, their effect will override the
3743 setting of the effective UID and GID. This argument corresponds to the C
3744 library :c:data:`POSIX_SPAWN_RESETIDS` flag.
3745
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003746 If the *setsid* argument is ``True``, it will create a new session ID
3747 for `posix_spawn`. *setsid* requires :c:data:`POSIX_SPAWN_SETSID`
3748 or :c:data:`POSIX_SPAWN_SETSID_NP` flag. Otherwise, :exc:`NotImplementedError`
3749 is raised.
3750
Pablo Galindo254a4662018-09-07 16:44:24 +01003751 The *setsigmask* argument will set the signal mask to the signal set
3752 specified. If the parameter is not used, then the child inherits the
3753 parent's signal mask. This argument corresponds to the C library
3754 :c:data:`POSIX_SPAWN_SETSIGMASK` flag.
3755
3756 The *sigdef* argument will reset the disposition of all signals in the set
3757 specified. This argument corresponds to the C library
3758 :c:data:`POSIX_SPAWN_SETSIGDEF` flag.
3759
3760 The *scheduler* argument must be a tuple containing the (optional) scheduler
3761 policy and an instance of :class:`sched_param` with the scheduler parameters.
3762 A value of ``None`` in the place of the scheduler policy indicates that is
3763 not being provided. This argument is a combination of the C library
3764 :c:data:`POSIX_SPAWN_SETSCHEDPARAM` and :c:data:`POSIX_SPAWN_SETSCHEDULER`
3765 flags.
3766
Saiyang Gou95f60012020-02-04 16:15:00 -08003767 .. audit-event:: os.posix_spawn path,argv,env os.posix_spawn
3768
Mark Williams8b504002019-03-03 09:42:25 -08003769 .. versionadded:: 3.8
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003770
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003771 .. availability:: Unix.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003772
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003773.. function:: posix_spawnp(path, argv, env, *, file_actions=None, \
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003774 setpgroup=None, resetids=False, setsid=False, setsigmask=(), \
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003775 setsigdef=(), scheduler=None)
3776
3777 Wraps the :c:func:`posix_spawnp` C library API for use from Python.
3778
3779 Similar to :func:`posix_spawn` except that the system searches
3780 for the *executable* file in the list of directories specified by the
3781 :envvar:`PATH` environment variable (in the same way as for ``execvp(3)``).
3782
Saiyang Gou95f60012020-02-04 16:15:00 -08003783 .. audit-event:: os.posix_spawn path,argv,env os.posix_spawnp
3784
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003785 .. versionadded:: 3.8
3786
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003787 .. availability:: See :func:`posix_spawn` documentation.
3788
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003789
Gregory P. Smith163468a2017-05-29 10:03:41 -07003790.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3791 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003792
Gregory P. Smith163468a2017-05-29 10:03:41 -07003793 Register callables to be executed when a new child process is forked
3794 using :func:`os.fork` or similar process cloning APIs.
3795 The parameters are optional and keyword-only.
3796 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003797
Gregory P. Smith163468a2017-05-29 10:03:41 -07003798 * *before* is a function called before forking a child process.
3799 * *after_in_parent* is a function called from the parent process
3800 after forking a child process.
3801 * *after_in_child* is a function called from the child process.
3802
3803 These calls are only made if control is expected to return to the
3804 Python interpreter. A typical :mod:`subprocess` launch will not
3805 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003806
3807 Functions registered for execution before forking are called in
3808 reverse registration order. Functions registered for execution
3809 after forking (either in the parent or in the child) are called
3810 in registration order.
3811
3812 Note that :c:func:`fork` calls made by third-party C code may not
3813 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3814 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3815
Gregory P. Smith163468a2017-05-29 10:03:41 -07003816 There is no way to unregister a function.
3817
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003818 .. availability:: Unix.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003819
3820 .. versionadded:: 3.7
3821
3822
Georg Brandl116aa622007-08-15 14:28:22 +00003823.. function:: spawnl(mode, path, ...)
3824 spawnle(mode, path, ..., env)
3825 spawnlp(mode, file, ...)
3826 spawnlpe(mode, file, ..., env)
3827 spawnv(mode, path, args)
3828 spawnve(mode, path, args, env)
3829 spawnvp(mode, file, args)
3830 spawnvpe(mode, file, args, env)
3831
3832 Execute the program *path* in a new process.
3833
3834 (Note that the :mod:`subprocess` module provides more powerful facilities for
3835 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003836 preferable to using these functions. Check especially the
3837 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003838
Christian Heimesfaf2f632008-01-06 16:59:19 +00003839 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003840 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3841 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003842 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003843 be used with the :func:`waitpid` function.
3844
pxinwrf2d7ac72019-05-21 18:46:37 +08003845 Note on VxWorks, this function doesn't return ``-signal`` when the new process is
3846 killed. Instead it raises OSError exception.
3847
Serhiy Storchakadab83542013-10-13 20:12:43 +03003848 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003849 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003850 to work with if the number of parameters is fixed when the code is written; the
3851 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003852 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003853 parameters is variable, with the arguments being passed in a list or tuple as
3854 the *args* parameter. In either case, the arguments to the child process must
3855 start with the name of the command being run.
3856
Christian Heimesfaf2f632008-01-06 16:59:19 +00003857 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003858 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3859 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003860 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003861 discussed in the next paragraph), the new environment is used as the source of
3862 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3863 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3864 :envvar:`PATH` variable to locate the executable; *path* must contain an
3865 appropriate absolute or relative path.
3866
3867 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003868 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003869 which is used to define the environment variables for the new process (they are
3870 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003871 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003872 the new process to inherit the environment of the current process. Note that
3873 keys and values in the *env* dictionary must be strings; invalid keys or
3874 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003875
3876 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3877 equivalent::
3878
3879 import os
3880 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3881
3882 L = ['cp', 'index.html', '/dev/null']
3883 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3884
Saiyang Gou95f60012020-02-04 16:15:00 -08003885 .. audit-event:: os.spawn mode,path,args,env os.spawnl
3886
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003887 .. availability:: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
3888 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3889 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3890 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003891
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003892 .. versionchanged:: 3.6
3893 Accepts a :term:`path-like object`.
3894
Georg Brandl116aa622007-08-15 14:28:22 +00003895
3896.. data:: P_NOWAIT
3897 P_NOWAITO
3898
Serhiy Storchakadab83542013-10-13 20:12:43 +03003899 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003900 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003901 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003902 the return value.
3903
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003904 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003905
Georg Brandl116aa622007-08-15 14:28:22 +00003906
3907.. data:: P_WAIT
3908
Serhiy Storchakadab83542013-10-13 20:12:43 +03003909 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003910 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3911 return until the new process has run to completion and will return the exit code
3912 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003913 process.
3914
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003915 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003916
Georg Brandl116aa622007-08-15 14:28:22 +00003917
3918.. data:: P_DETACH
3919 P_OVERLAY
3920
Serhiy Storchakadab83542013-10-13 20:12:43 +03003921 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003922 functions. These are less portable than those listed above. :const:`P_DETACH`
3923 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3924 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003925 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003926
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003927 .. availability:: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003928
Georg Brandl116aa622007-08-15 14:28:22 +00003929
3930.. function:: startfile(path[, operation])
3931
3932 Start a file with its associated application.
3933
3934 When *operation* is not specified or ``'open'``, this acts like double-clicking
3935 the file in Windows Explorer, or giving the file name as an argument to the
3936 :program:`start` command from the interactive command shell: the file is opened
3937 with whatever application (if any) its extension is associated.
3938
3939 When another *operation* is given, it must be a "command verb" that specifies
3940 what should be done with the file. Common verbs documented by Microsoft are
3941 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3942 ``'find'`` (to be used on directories).
3943
3944 :func:`startfile` returns as soon as the associated application is launched.
3945 There is no option to wait for the application to close, and no way to retrieve
3946 the application's exit status. The *path* parameter is relative to the current
3947 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003948 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003949 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003950 the path is properly encoded for Win32.
3951
Steve Dower7d0e0c92015-01-24 08:18:24 -08003952 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3953 function is not resolved until this function is first called. If the function
3954 cannot be resolved, :exc:`NotImplementedError` will be raised.
3955
Saiyang Gou95f60012020-02-04 16:15:00 -08003956 .. audit-event:: os.startfile path,operation os.startfile
3957
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003958 .. availability:: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003959
Georg Brandl116aa622007-08-15 14:28:22 +00003960
3961.. function:: system(command)
3962
3963 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003964 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003965 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3966 the executed command. If *command* generates any output, it will be sent to
3967 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003968
3969 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003970 format specified for :func:`wait`. Note that POSIX does not specify the
3971 meaning of the return value of the C :c:func:`system` function, so the return
3972 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003973
Georg Brandl8f7b4272010-10-14 06:35:53 +00003974 On Windows, the return value is that returned by the system shell after
3975 running *command*. The shell is given by the Windows environment variable
3976 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3977 status of the command run; on systems using a non-native shell, consult your
3978 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003979
Georg Brandl8f7b4272010-10-14 06:35:53 +00003980 The :mod:`subprocess` module provides more powerful facilities for spawning
3981 new processes and retrieving their results; using that module is preferable
3982 to using this function. See the :ref:`subprocess-replacements` section in
3983 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003984
Victor Stinner65a796e2020-04-01 18:49:29 +02003985 On Unix, :func:`waitstatus_to_exitcode` can be used to convert the result
3986 (exit status) into an exit code. On Windows, the result is directly the exit
3987 code.
3988
Steve Dower44f91c32019-06-27 10:47:59 -07003989 .. audit-event:: os.system command os.system
Steve Dowerb82e17e2019-05-23 08:45:22 -07003990
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003991 .. availability:: Unix, Windows.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003992
Georg Brandl116aa622007-08-15 14:28:22 +00003993
3994.. function:: times()
3995
Larry Hastings605a62d2012-06-24 04:33:36 -07003996 Returns the current global process times.
3997 The return value is an object with five attributes:
3998
3999 * :attr:`user` - user time
4000 * :attr:`system` - system time
4001 * :attr:`children_user` - user time of all child processes
4002 * :attr:`children_system` - system time of all child processes
4003 * :attr:`elapsed` - elapsed real time since a fixed point in the past
4004
4005 For backwards compatibility, this object also behaves like a five-tuple
4006 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
4007 :attr:`children_system`, and :attr:`elapsed` in that order.
4008
4009 See the Unix manual page
Joannah Nanjekye3ccdbc32019-09-07 04:05:29 -03004010 :manpage:`times(2)` and :manpage:`times(3)` manual page on Unix or `the GetProcessTimes MSDN
Roger Hurwitz37c55b22020-02-10 14:50:19 -08004011 <https://docs.microsoft.com/windows/win32/api/processthreadsapi/nf-processthreadsapi-getprocesstimes>`_
4012 on Windows. On Windows, only :attr:`user` and :attr:`system` are known; the other attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004013
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004014 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00004015
Larry Hastings605a62d2012-06-24 04:33:36 -07004016 .. versionchanged:: 3.3
4017 Return type changed from a tuple to a tuple-like object
4018 with named attributes.
4019
Georg Brandl116aa622007-08-15 14:28:22 +00004020
4021.. function:: wait()
4022
4023 Wait for completion of a child process, and return a tuple containing its pid
4024 and exit status indication: a 16-bit number, whose low byte is the signal number
4025 that killed the process, and whose high byte is the exit status (if the signal
4026 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00004027 produced.
4028
Victor Stinner65a796e2020-04-01 18:49:29 +02004029 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4030 exit code.
4031
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004032 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004033
Victor Stinner65a796e2020-04-01 18:49:29 +02004034 .. seealso::
4035
4036 :func:`waitpid` can be used to wait for the completion of a specific
4037 child process and has more options.
4038
Ross Lagerwall7807c352011-03-17 20:20:30 +02004039.. function:: waitid(idtype, id, options)
4040
4041 Wait for the completion of one or more child processes.
Benjamin Peterson5c0c3252019-11-05 21:58:31 -08004042 *idtype* can be :data:`P_PID`, :data:`P_PGID`, :data:`P_ALL`, or
4043 :data:`P_PIDFD` on Linux.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004044 *id* specifies the pid to wait on.
4045 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
4046 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
4047 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
4048 representing the data contained in the :c:type:`siginfo_t` structure, namely:
4049 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
4050 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
4051 children in a waitable state.
4052
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004053 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004054
4055 .. versionadded:: 3.3
4056
4057.. data:: P_PID
4058 P_PGID
4059 P_ALL
4060
4061 These are the possible values for *idtype* in :func:`waitid`. They affect
4062 how *id* is interpreted.
4063
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004064 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004065
4066 .. versionadded:: 3.3
4067
Benjamin Peterson5c0c3252019-11-05 21:58:31 -08004068.. data:: P_PIDFD
4069
4070 This is a Linux-specific *idtype* that indicates that *id* is a file
4071 descriptor that refers to a process.
4072
4073 .. availability:: Linux 5.4+
4074
4075 .. versionadded:: 3.9
4076
Ross Lagerwall7807c352011-03-17 20:20:30 +02004077.. data:: WEXITED
4078 WSTOPPED
4079 WNOWAIT
4080
4081 Flags that can be used in *options* in :func:`waitid` that specify what
4082 child signal to wait for.
4083
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004084 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004085
4086 .. versionadded:: 3.3
4087
4088
4089.. data:: CLD_EXITED
Dong-hee Na2eba6ad2019-10-21 16:01:05 +09004090 CLD_KILLED
Ross Lagerwall7807c352011-03-17 20:20:30 +02004091 CLD_DUMPED
4092 CLD_TRAPPED
Dong-hee Na2eba6ad2019-10-21 16:01:05 +09004093 CLD_STOPPED
Ross Lagerwall7807c352011-03-17 20:20:30 +02004094 CLD_CONTINUED
4095
4096 These are the possible values for :attr:`si_code` in the result returned by
4097 :func:`waitid`.
4098
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004099 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004100
4101 .. versionadded:: 3.3
4102
Dong-hee Na2eba6ad2019-10-21 16:01:05 +09004103 .. versionchanged:: 3.9
4104 Added :data:`CLD_KILLED` and :data:`CLD_STOPPED` values.
4105
Georg Brandl116aa622007-08-15 14:28:22 +00004106
4107.. function:: waitpid(pid, options)
4108
4109 The details of this function differ on Unix and Windows.
4110
4111 On Unix: Wait for completion of a child process given by process id *pid*, and
4112 return a tuple containing its process id and exit status indication (encoded as
4113 for :func:`wait`). The semantics of the call are affected by the value of the
4114 integer *options*, which should be ``0`` for normal operation.
4115
4116 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
4117 that specific process. If *pid* is ``0``, the request is for the status of any
4118 child in the process group of the current process. If *pid* is ``-1``, the
4119 request pertains to any child of the current process. If *pid* is less than
4120 ``-1``, status is requested for any process in the process group ``-pid`` (the
4121 absolute value of *pid*).
4122
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00004123 An :exc:`OSError` is raised with the value of errno when the syscall
4124 returns -1.
4125
Georg Brandl116aa622007-08-15 14:28:22 +00004126 On Windows: Wait for completion of a process given by process handle *pid*, and
4127 return a tuple containing *pid*, and its exit status shifted left by 8 bits
4128 (shifting makes cross-platform use of the function easier). A *pid* less than or
4129 equal to ``0`` has no special meaning on Windows, and raises an exception. The
4130 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03004131 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
4132 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00004133
Victor Stinner65a796e2020-04-01 18:49:29 +02004134 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4135 exit code.
4136
Victor Stinnera766ddf2015-03-26 23:50:57 +01004137 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02004138 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01004139 exception, the function now retries the system call instead of raising an
4140 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
4141
Georg Brandl116aa622007-08-15 14:28:22 +00004142
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02004143.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00004144
4145 Similar to :func:`waitpid`, except no process id argument is given and a
Serhiy Storchaka3f819ca2018-10-31 02:26:06 +02004146 3-element tuple containing the child's process id, exit status indication,
4147 and resource usage information is returned. Refer to
4148 :mod:`resource`.\ :func:`~resource.getrusage` for details on resource usage
4149 information. The option argument is the same as that provided to
4150 :func:`waitpid` and :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004151
Victor Stinner65a796e2020-04-01 18:49:29 +02004152 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4153 exitcode.
4154
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004155 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004156
Georg Brandl116aa622007-08-15 14:28:22 +00004157
Victor Stinner4195b5c2012-02-08 23:03:19 +01004158.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00004159
4160 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
4161 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03004162 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
4163 resource usage information. The arguments to :func:`wait4` are the same
4164 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004165
Victor Stinner65a796e2020-04-01 18:49:29 +02004166 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4167 exitcode.
4168
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004169 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004170
Georg Brandl116aa622007-08-15 14:28:22 +00004171
Victor Stinner65a796e2020-04-01 18:49:29 +02004172.. function:: waitstatus_to_exitcode(status)
4173
4174 Convert a wait status to an exit code.
4175
4176 On Unix:
4177
4178 * If the process exited normally (if ``WIFEXITED(status)`` is true),
4179 return the process exit status (return ``WEXITSTATUS(status)``):
4180 result greater than or equal to 0.
4181 * If the process was terminated by a signal (if ``WIFSIGNALED(status)`` is
4182 true), return ``-signum`` where *signum* is the number of the signal that
4183 caused the process to terminate (return ``-WTERMSIG(status)``):
4184 result less than 0.
4185 * Otherwise, raise a :exc:`ValueError`.
4186
4187 On Windows, return *status* shifted right by 8 bits.
4188
4189 On Unix, if the process is being traced or if :func:`waitpid` was called
4190 with :data:`WUNTRACED` option, the caller must first check if
4191 ``WIFSTOPPED(status)`` is true. This function must not be called if
4192 ``WIFSTOPPED(status)`` is true.
4193
4194 .. seealso::
4195
4196 :func:`WIFEXITED`, :func:`WEXITSTATUS`, :func:`WIFSIGNALED`,
4197 :func:`WTERMSIG`, :func:`WIFSTOPPED`, :func:`WSTOPSIG` functions.
4198
4199 .. versionadded:: 3.9
4200
4201
Georg Brandl116aa622007-08-15 14:28:22 +00004202.. data:: WNOHANG
4203
4204 The option for :func:`waitpid` to return immediately if no child process status
4205 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004206
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004207 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004208
4209
4210.. data:: WCONTINUED
4211
4212 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00004213 from a job control stop since their status was last reported.
4214
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004215 .. availability:: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00004216
Georg Brandl116aa622007-08-15 14:28:22 +00004217
4218.. data:: WUNTRACED
4219
4220 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00004221 their current state has not been reported since they were stopped.
4222
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004223 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004224
Georg Brandl116aa622007-08-15 14:28:22 +00004225
4226The following functions take a process status code as returned by
4227:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
4228used to determine the disposition of a process.
4229
Georg Brandl116aa622007-08-15 14:28:22 +00004230.. function:: WCOREDUMP(status)
4231
Christian Heimesfaf2f632008-01-06 16:59:19 +00004232 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00004233 return ``False``.
4234
Victor Stinner7c723832020-04-01 15:48:05 +02004235 This function should be employed only if :func:`WIFSIGNALED` is true.
4236
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004237 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004238
Georg Brandl116aa622007-08-15 14:28:22 +00004239
4240.. function:: WIFCONTINUED(status)
4241
Victor Stinner7c723832020-04-01 15:48:05 +02004242 Return ``True`` if a stopped child has been resumed by delivery of
4243 :data:`~signal.SIGCONT` (if the process has been continued from a job
4244 control stop), otherwise return ``False``.
4245
4246 See :data:`WCONTINUED` option.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004247
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004248 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004249
Georg Brandl116aa622007-08-15 14:28:22 +00004250
4251.. function:: WIFSTOPPED(status)
4252
Victor Stinner7c723832020-04-01 15:48:05 +02004253 Return ``True`` if the process was stopped by delivery of a signal,
4254 otherwise return ``False``.
4255
4256 :func:`WIFSTOPPED` only returns ``True`` if the :func:`waitpid` call was
4257 done using :data:`WUNTRACED` option or when the process is being traced (see
4258 :manpage:`ptrace(2)`).
Benjamin Petersonf650e462010-05-06 23:03:05 +00004259
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004260 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004261
Georg Brandl116aa622007-08-15 14:28:22 +00004262.. function:: WIFSIGNALED(status)
4263
Victor Stinner7c723832020-04-01 15:48:05 +02004264 Return ``True`` if the process was terminated by a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00004265 ``False``.
4266
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004267 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004268
4269
4270.. function:: WIFEXITED(status)
4271
Victor Stinner7c723832020-04-01 15:48:05 +02004272 Return ``True`` if the process exited terminated normally, that is,
4273 by calling ``exit()`` or ``_exit()``, or by returning from ``main()``;
Benjamin Petersonf650e462010-05-06 23:03:05 +00004274 otherwise return ``False``.
4275
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004276 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004277
4278
4279.. function:: WEXITSTATUS(status)
4280
Victor Stinner7c723832020-04-01 15:48:05 +02004281 Return the process exit status.
4282
4283 This function should be employed only if :func:`WIFEXITED` is true.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004284
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004285 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004286
4287
4288.. function:: WSTOPSIG(status)
4289
Benjamin Petersonf650e462010-05-06 23:03:05 +00004290 Return the signal which caused the process to stop.
4291
Victor Stinner7c723832020-04-01 15:48:05 +02004292 This function should be employed only if :func:`WIFSTOPPED` is true.
4293
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004294 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004295
4296
4297.. function:: WTERMSIG(status)
4298
Victor Stinner7c723832020-04-01 15:48:05 +02004299 Return the number of the signal that caused the process to terminate.
4300
4301 This function should be employed only if :func:`WIFSIGNALED` is true.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004302
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004303 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004304
4305
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004306Interface to the scheduler
4307--------------------------
4308
4309These functions control how a process is allocated CPU time by the operating
4310system. They are only available on some Unix platforms. For more detailed
4311information, consult your Unix manpages.
4312
4313.. versionadded:: 3.3
4314
Andrew Kuchling4921a082013-06-21 11:49:57 -04004315The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004316operating system.
4317
4318.. data:: SCHED_OTHER
4319
4320 The default scheduling policy.
4321
4322.. data:: SCHED_BATCH
4323
4324 Scheduling policy for CPU-intensive processes that tries to preserve
4325 interactivity on the rest of the computer.
4326
4327.. data:: SCHED_IDLE
4328
4329 Scheduling policy for extremely low priority background tasks.
4330
4331.. data:: SCHED_SPORADIC
4332
4333 Scheduling policy for sporadic server programs.
4334
4335.. data:: SCHED_FIFO
4336
4337 A First In First Out scheduling policy.
4338
4339.. data:: SCHED_RR
4340
4341 A round-robin scheduling policy.
4342
4343.. data:: SCHED_RESET_ON_FORK
4344
Martin Panter8d56c022016-05-29 04:13:35 +00004345 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004346 this flag set forks, its child's scheduling policy and priority are reset to
4347 the default.
4348
4349
4350.. class:: sched_param(sched_priority)
4351
4352 This class represents tunable scheduling parameters used in
4353 :func:`sched_setparam`, :func:`sched_setscheduler`, and
4354 :func:`sched_getparam`. It is immutable.
4355
4356 At the moment, there is only one possible parameter:
4357
4358 .. attribute:: sched_priority
4359
4360 The scheduling priority for a scheduling policy.
4361
4362
4363.. function:: sched_get_priority_min(policy)
4364
4365 Get the minimum priority value for *policy*. *policy* is one of the
4366 scheduling policy constants above.
4367
4368
4369.. function:: sched_get_priority_max(policy)
4370
4371 Get the maximum priority value for *policy*. *policy* is one of the
4372 scheduling policy constants above.
4373
4374
4375.. function:: sched_setscheduler(pid, policy, param)
4376
4377 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
4378 the calling process. *policy* is one of the scheduling policy constants
4379 above. *param* is a :class:`sched_param` instance.
4380
4381
4382.. function:: sched_getscheduler(pid)
4383
4384 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
4385 means the calling process. The result is one of the scheduling policy
4386 constants above.
4387
4388
4389.. function:: sched_setparam(pid, param)
4390
4391 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
4392 the calling process. *param* is a :class:`sched_param` instance.
4393
4394
4395.. function:: sched_getparam(pid)
4396
4397 Return the scheduling parameters as a :class:`sched_param` instance for the
4398 process with PID *pid*. A *pid* of 0 means the calling process.
4399
4400
4401.. function:: sched_rr_get_interval(pid)
4402
4403 Return the round-robin quantum in seconds for the process with PID *pid*. A
4404 *pid* of 0 means the calling process.
4405
4406
4407.. function:: sched_yield()
4408
4409 Voluntarily relinquish the CPU.
4410
4411
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004412.. function:: sched_setaffinity(pid, mask)
4413
Antoine Pitrou84869872012-08-04 16:16:35 +02004414 Restrict the process with PID *pid* (or the current process if zero) to a
4415 set of CPUs. *mask* is an iterable of integers representing the set of
4416 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004417
4418
Antoine Pitrou84869872012-08-04 16:16:35 +02004419.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004420
Antoine Pitrou84869872012-08-04 16:16:35 +02004421 Return the set of CPUs the process with PID *pid* (or the current process
4422 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004423
4424
Georg Brandl116aa622007-08-15 14:28:22 +00004425.. _os-path:
4426
4427Miscellaneous System Information
4428--------------------------------
4429
4430
4431.. function:: confstr(name)
4432
4433 Return string-valued system configuration values. *name* specifies the
4434 configuration value to retrieve; it may be a string which is the name of a
4435 defined system value; these names are specified in a number of standards (POSIX,
4436 Unix 95, Unix 98, and others). Some platforms define additional names as well.
4437 The names known to the host operating system are given as the keys of the
4438 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00004439 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00004440
4441 If the configuration value specified by *name* isn't defined, ``None`` is
4442 returned.
4443
4444 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
4445 specific value for *name* is not supported by the host system, even if it is
4446 included in ``confstr_names``, an :exc:`OSError` is raised with
4447 :const:`errno.EINVAL` for the error number.
4448
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004449 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004450
Georg Brandl116aa622007-08-15 14:28:22 +00004451
4452.. data:: confstr_names
4453
4454 Dictionary mapping names accepted by :func:`confstr` to the integer values
4455 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004456 determine the set of names known to the system.
4457
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004458 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004459
4460
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004461.. function:: cpu_count()
4462
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03004463 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004464
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01004465 This number is not equivalent to the number of CPUs the current process can
4466 use. The number of usable CPUs can be obtained with
4467 ``len(os.sched_getaffinity(0))``
4468
4469
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004470 .. versionadded:: 3.4
4471
4472
Georg Brandl116aa622007-08-15 14:28:22 +00004473.. function:: getloadavg()
4474
Christian Heimesa62da1d2008-01-12 19:39:10 +00004475 Return the number of processes in the system run queue averaged over the last
4476 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00004477 unobtainable.
4478
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004479 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004480
Georg Brandl116aa622007-08-15 14:28:22 +00004481
4482.. function:: sysconf(name)
4483
4484 Return integer-valued system configuration values. If the configuration value
4485 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
4486 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
4487 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004488
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004489 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004490
4491
4492.. data:: sysconf_names
4493
4494 Dictionary mapping names accepted by :func:`sysconf` to the integer values
4495 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004496 determine the set of names known to the system.
4497
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004498 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004499
Christian Heimesfaf2f632008-01-06 16:59:19 +00004500The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00004501are defined for all platforms.
4502
4503Higher-level operations on pathnames are defined in the :mod:`os.path` module.
4504
4505
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004506.. index:: single: . (dot); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004507.. data:: curdir
4508
4509 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00004510 directory. This is ``'.'`` for Windows and POSIX. Also available via
4511 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004512
4513
Serhiy Storchakaddb961d2018-10-26 09:00:49 +03004514.. index:: single: ..; in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004515.. data:: pardir
4516
4517 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00004518 directory. This is ``'..'`` for Windows and POSIX. Also available via
4519 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004520
4521
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004522.. index:: single: / (slash); in pathnames
4523.. index:: single: \ (backslash); in pathnames (Windows)
Georg Brandl116aa622007-08-15 14:28:22 +00004524.. data:: sep
4525
Georg Brandlc575c902008-09-13 17:46:05 +00004526 The character used by the operating system to separate pathname components.
4527 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
4528 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00004529 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
4530 useful. Also available via :mod:`os.path`.
4531
4532
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004533.. index:: single: / (slash); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004534.. data:: altsep
4535
4536 An alternative character used by the operating system to separate pathname
4537 components, or ``None`` if only one separator character exists. This is set to
4538 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
4539 :mod:`os.path`.
4540
4541
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004542.. index:: single: . (dot); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004543.. data:: extsep
4544
4545 The character which separates the base filename from the extension; for example,
4546 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
4547
Georg Brandl116aa622007-08-15 14:28:22 +00004548
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004549.. index:: single: : (colon); path separator (POSIX)
4550 single: ; (semicolon)
Georg Brandl116aa622007-08-15 14:28:22 +00004551.. data:: pathsep
4552
4553 The character conventionally used by the operating system to separate search
4554 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
4555 Windows. Also available via :mod:`os.path`.
4556
4557
4558.. data:: defpath
4559
Serhiy Storchakadab83542013-10-13 20:12:43 +03004560 The default search path used by :func:`exec\*p\* <execl>` and
4561 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
4562 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004563
4564
4565.. data:: linesep
4566
4567 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00004568 platform. This may be a single character, such as ``'\n'`` for POSIX, or
4569 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
4570 *os.linesep* as a line terminator when writing files opened in text mode (the
4571 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00004572
4573
4574.. data:: devnull
4575
Georg Brandl850a9902010-05-21 22:04:32 +00004576 The file path of the null device. For example: ``'/dev/null'`` for
4577 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004578
Andrew Kuchling4921a082013-06-21 11:49:57 -04004579.. data:: RTLD_LAZY
4580 RTLD_NOW
4581 RTLD_GLOBAL
4582 RTLD_LOCAL
4583 RTLD_NODELETE
4584 RTLD_NOLOAD
4585 RTLD_DEEPBIND
4586
4587 Flags for use with the :func:`~sys.setdlopenflags` and
4588 :func:`~sys.getdlopenflags` functions. See the Unix manual page
4589 :manpage:`dlopen(3)` for what the different flags mean.
4590
4591 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00004592
Georg Brandl116aa622007-08-15 14:28:22 +00004593
Victor Stinner9b1f4742016-09-06 16:18:52 -07004594Random numbers
4595--------------
Georg Brandl116aa622007-08-15 14:28:22 +00004596
4597
Victor Stinner9b1f4742016-09-06 16:18:52 -07004598.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00004599
Victor Stinner9b1f4742016-09-06 16:18:52 -07004600 Get up to *size* random bytes. The function can return less bytes than
4601 requested.
4602
4603 These bytes can be used to seed user-space random number generators or for
4604 cryptographic purposes.
4605
4606 ``getrandom()`` relies on entropy gathered from device drivers and other
4607 sources of environmental noise. Unnecessarily reading large quantities of
4608 data will have a negative impact on other users of the ``/dev/random`` and
4609 ``/dev/urandom`` devices.
4610
4611 The flags argument is a bit mask that can contain zero or more of the
4612 following values ORed together: :py:data:`os.GRND_RANDOM` and
4613 :py:data:`GRND_NONBLOCK`.
4614
4615 See also the `Linux getrandom() manual page
4616 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
4617
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004618 .. availability:: Linux 3.17 and newer.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004619
4620 .. versionadded:: 3.6
4621
4622.. function:: urandom(size)
4623
4624 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004625
4626 This function returns random bytes from an OS-specific randomness source. The
4627 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004628 though its exact quality depends on the OS implementation.
4629
Victor Stinnere66987e2016-09-06 16:33:52 -07004630 On Linux, if the ``getrandom()`` syscall is available, it is used in
4631 blocking mode: block until the system urandom entropy pool is initialized
4632 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4633 the rationale. On Linux, the :func:`getrandom` function can be used to get
4634 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4635 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004636
Victor Stinnere66987e2016-09-06 16:33:52 -07004637 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4638 device. If the ``/dev/urandom`` device is not available or not readable, the
4639 :exc:`NotImplementedError` exception is raised.
4640
4641 On Windows, it will use ``CryptGenRandom()``.
4642
4643 .. seealso::
4644 The :mod:`secrets` module provides higher level functions. For an
4645 easy-to-use interface to the random number generator provided by your
4646 platform, please see :class:`random.SystemRandom`.
4647
4648 .. versionchanged:: 3.6.0
4649 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4650 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004651
Victor Stinnerdddf4842016-06-07 11:21:42 +02004652 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004653 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4654 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004655
Victor Stinnerace88482015-07-29 02:28:32 +02004656 .. versionchanged:: 3.5
4657 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4658 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4659 function is now used. These functions avoid the usage of an internal file
4660 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004661
4662.. data:: GRND_NONBLOCK
4663
4664 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4665 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4666 if the entropy pool has not yet been initialized.
4667
4668 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4669 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4670
4671 .. versionadded:: 3.6
4672
4673.. data:: GRND_RANDOM
4674
4675 If this bit is set, then random bytes are drawn from the
4676 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4677
4678 .. versionadded:: 3.6