blob: 275b2d390e7cf54aadbdca1da848e59c2f06f062 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
pxinwrf2d7ac72019-05-21 18:46:37 +080035* On VxWorks, os.fork, os.execv and os.spawn*p* are not supported.
Benjamin Petersonf650e462010-05-06 23:03:05 +000036
Georg Brandlc575c902008-09-13 17:46:05 +000037.. note::
38
Tim Hoffmanna55f75a2019-07-05 10:41:35 +020039 All functions in this module raise :exc:`OSError` (or subclasses thereof) in
40 the case of invalid or inaccessible file names and paths, or other arguments
41 that have the correct type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000042
Georg Brandl116aa622007-08-15 14:28:22 +000043.. exception:: error
44
Christian Heimesa62da1d2008-01-12 19:39:10 +000045 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000046
47
48.. data:: name
49
Benjamin Peterson1baf4652009-12-31 03:11:23 +000050 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070051 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070052 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000053
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020054 .. seealso::
55 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
56 system-dependent version information.
57
58 The :mod:`platform` module provides detailed checks for the
59 system's identity.
60
Georg Brandl116aa622007-08-15 14:28:22 +000061
Martin v. Löwis011e8422009-05-05 04:43:17 +000062.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020063.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000064
65File Names, Command Line Arguments, and Environment Variables
66-------------------------------------------------------------
67
Georg Brandl67b21b72010-08-17 15:07:14 +000068In Python, file names, command line arguments, and environment variables are
69represented using the string type. On some systems, decoding these strings to
70and from bytes is necessary before passing them to the operating system. Python
71uses the file system encoding to perform this conversion (see
72:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000073
74.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000075 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020076 case, Python uses the :ref:`surrogateescape encoding error handler
77 <surrogateescape>`, which means that undecodable bytes are replaced by a
78 Unicode character U+DCxx on decoding, and these are again translated to the
79 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000080
81
Georg Brandl67b21b72010-08-17 15:07:14 +000082The file system encoding must guarantee to successfully decode all bytes
83below 128. If the file system encoding fails to provide this guarantee, API
84functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000085
86
Georg Brandl116aa622007-08-15 14:28:22 +000087.. _os-procinfo:
88
89Process Parameters
90------------------
91
92These functions and data items provide information and operate on the current
93process and user.
94
95
Georg Brandl8ccadaa2012-06-24 12:50:06 +020096.. function:: ctermid()
97
98 Return the filename corresponding to the controlling terminal of the process.
99
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400100 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200101
102
Georg Brandl116aa622007-08-15 14:28:22 +0000103.. data:: environ
104
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700105 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000106 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
107 and is equivalent to ``getenv("HOME")`` in C.
108
109 This mapping is captured the first time the :mod:`os` module is imported,
110 typically during Python startup as part of processing :file:`site.py`. Changes
111 to the environment made after this time are not reflected in ``os.environ``,
112 except for changes made by modifying ``os.environ`` directly.
113
Victor Stinnerb8d12622020-01-24 14:05:48 +0100114 This mapping may be used to modify the environment as well as query the
115 environment. :func:`putenv` will be called automatically when the mapping
116 is modified.
Georg Brandl116aa622007-08-15 14:28:22 +0000117
Victor Stinner84ae1182010-05-06 22:05:07 +0000118 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
119 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
120 to use a different encoding.
121
Georg Brandl116aa622007-08-15 14:28:22 +0000122 .. note::
123
124 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
125 to modify ``os.environ``.
126
127 .. note::
128
Georg Brandlc575c902008-09-13 17:46:05 +0000129 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
130 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000131 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000132
Victor Stinnerb8d12622020-01-24 14:05:48 +0100133 You can delete items in this mapping to unset environment variables.
134 :func:`unsetenv` will be called automatically when an item is deleted from
135 ``os.environ``, and when one of the :meth:`pop` or :meth:`clear` methods is
136 called.
Georg Brandl9afde1c2007-11-01 20:32:30 +0000137
Charles Burklandd648ef12020-03-13 09:04:43 -0700138 .. versionchanged:: 3.9
139 Updated to support :pep:`584`'s merge (``|``) and update (``|=``) operators.
140
Georg Brandl116aa622007-08-15 14:28:22 +0000141
Victor Stinner84ae1182010-05-06 22:05:07 +0000142.. data:: environb
143
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700144 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000145 environment as byte strings. :data:`environ` and :data:`environb` are
146 synchronized (modify :data:`environb` updates :data:`environ`, and vice
147 versa).
148
Victor Stinnerb745a742010-05-18 17:17:23 +0000149 :data:`environb` is only available if :data:`supports_bytes_environ` is
Serhiy Storchaka138ccbb2019-11-12 16:57:03 +0200150 ``True``.
Victor Stinner84ae1182010-05-06 22:05:07 +0000151
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000152 .. versionadded:: 3.2
153
Charles Burklandd648ef12020-03-13 09:04:43 -0700154 .. versionchanged:: 3.9
155 Updated to support :pep:`584`'s merge (``|``) and update (``|=``) operators.
156
Victor Stinner84ae1182010-05-06 22:05:07 +0000157
Georg Brandl116aa622007-08-15 14:28:22 +0000158.. function:: chdir(path)
159 fchdir(fd)
160 getcwd()
161 :noindex:
162
163 These functions are described in :ref:`os-file-dir`.
164
165
Victor Stinnere8d51452010-08-19 01:05:19 +0000166.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000167
Brett Cannonc28592b2016-06-24 12:21:47 -0700168 Encode :term:`path-like <path-like object>` *filename* to the filesystem
169 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
170 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000171
Antoine Pitroua305ca72010-09-25 22:12:00 +0000172 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000173
174 .. versionadded:: 3.2
175
Brett Cannonb08388d2016-06-09 15:58:06 -0700176 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700177 Support added to accept objects implementing the :class:`os.PathLike`
178 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700179
Victor Stinnere8d51452010-08-19 01:05:19 +0000180
181.. function:: fsdecode(filename)
182
Brett Cannonc28592b2016-06-24 12:21:47 -0700183 Decode the :term:`path-like <path-like object>` *filename* from the
184 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
185 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000188
189 .. versionadded:: 3.2
190
Brett Cannonb08388d2016-06-09 15:58:06 -0700191 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700192 Support added to accept objects implementing the :class:`os.PathLike`
193 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700194
Victor Stinner449c4662010-05-08 11:10:09 +0000195
Ethan Furmancdc08792016-06-02 15:06:09 -0700196.. function:: fspath(path)
197
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700198 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700199
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700200 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
201 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
202 returned as long as it is a :class:`str` or :class:`bytes` object.
203 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700204
Brett Cannonb08388d2016-06-09 15:58:06 -0700205 .. versionadded:: 3.6
206
207
208.. class:: PathLike
209
210 An :term:`abstract base class` for objects representing a file system path,
211 e.g. :class:`pathlib.PurePath`.
212
Berker Peksagb18ffb42016-06-10 08:43:54 +0300213 .. versionadded:: 3.6
214
Brett Cannonb08388d2016-06-09 15:58:06 -0700215 .. abstractmethod:: __fspath__()
216
217 Return the file system path representation of the object.
218
219 The method should only return a :class:`str` or :class:`bytes` object,
220 with the preference being for :class:`str`.
221
Ethan Furmancdc08792016-06-02 15:06:09 -0700222
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200223.. function:: getenv(key, default=None)
224
225 Return the value of the environment variable *key* if it exists, or
226 *default* if it doesn't. *key*, *default* and the result are str.
227
228 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
229 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
230 would like to use a different encoding.
231
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400232 .. availability:: most flavors of Unix, Windows.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200233
234
235.. function:: getenvb(key, default=None)
236
237 Return the value of the environment variable *key* if it exists, or
238 *default* if it doesn't. *key*, *default* and the result are bytes.
239
Berker Peksag996e5f92016-09-26 22:44:07 +0300240 :func:`getenvb` is only available if :data:`supports_bytes_environ`
Serhiy Storchaka138ccbb2019-11-12 16:57:03 +0200241 is ``True``.
Berker Peksag996e5f92016-09-26 22:44:07 +0300242
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400243 .. availability:: most flavors of Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200244
245 .. versionadded:: 3.2
246
247
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000248.. function:: get_exec_path(env=None)
249
250 Returns the list of directories that will be searched for a named
251 executable, similar to a shell, when launching a process.
252 *env*, when specified, should be an environment variable dictionary
253 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300254 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000255
256 .. versionadded:: 3.2
257
258
Georg Brandl116aa622007-08-15 14:28:22 +0000259.. function:: getegid()
260
261 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000262 "set id" bit on the file being executed in the current process.
263
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400264 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000265
266
267.. function:: geteuid()
268
269 .. index:: single: user; effective id
270
Benjamin Petersonf650e462010-05-06 23:03:05 +0000271 Return the current process's effective user id.
272
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400273 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000274
275
276.. function:: getgid()
277
278 .. index:: single: process; group
279
Benjamin Petersonf650e462010-05-06 23:03:05 +0000280 Return the real group id of the current process.
281
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400282 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000283
284
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200285.. function:: getgrouplist(user, group)
286
287 Return list of group ids that *user* belongs to. If *group* is not in the
288 list, it is included; typically, *group* is specified as the group ID
289 field from the password record for *user*.
290
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400291 .. availability:: Unix.
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200292
293 .. versionadded:: 3.3
294
295
Georg Brandl116aa622007-08-15 14:28:22 +0000296.. function:: getgroups()
297
298 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000299
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400300 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000301
Larry Hastings3732ed22014-03-15 21:13:56 -0700302 .. note::
303
304 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700305 other Unix platforms. If the Python interpreter was built with a
306 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
307 the list of effective group ids associated with the current user process;
308 this list is limited to a system-defined number of entries, typically 16,
309 and may be modified by calls to :func:`setgroups` if suitably privileged.
310 If built with a deployment target greater than :const:`10.5`,
311 :func:`getgroups` returns the current group access list for the user
312 associated with the effective user id of the process; the group access
313 list may change over the lifetime of the process, it is not affected by
314 calls to :func:`setgroups`, and its length is not limited to 16. The
315 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
316 obtained with :func:`sysconfig.get_config_var`.
317
Georg Brandl116aa622007-08-15 14:28:22 +0000318
319.. function:: getlogin()
320
321 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500322 process. For most purposes, it is more useful to use
323 :func:`getpass.getuser` since the latter checks the environment variables
324 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
325 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
326 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000327
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400328 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000329
330
331.. function:: getpgid(pid)
332
333 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000334 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400336 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000337
338.. function:: getpgrp()
339
340 .. index:: single: process; group
341
Benjamin Petersonf650e462010-05-06 23:03:05 +0000342 Return the id of the current process group.
343
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400344 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000345
346
347.. function:: getpid()
348
349 .. index:: single: process; id
350
Benjamin Petersonf650e462010-05-06 23:03:05 +0000351 Return the current process id.
352
Georg Brandl116aa622007-08-15 14:28:22 +0000353
354.. function:: getppid()
355
356 .. index:: single: process; id of parent
357
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000358 Return the parent's process id. When the parent process has exited, on Unix
359 the id returned is the one of the init process (1), on Windows it is still
360 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000361
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400362 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000363
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000364 .. versionchanged:: 3.2
365 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000366
Georg Brandl8a5555f2012-06-24 13:29:09 +0200367
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000368.. function:: getpriority(which, who)
369
370 .. index:: single: process; scheduling priority
371
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200372 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000373 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
374 is interpreted relative to *which* (a process identifier for
375 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200376 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000377 (respectively) the calling process, the process group of the calling process,
378 or the real user ID of the calling process.
379
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400380 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000381
382 .. versionadded:: 3.3
383
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200384
385.. data:: PRIO_PROCESS
386 PRIO_PGRP
387 PRIO_USER
388
389 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
390
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400391 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200392
393 .. versionadded:: 3.3
394
395
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000396.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000397
398 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000399 real, effective, and saved user ids.
400
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400401 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000402
Georg Brandl1b83a452009-11-28 11:12:26 +0000403 .. versionadded:: 3.2
404
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000405
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000406.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000407
408 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000409 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000410
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400411 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000412
Georg Brandl1b83a452009-11-28 11:12:26 +0000413 .. versionadded:: 3.2
414
Georg Brandl116aa622007-08-15 14:28:22 +0000415
416.. function:: getuid()
417
418 .. index:: single: user; id
419
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700420 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000421
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400422 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000423
424
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200425.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000426
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200427 Call the system initgroups() to initialize the group access list with all of
428 the groups of which the specified username is a member, plus the specified
429 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000430
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400431 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000432
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200433 .. versionadded:: 3.2
434
Georg Brandl116aa622007-08-15 14:28:22 +0000435
Georg Brandl18244152009-09-02 20:34:52 +0000436.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000437
438 .. index:: single: environment variables; setting
439
Georg Brandl18244152009-09-02 20:34:52 +0000440 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000441 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000442 :func:`popen` or :func:`fork` and :func:`execv`.
443
Victor Stinnerb8d12622020-01-24 14:05:48 +0100444 Assignments to items in ``os.environ`` are automatically translated into
445 corresponding calls to :func:`putenv`; however, calls to :func:`putenv`
446 don't update ``os.environ``, so it is actually preferable to assign to items
447 of ``os.environ``.
Georg Brandl116aa622007-08-15 14:28:22 +0000448
449 .. note::
450
Georg Brandlc575c902008-09-13 17:46:05 +0000451 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
Victor Stinnerb8d12622020-01-24 14:05:48 +0100452 cause memory leaks. Refer to the system documentation for :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000453
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800454 .. audit-event:: os.putenv key,value os.putenv
455
Victor Stinnerb8d12622020-01-24 14:05:48 +0100456 .. versionchanged:: 3.9
457 The function is now always available.
Georg Brandl116aa622007-08-15 14:28:22 +0000458
459
460.. function:: setegid(egid)
461
Benjamin Petersonf650e462010-05-06 23:03:05 +0000462 Set the current process's effective group id.
463
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400464 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000465
466
467.. function:: seteuid(euid)
468
Benjamin Petersonf650e462010-05-06 23:03:05 +0000469 Set the current process's effective user id.
470
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400471 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000472
473
474.. function:: setgid(gid)
475
Benjamin Petersonf650e462010-05-06 23:03:05 +0000476 Set the current process' group id.
477
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400478 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000479
480
481.. function:: setgroups(groups)
482
483 Set the list of supplemental group ids associated with the current process to
484 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000485 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000486
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400487 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000488
Ned Deily2e209682012-04-30 11:14:02 -0700489 .. note:: On Mac OS X, the length of *groups* may not exceed the
490 system-defined maximum number of effective group ids, typically 16.
491 See the documentation for :func:`getgroups` for cases where it may not
492 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000493
494.. function:: setpgrp()
495
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300496 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000497 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000498
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400499 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000500
501
502.. function:: setpgid(pid, pgrp)
503
Georg Brandl60203b42010-10-06 10:11:56 +0000504 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000505 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000506 for the semantics.
507
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400508 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000509
510
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000511.. function:: setpriority(which, who, priority)
512
513 .. index:: single: process; scheduling priority
514
515 Set program scheduling priority. The value *which* is one of
516 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
517 is interpreted relative to *which* (a process identifier for
518 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
519 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
520 (respectively) the calling process, the process group of the calling process,
521 or the real user ID of the calling process.
522 *priority* is a value in the range -20 to 19. The default priority is 0;
523 lower priorities cause more favorable scheduling.
524
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400525 .. availability:: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000526
527 .. versionadded:: 3.3
528
529
Georg Brandl116aa622007-08-15 14:28:22 +0000530.. function:: setregid(rgid, egid)
531
Benjamin Petersonf650e462010-05-06 23:03:05 +0000532 Set the current process's real and effective group ids.
533
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400534 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000535
Georg Brandl1b83a452009-11-28 11:12:26 +0000536
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000537.. function:: setresgid(rgid, egid, sgid)
538
539 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000540
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400541 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000542
Georg Brandl1b83a452009-11-28 11:12:26 +0000543 .. versionadded:: 3.2
544
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000545
546.. function:: setresuid(ruid, euid, suid)
547
548 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000549
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400550 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000551
Georg Brandl1b83a452009-11-28 11:12:26 +0000552 .. versionadded:: 3.2
553
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000554
555.. function:: setreuid(ruid, euid)
556
Benjamin Petersonf650e462010-05-06 23:03:05 +0000557 Set the current process's real and effective user ids.
558
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400559 .. availability:: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000560
Georg Brandl116aa622007-08-15 14:28:22 +0000561
562.. function:: getsid(pid)
563
Georg Brandl60203b42010-10-06 10:11:56 +0000564 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000565
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400566 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000567
Georg Brandl116aa622007-08-15 14:28:22 +0000568
569.. function:: setsid()
570
Georg Brandl60203b42010-10-06 10:11:56 +0000571 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000572
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400573 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000574
575
576.. function:: setuid(uid)
577
578 .. index:: single: user; id, setting
579
Benjamin Petersonf650e462010-05-06 23:03:05 +0000580 Set the current process's user id.
581
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400582 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000583
Georg Brandl116aa622007-08-15 14:28:22 +0000584
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000585.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000586.. function:: strerror(code)
587
588 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000589 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000590 error number, :exc:`ValueError` is raised.
591
Georg Brandl116aa622007-08-15 14:28:22 +0000592
Victor Stinnerb745a742010-05-18 17:17:23 +0000593.. data:: supports_bytes_environ
594
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200595 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000596 Windows).
597
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000598 .. versionadded:: 3.2
599
Victor Stinnerb745a742010-05-18 17:17:23 +0000600
Georg Brandl116aa622007-08-15 14:28:22 +0000601.. function:: umask(mask)
602
Benjamin Petersonf650e462010-05-06 23:03:05 +0000603 Set the current numeric umask and return the previous umask.
604
Georg Brandl116aa622007-08-15 14:28:22 +0000605
606.. function:: uname()
607
608 .. index::
609 single: gethostname() (in module socket)
610 single: gethostbyaddr() (in module socket)
611
Larry Hastings605a62d2012-06-24 04:33:36 -0700612 Returns information identifying the current operating system.
613 The return value is an object with five attributes:
614
615 * :attr:`sysname` - operating system name
616 * :attr:`nodename` - name of machine on network (implementation-defined)
617 * :attr:`release` - operating system release
618 * :attr:`version` - operating system version
619 * :attr:`machine` - hardware identifier
620
621 For backwards compatibility, this object is also iterable, behaving
622 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
623 :attr:`release`, :attr:`version`, and :attr:`machine`
624 in that order.
625
626 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000627 leading component; a better way to get the hostname is
628 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000629 ``socket.gethostbyaddr(socket.gethostname())``.
630
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400631 .. availability:: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000632
Larry Hastings605a62d2012-06-24 04:33:36 -0700633 .. versionchanged:: 3.3
634 Return type changed from a tuple to a tuple-like object
635 with named attributes.
636
Georg Brandl116aa622007-08-15 14:28:22 +0000637
Georg Brandl18244152009-09-02 20:34:52 +0000638.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000639
640 .. index:: single: environment variables; deleting
641
Georg Brandl18244152009-09-02 20:34:52 +0000642 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000643 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000644 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000645
Victor Stinnerb8d12622020-01-24 14:05:48 +0100646 Deletion of items in ``os.environ`` is automatically translated into a
647 corresponding call to :func:`unsetenv`; however, calls to :func:`unsetenv`
648 don't update ``os.environ``, so it is actually preferable to delete items of
649 ``os.environ``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000650
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800651 .. audit-event:: os.unsetenv key os.unsetenv
652
Victor Stinner161e7b32020-01-24 11:53:44 +0100653 .. versionchanged:: 3.9
Victor Stinnerb8d12622020-01-24 14:05:48 +0100654 The function is now always available and is also available on Windows.
Victor Stinner161e7b32020-01-24 11:53:44 +0100655
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657.. _os-newstreams:
658
659File Object Creation
660--------------------
661
Steve Dowerb82e17e2019-05-23 08:45:22 -0700662These functions create new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200663:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000664
665
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300666.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandlb2462e22012-06-24 13:24:56 +0200668 Return an open file object connected to the file descriptor *fd*. This is an
669 alias of the :func:`open` built-in function and accepts the same arguments.
670 The only difference is that the first argument of :func:`fdopen` must always
671 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673
Georg Brandl116aa622007-08-15 14:28:22 +0000674.. _os-fd-ops:
675
676File Descriptor Operations
677--------------------------
678
679These functions operate on I/O streams referenced using file descriptors.
680
681File descriptors are small integers corresponding to a file that has been opened
682by the current process. For example, standard input is usually file descriptor
6830, standard output is 1, and standard error is 2. Further files opened by a
684process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
685is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
686by file descriptors.
687
Serhiy Storchakadab83542013-10-13 20:12:43 +0300688The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000689associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000690descriptor directly will bypass the file object methods, ignoring aspects such
691as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000692
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000693
Georg Brandl116aa622007-08-15 14:28:22 +0000694.. function:: close(fd)
695
Benjamin Petersonf650e462010-05-06 23:03:05 +0000696 Close file descriptor *fd*.
697
Georg Brandl116aa622007-08-15 14:28:22 +0000698 .. note::
699
700 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000701 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000702 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300703 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
705
Christian Heimesfdab48e2008-01-20 09:06:41 +0000706.. function:: closerange(fd_low, fd_high)
707
708 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200709 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000710
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000711 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000712 try:
713 os.close(fd)
714 except OSError:
715 pass
716
Christian Heimesfdab48e2008-01-20 09:06:41 +0000717
Pablo Galindoaac4d032019-05-31 19:39:47 +0100718.. function:: copy_file_range(src, dst, count, offset_src=None, offset_dst=None)
719
720 Copy *count* bytes from file descriptor *src*, starting from offset
721 *offset_src*, to file descriptor *dst*, starting from offset *offset_dst*.
722 If *offset_src* is None, then *src* is read from the current position;
723 respectively for *offset_dst*. The files pointed by *src* and *dst*
724 must reside in the same filesystem, otherwise an :exc:`OSError` is
725 raised with :attr:`~OSError.errno` set to :data:`errno.EXDEV`.
726
727 This copy is done without the additional cost of transferring data
728 from the kernel to user space and then back into the kernel. Additionally,
729 some filesystems could implement extra optimizations. The copy is done as if
730 both files are opened as binary.
731
732 The return value is the amount of bytes copied. This could be less than the
733 amount requested.
734
735 .. availability:: Linux kernel >= 4.5 or glibc >= 2.27.
736
737 .. versionadded:: 3.8
738
739
Georg Brandl81f11302007-12-21 08:45:42 +0000740.. function:: device_encoding(fd)
741
742 Return a string describing the encoding of the device associated with *fd*
743 if it is connected to a terminal; else return :const:`None`.
744
745
Georg Brandl116aa622007-08-15 14:28:22 +0000746.. function:: dup(fd)
747
Victor Stinnerdaf45552013-08-28 00:53:59 +0200748 Return a duplicate of file descriptor *fd*. The new file descriptor is
749 :ref:`non-inheritable <fd_inheritance>`.
750
751 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
752 2: stderr), the new file descriptor is :ref:`inheritable
753 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000754
Victor Stinnerdaf45552013-08-28 00:53:59 +0200755 .. versionchanged:: 3.4
756 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000757
Victor Stinnerdaf45552013-08-28 00:53:59 +0200758
759.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000760
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800761 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
762 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
763 <fd_inheritance>` by default or non-inheritable if *inheritable*
764 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000765
Victor Stinnerdaf45552013-08-28 00:53:59 +0200766 .. versionchanged:: 3.4
767 Add the optional *inheritable* parameter.
768
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800769 .. versionchanged:: 3.7
770 Return *fd2* on success. Previously, ``None`` was always returned.
771
Georg Brandl116aa622007-08-15 14:28:22 +0000772
Christian Heimes4e30a842007-11-30 22:12:06 +0000773.. function:: fchmod(fd, mode)
774
Georg Brandlb9df00c2012-06-24 12:38:14 +0200775 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200776 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200777 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000778
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800779 .. audit-event:: os.chmod path,mode,dir_fd os.fchmod
780
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400781 .. availability:: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000782
783
784.. function:: fchown(fd, uid, gid)
785
786 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200787 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200788 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200789 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000790
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800791 .. audit-event:: os.chown path,uid,gid,dir_fd os.fchown
792
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400793 .. availability:: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000794
795
Georg Brandl116aa622007-08-15 14:28:22 +0000796.. function:: fdatasync(fd)
797
798 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000799 metadata.
800
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400801 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000802
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000803 .. note::
804 This function is not available on MacOS.
805
Georg Brandl116aa622007-08-15 14:28:22 +0000806
807.. function:: fpathconf(fd, name)
808
809 Return system configuration information relevant to an open file. *name*
810 specifies the configuration value to retrieve; it may be a string which is the
811 name of a defined system value; these names are specified in a number of
812 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
813 additional names as well. The names known to the host operating system are
814 given in the ``pathconf_names`` dictionary. For configuration variables not
815 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000816
817 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
818 specific value for *name* is not supported by the host system, even if it is
819 included in ``pathconf_names``, an :exc:`OSError` is raised with
820 :const:`errno.EINVAL` for the error number.
821
Georg Brandl4d399a42012-06-25 07:40:32 +0200822 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200823
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400824 .. availability:: Unix.
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700825
Georg Brandl116aa622007-08-15 14:28:22 +0000826
Victor Stinner4195b5c2012-02-08 23:03:19 +0100827.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000828
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200829 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
830 object.
831
832 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
833
834 .. seealso::
835
Berker Peksag2034caa2015-04-27 13:53:28 +0300836 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000837
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200838
Georg Brandl116aa622007-08-15 14:28:22 +0000839.. function:: fstatvfs(fd)
840
Georg Brandlb9df00c2012-06-24 12:38:14 +0200841 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200842 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200843 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000844
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400845 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000846
847
848.. function:: fsync(fd)
849
850 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000851 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000852
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000853 If you're starting with a buffered Python :term:`file object` *f*, first do
854 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
855 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000856
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400857 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000858
859
860.. function:: ftruncate(fd, length)
861
Georg Brandl306336b2012-06-24 12:55:33 +0200862 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200863 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200864 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000865
Steve Dower44f91c32019-06-27 10:47:59 -0700866 .. audit-event:: os.truncate fd,length os.ftruncate
Steve Dowerb82e17e2019-05-23 08:45:22 -0700867
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400868 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000869
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700870 .. versionchanged:: 3.5
871 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000872
Steve Dowerb82e17e2019-05-23 08:45:22 -0700873
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200874.. function:: get_blocking(fd)
875
876 Get the blocking mode of the file descriptor: ``False`` if the
877 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
878
879 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
880
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400881 .. availability:: Unix.
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200882
883 .. versionadded:: 3.5
884
Steve Dowerb82e17e2019-05-23 08:45:22 -0700885
Georg Brandl116aa622007-08-15 14:28:22 +0000886.. function:: isatty(fd)
887
888 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000889 tty(-like) device, else ``False``.
890
Georg Brandl116aa622007-08-15 14:28:22 +0000891
Ross Lagerwall7807c352011-03-17 20:20:30 +0200892.. function:: lockf(fd, cmd, len)
893
894 Apply, test or remove a POSIX lock on an open file descriptor.
895 *fd* is an open file descriptor.
896 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
897 :data:`F_ULOCK` or :data:`F_TEST`.
898 *len* specifies the section of the file to lock.
899
Saiyang Gou7514f4f2020-02-12 23:47:42 -0800900 .. audit-event:: os.lockf fd,cmd,len os.lockf
901
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400902 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +0200903
904 .. versionadded:: 3.3
905
906
907.. data:: F_LOCK
908 F_TLOCK
909 F_ULOCK
910 F_TEST
911
912 Flags that specify what action :func:`lockf` will take.
913
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400914 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +0200915
916 .. versionadded:: 3.3
917
Georg Brandlf62445a2012-06-24 13:31:20 +0200918
Georg Brandl116aa622007-08-15 14:28:22 +0000919.. function:: lseek(fd, pos, how)
920
Christian Heimesfaf2f632008-01-06 16:59:19 +0000921 Set the current position of file descriptor *fd* to position *pos*, modified
922 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
923 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300924 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100925 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000926
Georg Brandl116aa622007-08-15 14:28:22 +0000927
Georg Brandl8569e582010-05-19 20:57:08 +0000928.. data:: SEEK_SET
929 SEEK_CUR
930 SEEK_END
931
932 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200933 respectively.
934
Jesus Cea94363612012-06-22 18:32:07 +0200935 .. versionadded:: 3.3
936 Some operating systems could support additional values, like
937 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
938
Georg Brandl8569e582010-05-19 20:57:08 +0000939
Martin Panterbf19d162015-09-09 01:01:13 +0000940.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000941
Martin Panterbf19d162015-09-09 01:01:13 +0000942 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700943 its mode according to *mode*. When computing *mode*, the current umask value
944 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200945 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000946
947 For a description of the flag and mode values, see the C run-time documentation;
948 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400949 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000950 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000951
Georg Brandl50c40002012-06-24 11:45:20 +0200952 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400953 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700954
Steve Dower44f91c32019-06-27 10:47:59 -0700955 .. audit-event:: open path,mode,flags os.open
Steve Dowerb82e17e2019-05-23 08:45:22 -0700956
Victor Stinnerdaf45552013-08-28 00:53:59 +0200957 .. versionchanged:: 3.4
958 The new file descriptor is now non-inheritable.
959
Georg Brandl116aa622007-08-15 14:28:22 +0000960 .. note::
961
Georg Brandl502d9a52009-07-26 15:02:41 +0000962 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000963 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000964 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000965 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000966
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000967 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700968 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000969
Victor Stinnera766ddf2015-03-26 23:50:57 +0100970 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200971 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100972 exception, the function now retries the system call instead of raising an
973 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
974
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700975 .. versionchanged:: 3.6
976 Accepts a :term:`path-like object`.
977
Andrew Kuchling4921a082013-06-21 11:49:57 -0400978The following constants are options for the *flags* parameter to the
979:func:`~os.open` function. They can be combined using the bitwise OR operator
980``|``. Some of them are not available on all platforms. For descriptions of
981their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100982or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400983
984
985.. data:: O_RDONLY
986 O_WRONLY
987 O_RDWR
988 O_APPEND
989 O_CREAT
990 O_EXCL
991 O_TRUNC
992
Vinay Sajipe4946e72016-09-11 15:15:59 +0100993 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400994
995
996.. data:: O_DSYNC
997 O_RSYNC
998 O_SYNC
999 O_NDELAY
1000 O_NONBLOCK
1001 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -04001002 O_CLOEXEC
1003
Vinay Sajipe4946e72016-09-11 15:15:59 +01001004 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -04001005
1006 .. versionchanged:: 3.3
1007 Add :data:`O_CLOEXEC` constant.
1008
1009.. data:: O_BINARY
1010 O_NOINHERIT
1011 O_SHORT_LIVED
1012 O_TEMPORARY
1013 O_RANDOM
1014 O_SEQUENTIAL
1015 O_TEXT
1016
Vinay Sajipe4946e72016-09-11 15:15:59 +01001017 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -04001018
1019
1020.. data:: O_ASYNC
1021 O_DIRECT
1022 O_DIRECTORY
1023 O_NOFOLLOW
1024 O_NOATIME
1025 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +02001026 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +01001027 O_SHLOCK
1028 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -04001029
Vinay Sajipe4946e72016-09-11 15:15:59 +01001030 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -04001031 the C library.
1032
Christian Heimesd88f7352013-08-16 14:37:50 +02001033 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001034 Add :data:`O_PATH` on systems that support it.
1035 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1036 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001037
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001038
Georg Brandl116aa622007-08-15 14:28:22 +00001039.. function:: openpty()
1040
1041 .. index:: module: pty
1042
Victor Stinnerdaf45552013-08-28 00:53:59 +02001043 Open a new pseudo-terminal pair. Return a pair of file descriptors
1044 ``(master, slave)`` for the pty and the tty, respectively. The new file
1045 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1046 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001047
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001048 .. availability:: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001049
Victor Stinnerdaf45552013-08-28 00:53:59 +02001050 .. versionchanged:: 3.4
1051 The new file descriptors are now non-inheritable.
1052
Georg Brandl116aa622007-08-15 14:28:22 +00001053
1054.. function:: pipe()
1055
Victor Stinnerdaf45552013-08-28 00:53:59 +02001056 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001057 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001058 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001059
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001060 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001061
Victor Stinnerdaf45552013-08-28 00:53:59 +02001062 .. versionchanged:: 3.4
1063 The new file descriptors are now non-inheritable.
1064
Georg Brandl116aa622007-08-15 14:28:22 +00001065
Charles-François Natali368f34b2011-06-06 19:49:47 +02001066.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001067
1068 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001069 *flags* can be constructed by ORing together one or more of these values:
1070 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001071 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1072 respectively.
1073
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001074 .. availability:: some flavors of Unix.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001075
1076 .. versionadded:: 3.3
1077
1078
Ross Lagerwall7807c352011-03-17 20:20:30 +02001079.. function:: posix_fallocate(fd, offset, len)
1080
1081 Ensures that enough disk space is allocated for the file specified by *fd*
1082 starting from *offset* and continuing for *len* bytes.
1083
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001084 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001085
1086 .. versionadded:: 3.3
1087
1088
1089.. function:: posix_fadvise(fd, offset, len, advice)
1090
1091 Announces an intention to access data in a specific pattern thus allowing
1092 the kernel to make optimizations.
1093 The advice applies to the region of the file specified by *fd* starting at
1094 *offset* and continuing for *len* bytes.
1095 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1096 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1097 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1098
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001099 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001100
1101 .. versionadded:: 3.3
1102
1103
1104.. data:: POSIX_FADV_NORMAL
1105 POSIX_FADV_SEQUENTIAL
1106 POSIX_FADV_RANDOM
1107 POSIX_FADV_NOREUSE
1108 POSIX_FADV_WILLNEED
1109 POSIX_FADV_DONTNEED
1110
1111 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1112 the access pattern that is likely to be used.
1113
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001114 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001115
1116 .. versionadded:: 3.3
1117
1118
Pablo Galindo02e2a082018-05-31 00:00:04 +01001119.. function:: pread(fd, n, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001120
Pablo Galindo02e2a082018-05-31 00:00:04 +01001121 Read at most *n* bytes from file descriptor *fd* at a position of *offset*,
1122 leaving the file offset unchanged.
1123
1124 Return a bytestring containing the bytes read. If the end of the file
1125 referred to by *fd* has been reached, an empty bytes object is returned.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001126
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001127 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001128
1129 .. versionadded:: 3.3
1130
1131
Pablo Galindo02e2a082018-05-31 00:00:04 +01001132.. function:: preadv(fd, buffers, offset, flags=0)
1133
1134 Read from a file descriptor *fd* at a position of *offset* into mutable
1135 :term:`bytes-like objects <bytes-like object>` *buffers*, leaving the file
1136 offset unchanged. Transfer data into each buffer until it is full and then
1137 move on to the next buffer in the sequence to hold the rest of the data.
1138
1139 The flags argument contains a bitwise OR of zero or more of the following
1140 flags:
1141
1142 - :data:`RWF_HIPRI`
1143 - :data:`RWF_NOWAIT`
1144
1145 Return the total number of bytes actually read which can be less than the
1146 total capacity of all the objects.
1147
1148 The operating system may set a limit (:func:`sysconf` value
1149 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1150
1151 Combine the functionality of :func:`os.readv` and :func:`os.pread`.
1152
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001153 .. availability:: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
Batuhan Taskayacae22752020-05-17 01:36:40 +03001154 OpenBSD 2.7 and newer, AIX 7.1 and newer. Using flags requires
1155 Linux 4.6 or newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001156
1157 .. versionadded:: 3.7
1158
1159
1160.. data:: RWF_NOWAIT
1161
1162 Do not wait for data which is not immediately available. If this flag is
1163 specified, the system call will return instantly if it would have to read
1164 data from the backing storage or wait for a lock.
1165
1166 If some data was successfully read, it will return the number of bytes read.
1167 If no bytes were read, it will return ``-1`` and set errno to
1168 :data:`errno.EAGAIN`.
1169
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001170 .. availability:: Linux 4.14 and newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001171
1172 .. versionadded:: 3.7
1173
1174
1175.. data:: RWF_HIPRI
1176
1177 High priority read/write. Allows block-based filesystems to use polling
1178 of the device, which provides lower latency, but may use additional
1179 resources.
1180
1181 Currently, on Linux, this feature is usable only on a file descriptor opened
1182 using the :data:`O_DIRECT` flag.
1183
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001184 .. availability:: Linux 4.6 and newer.
Pablo Galindo02e2a082018-05-31 00:00:04 +01001185
1186 .. versionadded:: 3.7
1187
1188
Jesus Cea67503c52014-10-20 16:18:24 +02001189.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001190
Pablo Galindo02e2a082018-05-31 00:00:04 +01001191 Write the bytestring in *str* to file descriptor *fd* at position of
1192 *offset*, leaving the file offset unchanged.
1193
1194 Return the number of bytes actually written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001195
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001196 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001197
1198 .. versionadded:: 3.3
1199
1200
Pablo Galindo4defba32018-01-27 16:16:37 +00001201.. function:: pwritev(fd, buffers, offset, flags=0)
1202
Pablo Galindo02e2a082018-05-31 00:00:04 +01001203 Write the *buffers* contents to file descriptor *fd* at a offset *offset*,
1204 leaving the file offset unchanged. *buffers* must be a sequence of
1205 :term:`bytes-like objects <bytes-like object>`. Buffers are processed in
1206 array order. Entire contents of the first buffer is written before
1207 proceeding to the second, and so on.
Pablo Galindo4defba32018-01-27 16:16:37 +00001208
Pablo Galindo02e2a082018-05-31 00:00:04 +01001209 The flags argument contains a bitwise OR of zero or more of the following
Pablo Galindo4defba32018-01-27 16:16:37 +00001210 flags:
1211
Pablo Galindo02e2a082018-05-31 00:00:04 +01001212 - :data:`RWF_DSYNC`
1213 - :data:`RWF_SYNC`
YoSTEALTH76ef2552020-05-27 15:32:22 -06001214 - :data:`RWF_APPEND`
Pablo Galindo4defba32018-01-27 16:16:37 +00001215
Pablo Galindo02e2a082018-05-31 00:00:04 +01001216 Return the total number of bytes actually written.
Pablo Galindo4defba32018-01-27 16:16:37 +00001217
Pablo Galindo02e2a082018-05-31 00:00:04 +01001218 The operating system may set a limit (:func:`sysconf` value
1219 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1220
1221 Combine the functionality of :func:`os.writev` and :func:`os.pwrite`.
1222
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001223 .. availability:: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
Batuhan Taskayacae22752020-05-17 01:36:40 +03001224 OpenBSD 2.7 and newer, AIX 7.1 and newer. Using flags requires
1225 Linux 4.7 or newer.
Pablo Galindo4defba32018-01-27 16:16:37 +00001226
1227 .. versionadded:: 3.7
1228
Pablo Galindo02e2a082018-05-31 00:00:04 +01001229
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001230.. data:: RWF_DSYNC
1231
YoSTEALTH76ef2552020-05-27 15:32:22 -06001232 Provide a per-write equivalent of the :data:`O_DSYNC` :func:`os.open` flag.
1233 This flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001234
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001235 .. availability:: Linux 4.7 and newer.
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001236
Pablo Galindo4defba32018-01-27 16:16:37 +00001237 .. versionadded:: 3.7
1238
Pablo Galindo02e2a082018-05-31 00:00:04 +01001239
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001240.. data:: RWF_SYNC
1241
YoSTEALTH76ef2552020-05-27 15:32:22 -06001242 Provide a per-write equivalent of the :data:`O_SYNC` :func:`os.open` flag.
1243 This flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001244
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001245 .. availability:: Linux 4.7 and newer.
Pablo Galindod6ef6db2018-04-25 18:48:27 +01001246
Pablo Galindo4defba32018-01-27 16:16:37 +00001247 .. versionadded:: 3.7
1248
1249
YoSTEALTH76ef2552020-05-27 15:32:22 -06001250.. data:: RWF_APPEND
1251
1252 Provide a per-write equivalent of the :data:`O_APPEND` :func:`os.open`
1253 flag. This flag is meaningful only for :func:`os.pwritev`, and its
1254 effect applies only to the data range written by the system call. The
1255 *offset* argument does not affect the write operation; the data is always
1256 appended to the end of the file. However, if the *offset* argument is
1257 ``-1``, the current file *offset* is updated.
1258
1259 .. availability:: Linux 4.16 and newer.
1260
1261 .. versionadded:: 3.10
1262
1263
Georg Brandl116aa622007-08-15 14:28:22 +00001264.. function:: read(fd, n)
1265
Pablo Galindo02e2a082018-05-31 00:00:04 +01001266 Read at most *n* bytes from file descriptor *fd*.
1267
1268 Return a bytestring containing the bytes read. If the end of the file
1269 referred to by *fd* has been reached, an empty bytes object is returned.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001270
Georg Brandl116aa622007-08-15 14:28:22 +00001271 .. note::
1272
1273 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001274 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1275 "file object" returned by the built-in function :func:`open` or by
1276 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1277 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001278
Victor Stinnera766ddf2015-03-26 23:50:57 +01001279 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001280 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001281 exception, the function now retries the system call instead of raising an
1282 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1283
Georg Brandl116aa622007-08-15 14:28:22 +00001284
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001285.. function:: sendfile(out_fd, in_fd, offset, count)
Serhiy Storchaka2b560312020-04-18 19:14:10 +03001286 sendfile(out_fd, in_fd, offset, count, headers=(), trailers=(), flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001287
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001288 Copy *count* bytes from file descriptor *in_fd* to file descriptor *out_fd*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001289 starting at *offset*.
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001290 Return the number of bytes sent. When EOF is reached return ``0``.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001291
1292 The first function notation is supported by all platforms that define
1293 :func:`sendfile`.
1294
1295 On Linux, if *offset* is given as ``None``, the bytes are read from the
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001296 current position of *in_fd* and the position of *in_fd* is updated.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001297
1298 The second case may be used on Mac OS X and FreeBSD where *headers* and
1299 *trailers* are arbitrary sequences of buffers that are written before and
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001300 after the data from *in_fd* is written. It returns the same as the first case.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001301
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001302 On Mac OS X and FreeBSD, a value of ``0`` for *count* specifies to send until
1303 the end of *in_fd* is reached.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001304
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001305 All platforms support sockets as *out_fd* file descriptor, and some platforms
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001306 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001307
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001308 Cross-platform applications should not use *headers*, *trailers* and *flags*
1309 arguments.
1310
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001311 .. availability:: Unix.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001312
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001313 .. note::
1314
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001315 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001316 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001317
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001318 .. versionadded:: 3.3
1319
Serhiy Storchaka140a7d12019-10-13 11:59:31 +03001320 .. versionchanged:: 3.9
1321 Parameters *out* and *in* was renamed to *out_fd* and *in_fd*.
1322
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001323
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001324.. function:: set_blocking(fd, blocking)
1325
1326 Set the blocking mode of the specified file descriptor. Set the
1327 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1328
1329 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1330
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001331 .. availability:: Unix.
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001332
1333 .. versionadded:: 3.5
1334
1335
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001336.. data:: SF_NODISKIO
1337 SF_MNOWAIT
1338 SF_SYNC
1339
1340 Parameters to the :func:`sendfile` function, if the implementation supports
1341 them.
1342
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001343 .. availability:: Unix.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001344
1345 .. versionadded:: 3.3
1346
1347
Ross Lagerwall7807c352011-03-17 20:20:30 +02001348.. function:: readv(fd, buffers)
1349
Benjamin Petersone83ed432014-01-18 22:54:59 -05001350 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
Pablo Galindo02e2a082018-05-31 00:00:04 +01001351 objects <bytes-like object>` *buffers*. Transfer data into each buffer until
1352 it is full and then move on to the next buffer in the sequence to hold the
1353 rest of the data.
1354
1355 Return the total number of bytes actually read which can be less than the
1356 total capacity of all the objects.
1357
1358 The operating system may set a limit (:func:`sysconf` value
1359 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001360
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001361 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001362
1363 .. versionadded:: 3.3
1364
1365
Georg Brandl116aa622007-08-15 14:28:22 +00001366.. function:: tcgetpgrp(fd)
1367
1368 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001369 file descriptor as returned by :func:`os.open`).
1370
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001371 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001372
1373
1374.. function:: tcsetpgrp(fd, pg)
1375
1376 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001377 descriptor as returned by :func:`os.open`) to *pg*.
1378
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001379 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001380
1381
1382.. function:: ttyname(fd)
1383
1384 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001385 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001386 exception is raised.
1387
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001388 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001389
1390
1391.. function:: write(fd, str)
1392
Pablo Galindo02e2a082018-05-31 00:00:04 +01001393 Write the bytestring in *str* to file descriptor *fd*.
1394
1395 Return the number of bytes actually written.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001396
Georg Brandl116aa622007-08-15 14:28:22 +00001397 .. note::
1398
1399 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001400 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001401 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001402 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1403 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001404
Victor Stinnera766ddf2015-03-26 23:50:57 +01001405 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001406 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001407 exception, the function now retries the system call instead of raising an
1408 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1409
Georg Brandl8569e582010-05-19 20:57:08 +00001410
Ross Lagerwall7807c352011-03-17 20:20:30 +02001411.. function:: writev(fd, buffers)
1412
Pablo Galindo02e2a082018-05-31 00:00:04 +01001413 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be
1414 a sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1415 processed in array order. Entire contents of the first buffer is written
1416 before proceeding to the second, and so on.
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001417
Pablo Galindo02e2a082018-05-31 00:00:04 +01001418 Returns the total number of bytes actually written.
1419
1420 The operating system may set a limit (:func:`sysconf` value
1421 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001422
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001423 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001424
1425 .. versionadded:: 3.3
1426
1427
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001428.. _terminal-size:
1429
1430Querying the size of a terminal
1431~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1432
1433.. versionadded:: 3.3
1434
1435.. function:: get_terminal_size(fd=STDOUT_FILENO)
1436
1437 Return the size of the terminal window as ``(columns, lines)``,
1438 tuple of type :class:`terminal_size`.
1439
1440 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1441 output) specifies which file descriptor should be queried.
1442
1443 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001444 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001445
1446 :func:`shutil.get_terminal_size` is the high-level function which
1447 should normally be used, ``os.get_terminal_size`` is the low-level
1448 implementation.
1449
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001450 .. availability:: Unix, Windows.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001451
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001452.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001453
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001454 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001455
1456 .. attribute:: columns
1457
1458 Width of the terminal window in characters.
1459
1460 .. attribute:: lines
1461
1462 Height of the terminal window in characters.
1463
1464
Victor Stinnerdaf45552013-08-28 00:53:59 +02001465.. _fd_inheritance:
1466
1467Inheritance of File Descriptors
1468~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1469
Georg Brandl5642ff92013-09-15 10:37:57 +02001470.. versionadded:: 3.4
1471
1472A file descriptor has an "inheritable" flag which indicates if the file descriptor
1473can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001474created by Python are non-inheritable by default.
1475
1476On UNIX, non-inheritable file descriptors are closed in child processes at the
1477execution of a new program, other file descriptors are inherited.
1478
1479On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001480processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001481and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001482all inheritable handles and all inheritable file descriptors are inherited.
1483Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001484streams are closed, and inheritable handles are only inherited if the
1485*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001486
1487.. function:: get_inheritable(fd)
1488
Georg Brandl5642ff92013-09-15 10:37:57 +02001489 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001490
1491.. function:: set_inheritable(fd, inheritable)
1492
Georg Brandl5642ff92013-09-15 10:37:57 +02001493 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001494
1495.. function:: get_handle_inheritable(handle)
1496
Georg Brandl5642ff92013-09-15 10:37:57 +02001497 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001498
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001499 .. availability:: Windows.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001500
1501.. function:: set_handle_inheritable(handle, inheritable)
1502
Georg Brandl5642ff92013-09-15 10:37:57 +02001503 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001504
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001505 .. availability:: Windows.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001506
1507
Georg Brandl116aa622007-08-15 14:28:22 +00001508.. _os-file-dir:
1509
1510Files and Directories
1511---------------------
1512
Georg Brandl50c40002012-06-24 11:45:20 +02001513On some Unix platforms, many of these functions support one or more of these
1514features:
1515
1516.. _path_fd:
1517
Larry Hastings77892dc2012-06-25 03:27:33 -07001518* **specifying a file descriptor:**
Cheryl Sabellae1521692019-05-06 08:39:13 -04001519 Normally the *path* argument provided to functions in the :mod:`os` module
1520 must be a string specifying a file path. However, some functions now
1521 alternatively accept an open file descriptor for their *path* argument.
1522 The function will then operate on the file referred to by the descriptor.
1523 (For POSIX systems, Python will call the variant of the function prefixed
1524 with ``f`` (e.g. call ``fchdir`` instead of ``chdir``).)
Georg Brandl50c40002012-06-24 11:45:20 +02001525
Cheryl Sabellae1521692019-05-06 08:39:13 -04001526 You can check whether or not *path* can be specified as a file descriptor
1527 for a particular function on your platform using :data:`os.supports_fd`.
1528 If this functionality is unavailable, using it will raise a
1529 :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001530
Cheryl Sabellae1521692019-05-06 08:39:13 -04001531 If the function also supports *dir_fd* or *follow_symlinks* arguments, it's
Georg Brandl50c40002012-06-24 11:45:20 +02001532 an error to specify one of those when supplying *path* as a file descriptor.
1533
1534.. _dir_fd:
1535
Larry Hastings77892dc2012-06-25 03:27:33 -07001536* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001537 should be a file descriptor referring to a directory, and the path to operate
1538 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001539 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Cheryl Sabellae1521692019-05-06 08:39:13 -04001540 the variant of the function with an ``at`` suffix and possibly prefixed with
1541 ``f`` (e.g. call ``faccessat`` instead of ``access``).
Georg Brandl50c40002012-06-24 11:45:20 +02001542
Cheryl Sabellae1521692019-05-06 08:39:13 -04001543 You can check whether or not *dir_fd* is supported for a particular function
1544 on your platform using :data:`os.supports_dir_fd`. If it's unavailable,
1545 using it will raise a :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001546
1547.. _follow_symlinks:
1548
Larry Hastings77892dc2012-06-25 03:27:33 -07001549* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001550 ``False``, and the last element of the path to operate on is a symbolic link,
Cheryl Sabellae1521692019-05-06 08:39:13 -04001551 the function will operate on the symbolic link itself rather than the file
1552 pointed to by the link. (For POSIX systems, Python will call the ``l...``
1553 variant of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001554
Cheryl Sabellae1521692019-05-06 08:39:13 -04001555 You can check whether or not *follow_symlinks* is supported for a particular
1556 function on your platform using :data:`os.supports_follow_symlinks`.
1557 If it's unavailable, using it will raise a :exc:`NotImplementedError`.
Georg Brandl50c40002012-06-24 11:45:20 +02001558
1559
1560
Larry Hastings9cf065c2012-06-22 16:30:09 -07001561.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001562
1563 Use the real uid/gid to test for access to *path*. Note that most operations
1564 will use the effective uid/gid, therefore this routine can be used in a
1565 suid/sgid environment to test if the invoking user has the specified access to
1566 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1567 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1568 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1569 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001570 information.
1571
Georg Brandl50c40002012-06-24 11:45:20 +02001572 This function can support specifying :ref:`paths relative to directory
1573 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001574
1575 If *effective_ids* is ``True``, :func:`access` will perform its access
1576 checks using the effective uid/gid instead of the real uid/gid.
1577 *effective_ids* may not be supported on your platform; you can check whether
1578 or not it is available using :data:`os.supports_effective_ids`. If it is
1579 unavailable, using it will raise a :exc:`NotImplementedError`.
1580
Georg Brandl116aa622007-08-15 14:28:22 +00001581 .. note::
1582
Georg Brandl502d9a52009-07-26 15:02:41 +00001583 Using :func:`access` to check if a user is authorized to e.g. open a file
1584 before actually doing so using :func:`open` creates a security hole,
1585 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001586 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1587 techniques. For example::
1588
1589 if os.access("myfile", os.R_OK):
1590 with open("myfile") as fp:
1591 return fp.read()
1592 return "some default data"
1593
1594 is better written as::
1595
1596 try:
1597 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001598 except PermissionError:
1599 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001600 else:
1601 with fp:
1602 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001603
1604 .. note::
1605
1606 I/O operations may fail even when :func:`access` indicates that they would
1607 succeed, particularly for operations on network filesystems which may have
1608 permissions semantics beyond the usual POSIX permission-bit model.
1609
Larry Hastings9cf065c2012-06-22 16:30:09 -07001610 .. versionchanged:: 3.3
1611 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1612
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001613 .. versionchanged:: 3.6
1614 Accepts a :term:`path-like object`.
1615
Georg Brandl116aa622007-08-15 14:28:22 +00001616
1617.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001618 R_OK
1619 W_OK
1620 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001621
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001622 Values to pass as the *mode* parameter of :func:`access` to test the
1623 existence, readability, writability and executability of *path*,
1624 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001625
1626
1627.. function:: chdir(path)
1628
1629 .. index:: single: directory; changing
1630
Benjamin Petersonf650e462010-05-06 23:03:05 +00001631 Change the current working directory to *path*.
1632
Larry Hastings77892dc2012-06-25 03:27:33 -07001633 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001634 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001635
Terry Jan Reedya9b40e42019-07-06 22:44:01 -04001636 This function can raise :exc:`OSError` and subclasses such as
Kyle Stanley0717b4d2019-07-06 21:20:15 -04001637 :exc:`FileNotFoundError`, :exc:`PermissionError`, and :exc:`NotADirectoryError`.
1638
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001639 .. audit-event:: os.chdir path os.chdir
1640
Larry Hastings9cf065c2012-06-22 16:30:09 -07001641 .. versionadded:: 3.3
1642 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001643 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001644
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001645 .. versionchanged:: 3.6
1646 Accepts a :term:`path-like object`.
1647
Georg Brandl116aa622007-08-15 14:28:22 +00001648
Larry Hastings9cf065c2012-06-22 16:30:09 -07001649.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001650
1651 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1652 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1653
R David Murray30178062011-03-10 17:18:33 -05001654 * :data:`stat.UF_NODUMP`
1655 * :data:`stat.UF_IMMUTABLE`
1656 * :data:`stat.UF_APPEND`
1657 * :data:`stat.UF_OPAQUE`
1658 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001659 * :data:`stat.UF_COMPRESSED`
1660 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001661 * :data:`stat.SF_ARCHIVED`
1662 * :data:`stat.SF_IMMUTABLE`
1663 * :data:`stat.SF_APPEND`
1664 * :data:`stat.SF_NOUNLINK`
1665 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001666
Georg Brandl50c40002012-06-24 11:45:20 +02001667 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001668
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001669 .. audit-event:: os.chflags path,flags os.chflags
1670
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001671 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001672
Larry Hastings9cf065c2012-06-22 16:30:09 -07001673 .. versionadded:: 3.3
1674 The *follow_symlinks* argument.
1675
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001676 .. versionchanged:: 3.6
1677 Accepts a :term:`path-like object`.
1678
Georg Brandl116aa622007-08-15 14:28:22 +00001679
Larry Hastings9cf065c2012-06-22 16:30:09 -07001680.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001681
1682 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001683 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001684 combinations of them:
1685
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001686 * :data:`stat.S_ISUID`
1687 * :data:`stat.S_ISGID`
1688 * :data:`stat.S_ENFMT`
1689 * :data:`stat.S_ISVTX`
1690 * :data:`stat.S_IREAD`
1691 * :data:`stat.S_IWRITE`
1692 * :data:`stat.S_IEXEC`
1693 * :data:`stat.S_IRWXU`
1694 * :data:`stat.S_IRUSR`
1695 * :data:`stat.S_IWUSR`
1696 * :data:`stat.S_IXUSR`
1697 * :data:`stat.S_IRWXG`
1698 * :data:`stat.S_IRGRP`
1699 * :data:`stat.S_IWGRP`
1700 * :data:`stat.S_IXGRP`
1701 * :data:`stat.S_IRWXO`
1702 * :data:`stat.S_IROTH`
1703 * :data:`stat.S_IWOTH`
1704 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001705
Georg Brandl50c40002012-06-24 11:45:20 +02001706 This function can support :ref:`specifying a file descriptor <path_fd>`,
1707 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1708 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001709
Georg Brandl116aa622007-08-15 14:28:22 +00001710 .. note::
1711
Georg Brandl50c40002012-06-24 11:45:20 +02001712 Although Windows supports :func:`chmod`, you can only set the file's
1713 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1714 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001715
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001716 .. audit-event:: os.chmod path,mode,dir_fd os.chmod
1717
Larry Hastings9cf065c2012-06-22 16:30:09 -07001718 .. versionadded:: 3.3
1719 Added support for specifying *path* as an open file descriptor,
1720 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001721
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001722 .. versionchanged:: 3.6
1723 Accepts a :term:`path-like object`.
1724
Larry Hastings9cf065c2012-06-22 16:30:09 -07001725
1726.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001727
Georg Brandl50c40002012-06-24 11:45:20 +02001728 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1729 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001730
Georg Brandl50c40002012-06-24 11:45:20 +02001731 This function can support :ref:`specifying a file descriptor <path_fd>`,
1732 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1733 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001734
Sandro Tosid902a142011-08-22 23:28:27 +02001735 See :func:`shutil.chown` for a higher-level function that accepts names in
1736 addition to numeric ids.
1737
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001738 .. audit-event:: os.chown path,uid,gid,dir_fd os.chown
1739
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001740 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001741
Larry Hastings9cf065c2012-06-22 16:30:09 -07001742 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04001743 Added support for specifying *path* as an open file descriptor,
Larry Hastings9cf065c2012-06-22 16:30:09 -07001744 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001745
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001746 .. versionchanged:: 3.6
1747 Supports a :term:`path-like object`.
1748
Benjamin Peterson799bd802011-08-31 22:15:17 -04001749
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001750.. function:: chroot(path)
1751
Georg Brandl8a5555f2012-06-24 13:29:09 +02001752 Change the root directory of the current process to *path*.
1753
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001754 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001755
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001756 .. versionchanged:: 3.6
1757 Accepts a :term:`path-like object`.
1758
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001759
1760.. function:: fchdir(fd)
1761
1762 Change the current working directory to the directory represented by the file
1763 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001764 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001765
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001766 .. audit-event:: os.chdir path os.fchdir
1767
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001768 .. availability:: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001769
1770
1771.. function:: getcwd()
1772
1773 Return a string representing the current working directory.
1774
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001775
1776.. function:: getcwdb()
1777
1778 Return a bytestring representing the current working directory.
1779
Victor Stinner689830e2019-06-26 17:31:12 +02001780 .. versionchanged:: 3.8
1781 The function now uses the UTF-8 encoding on Windows, rather than the ANSI
1782 code page: see :pep:`529` for the rationale. The function is no longer
1783 deprecated on Windows.
1784
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001785
Georg Brandl116aa622007-08-15 14:28:22 +00001786.. function:: lchflags(path, flags)
1787
Georg Brandl50c40002012-06-24 11:45:20 +02001788 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001789 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001790 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001791
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001792 .. audit-event:: os.chflags path,flags os.lchflags
1793
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001794 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001795
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001796 .. versionchanged:: 3.6
1797 Accepts a :term:`path-like object`.
1798
Georg Brandl116aa622007-08-15 14:28:22 +00001799
Christian Heimes93852662007-12-01 12:22:32 +00001800.. function:: lchmod(path, mode)
1801
1802 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001803 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001804 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001805 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001806
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001807 .. audit-event:: os.chmod path,mode,dir_fd os.lchmod
1808
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001809 .. availability:: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001810
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001811 .. versionchanged:: 3.6
1812 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001813
Georg Brandl116aa622007-08-15 14:28:22 +00001814.. function:: lchown(path, uid, gid)
1815
Georg Brandl50c40002012-06-24 11:45:20 +02001816 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001817 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001818 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001819
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001820 .. audit-event:: os.chown path,uid,gid,dir_fd os.lchown
1821
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001822 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001823
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001824 .. versionchanged:: 3.6
1825 Accepts a :term:`path-like object`.
1826
Georg Brandl116aa622007-08-15 14:28:22 +00001827
Larry Hastings9cf065c2012-06-22 16:30:09 -07001828.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001829
Larry Hastings9cf065c2012-06-22 16:30:09 -07001830 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001831
Georg Brandlaceaf902012-06-25 08:33:56 +02001832 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1833 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1834 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001835
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001836 .. audit-event:: os.link src,dst,src_dir_fd,dst_dir_fd os.link
1837
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001838 .. availability:: Unix, Windows.
Brian Curtin1b9df392010-11-24 20:24:31 +00001839
1840 .. versionchanged:: 3.2
1841 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001842
Larry Hastings9cf065c2012-06-22 16:30:09 -07001843 .. versionadded:: 3.3
1844 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1845
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001846 .. versionchanged:: 3.6
1847 Accepts a :term:`path-like object` for *src* and *dst*.
1848
Georg Brandl116aa622007-08-15 14:28:22 +00001849
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001850.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001851
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001852 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001853 *path*. The list is in arbitrary order, and does not include the special
1854 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001855
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001856 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1857 (directly or indirectly through the :class:`PathLike` interface),
1858 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001859 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001860
Larry Hastings77892dc2012-06-25 03:27:33 -07001861 This function can also support :ref:`specifying a file descriptor
1862 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001863
Steve Dower44f91c32019-06-27 10:47:59 -07001864 .. audit-event:: os.listdir path os.listdir
Steve Dower60419a72019-06-24 08:42:54 -07001865
Larry Hastingsfdaea062012-06-25 04:42:23 -07001866 .. note::
1867 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1868
Victor Stinner6036e442015-03-08 01:58:04 +01001869 .. seealso::
1870
Victor Stinner51b58322015-05-15 09:12:58 +02001871 The :func:`scandir` function returns directory entries along with
1872 file attribute information, giving better performance for many
1873 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001874
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001875 .. versionchanged:: 3.2
1876 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001877
Larry Hastings9cf065c2012-06-22 16:30:09 -07001878 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04001879 Added support for specifying *path* as an open file descriptor.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001880
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001881 .. versionchanged:: 3.6
1882 Accepts a :term:`path-like object`.
1883
Georg Brandl50c40002012-06-24 11:45:20 +02001884
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001885.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001886
R. David Murray7b1aae92011-01-24 19:34:58 +00001887 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001888 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1889 :class:`stat_result` object.
1890
1891 On platforms that do not support symbolic links, this is an alias for
1892 :func:`~os.stat`.
1893
1894 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1895 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001896
Georg Brandl50c40002012-06-24 11:45:20 +02001897 This function can also support :ref:`paths relative to directory descriptors
1898 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001899
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001900 .. seealso::
1901
Berker Peksag2034caa2015-04-27 13:53:28 +03001902 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001903
Georg Brandlb3823372010-07-10 08:58:37 +00001904 .. versionchanged:: 3.2
1905 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001906
Larry Hastings9cf065c2012-06-22 16:30:09 -07001907 .. versionchanged:: 3.3
1908 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001909
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001910 .. versionchanged:: 3.6
1911 Accepts a :term:`path-like object` for *src* and *dst*.
1912
Steve Dowerdf2d4a62019-08-21 15:27:33 -07001913 .. versionchanged:: 3.8
1914 On Windows, now opens reparse points that represent another path
1915 (name surrogates), including symbolic links and directory junctions.
1916 Other kinds of reparse points are resolved by the operating system as
1917 for :func:`~os.stat`.
1918
Ross Lagerwall7807c352011-03-17 20:20:30 +02001919
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001920.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1921
1922 Create a directory named *path* with numeric mode *mode*.
1923
Tommy Beadle63b91e52016-06-02 15:41:20 -04001924 If the directory already exists, :exc:`FileExistsError` is raised.
1925
1926 .. _mkdir_modebits:
1927
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001928 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001929 value is first masked out. If bits other than the last 9 (i.e. the last 3
1930 digits of the octal representation of the *mode*) are set, their meaning is
1931 platform-dependent. On some platforms, they are ignored and you should call
1932 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001933
1934 This function can also support :ref:`paths relative to directory descriptors
1935 <dir_fd>`.
1936
1937 It is also possible to create temporary directories; see the
1938 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1939
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001940 .. audit-event:: os.mkdir path,mode,dir_fd os.mkdir
1941
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001942 .. versionadded:: 3.3
1943 The *dir_fd* argument.
1944
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001945 .. versionchanged:: 3.6
1946 Accepts a :term:`path-like object`.
1947
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001948
Zachary Warea22ae212014-03-20 09:42:01 -05001949.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001950
1951 .. index::
1952 single: directory; creating
1953 single: UNC paths; and os.makedirs()
1954
1955 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001956 intermediate-level directories needed to contain the leaf directory.
1957
Serhiy Storchakae304e332017-03-24 13:27:42 +02001958 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1959 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1960 is interpreted. To set the file permission bits of any newly-created parent
1961 directories you can set the umask before invoking :func:`makedirs`. The
1962 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001963
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02001964 If *exist_ok* is ``False`` (the default), an :exc:`FileExistsError` is
1965 raised if the target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001966
1967 .. note::
1968
1969 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001970 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001971
1972 This function handles UNC paths correctly.
1973
Saiyang Gou7514f4f2020-02-12 23:47:42 -08001974 .. audit-event:: os.mkdir path,mode,dir_fd os.makedirs
1975
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001976 .. versionadded:: 3.2
1977 The *exist_ok* parameter.
1978
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001979 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001980
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001981 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001982 :func:`makedirs` would still raise an error if *mode* did not match the
1983 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001984 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001985
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001986 .. versionchanged:: 3.6
1987 Accepts a :term:`path-like object`.
1988
Serhiy Storchakae304e332017-03-24 13:27:42 +02001989 .. versionchanged:: 3.7
1990 The *mode* argument no longer affects the file permission bits of
1991 newly-created intermediate-level directories.
1992
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001993
Larry Hastings9cf065c2012-06-22 16:30:09 -07001994.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001995
Larry Hastings9cf065c2012-06-22 16:30:09 -07001996 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1997 The current umask value is first masked out from the mode.
1998
Georg Brandl50c40002012-06-24 11:45:20 +02001999 This function can also support :ref:`paths relative to directory descriptors
2000 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002001
2002 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
2003 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
2004 rendezvous between "client" and "server" type processes: the server opens the
2005 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
2006 doesn't open the FIFO --- it just creates the rendezvous point.
2007
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002008 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002009
Larry Hastings9cf065c2012-06-22 16:30:09 -07002010 .. versionadded:: 3.3
2011 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00002012
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002013 .. versionchanged:: 3.6
2014 Accepts a :term:`path-like object`.
2015
Larry Hastings9cf065c2012-06-22 16:30:09 -07002016
Martin Panterbf19d162015-09-09 01:01:13 +00002017.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002018
2019 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00002020 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00002021 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
2022 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
2023 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
2024 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00002025 :func:`os.makedev`), otherwise it is ignored.
2026
Georg Brandl50c40002012-06-24 11:45:20 +02002027 This function can also support :ref:`paths relative to directory descriptors
2028 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002029
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002030 .. availability:: Unix.
Berker Peksag6129e142016-09-26 22:50:11 +03002031
Larry Hastings9cf065c2012-06-22 16:30:09 -07002032 .. versionadded:: 3.3
2033 The *dir_fd* argument.
2034
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002035 .. versionchanged:: 3.6
2036 Accepts a :term:`path-like object`.
2037
Georg Brandl116aa622007-08-15 14:28:22 +00002038
2039.. function:: major(device)
2040
Christian Heimesfaf2f632008-01-06 16:59:19 +00002041 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00002042 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00002043
Georg Brandl116aa622007-08-15 14:28:22 +00002044
2045.. function:: minor(device)
2046
Christian Heimesfaf2f632008-01-06 16:59:19 +00002047 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00002048 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00002049
Georg Brandl116aa622007-08-15 14:28:22 +00002050
2051.. function:: makedev(major, minor)
2052
Christian Heimesfaf2f632008-01-06 16:59:19 +00002053 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00002054
Georg Brandl116aa622007-08-15 14:28:22 +00002055
Georg Brandl116aa622007-08-15 14:28:22 +00002056.. function:: pathconf(path, name)
2057
2058 Return system configuration information relevant to a named file. *name*
2059 specifies the configuration value to retrieve; it may be a string which is the
2060 name of a defined system value; these names are specified in a number of
2061 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
2062 additional names as well. The names known to the host operating system are
2063 given in the ``pathconf_names`` dictionary. For configuration variables not
2064 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00002065
2066 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
2067 specific value for *name* is not supported by the host system, even if it is
2068 included in ``pathconf_names``, an :exc:`OSError` is raised with
2069 :const:`errno.EINVAL` for the error number.
2070
Larry Hastings77892dc2012-06-25 03:27:33 -07002071 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02002072 <path_fd>`.
2073
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002074 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002075
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002076 .. versionchanged:: 3.6
2077 Accepts a :term:`path-like object`.
2078
Georg Brandl116aa622007-08-15 14:28:22 +00002079
2080.. data:: pathconf_names
2081
2082 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
2083 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02002084 can be used to determine the set of names known to the system.
2085
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002086 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00002087
2088
Larry Hastings9cf065c2012-06-22 16:30:09 -07002089.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002090
2091 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02002092 result may be either an absolute or relative pathname; if it is relative, it
2093 may be converted to an absolute pathname using
2094 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00002095
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002096 If the *path* is a string object (directly or indirectly through a
2097 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00002098 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002099 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00002100
Georg Brandl50c40002012-06-24 11:45:20 +02002101 This function can also support :ref:`paths relative to directory descriptors
2102 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002103
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002104 When trying to resolve a path that may contain links, use
2105 :func:`~os.path.realpath` to properly handle recursion and platform
2106 differences.
2107
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002108 .. availability:: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002109
Georg Brandlb3823372010-07-10 08:58:37 +00002110 .. versionchanged:: 3.2
2111 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002112
Larry Hastings9cf065c2012-06-22 16:30:09 -07002113 .. versionadded:: 3.3
2114 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00002115
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002116 .. versionchanged:: 3.6
Berker Peksage0b5b202018-08-15 13:03:41 +03002117 Accepts a :term:`path-like object` on Unix.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002118
Berker Peksage0b5b202018-08-15 13:03:41 +03002119 .. versionchanged:: 3.8
2120 Accepts a :term:`path-like object` and a bytes object on Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00002121
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002122 .. versionchanged:: 3.8
2123 Added support for directory junctions, and changed to return the
2124 substitution path (which typically includes ``\\?\`` prefix) rather
2125 than the optional "print name" field that was previously returned.
2126
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002127.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002128
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002129 Remove (delete) the file *path*. If *path* is a directory, an
2130 :exc:`IsADirectoryError` is raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002131
Georg Brandl50c40002012-06-24 11:45:20 +02002132 This function can support :ref:`paths relative to directory descriptors
2133 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002134
2135 On Windows, attempting to remove a file that is in use causes an exception to
2136 be raised; on Unix, the directory entry is removed but the storage allocated
2137 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002138
Brett Cannon05039172015-12-28 17:28:19 -08002139 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002140
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002141 .. audit-event:: os.remove path,dir_fd os.remove
2142
Larry Hastings9cf065c2012-06-22 16:30:09 -07002143 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002144 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002145
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002146 .. versionchanged:: 3.6
2147 Accepts a :term:`path-like object`.
2148
Georg Brandl116aa622007-08-15 14:28:22 +00002149
Zachary Warea22ae212014-03-20 09:42:01 -05002150.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00002151
2152 .. index:: single: directory; deleting
2153
Christian Heimesfaf2f632008-01-06 16:59:19 +00002154 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00002155 leaf directory is successfully removed, :func:`removedirs` tries to
2156 successively remove every parent directory mentioned in *path* until an error
2157 is raised (which is ignored, because it generally means that a parent directory
2158 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
2159 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
2160 they are empty. Raises :exc:`OSError` if the leaf directory could not be
2161 successfully removed.
2162
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002163 .. audit-event:: os.remove path,dir_fd os.removedirs
2164
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002165 .. versionchanged:: 3.6
2166 Accepts a :term:`path-like object`.
2167
Georg Brandl116aa622007-08-15 14:28:22 +00002168
Larry Hastings9cf065c2012-06-22 16:30:09 -07002169.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002170
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002171 Rename the file or directory *src* to *dst*. If *dst* exists, the operation
2172 will fail with an :exc:`OSError` subclass in a number of cases:
2173
2174 On Windows, if *dst* exists a :exc:`FileExistsError` is always raised.
2175
Mariatta7cbef722019-07-11 10:31:19 -07002176 On Unix, if *src* is a file and *dst* is a directory or vice-versa, an
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002177 :exc:`IsADirectoryError` or a :exc:`NotADirectoryError` will be raised
2178 respectively. If both are directories and *dst* is empty, *dst* will be
2179 silently replaced. If *dst* is a non-empty directory, an :exc:`OSError`
2180 is raised. If both are files, *dst* it will be replaced silently if the user
2181 has permission. The operation may fail on some Unix flavors if *src* and
2182 *dst* are on different filesystems. If successful, the renaming will be an
2183 atomic operation (this is a POSIX requirement).
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002184
Georg Brandlaceaf902012-06-25 08:33:56 +02002185 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2186 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002187
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002188 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002189
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002190 .. audit-event:: os.rename src,dst,src_dir_fd,dst_dir_fd os.rename
2191
Larry Hastings9cf065c2012-06-22 16:30:09 -07002192 .. versionadded:: 3.3
2193 The *src_dir_fd* and *dst_dir_fd* arguments.
2194
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002195 .. versionchanged:: 3.6
2196 Accepts a :term:`path-like object` for *src* and *dst*.
2197
Georg Brandl116aa622007-08-15 14:28:22 +00002198
2199.. function:: renames(old, new)
2200
2201 Recursive directory or file renaming function. Works like :func:`rename`, except
2202 creation of any intermediate directories needed to make the new pathname good is
2203 attempted first. After the rename, directories corresponding to rightmost path
2204 segments of the old name will be pruned away using :func:`removedirs`.
2205
Georg Brandl116aa622007-08-15 14:28:22 +00002206 .. note::
2207
2208 This function can fail with the new directory structure made if you lack
2209 permissions needed to remove the leaf directory or file.
2210
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002211 .. audit-event:: os.rename src,dst,src_dir_fd,dst_dir_fd os.renames
2212
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002213 .. versionchanged:: 3.6
2214 Accepts a :term:`path-like object` for *old* and *new*.
2215
Georg Brandl116aa622007-08-15 14:28:22 +00002216
Larry Hastings9cf065c2012-06-22 16:30:09 -07002217.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002218
2219 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2220 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
2221 be replaced silently if the user has permission. The operation may fail
2222 if *src* and *dst* are on different filesystems. If successful,
2223 the renaming will be an atomic operation (this is a POSIX requirement).
2224
Georg Brandlaceaf902012-06-25 08:33:56 +02002225 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2226 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002227
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002228 .. audit-event:: os.rename src,dst,src_dir_fd,dst_dir_fd os.replace
2229
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002230 .. versionadded:: 3.3
2231
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002232 .. versionchanged:: 3.6
2233 Accepts a :term:`path-like object` for *src* and *dst*.
2234
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002235
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002236.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002237
Tim Hoffmanna55f75a2019-07-05 10:41:35 +02002238 Remove (delete) the directory *path*. If the directory does not exist or is
2239 not empty, an :exc:`FileNotFoundError` or an :exc:`OSError` is raised
2240 respectively. In order to remove whole directory trees,
2241 :func:`shutil.rmtree` can be used.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002242
Georg Brandl50c40002012-06-24 11:45:20 +02002243 This function can support :ref:`paths relative to directory descriptors
2244 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002245
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002246 .. audit-event:: os.rmdir path,dir_fd os.rmdir
2247
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002248 .. versionadded:: 3.3
2249 The *dir_fd* parameter.
2250
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002251 .. versionchanged:: 3.6
2252 Accepts a :term:`path-like object`.
2253
Georg Brandl116aa622007-08-15 14:28:22 +00002254
Victor Stinner6036e442015-03-08 01:58:04 +01002255.. function:: scandir(path='.')
2256
Brett Cannona32c4d02016-06-24 14:14:44 -07002257 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2258 entries in the directory given by *path*. The entries are yielded in
2259 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2260 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002261
Victor Stinner51b58322015-05-15 09:12:58 +02002262 Using :func:`scandir` instead of :func:`listdir` can significantly
2263 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002264 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002265 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002266 All :class:`os.DirEntry` methods may perform a system call, but
2267 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2268 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002269 always requires a system call on Unix but only requires one for
2270 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002271
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002272 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2273 (directly or indirectly through the :class:`PathLike` interface),
2274 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2275 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2276 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002277
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002278 This function can also support :ref:`specifying a file descriptor
2279 <path_fd>`; the file descriptor must refer to a directory.
2280
Steve Dower44f91c32019-06-27 10:47:59 -07002281 .. audit-event:: os.scandir path os.scandir
Steve Dower60419a72019-06-24 08:42:54 -07002282
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002283 The :func:`scandir` iterator supports the :term:`context manager` protocol
2284 and has the following method:
2285
2286 .. method:: scandir.close()
2287
2288 Close the iterator and free acquired resources.
2289
2290 This is called automatically when the iterator is exhausted or garbage
2291 collected, or when an error happens during iterating. However it
2292 is advisable to call it explicitly or use the :keyword:`with`
2293 statement.
2294
2295 .. versionadded:: 3.6
2296
Victor Stinner6036e442015-03-08 01:58:04 +01002297 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002298 the files (excluding directories) in the given *path* that don't start with
2299 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2300 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002301
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002302 with os.scandir(path) as it:
2303 for entry in it:
2304 if not entry.name.startswith('.') and entry.is_file():
2305 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002306
2307 .. note::
2308
2309 On Unix-based systems, :func:`scandir` uses the system's
2310 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2311 and
2312 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2313 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002314 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002315 and
Georg Brandl5d941342016-02-26 19:37:12 +01002316 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002317 functions.
2318
Victor Stinner6036e442015-03-08 01:58:04 +01002319 .. versionadded:: 3.5
2320
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002321 .. versionadded:: 3.6
2322 Added support for the :term:`context manager` protocol and the
2323 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2324 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2325 in its destructor.
2326
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002327 The function accepts a :term:`path-like object`.
2328
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002329 .. versionchanged:: 3.7
2330 Added support for :ref:`file descriptors <path_fd>` on Unix.
2331
Victor Stinner6036e442015-03-08 01:58:04 +01002332
2333.. class:: DirEntry
2334
2335 Object yielded by :func:`scandir` to expose the file path and other file
2336 attributes of a directory entry.
2337
2338 :func:`scandir` will provide as much of this information as possible without
2339 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002340 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002341
Brett Cannona32c4d02016-06-24 14:14:44 -07002342 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002343 structures; if you know the file metadata has changed or if a long time has
2344 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2345 up-to-date information.
2346
Brett Cannona32c4d02016-06-24 14:14:44 -07002347 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002348 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002349 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002350 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002351
Brett Cannona32c4d02016-06-24 14:14:44 -07002352 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002353 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002354
Brett Cannona32c4d02016-06-24 14:14:44 -07002355 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002356
2357 .. attribute:: name
2358
2359 The entry's base filename, relative to the :func:`scandir` *path*
2360 argument.
2361
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002362 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2363 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002364 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002365
2366 .. attribute:: path
2367
2368 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2369 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2370 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002371 argument was absolute. If the :func:`scandir` *path*
2372 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2373 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002374
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002375 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2376 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002377 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002378
2379 .. method:: inode()
2380
2381 Return the inode number of the entry.
2382
Brett Cannona32c4d02016-06-24 14:14:44 -07002383 The result is cached on the ``os.DirEntry`` object. Use
2384 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2385 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002386
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002387 On the first, uncached call, a system call is required on Windows but
2388 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002389
2390 .. method:: is_dir(\*, follow_symlinks=True)
2391
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002392 Return ``True`` if this entry is a directory or a symbolic link pointing
2393 to a directory; return ``False`` if the entry is or points to any other
2394 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002395
2396 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002397 is a directory (without following symlinks); return ``False`` if the
2398 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002399
Brett Cannona32c4d02016-06-24 14:14:44 -07002400 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002401 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2402 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2403
2404 On the first, uncached call, no system call is required in most cases.
2405 Specifically, for non-symlinks, neither Windows or Unix require a system
2406 call, except on certain Unix file systems, such as network file systems,
2407 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2408 a system call will be required to follow the symlink unless
2409 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002410
Victor Stinner51b58322015-05-15 09:12:58 +02002411 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2412 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002413
Victor Stinner6036e442015-03-08 01:58:04 +01002414 .. method:: is_file(\*, follow_symlinks=True)
2415
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002416 Return ``True`` if this entry is a file or a symbolic link pointing to a
2417 file; return ``False`` if the entry is or points to a directory or other
2418 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002419
2420 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002421 is a file (without following symlinks); return ``False`` if the entry is
2422 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002423
Brett Cannona32c4d02016-06-24 14:14:44 -07002424 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2425 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002426
2427 .. method:: is_symlink()
2428
Victor Stinner51b58322015-05-15 09:12:58 +02002429 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002430 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002431 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002432
Brett Cannona32c4d02016-06-24 14:14:44 -07002433 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002434 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002435
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002436 On the first, uncached call, no system call is required in most cases.
2437 Specifically, neither Windows or Unix require a system call, except on
2438 certain Unix file systems, such as network file systems, that return
2439 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002440
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002441 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2442 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002443
2444 .. method:: stat(\*, follow_symlinks=True)
2445
Victor Stinner51b58322015-05-15 09:12:58 +02002446 Return a :class:`stat_result` object for this entry. This method
2447 follows symbolic links by default; to stat a symbolic link add the
2448 ``follow_symlinks=False`` argument.
2449
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002450 On Unix, this method always requires a system call. On Windows, it
2451 only requires a system call if *follow_symlinks* is ``True`` and the
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002452 entry is a reparse point (for example, a symbolic link or directory
2453 junction).
Victor Stinner6036e442015-03-08 01:58:04 +01002454
2455 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2456 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2457 get these attributes.
2458
Brett Cannona32c4d02016-06-24 14:14:44 -07002459 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002460 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2461 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002462
Guido van Rossum1469d742016-01-06 11:36:03 -08002463 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002464 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002465 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002466 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2467 and ``stat()`` methods.
2468
Victor Stinner6036e442015-03-08 01:58:04 +01002469 .. versionadded:: 3.5
2470
Brett Cannon96881cd2016-06-10 14:37:21 -07002471 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002472 Added support for the :class:`~os.PathLike` interface. Added support
2473 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002474
Victor Stinner6036e442015-03-08 01:58:04 +01002475
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002476.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002477
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002478 Get the status of a file or a file descriptor. Perform the equivalent of a
2479 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002480 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002481 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002482 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002483
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002484 This function normally follows symlinks; to stat a symlink add the argument
2485 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002486
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002487 This function can support :ref:`specifying a file descriptor <path_fd>` and
2488 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002489
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002490 On Windows, passing ``follow_symlinks=False`` will disable following all
2491 name-surrogate reparse points, which includes symlinks and directory
2492 junctions. Other types of reparse points that do not resemble links or that
2493 the operating system is unable to follow will be opened directly. When
2494 following a chain of multiple links, this may result in the original link
2495 being returned instead of the non-link that prevented full traversal. To
2496 obtain stat results for the final path in this case, use the
2497 :func:`os.path.realpath` function to resolve the path name as far as
2498 possible and call :func:`lstat` on the result. This does not apply to
2499 dangling symlinks or junction points, which will raise the usual exceptions.
2500
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002501 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002502
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002503 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002504
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002505 >>> import os
2506 >>> statinfo = os.stat('somefile.txt')
2507 >>> statinfo
2508 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2509 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2510 st_mtime=1297230027, st_ctime=1297230027)
2511 >>> statinfo.st_size
2512 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002513
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002514 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002515
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002516 :func:`fstat` and :func:`lstat` functions.
2517
2518 .. versionadded:: 3.3
2519 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2520 descriptor instead of a path.
2521
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002522 .. versionchanged:: 3.6
2523 Accepts a :term:`path-like object`.
2524
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002525 .. versionchanged:: 3.8
2526 On Windows, all reparse points that can be resolved by the operating
2527 system are now followed, and passing ``follow_symlinks=False``
2528 disables following all name surrogate reparse points. If the operating
2529 system reaches a reparse point that it is not able to follow, *stat* now
2530 returns the information for the original path as if
2531 ``follow_symlinks=False`` had been specified instead of raising an error.
2532
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002533
2534.. class:: stat_result
2535
2536 Object whose attributes correspond roughly to the members of the
2537 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2538 :func:`os.fstat` and :func:`os.lstat`.
2539
2540 Attributes:
2541
2542 .. attribute:: st_mode
2543
2544 File mode: file type and file mode bits (permissions).
2545
2546 .. attribute:: st_ino
2547
Steve Dower3e51a3d2018-05-28 17:24:36 -07002548 Platform dependent, but if non-zero, uniquely identifies the
2549 file for a given value of ``st_dev``. Typically:
2550
2551 * the inode number on Unix,
2552 * the `file index
2553 <https://msdn.microsoft.com/en-us/library/aa363788>`_ on
2554 Windows
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002555
2556 .. attribute:: st_dev
2557
2558 Identifier of the device on which this file resides.
2559
2560 .. attribute:: st_nlink
2561
2562 Number of hard links.
2563
2564 .. attribute:: st_uid
2565
2566 User identifier of the file owner.
2567
2568 .. attribute:: st_gid
2569
2570 Group identifier of the file owner.
2571
2572 .. attribute:: st_size
2573
2574 Size of the file in bytes, if it is a regular file or a symbolic link.
2575 The size of a symbolic link is the length of the pathname it contains,
2576 without a terminating null byte.
2577
2578 Timestamps:
2579
2580 .. attribute:: st_atime
2581
2582 Time of most recent access expressed in seconds.
2583
2584 .. attribute:: st_mtime
2585
2586 Time of most recent content modification expressed in seconds.
2587
2588 .. attribute:: st_ctime
2589
2590 Platform dependent:
2591
2592 * the time of most recent metadata change on Unix,
2593 * the time of creation on Windows, expressed in seconds.
2594
2595 .. attribute:: st_atime_ns
2596
2597 Time of most recent access expressed in nanoseconds as an integer.
2598
2599 .. attribute:: st_mtime_ns
2600
2601 Time of most recent content modification expressed in nanoseconds as an
2602 integer.
2603
2604 .. attribute:: st_ctime_ns
2605
2606 Platform dependent:
2607
2608 * the time of most recent metadata change on Unix,
2609 * the time of creation on Windows, expressed in nanoseconds as an
2610 integer.
2611
Georg Brandl116aa622007-08-15 14:28:22 +00002612 .. note::
2613
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002614 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002615 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2616 system and the file system. For example, on Windows systems using the FAT
2617 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2618 :attr:`st_atime` has only 1-day resolution. See your operating system
2619 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002620
Larry Hastings6fe20b32012-04-19 15:07:49 -07002621 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2622 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2623 systems do not provide nanosecond precision. On systems that do
2624 provide nanosecond precision, the floating-point object used to
2625 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2626 cannot preserve all of it, and as such will be slightly inexact.
2627 If you need the exact timestamps you should always use
2628 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002629
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002630 On some Unix systems (such as Linux), the following attributes may also be
2631 available:
2632
2633 .. attribute:: st_blocks
2634
2635 Number of 512-byte blocks allocated for file.
2636 This may be smaller than :attr:`st_size`/512 when the file has holes.
2637
2638 .. attribute:: st_blksize
2639
2640 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2641 smaller chunks may cause an inefficient read-modify-rewrite.
2642
2643 .. attribute:: st_rdev
2644
2645 Type of device if an inode device.
2646
2647 .. attribute:: st_flags
2648
2649 User defined flags for file.
2650
2651 On other Unix systems (such as FreeBSD), the following attributes may be
2652 available (but may be only filled out if root tries to use them):
2653
2654 .. attribute:: st_gen
2655
2656 File generation number.
2657
2658 .. attribute:: st_birthtime
2659
2660 Time of file creation.
2661
jcea6c51d512018-01-28 14:00:08 +01002662 On Solaris and derivatives, the following attributes may also be
2663 available:
2664
2665 .. attribute:: st_fstype
2666
2667 String that uniquely identifies the type of the filesystem that
2668 contains the file.
2669
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002670 On Mac OS systems, the following attributes may also be available:
2671
2672 .. attribute:: st_rsize
2673
2674 Real size of the file.
2675
2676 .. attribute:: st_creator
2677
2678 Creator of the file.
2679
2680 .. attribute:: st_type
2681
2682 File type.
2683
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002684 On Windows systems, the following attributes are also available:
Victor Stinnere1d24f72014-07-24 12:44:07 +02002685
2686 .. attribute:: st_file_attributes
2687
2688 Windows file attributes: ``dwFileAttributes`` member of the
2689 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2690 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2691 constants in the :mod:`stat` module.
2692
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002693 .. attribute:: st_reparse_tag
2694
2695 When :attr:`st_file_attributes` has the ``FILE_ATTRIBUTE_REPARSE_POINT``
2696 set, this field contains the tag identifying the type of reparse point.
2697 See the ``IO_REPARSE_TAG_*`` constants in the :mod:`stat` module.
2698
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002699 The standard module :mod:`stat` defines functions and constants that are
2700 useful for extracting information from a :c:type:`stat` structure. (On
2701 Windows, some items are filled with dummy values.)
2702
2703 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002704 accessible as a tuple of at least 10 integers giving the most important (and
2705 portable) members of the :c:type:`stat` structure, in the order
2706 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2707 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2708 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002709 some implementations. For compatibility with older Python versions,
2710 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002711
Larry Hastings6fe20b32012-04-19 15:07:49 -07002712 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002713 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2714 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002715
Zachary Ware63f277b2014-06-19 09:46:37 -05002716 .. versionadded:: 3.5
2717 Added the :attr:`st_file_attributes` member on Windows.
2718
Steve Dower3e51a3d2018-05-28 17:24:36 -07002719 .. versionchanged:: 3.5
2720 Windows now returns the file index as :attr:`st_ino` when
2721 available.
2722
jcea6c51d512018-01-28 14:00:08 +01002723 .. versionadded:: 3.7
2724 Added the :attr:`st_fstype` member to Solaris/derivatives.
Georg Brandl116aa622007-08-15 14:28:22 +00002725
Steve Dowerdf2d4a62019-08-21 15:27:33 -07002726 .. versionadded:: 3.8
2727 Added the :attr:`st_reparse_tag` member on Windows.
2728
2729 .. versionchanged:: 3.8
2730 On Windows, the :attr:`st_mode` member now identifies special
2731 files as :const:`S_IFCHR`, :const:`S_IFIFO` or :const:`S_IFBLK`
2732 as appropriate.
2733
Georg Brandl116aa622007-08-15 14:28:22 +00002734.. function:: statvfs(path)
2735
Georg Brandl60203b42010-10-06 10:11:56 +00002736 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002737 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002738 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002739 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2740 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002741 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002742
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002743 Two module-level constants are defined for the :attr:`f_flag` attribute's
2744 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2745 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2746 setuid/setgid bits are disabled or not supported.
2747
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002748 Additional module-level constants are defined for GNU/glibc based systems.
2749 These are :const:`ST_NODEV` (disallow access to device special files),
2750 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2751 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2752 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2753 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2754 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2755 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2756
Georg Brandl50c40002012-06-24 11:45:20 +02002757 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002758
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002759 .. availability:: Unix.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002760
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002761 .. versionchanged:: 3.2
2762 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2763
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002764 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04002765 Added support for specifying *path* as an open file descriptor.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002766
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002767 .. versionchanged:: 3.4
2768 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2769 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2770 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2771 and :const:`ST_RELATIME` constants were added.
2772
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002773 .. versionchanged:: 3.6
2774 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002775
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002776 .. versionadded:: 3.7
2777 Added :attr:`f_fsid`.
2778
Larry Hastings9cf065c2012-06-22 16:30:09 -07002779
2780.. data:: supports_dir_fd
2781
Cheryl Sabellae1521692019-05-06 08:39:13 -04002782 A :class:`set` object indicating which functions in the :mod:`os`
2783 module accept an open file descriptor for their *dir_fd* parameter.
2784 Different platforms provide different features, and the underlying
2785 functionality Python uses to implement the *dir_fd* parameter is not
2786 available on all platforms Python supports. For consistency's sake,
2787 functions that may support *dir_fd* always allow specifying the
2788 parameter, but will throw an exception if the functionality is used
2789 when it's not locally available. (Specifying ``None`` for *dir_fd*
2790 is always supported on all platforms.)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002791
Cheryl Sabellae1521692019-05-06 08:39:13 -04002792 To check whether a particular function accepts an open file descriptor
2793 for its *dir_fd* parameter, use the ``in`` operator on ``supports_dir_fd``.
2794 As an example, this expression evaluates to ``True`` if :func:`os.stat`
2795 accepts open file descriptors for *dir_fd* on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002796
2797 os.stat in os.supports_dir_fd
2798
Cheryl Sabellae1521692019-05-06 08:39:13 -04002799 Currently *dir_fd* parameters only work on Unix platforms;
2800 none of them work on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002801
2802 .. versionadded:: 3.3
2803
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002804
Larry Hastings9cf065c2012-06-22 16:30:09 -07002805.. data:: supports_effective_ids
2806
Cheryl Sabellae1521692019-05-06 08:39:13 -04002807 A :class:`set` object indicating whether :func:`os.access` permits
2808 specifying ``True`` for its *effective_ids* parameter on the local platform.
2809 (Specifying ``False`` for *effective_ids* is always supported on all
2810 platforms.) If the local platform supports it, the collection will contain
2811 :func:`os.access`; otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002812
Cheryl Sabellae1521692019-05-06 08:39:13 -04002813 This expression evaluates to ``True`` if :func:`os.access` supports
2814 ``effective_ids=True`` on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002815
2816 os.access in os.supports_effective_ids
2817
Cheryl Sabellae1521692019-05-06 08:39:13 -04002818 Currently *effective_ids* is only supported on Unix platforms;
2819 it does not work on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002820
2821 .. versionadded:: 3.3
2822
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002823
Larry Hastings9cf065c2012-06-22 16:30:09 -07002824.. data:: supports_fd
2825
Cheryl Sabellae1521692019-05-06 08:39:13 -04002826 A :class:`set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002827 :mod:`os` module permit specifying their *path* parameter as an open file
Cheryl Sabellae1521692019-05-06 08:39:13 -04002828 descriptor on the local platform. Different platforms provide different
2829 features, and the underlying functionality Python uses to accept open file
2830 descriptors as *path* arguments is not available on all platforms Python
2831 supports.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002832
Cheryl Sabellae1521692019-05-06 08:39:13 -04002833 To determine whether a particular function permits specifying an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002834 descriptor for its *path* parameter, use the ``in`` operator on
Cheryl Sabellae1521692019-05-06 08:39:13 -04002835 ``supports_fd``. As an example, this expression evaluates to ``True`` if
2836 :func:`os.chdir` accepts open file descriptors for *path* on your local
Larry Hastings9cf065c2012-06-22 16:30:09 -07002837 platform::
2838
2839 os.chdir in os.supports_fd
2840
2841 .. versionadded:: 3.3
2842
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002843
Larry Hastings9cf065c2012-06-22 16:30:09 -07002844.. data:: supports_follow_symlinks
2845
Cheryl Sabellae1521692019-05-06 08:39:13 -04002846 A :class:`set` object indicating which functions in the :mod:`os` module
2847 accept ``False`` for their *follow_symlinks* parameter on the local platform.
2848 Different platforms provide different features, and the underlying
2849 functionality Python uses to implement *follow_symlinks* is not available
2850 on all platforms Python supports. For consistency's sake, functions that
2851 may support *follow_symlinks* always allow specifying the parameter, but
2852 will throw an exception if the functionality is used when it's not locally
2853 available. (Specifying ``True`` for *follow_symlinks* is always supported
2854 on all platforms.)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002855
Cheryl Sabellae1521692019-05-06 08:39:13 -04002856 To check whether a particular function accepts ``False`` for its
2857 *follow_symlinks* parameter, use the ``in`` operator on
2858 ``supports_follow_symlinks``. As an example, this expression evaluates
2859 to ``True`` if you may specify ``follow_symlinks=False`` when calling
2860 :func:`os.stat` on the local platform::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002861
2862 os.stat in os.supports_follow_symlinks
2863
2864 .. versionadded:: 3.3
2865
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002866
Martin Panterbf19d162015-09-09 01:01:13 +00002867.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002868
Martin Panterbf19d162015-09-09 01:01:13 +00002869 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002870
Larry Hastings9cf065c2012-06-22 16:30:09 -07002871 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002872 morph to the target dynamically. If the target is present, the type of the
2873 symlink will be created to match. Otherwise, the symlink will be created
2874 as a directory if *target_is_directory* is ``True`` or a file symlink (the
l-n-sdaeb3c42018-11-14 00:13:12 +00002875 default) otherwise. On non-Windows platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002876
Georg Brandl50c40002012-06-24 11:45:20 +02002877 This function can support :ref:`paths relative to directory descriptors
2878 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002879
Brian Curtin52173d42010-12-02 18:29:18 +00002880 .. note::
2881
Vidar Tonaas Fauske0e107662019-04-09 20:19:46 +02002882 On newer versions of Windows 10, unprivileged accounts can create symlinks
2883 if Developer Mode is enabled. When Developer Mode is not available/enabled,
2884 the *SeCreateSymbolicLinkPrivilege* privilege is required, or the process
2885 must be run as an administrator.
Brian Curtin96245592010-12-28 17:08:22 +00002886
Jason R. Coombs3a092862013-05-27 23:21:28 -04002887
Brian Curtin96245592010-12-28 17:08:22 +00002888 :exc:`OSError` is raised when the function is called by an unprivileged
2889 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002890
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002891 .. audit-event:: os.symlink src,dst,dir_fd os.symlink
2892
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002893 .. availability:: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002894
Georg Brandlb3823372010-07-10 08:58:37 +00002895 .. versionchanged:: 3.2
2896 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002897
Larry Hastings9cf065c2012-06-22 16:30:09 -07002898 .. versionadded:: 3.3
2899 Added the *dir_fd* argument, and now allow *target_is_directory*
2900 on non-Windows platforms.
2901
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002902 .. versionchanged:: 3.6
2903 Accepts a :term:`path-like object` for *src* and *dst*.
2904
Vidar Tonaas Fauske0e107662019-04-09 20:19:46 +02002905 .. versionchanged:: 3.8
2906 Added support for unelevated symlinks on Windows with Developer Mode.
2907
Georg Brandl116aa622007-08-15 14:28:22 +00002908
Ross Lagerwall7807c352011-03-17 20:20:30 +02002909.. function:: sync()
2910
2911 Force write of everything to disk.
2912
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002913 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002914
2915 .. versionadded:: 3.3
2916
2917
2918.. function:: truncate(path, length)
2919
2920 Truncate the file corresponding to *path*, so that it is at most
2921 *length* bytes in size.
2922
Georg Brandl306336b2012-06-24 12:55:33 +02002923 This function can support :ref:`specifying a file descriptor <path_fd>`.
2924
Steve Dower44f91c32019-06-27 10:47:59 -07002925 .. audit-event:: os.truncate path,length os.truncate
Steve Dowerb82e17e2019-05-23 08:45:22 -07002926
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04002927 .. availability:: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002928
2929 .. versionadded:: 3.3
2930
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002931 .. versionchanged:: 3.5
2932 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002933
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002934 .. versionchanged:: 3.6
2935 Accepts a :term:`path-like object`.
2936
2937
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002938.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002939
Brett Cannon05039172015-12-28 17:28:19 -08002940 Remove (delete) the file *path*. This function is semantically
2941 identical to :func:`remove`; the ``unlink`` name is its
2942 traditional Unix name. Please see the documentation for
2943 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002944
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002945 .. audit-event:: os.remove path,dir_fd os.unlink
2946
Larry Hastings9cf065c2012-06-22 16:30:09 -07002947 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002948 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002949
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002950 .. versionchanged:: 3.6
2951 Accepts a :term:`path-like object`.
2952
Larry Hastings9cf065c2012-06-22 16:30:09 -07002953
Martin Panterbf19d162015-09-09 01:01:13 +00002954.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002955
Larry Hastings76ad59b2012-05-03 00:30:07 -07002956 Set the access and modified times of the file specified by *path*.
2957
2958 :func:`utime` takes two optional parameters, *times* and *ns*.
2959 These specify the times set on *path* and are used as follows:
2960
Martin Panterbf19d162015-09-09 01:01:13 +00002961 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002962 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2963 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002964 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002965 it must be a 2-tuple of the form ``(atime, mtime)``
2966 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002967 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002968 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002969 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002970
Larry Hastings9cf065c2012-06-22 16:30:09 -07002971 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002972
Stéphane Wirtel7508a542018-05-01 12:02:26 +02002973 Note that the exact times you set here may not be returned by a subsequent
2974 :func:`~os.stat` call, depending on the resolution with which your operating
2975 system records access and modification times; see :func:`~os.stat`. The best
2976 way to preserve exact times is to use the *st_atime_ns* and *st_mtime_ns*
2977 fields from the :func:`os.stat` result object with the *ns* parameter to
2978 `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002979
Georg Brandl50c40002012-06-24 11:45:20 +02002980 This function can support :ref:`specifying a file descriptor <path_fd>`,
2981 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2982 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002983
Saiyang Gou7514f4f2020-02-12 23:47:42 -08002984 .. audit-event:: os.utime path,times,ns,dir_fd os.utime
2985
Larry Hastings76ad59b2012-05-03 00:30:07 -07002986 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04002987 Added support for specifying *path* as an open file descriptor,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002988 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002989
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002990 .. versionchanged:: 3.6
2991 Accepts a :term:`path-like object`.
2992
Georg Brandl116aa622007-08-15 14:28:22 +00002993
Georg Brandl18244152009-09-02 20:34:52 +00002994.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002995
2996 .. index::
2997 single: directory; walking
2998 single: directory; traversal
2999
Christian Heimesfaf2f632008-01-06 16:59:19 +00003000 Generate the file names in a directory tree by walking the tree
3001 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00003002 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
3003 filenames)``.
3004
3005 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
3006 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
3007 *filenames* is a list of the names of the non-directory files in *dirpath*.
3008 Note that the names in the lists contain no path components. To get a full path
3009 (which begins with *top*) to a file or directory in *dirpath*, do
3010 ``os.path.join(dirpath, name)``.
3011
Christian Heimesfaf2f632008-01-06 16:59:19 +00003012 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00003013 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07003014 (directories are generated top-down). If *topdown* is ``False``, the triple
3015 for a directory is generated after the triples for all of its subdirectories
3016 (directories are generated bottom-up). No matter the value of *topdown*, the
3017 list of subdirectories is retrieved before the tuples for the directory and
3018 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00003019
Christian Heimesfaf2f632008-01-06 16:59:19 +00003020 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00003021 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
3022 recurse into the subdirectories whose names remain in *dirnames*; this can be
3023 used to prune the search, impose a specific order of visiting, or even to inform
3024 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02003025 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
3026 no effect on the behavior of the walk, because in bottom-up mode the directories
3027 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00003028
Andrés Delfinobadb8942018-04-02 23:48:54 -03003029 By default, errors from the :func:`scandir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00003030 argument *onerror* is specified, it should be a function; it will be called with
3031 one argument, an :exc:`OSError` instance. It can report the error to continue
3032 with the walk, or raise the exception to abort the walk. Note that the filename
3033 is available as the ``filename`` attribute of the exception object.
3034
3035 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00003036 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00003037 symlinks, on systems that support them.
3038
Georg Brandl116aa622007-08-15 14:28:22 +00003039 .. note::
3040
Georg Brandl50c40002012-06-24 11:45:20 +02003041 Be aware that setting *followlinks* to ``True`` can lead to infinite
3042 recursion if a link points to a parent directory of itself. :func:`walk`
3043 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00003044
3045 .. note::
3046
3047 If you pass a relative pathname, don't change the current working directory
3048 between resumptions of :func:`walk`. :func:`walk` never changes the current
3049 directory, and assumes that its caller doesn't either.
3050
3051 This example displays the number of bytes taken by non-directory files in each
3052 directory under the starting directory, except that it doesn't look under any
3053 CVS subdirectory::
3054
3055 import os
3056 from os.path import join, getsize
3057 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00003058 print(root, "consumes", end=" ")
3059 print(sum(getsize(join(root, name)) for name in files), end=" ")
3060 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00003061 if 'CVS' in dirs:
3062 dirs.remove('CVS') # don't visit CVS directories
3063
Victor Stinner47c41b42015-03-10 13:31:47 +01003064 In the next example (simple implementation of :func:`shutil.rmtree`),
3065 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
3066 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00003067
Christian Heimesfaf2f632008-01-06 16:59:19 +00003068 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00003069 # assuming there are no symbolic links.
3070 # CAUTION: This is dangerous! For example, if top == '/', it
3071 # could delete all your disk files.
3072 import os
3073 for root, dirs, files in os.walk(top, topdown=False):
3074 for name in files:
3075 os.remove(os.path.join(root, name))
3076 for name in dirs:
3077 os.rmdir(os.path.join(root, name))
3078
Serhiy Storchakadb283b32020-03-08 14:31:47 +02003079 .. audit-event:: os.walk top,topdown,onerror,followlinks os.walk
3080
Victor Stinner524a5ba2015-03-10 13:20:34 +01003081 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02003082 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
3083 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01003084
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003085 .. versionchanged:: 3.6
3086 Accepts a :term:`path-like object`.
3087
Georg Brandl116aa622007-08-15 14:28:22 +00003088
Larry Hastingsb4038062012-07-15 10:57:38 -07003089.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01003090
3091 .. index::
3092 single: directory; walking
3093 single: directory; traversal
3094
Eli Benderskyd049d5c2012-02-11 09:52:29 +02003095 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07003096 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01003097
3098 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
3099 and *dirfd* is a file descriptor referring to the directory *dirpath*.
3100
Larry Hastingsc48fe982012-06-25 04:49:05 -07003101 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07003102 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07003103 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07003104 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07003105
Charles-François Natali7372b062012-02-05 15:15:38 +01003106 .. note::
3107
3108 Since :func:`fwalk` yields file descriptors, those are only valid until
3109 the next iteration step, so you should duplicate them (e.g. with
3110 :func:`dup`) if you want to keep them longer.
3111
3112 This example displays the number of bytes taken by non-directory files in each
3113 directory under the starting directory, except that it doesn't look under any
3114 CVS subdirectory::
3115
3116 import os
3117 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
3118 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02003119 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01003120 end="")
3121 print("bytes in", len(files), "non-directory files")
3122 if 'CVS' in dirs:
3123 dirs.remove('CVS') # don't visit CVS directories
3124
3125 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003126 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01003127 empty::
3128
3129 # Delete everything reachable from the directory named in "top",
3130 # assuming there are no symbolic links.
3131 # CAUTION: This is dangerous! For example, if top == '/', it
3132 # could delete all your disk files.
3133 import os
3134 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
3135 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003136 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01003137 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02003138 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01003139
Serhiy Storchakadb283b32020-03-08 14:31:47 +02003140 .. audit-event:: os.fwalk top,topdown,onerror,follow_symlinks,dir_fd os.fwalk
3141
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003142 .. availability:: Unix.
Charles-François Natali7372b062012-02-05 15:15:38 +01003143
3144 .. versionadded:: 3.3
3145
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003146 .. versionchanged:: 3.6
3147 Accepts a :term:`path-like object`.
3148
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02003149 .. versionchanged:: 3.7
3150 Added support for :class:`bytes` paths.
3151
Charles-François Natali7372b062012-02-05 15:15:38 +01003152
Zackery Spytz43fdbd22019-05-29 13:57:07 -06003153.. function:: memfd_create(name[, flags=os.MFD_CLOEXEC])
3154
3155 Create an anonymous file and return a file descriptor that refers to it.
3156 *flags* must be one of the ``os.MFD_*`` constants available on the system
3157 (or a bitwise ORed combination of them). By default, the new file
3158 descriptor is :ref:`non-inheritable <fd_inheritance>`.
3159
Victor Stinnerccf0efb2019-06-05 12:24:52 +02003160 The name supplied in *name* is used as a filename and will be displayed as
3161 the target of the corresponding symbolic link in the directory
3162 ``/proc/self/fd/``. The displayed name is always prefixed with ``memfd:``
3163 and serves only for debugging purposes. Names do not affect the behavior of
3164 the file descriptor, and as such multiple files can have the same name
3165 without any side effects.
3166
Zackery Spytz43fdbd22019-05-29 13:57:07 -06003167 .. availability:: Linux 3.17 or newer with glibc 2.27 or newer.
3168
3169 .. versionadded:: 3.8
3170
3171
3172.. data:: MFD_CLOEXEC
3173 MFD_ALLOW_SEALING
3174 MFD_HUGETLB
3175 MFD_HUGE_SHIFT
3176 MFD_HUGE_MASK
3177 MFD_HUGE_64KB
3178 MFD_HUGE_512KB
3179 MFD_HUGE_1MB
3180 MFD_HUGE_2MB
3181 MFD_HUGE_8MB
3182 MFD_HUGE_16MB
3183 MFD_HUGE_32MB
3184 MFD_HUGE_256MB
3185 MFD_HUGE_512MB
3186 MFD_HUGE_1GB
3187 MFD_HUGE_2GB
3188 MFD_HUGE_16GB
3189
3190 These flags can be passed to :func:`memfd_create`.
3191
3192 .. availability:: Linux 3.17 or newer with glibc 2.27 or newer. The
3193 ``MFD_HUGE*`` flags are only available since Linux 4.14.
3194
3195 .. versionadded:: 3.8
3196
3197
Georg Brandlb9831ab2012-06-24 11:57:07 +02003198Linux extended attributes
3199~~~~~~~~~~~~~~~~~~~~~~~~~
3200
3201.. versionadded:: 3.3
3202
3203These functions are all available on Linux only.
3204
3205.. function:: getxattr(path, attribute, *, follow_symlinks=True)
3206
3207 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003208 *path*. *attribute* can be bytes or str (directly or indirectly through the
3209 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
3210 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003211
3212 This function can support :ref:`specifying a file descriptor <path_fd>` and
3213 :ref:`not following symlinks <follow_symlinks>`.
3214
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003215 .. audit-event:: os.getxattr path,attribute os.getxattr
3216
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003217 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03003218 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003219
Georg Brandlb9831ab2012-06-24 11:57:07 +02003220
3221.. function:: listxattr(path=None, *, follow_symlinks=True)
3222
3223 Return a list of the extended filesystem attributes on *path*. The
3224 attributes in the list are represented as strings decoded with the filesystem
3225 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
3226 directory.
3227
3228 This function can support :ref:`specifying a file descriptor <path_fd>` and
3229 :ref:`not following symlinks <follow_symlinks>`.
3230
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003231 .. audit-event:: os.listxattr path os.listxattr
3232
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003233 .. versionchanged:: 3.6
3234 Accepts a :term:`path-like object`.
3235
Georg Brandlb9831ab2012-06-24 11:57:07 +02003236
3237.. function:: removexattr(path, attribute, *, follow_symlinks=True)
3238
3239 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003240 *attribute* should be bytes or str (directly or indirectly through the
3241 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02003242 with the filesystem encoding.
3243
3244 This function can support :ref:`specifying a file descriptor <path_fd>` and
3245 :ref:`not following symlinks <follow_symlinks>`.
3246
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003247 .. audit-event:: os.removexattr path,attribute os.removexattr
3248
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003249 .. versionchanged:: 3.6
3250 Accepts a :term:`path-like object` for *path* and *attribute*.
3251
Georg Brandlb9831ab2012-06-24 11:57:07 +02003252
3253.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
3254
3255 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003256 *attribute* must be a bytes or str with no embedded NULs (directly or
3257 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02003258 it is encoded with the filesystem encoding. *flags* may be
3259 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
3260 given and the attribute does not exist, ``EEXISTS`` will be raised.
3261 If :data:`XATTR_CREATE` is given and the attribute already exists, the
3262 attribute will not be created and ``ENODATA`` will be raised.
3263
3264 This function can support :ref:`specifying a file descriptor <path_fd>` and
3265 :ref:`not following symlinks <follow_symlinks>`.
3266
3267 .. note::
3268
3269 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
3270 to be ignored on some filesystems.
3271
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003272 .. audit-event:: os.setxattr path,attribute,value,flags os.setxattr
3273
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003274 .. versionchanged:: 3.6
3275 Accepts a :term:`path-like object` for *path* and *attribute*.
3276
Georg Brandlb9831ab2012-06-24 11:57:07 +02003277
3278.. data:: XATTR_SIZE_MAX
3279
3280 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02003281 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003282
3283
3284.. data:: XATTR_CREATE
3285
3286 This is a possible value for the flags argument in :func:`setxattr`. It
3287 indicates the operation must create an attribute.
3288
3289
3290.. data:: XATTR_REPLACE
3291
3292 This is a possible value for the flags argument in :func:`setxattr`. It
3293 indicates the operation must replace an existing attribute.
3294
3295
Georg Brandl116aa622007-08-15 14:28:22 +00003296.. _os-process:
3297
3298Process Management
3299------------------
3300
3301These functions may be used to create and manage processes.
3302
Serhiy Storchakadab83542013-10-13 20:12:43 +03003303The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00003304program loaded into the process. In each case, the first of these arguments is
3305passed to the new program as its own name rather than as an argument a user may
3306have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00003307passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00003308['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
3309to be ignored.
3310
3311
3312.. function:: abort()
3313
3314 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
3315 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02003316 an exit code of ``3``. Be aware that calling this function will not call the
3317 Python signal handler registered for :const:`SIGABRT` with
3318 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003319
Georg Brandl116aa622007-08-15 14:28:22 +00003320
Steve Dower2438cdf2019-03-29 16:37:16 -07003321.. function:: add_dll_directory(path)
3322
3323 Add a path to the DLL search path.
3324
3325 This search path is used when resolving dependencies for imported
3326 extension modules (the module itself is resolved through sys.path),
3327 and also by :mod:`ctypes`.
3328
3329 Remove the directory by calling **close()** on the returned object
3330 or using it in a :keyword:`with` statement.
3331
3332 See the `Microsoft documentation
3333 <https://msdn.microsoft.com/44228cf2-6306-466c-8f16-f513cd3ba8b5>`_
3334 for more information about how DLLs are loaded.
3335
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003336 .. audit-event:: os.add_dll_directory path os.add_dll_directory
3337
Steve Dower2438cdf2019-03-29 16:37:16 -07003338 .. availability:: Windows.
3339
3340 .. versionadded:: 3.8
3341 Previous versions of CPython would resolve DLLs using the default
3342 behavior for the current process. This led to inconsistencies,
3343 such as only sometimes searching :envvar:`PATH` or the current
3344 working directory, and OS functions such as ``AddDllDirectory``
3345 having no effect.
3346
3347 In 3.8, the two primary ways DLLs are loaded now explicitly
3348 override the process-wide behavior to ensure consistency. See the
3349 :ref:`porting notes <bpo-36085-whatsnew>` for information on
3350 updating libraries.
3351
3352
Georg Brandl116aa622007-08-15 14:28:22 +00003353.. function:: execl(path, arg0, arg1, ...)
3354 execle(path, arg0, arg1, ..., env)
3355 execlp(file, arg0, arg1, ...)
3356 execlpe(file, arg0, arg1, ..., env)
3357 execv(path, args)
3358 execve(path, args, env)
3359 execvp(file, args)
3360 execvpe(file, args, env)
3361
3362 These functions all execute a new program, replacing the current process; they
3363 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00003364 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00003365 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003366
3367 The current process is replaced immediately. Open file objects and
3368 descriptors are not flushed, so if there may be data buffered
3369 on these open files, you should flush them using
3370 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03003371 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00003372
Serhiy Storchakadab83542013-10-13 20:12:43 +03003373 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003374 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003375 to work with if the number of parameters is fixed when the code is written; the
3376 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003377 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00003378 variable, with the arguments being passed in a list or tuple as the *args*
3379 parameter. In either case, the arguments to the child process should start with
3380 the name of the command being run, but this is not enforced.
3381
Christian Heimesfaf2f632008-01-06 16:59:19 +00003382 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003383 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
3384 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003385 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003386 discussed in the next paragraph), the new environment is used as the source of
3387 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
3388 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
3389 locate the executable; *path* must contain an appropriate absolute or relative
3390 path.
3391
3392 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00003393 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00003394 used to define the environment variables for the new process (these are used
3395 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00003396 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003397 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003398
Larry Hastings9cf065c2012-06-22 16:30:09 -07003399 For :func:`execve` on some platforms, *path* may also be specified as an open
3400 file descriptor. This functionality may not be supported on your platform;
3401 you can check whether or not it is available using :data:`os.supports_fd`.
3402 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3403
Saiyang Gou95f60012020-02-04 16:15:00 -08003404 .. audit-event:: os.exec path,args,env os.execl
3405
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003406 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003407
Larry Hastings9cf065c2012-06-22 16:30:09 -07003408 .. versionadded:: 3.3
Cheryl Sabellae1521692019-05-06 08:39:13 -04003409 Added support for specifying *path* as an open file descriptor
Larry Hastings9cf065c2012-06-22 16:30:09 -07003410 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003411
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003412 .. versionchanged:: 3.6
3413 Accepts a :term:`path-like object`.
3414
Georg Brandl116aa622007-08-15 14:28:22 +00003415.. function:: _exit(n)
3416
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003417 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003418 stdio buffers, etc.
3419
Georg Brandl116aa622007-08-15 14:28:22 +00003420 .. note::
3421
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003422 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3423 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003424
Christian Heimesfaf2f632008-01-06 16:59:19 +00003425The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003426although they are not required. These are typically used for system programs
3427written in Python, such as a mail server's external command delivery program.
3428
3429.. note::
3430
3431 Some of these may not be available on all Unix platforms, since there is some
3432 variation. These constants are defined where they are defined by the underlying
3433 platform.
3434
3435
3436.. data:: EX_OK
3437
Benjamin Petersonf650e462010-05-06 23:03:05 +00003438 Exit code that means no error occurred.
3439
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003440 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003441
Georg Brandl116aa622007-08-15 14:28:22 +00003442
3443.. data:: EX_USAGE
3444
3445 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003446 number of arguments are given.
3447
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003448 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003449
Georg Brandl116aa622007-08-15 14:28:22 +00003450
3451.. data:: EX_DATAERR
3452
Benjamin Petersonf650e462010-05-06 23:03:05 +00003453 Exit code that means the input data was incorrect.
3454
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003455 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003456
Georg Brandl116aa622007-08-15 14:28:22 +00003457
3458.. data:: EX_NOINPUT
3459
3460 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003461
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003462 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003463
Georg Brandl116aa622007-08-15 14:28:22 +00003464
3465.. data:: EX_NOUSER
3466
Benjamin Petersonf650e462010-05-06 23:03:05 +00003467 Exit code that means a specified user did not exist.
3468
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003469 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003470
Georg Brandl116aa622007-08-15 14:28:22 +00003471
3472.. data:: EX_NOHOST
3473
Benjamin Petersonf650e462010-05-06 23:03:05 +00003474 Exit code that means a specified host did not exist.
3475
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003476 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003477
Georg Brandl116aa622007-08-15 14:28:22 +00003478
3479.. data:: EX_UNAVAILABLE
3480
Benjamin Petersonf650e462010-05-06 23:03:05 +00003481 Exit code that means that a required service is unavailable.
3482
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003483 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003484
Georg Brandl116aa622007-08-15 14:28:22 +00003485
3486.. data:: EX_SOFTWARE
3487
Benjamin Petersonf650e462010-05-06 23:03:05 +00003488 Exit code that means an internal software error was detected.
3489
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003490 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003491
Georg Brandl116aa622007-08-15 14:28:22 +00003492
3493.. data:: EX_OSERR
3494
3495 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003496 inability to fork or create a pipe.
3497
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003498 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003499
Georg Brandl116aa622007-08-15 14:28:22 +00003500
3501.. data:: EX_OSFILE
3502
3503 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003504 some other kind of error.
3505
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003506 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003507
Georg Brandl116aa622007-08-15 14:28:22 +00003508
3509.. data:: EX_CANTCREAT
3510
3511 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003512
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003513 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003514
Georg Brandl116aa622007-08-15 14:28:22 +00003515
3516.. data:: EX_IOERR
3517
3518 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003519
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003520 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003521
Georg Brandl116aa622007-08-15 14:28:22 +00003522
3523.. data:: EX_TEMPFAIL
3524
3525 Exit code that means a temporary failure occurred. This indicates something
3526 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003527 made during a retryable operation.
3528
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003529 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003530
Georg Brandl116aa622007-08-15 14:28:22 +00003531
3532.. data:: EX_PROTOCOL
3533
3534 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003535 understood.
3536
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003537 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003538
Georg Brandl116aa622007-08-15 14:28:22 +00003539
3540.. data:: EX_NOPERM
3541
3542 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003543 operation (but not intended for file system problems).
3544
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003545 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003546
Georg Brandl116aa622007-08-15 14:28:22 +00003547
3548.. data:: EX_CONFIG
3549
3550 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003551
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003552 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003553
Georg Brandl116aa622007-08-15 14:28:22 +00003554
3555.. data:: EX_NOTFOUND
3556
Benjamin Petersonf650e462010-05-06 23:03:05 +00003557 Exit code that means something like "an entry was not found".
3558
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003559 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003560
Georg Brandl116aa622007-08-15 14:28:22 +00003561
3562.. function:: fork()
3563
Christian Heimesfaf2f632008-01-06 16:59:19 +00003564 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003565 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003566
Larry Hastings3732ed22014-03-15 21:13:56 -07003567 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Phil Connellb2203002019-11-15 16:56:03 +00003568 known issues when using ``fork()`` from a thread.
3569
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003570 .. audit-event:: os.fork "" os.fork
3571
Phil Connellb2203002019-11-15 16:56:03 +00003572 .. versionchanged:: 3.8
3573 Calling ``fork()`` in a subinterpreter is no longer supported
3574 (:exc:`RuntimeError` is raised).
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003575
Christian Heimes3046fe42013-10-29 21:08:56 +01003576 .. warning::
3577
3578 See :mod:`ssl` for applications that use the SSL module with fork().
3579
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003580 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003581
3582
3583.. function:: forkpty()
3584
3585 Fork a child process, using a new pseudo-terminal as the child's controlling
3586 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3587 new child's process id in the parent, and *fd* is the file descriptor of the
3588 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003589 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003590
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003591 .. audit-event:: os.forkpty "" os.forkpty
3592
Phil Connellb2203002019-11-15 16:56:03 +00003593 .. versionchanged:: 3.8
3594 Calling ``forkpty()`` in a subinterpreter is no longer supported
3595 (:exc:`RuntimeError` is raised).
3596
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003597 .. availability:: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003598
3599
3600.. function:: kill(pid, sig)
3601
3602 .. index::
3603 single: process; killing
3604 single: process; signalling
3605
3606 Send signal *sig* to the process *pid*. Constants for the specific signals
3607 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003608
3609 Windows: The :data:`signal.CTRL_C_EVENT` and
3610 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3611 only be sent to console processes which share a common console window,
3612 e.g., some subprocesses. Any other value for *sig* will cause the process
3613 to be unconditionally killed by the TerminateProcess API, and the exit code
3614 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3615 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003616
Victor Stinnerb3e72192011-05-08 01:46:11 +02003617 See also :func:`signal.pthread_kill`.
3618
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003619 .. audit-event:: os.kill pid,sig os.kill
3620
Georg Brandl67b21b72010-08-17 15:07:14 +00003621 .. versionadded:: 3.2
3622 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003623
Georg Brandl116aa622007-08-15 14:28:22 +00003624
3625.. function:: killpg(pgid, sig)
3626
3627 .. index::
3628 single: process; killing
3629 single: process; signalling
3630
Benjamin Petersonf650e462010-05-06 23:03:05 +00003631 Send the signal *sig* to the process group *pgid*.
3632
Saiyang Gou7514f4f2020-02-12 23:47:42 -08003633 .. audit-event:: os.killpg pgid,sig os.killpg
3634
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003635 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003636
Georg Brandl116aa622007-08-15 14:28:22 +00003637
3638.. function:: nice(increment)
3639
3640 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003641
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003642 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003643
3644
Benjamin Peterson6c4c45e2019-11-05 19:21:29 -08003645.. function:: pidfd_open(pid, flags=0)
3646
3647 Return a file descriptor referring to the process *pid*. This descriptor can
3648 be used to perform process management without races and signals. The *flags*
3649 argument is provided for future extensions; no flag values are currently
3650 defined.
3651
3652 See the :manpage:`pidfd_open(2)` man page for more details.
3653
3654 .. availability:: Linux 5.3+
3655 .. versionadded:: 3.9
3656
3657
Georg Brandl116aa622007-08-15 14:28:22 +00003658.. function:: plock(op)
3659
3660 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003661 ``<sys/lock.h>``) determines which segments are locked.
3662
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003663 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003664
3665
Martin Panterbf19d162015-09-09 01:01:13 +00003666.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003667
Martin Panterbf19d162015-09-09 01:01:13 +00003668 Open a pipe to or from command *cmd*.
3669 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003670 connected to the pipe, which can be read or written depending on whether *mode*
3671 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3672 the corresponding argument to the built-in :func:`open` function. The
3673 returned file object reads or writes text strings rather than bytes.
3674
3675 The ``close`` method returns :const:`None` if the subprocess exited
3676 successfully, or the subprocess's return code if there was an
3677 error. On POSIX systems, if the return code is positive it
3678 represents the return value of the process left-shifted by one
3679 byte. If the return code is negative, the process was terminated
3680 by the signal given by the negated value of the return code. (For
3681 example, the return value might be ``- signal.SIGKILL`` if the
3682 subprocess was killed.) On Windows systems, the return value
3683 contains the signed integer return code from the child process.
3684
Victor Stinner65a796e2020-04-01 18:49:29 +02003685 On Unix, :func:`waitstatus_to_exitcode` can be used to convert the ``close``
3686 method result (exit status) into an exit code if it is not ``None``. On
3687 Windows, the ``close`` method result is directly the exit code
3688 (or ``None``).
3689
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003690 This is implemented using :class:`subprocess.Popen`; see that class's
3691 documentation for more powerful ways to manage and communicate with
3692 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003693
3694
Serhiy Storchakad700f972018-09-08 14:48:18 +03003695.. function:: posix_spawn(path, argv, env, *, file_actions=None, \
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003696 setpgroup=None, resetids=False, setsid=False, setsigmask=(), \
Pablo Galindo254a4662018-09-07 16:44:24 +01003697 setsigdef=(), scheduler=None)
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003698
Serhiy Storchakaef347532018-05-01 16:45:04 +03003699 Wraps the :c:func:`posix_spawn` C library API for use from Python.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003700
Serhiy Storchakaef347532018-05-01 16:45:04 +03003701 Most users should use :func:`subprocess.run` instead of :func:`posix_spawn`.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003702
Serhiy Storchakad700f972018-09-08 14:48:18 +03003703 The positional-only arguments *path*, *args*, and *env* are similar to
3704 :func:`execve`.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003705
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003706 The *path* parameter is the path to the executable file.The *path* should
3707 contain a directory.Use :func:`posix_spawnp` to pass an executable file
3708 without directory.
3709
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003710 The *file_actions* argument may be a sequence of tuples describing actions
3711 to take on specific file descriptors in the child process between the C
Serhiy Storchakaef347532018-05-01 16:45:04 +03003712 library implementation's :c:func:`fork` and :c:func:`exec` steps.
3713 The first item in each tuple must be one of the three type indicator
3714 listed below describing the remaining tuple elements:
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003715
Serhiy Storchakaef347532018-05-01 16:45:04 +03003716 .. data:: POSIX_SPAWN_OPEN
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003717
Serhiy Storchakaef347532018-05-01 16:45:04 +03003718 (``os.POSIX_SPAWN_OPEN``, *fd*, *path*, *flags*, *mode*)
3719
3720 Performs ``os.dup2(os.open(path, flags, mode), fd)``.
3721
3722 .. data:: POSIX_SPAWN_CLOSE
3723
3724 (``os.POSIX_SPAWN_CLOSE``, *fd*)
3725
3726 Performs ``os.close(fd)``.
3727
3728 .. data:: POSIX_SPAWN_DUP2
3729
3730 (``os.POSIX_SPAWN_DUP2``, *fd*, *new_fd*)
3731
3732 Performs ``os.dup2(fd, new_fd)``.
3733
3734 These tuples correspond to the C library
3735 :c:func:`posix_spawn_file_actions_addopen`,
3736 :c:func:`posix_spawn_file_actions_addclose`, and
3737 :c:func:`posix_spawn_file_actions_adddup2` API calls used to prepare
3738 for the :c:func:`posix_spawn` call itself.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003739
Pablo Galindo254a4662018-09-07 16:44:24 +01003740 The *setpgroup* argument will set the process group of the child to the value
3741 specified. If the value specified is 0, the child's process group ID will be
3742 made the same as its process ID. If the value of *setpgroup* is not set, the
3743 child will inherit the parent's process group ID. This argument corresponds
3744 to the C library :c:data:`POSIX_SPAWN_SETPGROUP` flag.
3745
3746 If the *resetids* argument is ``True`` it will reset the effective UID and
3747 GID of the child to the real UID and GID of the parent process. If the
3748 argument is ``False``, then the child retains the effective UID and GID of
3749 the parent. In either case, if the set-user-ID and set-group-ID permission
3750 bits are enabled on the executable file, their effect will override the
3751 setting of the effective UID and GID. This argument corresponds to the C
3752 library :c:data:`POSIX_SPAWN_RESETIDS` flag.
3753
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003754 If the *setsid* argument is ``True``, it will create a new session ID
3755 for `posix_spawn`. *setsid* requires :c:data:`POSIX_SPAWN_SETSID`
3756 or :c:data:`POSIX_SPAWN_SETSID_NP` flag. Otherwise, :exc:`NotImplementedError`
3757 is raised.
3758
Pablo Galindo254a4662018-09-07 16:44:24 +01003759 The *setsigmask* argument will set the signal mask to the signal set
3760 specified. If the parameter is not used, then the child inherits the
3761 parent's signal mask. This argument corresponds to the C library
3762 :c:data:`POSIX_SPAWN_SETSIGMASK` flag.
3763
3764 The *sigdef* argument will reset the disposition of all signals in the set
3765 specified. This argument corresponds to the C library
3766 :c:data:`POSIX_SPAWN_SETSIGDEF` flag.
3767
3768 The *scheduler* argument must be a tuple containing the (optional) scheduler
3769 policy and an instance of :class:`sched_param` with the scheduler parameters.
3770 A value of ``None`` in the place of the scheduler policy indicates that is
3771 not being provided. This argument is a combination of the C library
3772 :c:data:`POSIX_SPAWN_SETSCHEDPARAM` and :c:data:`POSIX_SPAWN_SETSCHEDULER`
3773 flags.
3774
Saiyang Gou95f60012020-02-04 16:15:00 -08003775 .. audit-event:: os.posix_spawn path,argv,env os.posix_spawn
3776
Mark Williams8b504002019-03-03 09:42:25 -08003777 .. versionadded:: 3.8
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003778
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003779 .. availability:: Unix.
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003780
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003781.. function:: posix_spawnp(path, argv, env, *, file_actions=None, \
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003782 setpgroup=None, resetids=False, setsid=False, setsigmask=(), \
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003783 setsigdef=(), scheduler=None)
3784
3785 Wraps the :c:func:`posix_spawnp` C library API for use from Python.
3786
3787 Similar to :func:`posix_spawn` except that the system searches
3788 for the *executable* file in the list of directories specified by the
3789 :envvar:`PATH` environment variable (in the same way as for ``execvp(3)``).
3790
Saiyang Gou95f60012020-02-04 16:15:00 -08003791 .. audit-event:: os.posix_spawn path,argv,env os.posix_spawnp
3792
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003793 .. versionadded:: 3.8
3794
Joannah Nanjekye80c5dfe2019-02-01 13:05:22 +03003795 .. availability:: See :func:`posix_spawn` documentation.
3796
Joannah Nanjekye92b83222019-01-16 16:29:26 +03003797
Gregory P. Smith163468a2017-05-29 10:03:41 -07003798.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3799 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003800
Gregory P. Smith163468a2017-05-29 10:03:41 -07003801 Register callables to be executed when a new child process is forked
3802 using :func:`os.fork` or similar process cloning APIs.
3803 The parameters are optional and keyword-only.
3804 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003805
Gregory P. Smith163468a2017-05-29 10:03:41 -07003806 * *before* is a function called before forking a child process.
3807 * *after_in_parent* is a function called from the parent process
3808 after forking a child process.
3809 * *after_in_child* is a function called from the child process.
3810
3811 These calls are only made if control is expected to return to the
3812 Python interpreter. A typical :mod:`subprocess` launch will not
3813 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003814
3815 Functions registered for execution before forking are called in
3816 reverse registration order. Functions registered for execution
3817 after forking (either in the parent or in the child) are called
3818 in registration order.
3819
3820 Note that :c:func:`fork` calls made by third-party C code may not
3821 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3822 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3823
Gregory P. Smith163468a2017-05-29 10:03:41 -07003824 There is no way to unregister a function.
3825
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003826 .. availability:: Unix.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003827
3828 .. versionadded:: 3.7
3829
3830
Georg Brandl116aa622007-08-15 14:28:22 +00003831.. function:: spawnl(mode, path, ...)
3832 spawnle(mode, path, ..., env)
3833 spawnlp(mode, file, ...)
3834 spawnlpe(mode, file, ..., env)
3835 spawnv(mode, path, args)
3836 spawnve(mode, path, args, env)
3837 spawnvp(mode, file, args)
3838 spawnvpe(mode, file, args, env)
3839
3840 Execute the program *path* in a new process.
3841
3842 (Note that the :mod:`subprocess` module provides more powerful facilities for
3843 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003844 preferable to using these functions. Check especially the
3845 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003846
Christian Heimesfaf2f632008-01-06 16:59:19 +00003847 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003848 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3849 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003850 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003851 be used with the :func:`waitpid` function.
3852
pxinwrf2d7ac72019-05-21 18:46:37 +08003853 Note on VxWorks, this function doesn't return ``-signal`` when the new process is
3854 killed. Instead it raises OSError exception.
3855
Serhiy Storchakadab83542013-10-13 20:12:43 +03003856 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003857 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003858 to work with if the number of parameters is fixed when the code is written; the
3859 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003860 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003861 parameters is variable, with the arguments being passed in a list or tuple as
3862 the *args* parameter. In either case, the arguments to the child process must
3863 start with the name of the command being run.
3864
Christian Heimesfaf2f632008-01-06 16:59:19 +00003865 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003866 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3867 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003868 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003869 discussed in the next paragraph), the new environment is used as the source of
3870 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3871 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3872 :envvar:`PATH` variable to locate the executable; *path* must contain an
3873 appropriate absolute or relative path.
3874
3875 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003876 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003877 which is used to define the environment variables for the new process (they are
3878 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003879 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003880 the new process to inherit the environment of the current process. Note that
3881 keys and values in the *env* dictionary must be strings; invalid keys or
3882 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003883
3884 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3885 equivalent::
3886
3887 import os
3888 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3889
3890 L = ['cp', 'index.html', '/dev/null']
3891 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3892
Saiyang Gou95f60012020-02-04 16:15:00 -08003893 .. audit-event:: os.spawn mode,path,args,env os.spawnl
3894
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003895 .. availability:: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
3896 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3897 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3898 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003899
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003900 .. versionchanged:: 3.6
3901 Accepts a :term:`path-like object`.
3902
Georg Brandl116aa622007-08-15 14:28:22 +00003903
3904.. data:: P_NOWAIT
3905 P_NOWAITO
3906
Serhiy Storchakadab83542013-10-13 20:12:43 +03003907 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003908 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003909 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003910 the return value.
3911
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003912 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003913
Georg Brandl116aa622007-08-15 14:28:22 +00003914
3915.. data:: P_WAIT
3916
Serhiy Storchakadab83542013-10-13 20:12:43 +03003917 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003918 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3919 return until the new process has run to completion and will return the exit code
3920 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003921 process.
3922
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003923 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003924
Georg Brandl116aa622007-08-15 14:28:22 +00003925
3926.. data:: P_DETACH
3927 P_OVERLAY
3928
Serhiy Storchakadab83542013-10-13 20:12:43 +03003929 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003930 functions. These are less portable than those listed above. :const:`P_DETACH`
3931 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3932 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003933 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003934
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003935 .. availability:: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003936
Georg Brandl116aa622007-08-15 14:28:22 +00003937
3938.. function:: startfile(path[, operation])
3939
3940 Start a file with its associated application.
3941
3942 When *operation* is not specified or ``'open'``, this acts like double-clicking
3943 the file in Windows Explorer, or giving the file name as an argument to the
3944 :program:`start` command from the interactive command shell: the file is opened
3945 with whatever application (if any) its extension is associated.
3946
3947 When another *operation* is given, it must be a "command verb" that specifies
3948 what should be done with the file. Common verbs documented by Microsoft are
3949 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3950 ``'find'`` (to be used on directories).
3951
3952 :func:`startfile` returns as soon as the associated application is launched.
3953 There is no option to wait for the application to close, and no way to retrieve
3954 the application's exit status. The *path* parameter is relative to the current
3955 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003956 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003957 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003958 the path is properly encoded for Win32.
3959
Steve Dower7d0e0c92015-01-24 08:18:24 -08003960 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3961 function is not resolved until this function is first called. If the function
3962 cannot be resolved, :exc:`NotImplementedError` will be raised.
3963
Saiyang Gou95f60012020-02-04 16:15:00 -08003964 .. audit-event:: os.startfile path,operation os.startfile
3965
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003966 .. availability:: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003967
Georg Brandl116aa622007-08-15 14:28:22 +00003968
3969.. function:: system(command)
3970
3971 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003972 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003973 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3974 the executed command. If *command* generates any output, it will be sent to
3975 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003976
3977 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003978 format specified for :func:`wait`. Note that POSIX does not specify the
3979 meaning of the return value of the C :c:func:`system` function, so the return
3980 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003981
Georg Brandl8f7b4272010-10-14 06:35:53 +00003982 On Windows, the return value is that returned by the system shell after
3983 running *command*. The shell is given by the Windows environment variable
3984 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3985 status of the command run; on systems using a non-native shell, consult your
3986 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003987
Georg Brandl8f7b4272010-10-14 06:35:53 +00003988 The :mod:`subprocess` module provides more powerful facilities for spawning
3989 new processes and retrieving their results; using that module is preferable
3990 to using this function. See the :ref:`subprocess-replacements` section in
3991 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003992
Victor Stinner65a796e2020-04-01 18:49:29 +02003993 On Unix, :func:`waitstatus_to_exitcode` can be used to convert the result
3994 (exit status) into an exit code. On Windows, the result is directly the exit
3995 code.
3996
Steve Dower44f91c32019-06-27 10:47:59 -07003997 .. audit-event:: os.system command os.system
Steve Dowerb82e17e2019-05-23 08:45:22 -07003998
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04003999 .. availability:: Unix, Windows.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004000
Georg Brandl116aa622007-08-15 14:28:22 +00004001
4002.. function:: times()
4003
Larry Hastings605a62d2012-06-24 04:33:36 -07004004 Returns the current global process times.
4005 The return value is an object with five attributes:
4006
4007 * :attr:`user` - user time
4008 * :attr:`system` - system time
4009 * :attr:`children_user` - user time of all child processes
4010 * :attr:`children_system` - system time of all child processes
4011 * :attr:`elapsed` - elapsed real time since a fixed point in the past
4012
4013 For backwards compatibility, this object also behaves like a five-tuple
4014 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
4015 :attr:`children_system`, and :attr:`elapsed` in that order.
4016
4017 See the Unix manual page
Joannah Nanjekye3ccdbc32019-09-07 04:05:29 -03004018 :manpage:`times(2)` and :manpage:`times(3)` manual page on Unix or `the GetProcessTimes MSDN
Roger Hurwitz37c55b22020-02-10 14:50:19 -08004019 <https://docs.microsoft.com/windows/win32/api/processthreadsapi/nf-processthreadsapi-getprocesstimes>`_
4020 on Windows. On Windows, only :attr:`user` and :attr:`system` are known; the other attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004021
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004022 .. availability:: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00004023
Larry Hastings605a62d2012-06-24 04:33:36 -07004024 .. versionchanged:: 3.3
4025 Return type changed from a tuple to a tuple-like object
4026 with named attributes.
4027
Georg Brandl116aa622007-08-15 14:28:22 +00004028
4029.. function:: wait()
4030
4031 Wait for completion of a child process, and return a tuple containing its pid
4032 and exit status indication: a 16-bit number, whose low byte is the signal number
4033 that killed the process, and whose high byte is the exit status (if the signal
4034 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00004035 produced.
4036
Victor Stinner65a796e2020-04-01 18:49:29 +02004037 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4038 exit code.
4039
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004040 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004041
Victor Stinner65a796e2020-04-01 18:49:29 +02004042 .. seealso::
4043
4044 :func:`waitpid` can be used to wait for the completion of a specific
4045 child process and has more options.
4046
Ross Lagerwall7807c352011-03-17 20:20:30 +02004047.. function:: waitid(idtype, id, options)
4048
4049 Wait for the completion of one or more child processes.
Benjamin Peterson5c0c3252019-11-05 21:58:31 -08004050 *idtype* can be :data:`P_PID`, :data:`P_PGID`, :data:`P_ALL`, or
4051 :data:`P_PIDFD` on Linux.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004052 *id* specifies the pid to wait on.
4053 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
4054 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
4055 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
4056 representing the data contained in the :c:type:`siginfo_t` structure, namely:
4057 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
4058 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
4059 children in a waitable state.
4060
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004061 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004062
4063 .. versionadded:: 3.3
4064
4065.. data:: P_PID
4066 P_PGID
4067 P_ALL
4068
4069 These are the possible values for *idtype* in :func:`waitid`. They affect
4070 how *id* is interpreted.
4071
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004072 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004073
4074 .. versionadded:: 3.3
4075
Benjamin Peterson5c0c3252019-11-05 21:58:31 -08004076.. data:: P_PIDFD
4077
4078 This is a Linux-specific *idtype* that indicates that *id* is a file
4079 descriptor that refers to a process.
4080
4081 .. availability:: Linux 5.4+
4082
4083 .. versionadded:: 3.9
4084
Ross Lagerwall7807c352011-03-17 20:20:30 +02004085.. data:: WEXITED
4086 WSTOPPED
4087 WNOWAIT
4088
4089 Flags that can be used in *options* in :func:`waitid` that specify what
4090 child signal to wait for.
4091
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004092 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004093
4094 .. versionadded:: 3.3
4095
4096
4097.. data:: CLD_EXITED
Dong-hee Na2eba6ad2019-10-21 16:01:05 +09004098 CLD_KILLED
Ross Lagerwall7807c352011-03-17 20:20:30 +02004099 CLD_DUMPED
4100 CLD_TRAPPED
Dong-hee Na2eba6ad2019-10-21 16:01:05 +09004101 CLD_STOPPED
Ross Lagerwall7807c352011-03-17 20:20:30 +02004102 CLD_CONTINUED
4103
4104 These are the possible values for :attr:`si_code` in the result returned by
4105 :func:`waitid`.
4106
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004107 .. availability:: Unix.
Ross Lagerwall7807c352011-03-17 20:20:30 +02004108
4109 .. versionadded:: 3.3
4110
Dong-hee Na2eba6ad2019-10-21 16:01:05 +09004111 .. versionchanged:: 3.9
4112 Added :data:`CLD_KILLED` and :data:`CLD_STOPPED` values.
4113
Georg Brandl116aa622007-08-15 14:28:22 +00004114
4115.. function:: waitpid(pid, options)
4116
4117 The details of this function differ on Unix and Windows.
4118
4119 On Unix: Wait for completion of a child process given by process id *pid*, and
4120 return a tuple containing its process id and exit status indication (encoded as
4121 for :func:`wait`). The semantics of the call are affected by the value of the
4122 integer *options*, which should be ``0`` for normal operation.
4123
4124 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
4125 that specific process. If *pid* is ``0``, the request is for the status of any
4126 child in the process group of the current process. If *pid* is ``-1``, the
4127 request pertains to any child of the current process. If *pid* is less than
4128 ``-1``, status is requested for any process in the process group ``-pid`` (the
4129 absolute value of *pid*).
4130
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00004131 An :exc:`OSError` is raised with the value of errno when the syscall
4132 returns -1.
4133
Georg Brandl116aa622007-08-15 14:28:22 +00004134 On Windows: Wait for completion of a process given by process handle *pid*, and
4135 return a tuple containing *pid*, and its exit status shifted left by 8 bits
4136 (shifting makes cross-platform use of the function easier). A *pid* less than or
4137 equal to ``0`` has no special meaning on Windows, and raises an exception. The
4138 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03004139 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
4140 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00004141
Victor Stinner65a796e2020-04-01 18:49:29 +02004142 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4143 exit code.
4144
Victor Stinnera766ddf2015-03-26 23:50:57 +01004145 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02004146 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01004147 exception, the function now retries the system call instead of raising an
4148 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
4149
Georg Brandl116aa622007-08-15 14:28:22 +00004150
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02004151.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00004152
4153 Similar to :func:`waitpid`, except no process id argument is given and a
Serhiy Storchaka3f819ca2018-10-31 02:26:06 +02004154 3-element tuple containing the child's process id, exit status indication,
4155 and resource usage information is returned. Refer to
4156 :mod:`resource`.\ :func:`~resource.getrusage` for details on resource usage
4157 information. The option argument is the same as that provided to
4158 :func:`waitpid` and :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004159
Victor Stinner65a796e2020-04-01 18:49:29 +02004160 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4161 exitcode.
4162
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004163 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004164
Georg Brandl116aa622007-08-15 14:28:22 +00004165
Victor Stinner4195b5c2012-02-08 23:03:19 +01004166.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00004167
4168 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
4169 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03004170 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
4171 resource usage information. The arguments to :func:`wait4` are the same
4172 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004173
Victor Stinner65a796e2020-04-01 18:49:29 +02004174 :func:`waitstatus_to_exitcode` can be used to convert the exit status into an
4175 exitcode.
4176
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004177 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004178
Georg Brandl116aa622007-08-15 14:28:22 +00004179
Victor Stinner65a796e2020-04-01 18:49:29 +02004180.. function:: waitstatus_to_exitcode(status)
4181
4182 Convert a wait status to an exit code.
4183
4184 On Unix:
4185
4186 * If the process exited normally (if ``WIFEXITED(status)`` is true),
4187 return the process exit status (return ``WEXITSTATUS(status)``):
4188 result greater than or equal to 0.
4189 * If the process was terminated by a signal (if ``WIFSIGNALED(status)`` is
4190 true), return ``-signum`` where *signum* is the number of the signal that
4191 caused the process to terminate (return ``-WTERMSIG(status)``):
4192 result less than 0.
4193 * Otherwise, raise a :exc:`ValueError`.
4194
4195 On Windows, return *status* shifted right by 8 bits.
4196
4197 On Unix, if the process is being traced or if :func:`waitpid` was called
4198 with :data:`WUNTRACED` option, the caller must first check if
4199 ``WIFSTOPPED(status)`` is true. This function must not be called if
4200 ``WIFSTOPPED(status)`` is true.
4201
4202 .. seealso::
4203
4204 :func:`WIFEXITED`, :func:`WEXITSTATUS`, :func:`WIFSIGNALED`,
4205 :func:`WTERMSIG`, :func:`WIFSTOPPED`, :func:`WSTOPSIG` functions.
4206
4207 .. versionadded:: 3.9
4208
4209
Georg Brandl116aa622007-08-15 14:28:22 +00004210.. data:: WNOHANG
4211
4212 The option for :func:`waitpid` to return immediately if no child process status
4213 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004214
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004215 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004216
4217
4218.. data:: WCONTINUED
4219
4220 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00004221 from a job control stop since their status was last reported.
4222
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004223 .. availability:: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00004224
Georg Brandl116aa622007-08-15 14:28:22 +00004225
4226.. data:: WUNTRACED
4227
4228 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00004229 their current state has not been reported since they were stopped.
4230
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004231 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004232
Georg Brandl116aa622007-08-15 14:28:22 +00004233
4234The following functions take a process status code as returned by
4235:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
4236used to determine the disposition of a process.
4237
Georg Brandl116aa622007-08-15 14:28:22 +00004238.. function:: WCOREDUMP(status)
4239
Christian Heimesfaf2f632008-01-06 16:59:19 +00004240 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00004241 return ``False``.
4242
Victor Stinner7c723832020-04-01 15:48:05 +02004243 This function should be employed only if :func:`WIFSIGNALED` is true.
4244
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004245 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004246
Georg Brandl116aa622007-08-15 14:28:22 +00004247
4248.. function:: WIFCONTINUED(status)
4249
Victor Stinner7c723832020-04-01 15:48:05 +02004250 Return ``True`` if a stopped child has been resumed by delivery of
4251 :data:`~signal.SIGCONT` (if the process has been continued from a job
4252 control stop), otherwise return ``False``.
4253
4254 See :data:`WCONTINUED` option.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004255
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004256 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004257
Georg Brandl116aa622007-08-15 14:28:22 +00004258
4259.. function:: WIFSTOPPED(status)
4260
Victor Stinner7c723832020-04-01 15:48:05 +02004261 Return ``True`` if the process was stopped by delivery of a signal,
4262 otherwise return ``False``.
4263
4264 :func:`WIFSTOPPED` only returns ``True`` if the :func:`waitpid` call was
4265 done using :data:`WUNTRACED` option or when the process is being traced (see
4266 :manpage:`ptrace(2)`).
Benjamin Petersonf650e462010-05-06 23:03:05 +00004267
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004268 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004269
Georg Brandl116aa622007-08-15 14:28:22 +00004270.. function:: WIFSIGNALED(status)
4271
Victor Stinner7c723832020-04-01 15:48:05 +02004272 Return ``True`` if the process was terminated by a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00004273 ``False``.
4274
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004275 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004276
4277
4278.. function:: WIFEXITED(status)
4279
Victor Stinner7c723832020-04-01 15:48:05 +02004280 Return ``True`` if the process exited terminated normally, that is,
4281 by calling ``exit()`` or ``_exit()``, or by returning from ``main()``;
Benjamin Petersonf650e462010-05-06 23:03:05 +00004282 otherwise return ``False``.
4283
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004284 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004285
4286
4287.. function:: WEXITSTATUS(status)
4288
Victor Stinner7c723832020-04-01 15:48:05 +02004289 Return the process exit status.
4290
4291 This function should be employed only if :func:`WIFEXITED` is true.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004292
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004293 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004294
4295
4296.. function:: WSTOPSIG(status)
4297
Benjamin Petersonf650e462010-05-06 23:03:05 +00004298 Return the signal which caused the process to stop.
4299
Victor Stinner7c723832020-04-01 15:48:05 +02004300 This function should be employed only if :func:`WIFSTOPPED` is true.
4301
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004302 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004303
4304
4305.. function:: WTERMSIG(status)
4306
Victor Stinner7c723832020-04-01 15:48:05 +02004307 Return the number of the signal that caused the process to terminate.
4308
4309 This function should be employed only if :func:`WIFSIGNALED` is true.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004310
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004311 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004312
4313
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004314Interface to the scheduler
4315--------------------------
4316
4317These functions control how a process is allocated CPU time by the operating
4318system. They are only available on some Unix platforms. For more detailed
4319information, consult your Unix manpages.
4320
4321.. versionadded:: 3.3
4322
Andrew Kuchling4921a082013-06-21 11:49:57 -04004323The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004324operating system.
4325
4326.. data:: SCHED_OTHER
4327
4328 The default scheduling policy.
4329
4330.. data:: SCHED_BATCH
4331
4332 Scheduling policy for CPU-intensive processes that tries to preserve
4333 interactivity on the rest of the computer.
4334
4335.. data:: SCHED_IDLE
4336
4337 Scheduling policy for extremely low priority background tasks.
4338
4339.. data:: SCHED_SPORADIC
4340
4341 Scheduling policy for sporadic server programs.
4342
4343.. data:: SCHED_FIFO
4344
4345 A First In First Out scheduling policy.
4346
4347.. data:: SCHED_RR
4348
4349 A round-robin scheduling policy.
4350
4351.. data:: SCHED_RESET_ON_FORK
4352
Martin Panter8d56c022016-05-29 04:13:35 +00004353 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004354 this flag set forks, its child's scheduling policy and priority are reset to
4355 the default.
4356
4357
4358.. class:: sched_param(sched_priority)
4359
4360 This class represents tunable scheduling parameters used in
4361 :func:`sched_setparam`, :func:`sched_setscheduler`, and
4362 :func:`sched_getparam`. It is immutable.
4363
4364 At the moment, there is only one possible parameter:
4365
4366 .. attribute:: sched_priority
4367
4368 The scheduling priority for a scheduling policy.
4369
4370
4371.. function:: sched_get_priority_min(policy)
4372
4373 Get the minimum priority value for *policy*. *policy* is one of the
4374 scheduling policy constants above.
4375
4376
4377.. function:: sched_get_priority_max(policy)
4378
4379 Get the maximum priority value for *policy*. *policy* is one of the
4380 scheduling policy constants above.
4381
4382
4383.. function:: sched_setscheduler(pid, policy, param)
4384
4385 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
4386 the calling process. *policy* is one of the scheduling policy constants
4387 above. *param* is a :class:`sched_param` instance.
4388
4389
4390.. function:: sched_getscheduler(pid)
4391
4392 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
4393 means the calling process. The result is one of the scheduling policy
4394 constants above.
4395
4396
4397.. function:: sched_setparam(pid, param)
4398
4399 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
4400 the calling process. *param* is a :class:`sched_param` instance.
4401
4402
4403.. function:: sched_getparam(pid)
4404
4405 Return the scheduling parameters as a :class:`sched_param` instance for the
4406 process with PID *pid*. A *pid* of 0 means the calling process.
4407
4408
4409.. function:: sched_rr_get_interval(pid)
4410
4411 Return the round-robin quantum in seconds for the process with PID *pid*. A
4412 *pid* of 0 means the calling process.
4413
4414
4415.. function:: sched_yield()
4416
4417 Voluntarily relinquish the CPU.
4418
4419
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004420.. function:: sched_setaffinity(pid, mask)
4421
Antoine Pitrou84869872012-08-04 16:16:35 +02004422 Restrict the process with PID *pid* (or the current process if zero) to a
4423 set of CPUs. *mask* is an iterable of integers representing the set of
4424 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004425
4426
Antoine Pitrou84869872012-08-04 16:16:35 +02004427.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004428
Antoine Pitrou84869872012-08-04 16:16:35 +02004429 Return the set of CPUs the process with PID *pid* (or the current process
4430 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05004431
4432
Georg Brandl116aa622007-08-15 14:28:22 +00004433.. _os-path:
4434
4435Miscellaneous System Information
4436--------------------------------
4437
4438
4439.. function:: confstr(name)
4440
4441 Return string-valued system configuration values. *name* specifies the
4442 configuration value to retrieve; it may be a string which is the name of a
4443 defined system value; these names are specified in a number of standards (POSIX,
4444 Unix 95, Unix 98, and others). Some platforms define additional names as well.
4445 The names known to the host operating system are given as the keys of the
4446 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00004447 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00004448
4449 If the configuration value specified by *name* isn't defined, ``None`` is
4450 returned.
4451
4452 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
4453 specific value for *name* is not supported by the host system, even if it is
4454 included in ``confstr_names``, an :exc:`OSError` is raised with
4455 :const:`errno.EINVAL` for the error number.
4456
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004457 .. availability:: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004458
Georg Brandl116aa622007-08-15 14:28:22 +00004459
4460.. data:: confstr_names
4461
4462 Dictionary mapping names accepted by :func:`confstr` to the integer values
4463 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004464 determine the set of names known to the system.
4465
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004466 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004467
4468
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004469.. function:: cpu_count()
4470
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03004471 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004472
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01004473 This number is not equivalent to the number of CPUs the current process can
4474 use. The number of usable CPUs can be obtained with
4475 ``len(os.sched_getaffinity(0))``
4476
4477
Charles-Francois Natali44feda32013-05-20 14:40:46 +02004478 .. versionadded:: 3.4
4479
4480
Georg Brandl116aa622007-08-15 14:28:22 +00004481.. function:: getloadavg()
4482
Christian Heimesa62da1d2008-01-12 19:39:10 +00004483 Return the number of processes in the system run queue averaged over the last
4484 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00004485 unobtainable.
4486
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004487 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004488
Georg Brandl116aa622007-08-15 14:28:22 +00004489
4490.. function:: sysconf(name)
4491
4492 Return integer-valued system configuration values. If the configuration value
4493 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
4494 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
4495 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004496
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004497 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004498
4499
4500.. data:: sysconf_names
4501
4502 Dictionary mapping names accepted by :func:`sysconf` to the integer values
4503 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004504 determine the set of names known to the system.
4505
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004506 .. availability:: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004507
Christian Heimesfaf2f632008-01-06 16:59:19 +00004508The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00004509are defined for all platforms.
4510
4511Higher-level operations on pathnames are defined in the :mod:`os.path` module.
4512
4513
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004514.. index:: single: . (dot); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004515.. data:: curdir
4516
4517 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00004518 directory. This is ``'.'`` for Windows and POSIX. Also available via
4519 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004520
4521
Serhiy Storchakaddb961d2018-10-26 09:00:49 +03004522.. index:: single: ..; in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004523.. data:: pardir
4524
4525 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00004526 directory. This is ``'..'`` for Windows and POSIX. Also available via
4527 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004528
4529
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004530.. index:: single: / (slash); in pathnames
4531.. index:: single: \ (backslash); in pathnames (Windows)
Georg Brandl116aa622007-08-15 14:28:22 +00004532.. data:: sep
4533
Georg Brandlc575c902008-09-13 17:46:05 +00004534 The character used by the operating system to separate pathname components.
4535 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
4536 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00004537 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
4538 useful. Also available via :mod:`os.path`.
4539
4540
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004541.. index:: single: / (slash); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004542.. data:: altsep
4543
4544 An alternative character used by the operating system to separate pathname
4545 components, or ``None`` if only one separator character exists. This is set to
4546 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
4547 :mod:`os.path`.
4548
4549
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004550.. index:: single: . (dot); in pathnames
Georg Brandl116aa622007-08-15 14:28:22 +00004551.. data:: extsep
4552
4553 The character which separates the base filename from the extension; for example,
4554 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
4555
Georg Brandl116aa622007-08-15 14:28:22 +00004556
Serhiy Storchaka913876d2018-10-28 13:41:26 +02004557.. index:: single: : (colon); path separator (POSIX)
4558 single: ; (semicolon)
Georg Brandl116aa622007-08-15 14:28:22 +00004559.. data:: pathsep
4560
4561 The character conventionally used by the operating system to separate search
4562 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
4563 Windows. Also available via :mod:`os.path`.
4564
4565
4566.. data:: defpath
4567
Serhiy Storchakadab83542013-10-13 20:12:43 +03004568 The default search path used by :func:`exec\*p\* <execl>` and
4569 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
4570 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004571
4572
4573.. data:: linesep
4574
4575 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00004576 platform. This may be a single character, such as ``'\n'`` for POSIX, or
4577 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
4578 *os.linesep* as a line terminator when writing files opened in text mode (the
4579 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00004580
4581
4582.. data:: devnull
4583
Georg Brandl850a9902010-05-21 22:04:32 +00004584 The file path of the null device. For example: ``'/dev/null'`` for
4585 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004586
Andrew Kuchling4921a082013-06-21 11:49:57 -04004587.. data:: RTLD_LAZY
4588 RTLD_NOW
4589 RTLD_GLOBAL
4590 RTLD_LOCAL
4591 RTLD_NODELETE
4592 RTLD_NOLOAD
4593 RTLD_DEEPBIND
4594
4595 Flags for use with the :func:`~sys.setdlopenflags` and
4596 :func:`~sys.getdlopenflags` functions. See the Unix manual page
4597 :manpage:`dlopen(3)` for what the different flags mean.
4598
4599 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00004600
Georg Brandl116aa622007-08-15 14:28:22 +00004601
Victor Stinner9b1f4742016-09-06 16:18:52 -07004602Random numbers
4603--------------
Georg Brandl116aa622007-08-15 14:28:22 +00004604
4605
Victor Stinner9b1f4742016-09-06 16:18:52 -07004606.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00004607
Victor Stinner9b1f4742016-09-06 16:18:52 -07004608 Get up to *size* random bytes. The function can return less bytes than
4609 requested.
4610
4611 These bytes can be used to seed user-space random number generators or for
4612 cryptographic purposes.
4613
4614 ``getrandom()`` relies on entropy gathered from device drivers and other
4615 sources of environmental noise. Unnecessarily reading large quantities of
4616 data will have a negative impact on other users of the ``/dev/random`` and
4617 ``/dev/urandom`` devices.
4618
4619 The flags argument is a bit mask that can contain zero or more of the
4620 following values ORed together: :py:data:`os.GRND_RANDOM` and
4621 :py:data:`GRND_NONBLOCK`.
4622
4623 See also the `Linux getrandom() manual page
4624 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
4625
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04004626 .. availability:: Linux 3.17 and newer.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004627
4628 .. versionadded:: 3.6
4629
4630.. function:: urandom(size)
4631
4632 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004633
4634 This function returns random bytes from an OS-specific randomness source. The
4635 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004636 though its exact quality depends on the OS implementation.
4637
Victor Stinnere66987e2016-09-06 16:33:52 -07004638 On Linux, if the ``getrandom()`` syscall is available, it is used in
4639 blocking mode: block until the system urandom entropy pool is initialized
4640 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4641 the rationale. On Linux, the :func:`getrandom` function can be used to get
4642 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4643 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004644
Victor Stinnere66987e2016-09-06 16:33:52 -07004645 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4646 device. If the ``/dev/urandom`` device is not available or not readable, the
4647 :exc:`NotImplementedError` exception is raised.
4648
4649 On Windows, it will use ``CryptGenRandom()``.
4650
4651 .. seealso::
4652 The :mod:`secrets` module provides higher level functions. For an
4653 easy-to-use interface to the random number generator provided by your
4654 platform, please see :class:`random.SystemRandom`.
4655
4656 .. versionchanged:: 3.6.0
4657 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4658 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004659
Victor Stinnerdddf4842016-06-07 11:21:42 +02004660 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004661 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4662 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004663
Victor Stinnerace88482015-07-29 02:28:32 +02004664 .. versionchanged:: 3.5
4665 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4666 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4667 function is now used. These functions avoid the usage of an internal file
4668 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004669
4670.. data:: GRND_NONBLOCK
4671
4672 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4673 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4674 if the entropy pool has not yet been initialized.
4675
4676 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4677 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4678
4679 .. versionadded:: 3.6
4680
4681.. data:: GRND_RANDOM
4682
4683 If this bit is set, then random bytes are drawn from the
4684 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4685
4686 .. versionadded:: 3.6