blob: 95c81137230816e76f14661cd30b0875fd91f82a [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
Benjamin Peterson1baf4652009-12-31 03:11:23 +000035* An "Availability: Unix" note means that this function is commonly found on
36 Unix systems. It does not make any claims about its existence on a specific
37 operating system.
38
39* If not separately noted, all functions that claim "Availability: Unix" are
40 supported on Mac OS X, which builds on a Unix core.
41
Benjamin Petersonf650e462010-05-06 23:03:05 +000042.. Availability notes get their own line and occur at the end of the function
43.. documentation.
44
Georg Brandlc575c902008-09-13 17:46:05 +000045.. note::
46
Christian Heimesa62da1d2008-01-12 19:39:10 +000047 All functions in this module raise :exc:`OSError` in the case of invalid or
48 inaccessible file names and paths, or other arguments that have the correct
49 type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000050
Georg Brandl116aa622007-08-15 14:28:22 +000051.. exception:: error
52
Christian Heimesa62da1d2008-01-12 19:39:10 +000053 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000054
55
56.. data:: name
57
Benjamin Peterson1baf4652009-12-31 03:11:23 +000058 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070059 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070060 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000061
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020062 .. seealso::
63 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
64 system-dependent version information.
65
66 The :mod:`platform` module provides detailed checks for the
67 system's identity.
68
Georg Brandl116aa622007-08-15 14:28:22 +000069
Martin v. Löwis011e8422009-05-05 04:43:17 +000070.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020071.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000072
73File Names, Command Line Arguments, and Environment Variables
74-------------------------------------------------------------
75
Georg Brandl67b21b72010-08-17 15:07:14 +000076In Python, file names, command line arguments, and environment variables are
77represented using the string type. On some systems, decoding these strings to
78and from bytes is necessary before passing them to the operating system. Python
79uses the file system encoding to perform this conversion (see
80:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000081
82.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000083 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020084 case, Python uses the :ref:`surrogateescape encoding error handler
85 <surrogateescape>`, which means that undecodable bytes are replaced by a
86 Unicode character U+DCxx on decoding, and these are again translated to the
87 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000088
89
Georg Brandl67b21b72010-08-17 15:07:14 +000090The file system encoding must guarantee to successfully decode all bytes
91below 128. If the file system encoding fails to provide this guarantee, API
92functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000093
94
Georg Brandl116aa622007-08-15 14:28:22 +000095.. _os-procinfo:
96
97Process Parameters
98------------------
99
100These functions and data items provide information and operate on the current
101process and user.
102
103
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200104.. function:: ctermid()
105
106 Return the filename corresponding to the controlling terminal of the process.
107
108 Availability: Unix.
109
110
Georg Brandl116aa622007-08-15 14:28:22 +0000111.. data:: environ
112
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700113 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000114 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
115 and is equivalent to ``getenv("HOME")`` in C.
116
117 This mapping is captured the first time the :mod:`os` module is imported,
118 typically during Python startup as part of processing :file:`site.py`. Changes
119 to the environment made after this time are not reflected in ``os.environ``,
120 except for changes made by modifying ``os.environ`` directly.
121
122 If the platform supports the :func:`putenv` function, this mapping may be used
123 to modify the environment as well as query the environment. :func:`putenv` will
124 be called automatically when the mapping is modified.
125
Victor Stinner84ae1182010-05-06 22:05:07 +0000126 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
127 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
128 to use a different encoding.
129
Georg Brandl116aa622007-08-15 14:28:22 +0000130 .. note::
131
132 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
133 to modify ``os.environ``.
134
135 .. note::
136
Georg Brandlc575c902008-09-13 17:46:05 +0000137 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
138 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000139 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000140
141 If :func:`putenv` is not provided, a modified copy of this mapping may be
142 passed to the appropriate process-creation functions to cause child processes
143 to use a modified environment.
144
Georg Brandl9afde1c2007-11-01 20:32:30 +0000145 If the platform supports the :func:`unsetenv` function, you can delete items in
Georg Brandl116aa622007-08-15 14:28:22 +0000146 this mapping to unset environment variables. :func:`unsetenv` will be called
Georg Brandl9afde1c2007-11-01 20:32:30 +0000147 automatically when an item is deleted from ``os.environ``, and when
148 one of the :meth:`pop` or :meth:`clear` methods is called.
149
Georg Brandl116aa622007-08-15 14:28:22 +0000150
Victor Stinner84ae1182010-05-06 22:05:07 +0000151.. data:: environb
152
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700153 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000154 environment as byte strings. :data:`environ` and :data:`environb` are
155 synchronized (modify :data:`environb` updates :data:`environ`, and vice
156 versa).
157
Victor Stinnerb745a742010-05-18 17:17:23 +0000158 :data:`environb` is only available if :data:`supports_bytes_environ` is
159 True.
Victor Stinner84ae1182010-05-06 22:05:07 +0000160
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000161 .. versionadded:: 3.2
162
Victor Stinner84ae1182010-05-06 22:05:07 +0000163
Georg Brandl116aa622007-08-15 14:28:22 +0000164.. function:: chdir(path)
165 fchdir(fd)
166 getcwd()
167 :noindex:
168
169 These functions are described in :ref:`os-file-dir`.
170
171
Victor Stinnere8d51452010-08-19 01:05:19 +0000172.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000173
Brett Cannonc28592b2016-06-24 12:21:47 -0700174 Encode :term:`path-like <path-like object>` *filename* to the filesystem
175 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
176 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000177
Antoine Pitroua305ca72010-09-25 22:12:00 +0000178 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000179
180 .. versionadded:: 3.2
181
Brett Cannonb08388d2016-06-09 15:58:06 -0700182 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700183 Support added to accept objects implementing the :class:`os.PathLike`
184 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700185
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187.. function:: fsdecode(filename)
188
Brett Cannonc28592b2016-06-24 12:21:47 -0700189 Decode the :term:`path-like <path-like object>` *filename* from the
190 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
191 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000192
193 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000194
195 .. versionadded:: 3.2
196
Brett Cannonb08388d2016-06-09 15:58:06 -0700197 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700198 Support added to accept objects implementing the :class:`os.PathLike`
199 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700200
Victor Stinner449c4662010-05-08 11:10:09 +0000201
Ethan Furmancdc08792016-06-02 15:06:09 -0700202.. function:: fspath(path)
203
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700204 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700205
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700206 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
207 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
208 returned as long as it is a :class:`str` or :class:`bytes` object.
209 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700210
Brett Cannonb08388d2016-06-09 15:58:06 -0700211 .. versionadded:: 3.6
212
213
214.. class:: PathLike
215
216 An :term:`abstract base class` for objects representing a file system path,
217 e.g. :class:`pathlib.PurePath`.
218
Berker Peksagb18ffb42016-06-10 08:43:54 +0300219 .. versionadded:: 3.6
220
Brett Cannonb08388d2016-06-09 15:58:06 -0700221 .. abstractmethod:: __fspath__()
222
223 Return the file system path representation of the object.
224
225 The method should only return a :class:`str` or :class:`bytes` object,
226 with the preference being for :class:`str`.
227
Ethan Furmancdc08792016-06-02 15:06:09 -0700228
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200229.. function:: getenv(key, default=None)
230
231 Return the value of the environment variable *key* if it exists, or
232 *default* if it doesn't. *key*, *default* and the result are str.
233
234 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
235 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
236 would like to use a different encoding.
237
238 Availability: most flavors of Unix, Windows.
239
240
241.. function:: getenvb(key, default=None)
242
243 Return the value of the environment variable *key* if it exists, or
244 *default* if it doesn't. *key*, *default* and the result are bytes.
245
Berker Peksag996e5f92016-09-26 22:44:07 +0300246 :func:`getenvb` is only available if :data:`supports_bytes_environ`
247 is True.
248
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200249 Availability: most flavors of Unix.
250
251 .. versionadded:: 3.2
252
253
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000254.. function:: get_exec_path(env=None)
255
256 Returns the list of directories that will be searched for a named
257 executable, similar to a shell, when launching a process.
258 *env*, when specified, should be an environment variable dictionary
259 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300260 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000261
262 .. versionadded:: 3.2
263
264
Georg Brandl116aa622007-08-15 14:28:22 +0000265.. function:: getegid()
266
267 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000268 "set id" bit on the file being executed in the current process.
269
270 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000271
272
273.. function:: geteuid()
274
275 .. index:: single: user; effective id
276
Benjamin Petersonf650e462010-05-06 23:03:05 +0000277 Return the current process's effective user id.
278
279 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000280
281
282.. function:: getgid()
283
284 .. index:: single: process; group
285
Benjamin Petersonf650e462010-05-06 23:03:05 +0000286 Return the real group id of the current process.
287
288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000289
290
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200291.. function:: getgrouplist(user, group)
292
293 Return list of group ids that *user* belongs to. If *group* is not in the
294 list, it is included; typically, *group* is specified as the group ID
295 field from the password record for *user*.
296
297 Availability: Unix.
298
299 .. versionadded:: 3.3
300
301
Georg Brandl116aa622007-08-15 14:28:22 +0000302.. function:: getgroups()
303
304 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000305
Georg Brandl116aa622007-08-15 14:28:22 +0000306 Availability: Unix.
307
Larry Hastings3732ed22014-03-15 21:13:56 -0700308 .. note::
309
310 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700311 other Unix platforms. If the Python interpreter was built with a
312 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
313 the list of effective group ids associated with the current user process;
314 this list is limited to a system-defined number of entries, typically 16,
315 and may be modified by calls to :func:`setgroups` if suitably privileged.
316 If built with a deployment target greater than :const:`10.5`,
317 :func:`getgroups` returns the current group access list for the user
318 associated with the effective user id of the process; the group access
319 list may change over the lifetime of the process, it is not affected by
320 calls to :func:`setgroups`, and its length is not limited to 16. The
321 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
322 obtained with :func:`sysconfig.get_config_var`.
323
Georg Brandl116aa622007-08-15 14:28:22 +0000324
325.. function:: getlogin()
326
327 Return the name of the user logged in on the controlling terminal of the
Benjamin Petersone218bcb2014-08-30 21:04:15 -0400328 process. For most purposes, it is more useful to use the environment
329 variables :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user
330 is, or ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the current
331 real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000332
Brian Curtine8e4b3b2010-09-23 20:04:14 +0000333 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000334
335
336.. function:: getpgid(pid)
337
338 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000339 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000340
Benjamin Petersonf650e462010-05-06 23:03:05 +0000341 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000342
343.. function:: getpgrp()
344
345 .. index:: single: process; group
346
Benjamin Petersonf650e462010-05-06 23:03:05 +0000347 Return the id of the current process group.
348
349 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000350
351
352.. function:: getpid()
353
354 .. index:: single: process; id
355
Benjamin Petersonf650e462010-05-06 23:03:05 +0000356 Return the current process id.
357
Georg Brandl116aa622007-08-15 14:28:22 +0000358
359.. function:: getppid()
360
361 .. index:: single: process; id of parent
362
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000363 Return the parent's process id. When the parent process has exited, on Unix
364 the id returned is the one of the init process (1), on Windows it is still
365 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000366
Georg Brandl8a5555f2012-06-24 13:29:09 +0200367 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000368
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000369 .. versionchanged:: 3.2
370 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000371
Georg Brandl8a5555f2012-06-24 13:29:09 +0200372
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000373.. function:: getpriority(which, who)
374
375 .. index:: single: process; scheduling priority
376
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200377 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000378 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
379 is interpreted relative to *which* (a process identifier for
380 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200381 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000382 (respectively) the calling process, the process group of the calling process,
383 or the real user ID of the calling process.
384
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200385 Availability: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000386
387 .. versionadded:: 3.3
388
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200389
390.. data:: PRIO_PROCESS
391 PRIO_PGRP
392 PRIO_USER
393
394 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
395
396 Availability: Unix.
397
398 .. versionadded:: 3.3
399
400
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000401.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000402
403 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000404 real, effective, and saved user ids.
405
406 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000407
Georg Brandl1b83a452009-11-28 11:12:26 +0000408 .. versionadded:: 3.2
409
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000410
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000411.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000412
413 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000414 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000415
416 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000417
Georg Brandl1b83a452009-11-28 11:12:26 +0000418 .. versionadded:: 3.2
419
Georg Brandl116aa622007-08-15 14:28:22 +0000420
421.. function:: getuid()
422
423 .. index:: single: user; id
424
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700425 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000426
427 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000428
429
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200430.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000431
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200432 Call the system initgroups() to initialize the group access list with all of
433 the groups of which the specified username is a member, plus the specified
434 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000435
436 Availability: Unix.
437
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200438 .. versionadded:: 3.2
439
Georg Brandl116aa622007-08-15 14:28:22 +0000440
Georg Brandl18244152009-09-02 20:34:52 +0000441.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000442
443 .. index:: single: environment variables; setting
444
Georg Brandl18244152009-09-02 20:34:52 +0000445 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000446 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000447 :func:`popen` or :func:`fork` and :func:`execv`.
448
449 Availability: most flavors of Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000450
451 .. note::
452
Georg Brandlc575c902008-09-13 17:46:05 +0000453 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
454 cause memory leaks. Refer to the system documentation for putenv.
Georg Brandl116aa622007-08-15 14:28:22 +0000455
456 When :func:`putenv` is supported, assignments to items in ``os.environ`` are
457 automatically translated into corresponding calls to :func:`putenv`; however,
458 calls to :func:`putenv` don't update ``os.environ``, so it is actually
459 preferable to assign to items of ``os.environ``.
460
461
462.. function:: setegid(egid)
463
Benjamin Petersonf650e462010-05-06 23:03:05 +0000464 Set the current process's effective group id.
465
466 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000467
468
469.. function:: seteuid(euid)
470
Benjamin Petersonf650e462010-05-06 23:03:05 +0000471 Set the current process's effective user id.
472
473 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000474
475
476.. function:: setgid(gid)
477
Benjamin Petersonf650e462010-05-06 23:03:05 +0000478 Set the current process' group id.
479
480 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000481
482
483.. function:: setgroups(groups)
484
485 Set the list of supplemental group ids associated with the current process to
486 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000487 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000488
Georg Brandl116aa622007-08-15 14:28:22 +0000489 Availability: Unix.
490
Ned Deily2e209682012-04-30 11:14:02 -0700491 .. note:: On Mac OS X, the length of *groups* may not exceed the
492 system-defined maximum number of effective group ids, typically 16.
493 See the documentation for :func:`getgroups` for cases where it may not
494 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000495
496.. function:: setpgrp()
497
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300498 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000499 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000500
Georg Brandl116aa622007-08-15 14:28:22 +0000501 Availability: Unix.
502
503
504.. function:: setpgid(pid, pgrp)
505
Georg Brandl60203b42010-10-06 10:11:56 +0000506 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000507 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000508 for the semantics.
509
510 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000511
512
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000513.. function:: setpriority(which, who, priority)
514
515 .. index:: single: process; scheduling priority
516
517 Set program scheduling priority. The value *which* is one of
518 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
519 is interpreted relative to *which* (a process identifier for
520 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
521 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
522 (respectively) the calling process, the process group of the calling process,
523 or the real user ID of the calling process.
524 *priority* is a value in the range -20 to 19. The default priority is 0;
525 lower priorities cause more favorable scheduling.
526
527 Availability: Unix
528
529 .. versionadded:: 3.3
530
531
Georg Brandl116aa622007-08-15 14:28:22 +0000532.. function:: setregid(rgid, egid)
533
Benjamin Petersonf650e462010-05-06 23:03:05 +0000534 Set the current process's real and effective group ids.
535
536 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000537
Georg Brandl1b83a452009-11-28 11:12:26 +0000538
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000539.. function:: setresgid(rgid, egid, sgid)
540
541 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000542
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000543 Availability: Unix.
544
Georg Brandl1b83a452009-11-28 11:12:26 +0000545 .. versionadded:: 3.2
546
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000547
548.. function:: setresuid(ruid, euid, suid)
549
550 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000551
Georg Brandl6faee4e2010-09-21 14:48:28 +0000552 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000553
Georg Brandl1b83a452009-11-28 11:12:26 +0000554 .. versionadded:: 3.2
555
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000556
557.. function:: setreuid(ruid, euid)
558
Benjamin Petersonf650e462010-05-06 23:03:05 +0000559 Set the current process's real and effective user ids.
560
561 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000562
Georg Brandl116aa622007-08-15 14:28:22 +0000563
564.. function:: getsid(pid)
565
Georg Brandl60203b42010-10-06 10:11:56 +0000566 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000567
Georg Brandl116aa622007-08-15 14:28:22 +0000568 Availability: Unix.
569
Georg Brandl116aa622007-08-15 14:28:22 +0000570
571.. function:: setsid()
572
Georg Brandl60203b42010-10-06 10:11:56 +0000573 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000574
Georg Brandl116aa622007-08-15 14:28:22 +0000575 Availability: Unix.
576
577
578.. function:: setuid(uid)
579
580 .. index:: single: user; id, setting
581
Benjamin Petersonf650e462010-05-06 23:03:05 +0000582 Set the current process's user id.
583
584 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000585
Georg Brandl116aa622007-08-15 14:28:22 +0000586
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000587.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000588.. function:: strerror(code)
589
590 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000591 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000592 error number, :exc:`ValueError` is raised.
593
Georg Brandl116aa622007-08-15 14:28:22 +0000594
Victor Stinnerb745a742010-05-18 17:17:23 +0000595.. data:: supports_bytes_environ
596
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200597 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000598 Windows).
599
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000600 .. versionadded:: 3.2
601
Victor Stinnerb745a742010-05-18 17:17:23 +0000602
Georg Brandl116aa622007-08-15 14:28:22 +0000603.. function:: umask(mask)
604
Benjamin Petersonf650e462010-05-06 23:03:05 +0000605 Set the current numeric umask and return the previous umask.
606
Georg Brandl116aa622007-08-15 14:28:22 +0000607
608.. function:: uname()
609
610 .. index::
611 single: gethostname() (in module socket)
612 single: gethostbyaddr() (in module socket)
613
Larry Hastings605a62d2012-06-24 04:33:36 -0700614 Returns information identifying the current operating system.
615 The return value is an object with five attributes:
616
617 * :attr:`sysname` - operating system name
618 * :attr:`nodename` - name of machine on network (implementation-defined)
619 * :attr:`release` - operating system release
620 * :attr:`version` - operating system version
621 * :attr:`machine` - hardware identifier
622
623 For backwards compatibility, this object is also iterable, behaving
624 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
625 :attr:`release`, :attr:`version`, and :attr:`machine`
626 in that order.
627
628 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000629 leading component; a better way to get the hostname is
630 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000631 ``socket.gethostbyaddr(socket.gethostname())``.
632
633 Availability: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000634
Larry Hastings605a62d2012-06-24 04:33:36 -0700635 .. versionchanged:: 3.3
636 Return type changed from a tuple to a tuple-like object
637 with named attributes.
638
Georg Brandl116aa622007-08-15 14:28:22 +0000639
Georg Brandl18244152009-09-02 20:34:52 +0000640.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000641
642 .. index:: single: environment variables; deleting
643
Georg Brandl18244152009-09-02 20:34:52 +0000644 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000645 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000646 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000647
648 When :func:`unsetenv` is supported, deletion of items in ``os.environ`` is
649 automatically translated into a corresponding call to :func:`unsetenv`; however,
650 calls to :func:`unsetenv` don't update ``os.environ``, so it is actually
651 preferable to delete items of ``os.environ``.
652
Benjamin Petersonf650e462010-05-06 23:03:05 +0000653 Availability: most flavors of Unix, Windows.
654
Georg Brandl116aa622007-08-15 14:28:22 +0000655
656.. _os-newstreams:
657
658File Object Creation
659--------------------
660
Georg Brandla570e982012-06-24 13:26:22 +0200661This function creates new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200662:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000663
664
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300665.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000666
Georg Brandlb2462e22012-06-24 13:24:56 +0200667 Return an open file object connected to the file descriptor *fd*. This is an
668 alias of the :func:`open` built-in function and accepts the same arguments.
669 The only difference is that the first argument of :func:`fdopen` must always
670 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000671
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673.. _os-fd-ops:
674
675File Descriptor Operations
676--------------------------
677
678These functions operate on I/O streams referenced using file descriptors.
679
680File descriptors are small integers corresponding to a file that has been opened
681by the current process. For example, standard input is usually file descriptor
6820, standard output is 1, and standard error is 2. Further files opened by a
683process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
684is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
685by file descriptors.
686
Serhiy Storchakadab83542013-10-13 20:12:43 +0300687The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000688associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000689descriptor directly will bypass the file object methods, ignoring aspects such
690as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000691
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000692
Georg Brandl116aa622007-08-15 14:28:22 +0000693.. function:: close(fd)
694
Benjamin Petersonf650e462010-05-06 23:03:05 +0000695 Close file descriptor *fd*.
696
Georg Brandl116aa622007-08-15 14:28:22 +0000697 .. note::
698
699 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000700 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000701 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300702 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000703
704
Christian Heimesfdab48e2008-01-20 09:06:41 +0000705.. function:: closerange(fd_low, fd_high)
706
707 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200708 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000709
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000710 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000711 try:
712 os.close(fd)
713 except OSError:
714 pass
715
Christian Heimesfdab48e2008-01-20 09:06:41 +0000716
Georg Brandl81f11302007-12-21 08:45:42 +0000717.. function:: device_encoding(fd)
718
719 Return a string describing the encoding of the device associated with *fd*
720 if it is connected to a terminal; else return :const:`None`.
721
722
Georg Brandl116aa622007-08-15 14:28:22 +0000723.. function:: dup(fd)
724
Victor Stinnerdaf45552013-08-28 00:53:59 +0200725 Return a duplicate of file descriptor *fd*. The new file descriptor is
726 :ref:`non-inheritable <fd_inheritance>`.
727
728 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
729 2: stderr), the new file descriptor is :ref:`inheritable
730 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000731
Victor Stinnerdaf45552013-08-28 00:53:59 +0200732 .. versionchanged:: 3.4
733 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000734
Victor Stinnerdaf45552013-08-28 00:53:59 +0200735
736.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000737
738 Duplicate file descriptor *fd* to *fd2*, closing the latter first if necessary.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200739 The file descriptor *fd2* is :ref:`inheritable <fd_inheritance>` by default,
740 or non-inheritable if *inheritable* is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000741
Victor Stinnerdaf45552013-08-28 00:53:59 +0200742 .. versionchanged:: 3.4
743 Add the optional *inheritable* parameter.
744
Georg Brandl116aa622007-08-15 14:28:22 +0000745
Christian Heimes4e30a842007-11-30 22:12:06 +0000746.. function:: fchmod(fd, mode)
747
Georg Brandlb9df00c2012-06-24 12:38:14 +0200748 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200749 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200750 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000751
752 Availability: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000753
754
755.. function:: fchown(fd, uid, gid)
756
757 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200758 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200759 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200760 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000761
Christian Heimes4e30a842007-11-30 22:12:06 +0000762 Availability: Unix.
763
764
Georg Brandl116aa622007-08-15 14:28:22 +0000765.. function:: fdatasync(fd)
766
767 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000768 metadata.
769
770 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000771
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000772 .. note::
773 This function is not available on MacOS.
774
Georg Brandl116aa622007-08-15 14:28:22 +0000775
776.. function:: fpathconf(fd, name)
777
778 Return system configuration information relevant to an open file. *name*
779 specifies the configuration value to retrieve; it may be a string which is the
780 name of a defined system value; these names are specified in a number of
781 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
782 additional names as well. The names known to the host operating system are
783 given in the ``pathconf_names`` dictionary. For configuration variables not
784 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000785
786 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
787 specific value for *name* is not supported by the host system, even if it is
788 included in ``pathconf_names``, an :exc:`OSError` is raised with
789 :const:`errno.EINVAL` for the error number.
790
Georg Brandl4d399a42012-06-25 07:40:32 +0200791 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200792
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700793 Availability: Unix.
794
Georg Brandl116aa622007-08-15 14:28:22 +0000795
Victor Stinner4195b5c2012-02-08 23:03:19 +0100796.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000797
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200798 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
799 object.
800
801 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
802
803 .. seealso::
804
Berker Peksag2034caa2015-04-27 13:53:28 +0300805 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000806
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200807
Georg Brandl116aa622007-08-15 14:28:22 +0000808.. function:: fstatvfs(fd)
809
Georg Brandlb9df00c2012-06-24 12:38:14 +0200810 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200811 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200812 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000813
814 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000815
816
817.. function:: fsync(fd)
818
819 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000820 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000821
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000822 If you're starting with a buffered Python :term:`file object` *f*, first do
823 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
824 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000825
Georg Brandl8a5555f2012-06-24 13:29:09 +0200826 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000827
828
829.. function:: ftruncate(fd, length)
830
Georg Brandl306336b2012-06-24 12:55:33 +0200831 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200832 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200833 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000834
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700835 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000836
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700837 .. versionchanged:: 3.5
838 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000839
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200840.. function:: get_blocking(fd)
841
842 Get the blocking mode of the file descriptor: ``False`` if the
843 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
844
845 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
846
847 Availability: Unix.
848
849 .. versionadded:: 3.5
850
Georg Brandl116aa622007-08-15 14:28:22 +0000851.. function:: isatty(fd)
852
853 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000854 tty(-like) device, else ``False``.
855
Georg Brandl116aa622007-08-15 14:28:22 +0000856
Ross Lagerwall7807c352011-03-17 20:20:30 +0200857.. function:: lockf(fd, cmd, len)
858
859 Apply, test or remove a POSIX lock on an open file descriptor.
860 *fd* is an open file descriptor.
861 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
862 :data:`F_ULOCK` or :data:`F_TEST`.
863 *len* specifies the section of the file to lock.
864
865 Availability: Unix.
866
867 .. versionadded:: 3.3
868
869
870.. data:: F_LOCK
871 F_TLOCK
872 F_ULOCK
873 F_TEST
874
875 Flags that specify what action :func:`lockf` will take.
876
877 Availability: Unix.
878
879 .. versionadded:: 3.3
880
Georg Brandlf62445a2012-06-24 13:31:20 +0200881
Georg Brandl116aa622007-08-15 14:28:22 +0000882.. function:: lseek(fd, pos, how)
883
Christian Heimesfaf2f632008-01-06 16:59:19 +0000884 Set the current position of file descriptor *fd* to position *pos*, modified
885 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
886 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300887 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100888 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000889
Georg Brandl116aa622007-08-15 14:28:22 +0000890
Georg Brandl8569e582010-05-19 20:57:08 +0000891.. data:: SEEK_SET
892 SEEK_CUR
893 SEEK_END
894
895 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200896 respectively.
897
Jesus Cea94363612012-06-22 18:32:07 +0200898 .. versionadded:: 3.3
899 Some operating systems could support additional values, like
900 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
901
Georg Brandl8569e582010-05-19 20:57:08 +0000902
Martin Panterbf19d162015-09-09 01:01:13 +0000903.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000904
Martin Panterbf19d162015-09-09 01:01:13 +0000905 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700906 its mode according to *mode*. When computing *mode*, the current umask value
907 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200908 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000909
910 For a description of the flag and mode values, see the C run-time documentation;
911 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400912 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000913 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000914
Georg Brandl50c40002012-06-24 11:45:20 +0200915 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400916 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700917
Victor Stinnerdaf45552013-08-28 00:53:59 +0200918 .. versionchanged:: 3.4
919 The new file descriptor is now non-inheritable.
920
Georg Brandl116aa622007-08-15 14:28:22 +0000921 .. note::
922
Georg Brandl502d9a52009-07-26 15:02:41 +0000923 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000924 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000925 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000926 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000927
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000928 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700929 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000930
Victor Stinnera766ddf2015-03-26 23:50:57 +0100931 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200932 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100933 exception, the function now retries the system call instead of raising an
934 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
935
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700936 .. versionchanged:: 3.6
937 Accepts a :term:`path-like object`.
938
Andrew Kuchling4921a082013-06-21 11:49:57 -0400939The following constants are options for the *flags* parameter to the
940:func:`~os.open` function. They can be combined using the bitwise OR operator
941``|``. Some of them are not available on all platforms. For descriptions of
942their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100943or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400944
945
946.. data:: O_RDONLY
947 O_WRONLY
948 O_RDWR
949 O_APPEND
950 O_CREAT
951 O_EXCL
952 O_TRUNC
953
Vinay Sajipe4946e72016-09-11 15:15:59 +0100954 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400955
956
957.. data:: O_DSYNC
958 O_RSYNC
959 O_SYNC
960 O_NDELAY
961 O_NONBLOCK
962 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -0400963 O_CLOEXEC
964
Vinay Sajipe4946e72016-09-11 15:15:59 +0100965 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400966
967 .. versionchanged:: 3.3
968 Add :data:`O_CLOEXEC` constant.
969
970.. data:: O_BINARY
971 O_NOINHERIT
972 O_SHORT_LIVED
973 O_TEMPORARY
974 O_RANDOM
975 O_SEQUENTIAL
976 O_TEXT
977
Vinay Sajipe4946e72016-09-11 15:15:59 +0100978 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400979
980
981.. data:: O_ASYNC
982 O_DIRECT
983 O_DIRECTORY
984 O_NOFOLLOW
985 O_NOATIME
986 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +0200987 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +0100988 O_SHLOCK
989 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -0400990
Vinay Sajipe4946e72016-09-11 15:15:59 +0100991 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -0400992 the C library.
993
Christian Heimesd88f7352013-08-16 14:37:50 +0200994 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -0700995 Add :data:`O_PATH` on systems that support it.
996 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
997 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +0200998
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000999
Georg Brandl116aa622007-08-15 14:28:22 +00001000.. function:: openpty()
1001
1002 .. index:: module: pty
1003
Victor Stinnerdaf45552013-08-28 00:53:59 +02001004 Open a new pseudo-terminal pair. Return a pair of file descriptors
1005 ``(master, slave)`` for the pty and the tty, respectively. The new file
1006 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1007 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001008
1009 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001010
Victor Stinnerdaf45552013-08-28 00:53:59 +02001011 .. versionchanged:: 3.4
1012 The new file descriptors are now non-inheritable.
1013
Georg Brandl116aa622007-08-15 14:28:22 +00001014
1015.. function:: pipe()
1016
Victor Stinnerdaf45552013-08-28 00:53:59 +02001017 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001018 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001019 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001020
1021 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001022
Victor Stinnerdaf45552013-08-28 00:53:59 +02001023 .. versionchanged:: 3.4
1024 The new file descriptors are now non-inheritable.
1025
Georg Brandl116aa622007-08-15 14:28:22 +00001026
Charles-François Natali368f34b2011-06-06 19:49:47 +02001027.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001028
1029 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001030 *flags* can be constructed by ORing together one or more of these values:
1031 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001032 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1033 respectively.
1034
1035 Availability: some flavors of Unix.
1036
1037 .. versionadded:: 3.3
1038
1039
Ross Lagerwall7807c352011-03-17 20:20:30 +02001040.. function:: posix_fallocate(fd, offset, len)
1041
1042 Ensures that enough disk space is allocated for the file specified by *fd*
1043 starting from *offset* and continuing for *len* bytes.
1044
1045 Availability: Unix.
1046
1047 .. versionadded:: 3.3
1048
1049
1050.. function:: posix_fadvise(fd, offset, len, advice)
1051
1052 Announces an intention to access data in a specific pattern thus allowing
1053 the kernel to make optimizations.
1054 The advice applies to the region of the file specified by *fd* starting at
1055 *offset* and continuing for *len* bytes.
1056 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1057 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1058 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1059
1060 Availability: Unix.
1061
1062 .. versionadded:: 3.3
1063
1064
1065.. data:: POSIX_FADV_NORMAL
1066 POSIX_FADV_SEQUENTIAL
1067 POSIX_FADV_RANDOM
1068 POSIX_FADV_NOREUSE
1069 POSIX_FADV_WILLNEED
1070 POSIX_FADV_DONTNEED
1071
1072 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1073 the access pattern that is likely to be used.
1074
1075 Availability: Unix.
1076
1077 .. versionadded:: 3.3
1078
1079
1080.. function:: pread(fd, buffersize, offset)
1081
1082 Read from a file descriptor, *fd*, at a position of *offset*. It will read up
1083 to *buffersize* number of bytes. The file offset remains unchanged.
1084
1085 Availability: Unix.
1086
1087 .. versionadded:: 3.3
1088
1089
Jesus Cea67503c52014-10-20 16:18:24 +02001090.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001091
Jesus Cea67503c52014-10-20 16:18:24 +02001092 Write *bytestring* to a file descriptor, *fd*, from *offset*,
1093 leaving the file offset unchanged.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001094
1095 Availability: Unix.
1096
1097 .. versionadded:: 3.3
1098
1099
Georg Brandl116aa622007-08-15 14:28:22 +00001100.. function:: read(fd, n)
1101
Georg Brandlb90be692009-07-29 16:14:16 +00001102 Read at most *n* bytes from file descriptor *fd*. Return a bytestring containing the
Georg Brandl116aa622007-08-15 14:28:22 +00001103 bytes read. If the end of the file referred to by *fd* has been reached, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001104 empty bytes object is returned.
1105
Georg Brandl116aa622007-08-15 14:28:22 +00001106 .. note::
1107
1108 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001109 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1110 "file object" returned by the built-in function :func:`open` or by
1111 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1112 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001113
Victor Stinnera766ddf2015-03-26 23:50:57 +01001114 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001115 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001116 exception, the function now retries the system call instead of raising an
1117 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1118
Georg Brandl116aa622007-08-15 14:28:22 +00001119
Martin Panterbf19d162015-09-09 01:01:13 +00001120.. function:: sendfile(out, in, offset, count)
Martin Panter94994132015-09-09 05:29:24 +00001121 sendfile(out, in, offset, count, [headers], [trailers], flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001122
Martin Panterbf19d162015-09-09 01:01:13 +00001123 Copy *count* bytes from file descriptor *in* to file descriptor *out*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001124 starting at *offset*.
1125 Return the number of bytes sent. When EOF is reached return 0.
1126
1127 The first function notation is supported by all platforms that define
1128 :func:`sendfile`.
1129
1130 On Linux, if *offset* is given as ``None``, the bytes are read from the
1131 current position of *in* and the position of *in* is updated.
1132
1133 The second case may be used on Mac OS X and FreeBSD where *headers* and
1134 *trailers* are arbitrary sequences of buffers that are written before and
1135 after the data from *in* is written. It returns the same as the first case.
1136
Martin Panterbf19d162015-09-09 01:01:13 +00001137 On Mac OS X and FreeBSD, a value of 0 for *count* specifies to send until
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001138 the end of *in* is reached.
1139
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001140 All platforms support sockets as *out* file descriptor, and some platforms
1141 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001142
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001143 Cross-platform applications should not use *headers*, *trailers* and *flags*
1144 arguments.
1145
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001146 Availability: Unix.
1147
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001148 .. note::
1149
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001150 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001151 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001152
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001153 .. versionadded:: 3.3
1154
1155
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001156.. function:: set_blocking(fd, blocking)
1157
1158 Set the blocking mode of the specified file descriptor. Set the
1159 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1160
1161 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1162
1163 Availability: Unix.
1164
1165 .. versionadded:: 3.5
1166
1167
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001168.. data:: SF_NODISKIO
1169 SF_MNOWAIT
1170 SF_SYNC
1171
1172 Parameters to the :func:`sendfile` function, if the implementation supports
1173 them.
1174
1175 Availability: Unix.
1176
1177 .. versionadded:: 3.3
1178
1179
Ross Lagerwall7807c352011-03-17 20:20:30 +02001180.. function:: readv(fd, buffers)
1181
Benjamin Petersone83ed432014-01-18 22:54:59 -05001182 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
1183 objects <bytes-like object>` *buffers*. :func:`~os.readv` will transfer data
1184 into each buffer until it is full and then move on to the next buffer in the
1185 sequence to hold the rest of the data. :func:`~os.readv` returns the total
1186 number of bytes read (which may be less than the total capacity of all the
1187 objects).
Ross Lagerwall7807c352011-03-17 20:20:30 +02001188
1189 Availability: Unix.
1190
1191 .. versionadded:: 3.3
1192
1193
Georg Brandl116aa622007-08-15 14:28:22 +00001194.. function:: tcgetpgrp(fd)
1195
1196 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001197 file descriptor as returned by :func:`os.open`).
1198
1199 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001200
1201
1202.. function:: tcsetpgrp(fd, pg)
1203
1204 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001205 descriptor as returned by :func:`os.open`) to *pg*.
1206
1207 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001208
1209
1210.. function:: ttyname(fd)
1211
1212 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001213 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001214 exception is raised.
1215
1216 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001217
1218
1219.. function:: write(fd, str)
1220
Georg Brandlb90be692009-07-29 16:14:16 +00001221 Write the bytestring in *str* to file descriptor *fd*. Return the number of
Benjamin Petersonf650e462010-05-06 23:03:05 +00001222 bytes actually written.
1223
Georg Brandl116aa622007-08-15 14:28:22 +00001224 .. note::
1225
1226 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001227 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001228 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001229 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1230 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001231
Victor Stinnera766ddf2015-03-26 23:50:57 +01001232 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001233 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001234 exception, the function now retries the system call instead of raising an
1235 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1236
Georg Brandl8569e582010-05-19 20:57:08 +00001237
Ross Lagerwall7807c352011-03-17 20:20:30 +02001238.. function:: writev(fd, buffers)
1239
Benjamin Petersone83ed432014-01-18 22:54:59 -05001240 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be a
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001241 sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1242 processed in array order. Entire contents of first buffer is written before
1243 proceeding to second, and so on. The operating system may set a limit
1244 (sysconf() value SC_IOV_MAX) on the number of buffers that can be used.
1245
Benjamin Petersone83ed432014-01-18 22:54:59 -05001246 :func:`~os.writev` writes the contents of each object to the file descriptor
1247 and returns the total number of bytes written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001248
1249 Availability: Unix.
1250
1251 .. versionadded:: 3.3
1252
1253
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001254.. _terminal-size:
1255
1256Querying the size of a terminal
1257~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1258
1259.. versionadded:: 3.3
1260
1261.. function:: get_terminal_size(fd=STDOUT_FILENO)
1262
1263 Return the size of the terminal window as ``(columns, lines)``,
1264 tuple of type :class:`terminal_size`.
1265
1266 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1267 output) specifies which file descriptor should be queried.
1268
1269 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001270 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001271
1272 :func:`shutil.get_terminal_size` is the high-level function which
1273 should normally be used, ``os.get_terminal_size`` is the low-level
1274 implementation.
1275
1276 Availability: Unix, Windows.
1277
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001278.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001279
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001280 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001281
1282 .. attribute:: columns
1283
1284 Width of the terminal window in characters.
1285
1286 .. attribute:: lines
1287
1288 Height of the terminal window in characters.
1289
1290
Victor Stinnerdaf45552013-08-28 00:53:59 +02001291.. _fd_inheritance:
1292
1293Inheritance of File Descriptors
1294~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1295
Georg Brandl5642ff92013-09-15 10:37:57 +02001296.. versionadded:: 3.4
1297
1298A file descriptor has an "inheritable" flag which indicates if the file descriptor
1299can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001300created by Python are non-inheritable by default.
1301
1302On UNIX, non-inheritable file descriptors are closed in child processes at the
1303execution of a new program, other file descriptors are inherited.
1304
1305On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001306processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001307and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001308all inheritable handles and all inheritable file descriptors are inherited.
1309Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001310streams are closed, and inheritable handles are only inherited if the
1311*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001312
1313.. function:: get_inheritable(fd)
1314
Georg Brandl5642ff92013-09-15 10:37:57 +02001315 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001316
1317.. function:: set_inheritable(fd, inheritable)
1318
Georg Brandl5642ff92013-09-15 10:37:57 +02001319 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001320
1321.. function:: get_handle_inheritable(handle)
1322
Georg Brandl5642ff92013-09-15 10:37:57 +02001323 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001324
1325 Availability: Windows.
1326
1327.. function:: set_handle_inheritable(handle, inheritable)
1328
Georg Brandl5642ff92013-09-15 10:37:57 +02001329 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001330
1331 Availability: Windows.
1332
1333
Georg Brandl116aa622007-08-15 14:28:22 +00001334.. _os-file-dir:
1335
1336Files and Directories
1337---------------------
1338
Georg Brandl50c40002012-06-24 11:45:20 +02001339On some Unix platforms, many of these functions support one or more of these
1340features:
1341
1342.. _path_fd:
1343
Larry Hastings77892dc2012-06-25 03:27:33 -07001344* **specifying a file descriptor:**
1345 For some functions, the *path* argument can be not only a string giving a path
Georg Brandl50c40002012-06-24 11:45:20 +02001346 name, but also a file descriptor. The function will then operate on the file
Georg Brandlaceaf902012-06-25 08:33:56 +02001347 referred to by the descriptor. (For POSIX systems, Python will call the
1348 ``f...`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001349
1350 You can check whether or not *path* can be specified as a file descriptor on
1351 your platform using :data:`os.supports_fd`. If it is unavailable, using it
1352 will raise a :exc:`NotImplementedError`.
1353
1354 If the function also supports *dir_fd* or *follow_symlinks* arguments, it is
1355 an error to specify one of those when supplying *path* as a file descriptor.
1356
1357.. _dir_fd:
1358
Larry Hastings77892dc2012-06-25 03:27:33 -07001359* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001360 should be a file descriptor referring to a directory, and the path to operate
1361 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001362 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Larry Hastings77892dc2012-06-25 03:27:33 -07001363 the ``...at`` or ``f...at`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001364
1365 You can check whether or not *dir_fd* is supported on your platform using
1366 :data:`os.supports_dir_fd`. If it is unavailable, using it will raise a
1367 :exc:`NotImplementedError`.
1368
1369.. _follow_symlinks:
1370
Larry Hastings77892dc2012-06-25 03:27:33 -07001371* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001372 ``False``, and the last element of the path to operate on is a symbolic link,
1373 the function will operate on the symbolic link itself instead of the file the
Georg Brandlaceaf902012-06-25 08:33:56 +02001374 link points to. (For POSIX systems, Python will call the ``l...`` version of
Georg Brandl50c40002012-06-24 11:45:20 +02001375 the function.)
1376
1377 You can check whether or not *follow_symlinks* is supported on your platform
1378 using :data:`os.supports_follow_symlinks`. If it is unavailable, using it
1379 will raise a :exc:`NotImplementedError`.
1380
1381
1382
Larry Hastings9cf065c2012-06-22 16:30:09 -07001383.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001384
1385 Use the real uid/gid to test for access to *path*. Note that most operations
1386 will use the effective uid/gid, therefore this routine can be used in a
1387 suid/sgid environment to test if the invoking user has the specified access to
1388 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1389 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1390 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1391 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001392 information.
1393
Georg Brandl50c40002012-06-24 11:45:20 +02001394 This function can support specifying :ref:`paths relative to directory
1395 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001396
1397 If *effective_ids* is ``True``, :func:`access` will perform its access
1398 checks using the effective uid/gid instead of the real uid/gid.
1399 *effective_ids* may not be supported on your platform; you can check whether
1400 or not it is available using :data:`os.supports_effective_ids`. If it is
1401 unavailable, using it will raise a :exc:`NotImplementedError`.
1402
Georg Brandl116aa622007-08-15 14:28:22 +00001403 .. note::
1404
Georg Brandl502d9a52009-07-26 15:02:41 +00001405 Using :func:`access` to check if a user is authorized to e.g. open a file
1406 before actually doing so using :func:`open` creates a security hole,
1407 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001408 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1409 techniques. For example::
1410
1411 if os.access("myfile", os.R_OK):
1412 with open("myfile") as fp:
1413 return fp.read()
1414 return "some default data"
1415
1416 is better written as::
1417
1418 try:
1419 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001420 except PermissionError:
1421 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001422 else:
1423 with fp:
1424 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001425
1426 .. note::
1427
1428 I/O operations may fail even when :func:`access` indicates that they would
1429 succeed, particularly for operations on network filesystems which may have
1430 permissions semantics beyond the usual POSIX permission-bit model.
1431
Larry Hastings9cf065c2012-06-22 16:30:09 -07001432 .. versionchanged:: 3.3
1433 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1434
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001435 .. versionchanged:: 3.6
1436 Accepts a :term:`path-like object`.
1437
Georg Brandl116aa622007-08-15 14:28:22 +00001438
1439.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001440 R_OK
1441 W_OK
1442 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001443
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001444 Values to pass as the *mode* parameter of :func:`access` to test the
1445 existence, readability, writability and executability of *path*,
1446 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001447
1448
1449.. function:: chdir(path)
1450
1451 .. index:: single: directory; changing
1452
Benjamin Petersonf650e462010-05-06 23:03:05 +00001453 Change the current working directory to *path*.
1454
Larry Hastings77892dc2012-06-25 03:27:33 -07001455 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001456 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001457
Larry Hastings9cf065c2012-06-22 16:30:09 -07001458 .. versionadded:: 3.3
1459 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001460 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001461
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001462 .. versionchanged:: 3.6
1463 Accepts a :term:`path-like object`.
1464
Georg Brandl116aa622007-08-15 14:28:22 +00001465
Larry Hastings9cf065c2012-06-22 16:30:09 -07001466.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001467
1468 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1469 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1470
R David Murray30178062011-03-10 17:18:33 -05001471 * :data:`stat.UF_NODUMP`
1472 * :data:`stat.UF_IMMUTABLE`
1473 * :data:`stat.UF_APPEND`
1474 * :data:`stat.UF_OPAQUE`
1475 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001476 * :data:`stat.UF_COMPRESSED`
1477 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001478 * :data:`stat.SF_ARCHIVED`
1479 * :data:`stat.SF_IMMUTABLE`
1480 * :data:`stat.SF_APPEND`
1481 * :data:`stat.SF_NOUNLINK`
1482 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001483
Georg Brandl50c40002012-06-24 11:45:20 +02001484 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001485
Georg Brandlc575c902008-09-13 17:46:05 +00001486 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001487
Larry Hastings9cf065c2012-06-22 16:30:09 -07001488 .. versionadded:: 3.3
1489 The *follow_symlinks* argument.
1490
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001491 .. versionchanged:: 3.6
1492 Accepts a :term:`path-like object`.
1493
Georg Brandl116aa622007-08-15 14:28:22 +00001494
Larry Hastings9cf065c2012-06-22 16:30:09 -07001495.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001496
1497 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001498 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001499 combinations of them:
1500
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001501 * :data:`stat.S_ISUID`
1502 * :data:`stat.S_ISGID`
1503 * :data:`stat.S_ENFMT`
1504 * :data:`stat.S_ISVTX`
1505 * :data:`stat.S_IREAD`
1506 * :data:`stat.S_IWRITE`
1507 * :data:`stat.S_IEXEC`
1508 * :data:`stat.S_IRWXU`
1509 * :data:`stat.S_IRUSR`
1510 * :data:`stat.S_IWUSR`
1511 * :data:`stat.S_IXUSR`
1512 * :data:`stat.S_IRWXG`
1513 * :data:`stat.S_IRGRP`
1514 * :data:`stat.S_IWGRP`
1515 * :data:`stat.S_IXGRP`
1516 * :data:`stat.S_IRWXO`
1517 * :data:`stat.S_IROTH`
1518 * :data:`stat.S_IWOTH`
1519 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001520
Georg Brandl50c40002012-06-24 11:45:20 +02001521 This function can support :ref:`specifying a file descriptor <path_fd>`,
1522 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1523 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001524
Georg Brandl116aa622007-08-15 14:28:22 +00001525 .. note::
1526
Georg Brandl50c40002012-06-24 11:45:20 +02001527 Although Windows supports :func:`chmod`, you can only set the file's
1528 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1529 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001530
Larry Hastings9cf065c2012-06-22 16:30:09 -07001531 .. versionadded:: 3.3
1532 Added support for specifying *path* as an open file descriptor,
1533 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001534
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001535 .. versionchanged:: 3.6
1536 Accepts a :term:`path-like object`.
1537
Larry Hastings9cf065c2012-06-22 16:30:09 -07001538
1539.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001540
Georg Brandl50c40002012-06-24 11:45:20 +02001541 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1542 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001543
Georg Brandl50c40002012-06-24 11:45:20 +02001544 This function can support :ref:`specifying a file descriptor <path_fd>`,
1545 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1546 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001547
Sandro Tosid902a142011-08-22 23:28:27 +02001548 See :func:`shutil.chown` for a higher-level function that accepts names in
1549 addition to numeric ids.
1550
Benjamin Petersonf650e462010-05-06 23:03:05 +00001551 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001552
Larry Hastings9cf065c2012-06-22 16:30:09 -07001553 .. versionadded:: 3.3
1554 Added support for specifying an open file descriptor for *path*,
1555 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001556
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001557 .. versionchanged:: 3.6
1558 Supports a :term:`path-like object`.
1559
Benjamin Peterson799bd802011-08-31 22:15:17 -04001560
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001561.. function:: chroot(path)
1562
Georg Brandl8a5555f2012-06-24 13:29:09 +02001563 Change the root directory of the current process to *path*.
1564
1565 Availability: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001566
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001567 .. versionchanged:: 3.6
1568 Accepts a :term:`path-like object`.
1569
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001570
1571.. function:: fchdir(fd)
1572
1573 Change the current working directory to the directory represented by the file
1574 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001575 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001576
1577 Availability: Unix.
1578
1579
1580.. function:: getcwd()
1581
1582 Return a string representing the current working directory.
1583
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001584
1585.. function:: getcwdb()
1586
1587 Return a bytestring representing the current working directory.
1588
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001589
Georg Brandl116aa622007-08-15 14:28:22 +00001590.. function:: lchflags(path, flags)
1591
Georg Brandl50c40002012-06-24 11:45:20 +02001592 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001593 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001594 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001595
1596 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001597
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001598 .. versionchanged:: 3.6
1599 Accepts a :term:`path-like object`.
1600
Georg Brandl116aa622007-08-15 14:28:22 +00001601
Christian Heimes93852662007-12-01 12:22:32 +00001602.. function:: lchmod(path, mode)
1603
1604 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001605 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001606 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001607 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001608
1609 Availability: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001610
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001611 .. versionchanged:: 3.6
1612 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001613
Georg Brandl116aa622007-08-15 14:28:22 +00001614.. function:: lchown(path, uid, gid)
1615
Georg Brandl50c40002012-06-24 11:45:20 +02001616 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001617 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001618 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001619
1620 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001621
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001622 .. versionchanged:: 3.6
1623 Accepts a :term:`path-like object`.
1624
Georg Brandl116aa622007-08-15 14:28:22 +00001625
Larry Hastings9cf065c2012-06-22 16:30:09 -07001626.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001627
Larry Hastings9cf065c2012-06-22 16:30:09 -07001628 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001629
Georg Brandlaceaf902012-06-25 08:33:56 +02001630 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1631 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1632 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001633
Brian Curtin1b9df392010-11-24 20:24:31 +00001634 Availability: Unix, Windows.
1635
1636 .. versionchanged:: 3.2
1637 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001638
Larry Hastings9cf065c2012-06-22 16:30:09 -07001639 .. versionadded:: 3.3
1640 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1641
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001642 .. versionchanged:: 3.6
1643 Accepts a :term:`path-like object` for *src* and *dst*.
1644
Georg Brandl116aa622007-08-15 14:28:22 +00001645
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001646.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001647
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001648 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001649 *path*. The list is in arbitrary order, and does not include the special
1650 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001651
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001652 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1653 (directly or indirectly through the :class:`PathLike` interface),
1654 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001655 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001656
Larry Hastings77892dc2012-06-25 03:27:33 -07001657 This function can also support :ref:`specifying a file descriptor
1658 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001659
Larry Hastingsfdaea062012-06-25 04:42:23 -07001660 .. note::
1661 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1662
Victor Stinner6036e442015-03-08 01:58:04 +01001663 .. seealso::
1664
Victor Stinner51b58322015-05-15 09:12:58 +02001665 The :func:`scandir` function returns directory entries along with
1666 file attribute information, giving better performance for many
1667 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001668
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001669 .. versionchanged:: 3.2
1670 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001671
Larry Hastings9cf065c2012-06-22 16:30:09 -07001672 .. versionadded:: 3.3
1673 Added support for specifying an open file descriptor for *path*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001674
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001675 .. versionchanged:: 3.6
1676 Accepts a :term:`path-like object`.
1677
Georg Brandl50c40002012-06-24 11:45:20 +02001678
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001679.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001680
R. David Murray7b1aae92011-01-24 19:34:58 +00001681 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001682 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1683 :class:`stat_result` object.
1684
1685 On platforms that do not support symbolic links, this is an alias for
1686 :func:`~os.stat`.
1687
1688 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1689 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001690
Georg Brandl50c40002012-06-24 11:45:20 +02001691 This function can also support :ref:`paths relative to directory descriptors
1692 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001693
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001694 .. seealso::
1695
Berker Peksag2034caa2015-04-27 13:53:28 +03001696 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001697
Georg Brandlb3823372010-07-10 08:58:37 +00001698 .. versionchanged:: 3.2
1699 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001700
Larry Hastings9cf065c2012-06-22 16:30:09 -07001701 .. versionchanged:: 3.3
1702 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001703
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001704 .. versionchanged:: 3.6
1705 Accepts a :term:`path-like object` for *src* and *dst*.
1706
Ross Lagerwall7807c352011-03-17 20:20:30 +02001707
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001708.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1709
1710 Create a directory named *path* with numeric mode *mode*.
1711
Tommy Beadle63b91e52016-06-02 15:41:20 -04001712 If the directory already exists, :exc:`FileExistsError` is raised.
1713
1714 .. _mkdir_modebits:
1715
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001716 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001717 value is first masked out. If bits other than the last 9 (i.e. the last 3
1718 digits of the octal representation of the *mode*) are set, their meaning is
1719 platform-dependent. On some platforms, they are ignored and you should call
1720 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001721
1722 This function can also support :ref:`paths relative to directory descriptors
1723 <dir_fd>`.
1724
1725 It is also possible to create temporary directories; see the
1726 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1727
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001728 .. versionadded:: 3.3
1729 The *dir_fd* argument.
1730
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001731 .. versionchanged:: 3.6
1732 Accepts a :term:`path-like object`.
1733
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001734
Zachary Warea22ae212014-03-20 09:42:01 -05001735.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001736
1737 .. index::
1738 single: directory; creating
1739 single: UNC paths; and os.makedirs()
1740
1741 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001742 intermediate-level directories needed to contain the leaf directory.
1743
Serhiy Storchakae304e332017-03-24 13:27:42 +02001744 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1745 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1746 is interpreted. To set the file permission bits of any newly-created parent
1747 directories you can set the umask before invoking :func:`makedirs`. The
1748 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001749
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001750 If *exist_ok* is ``False`` (the default), an :exc:`OSError` is raised if the
1751 target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001752
1753 .. note::
1754
1755 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001756 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001757
1758 This function handles UNC paths correctly.
1759
1760 .. versionadded:: 3.2
1761 The *exist_ok* parameter.
1762
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001763 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001764
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001765 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001766 :func:`makedirs` would still raise an error if *mode* did not match the
1767 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001768 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001769
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001770 .. versionchanged:: 3.6
1771 Accepts a :term:`path-like object`.
1772
Serhiy Storchakae304e332017-03-24 13:27:42 +02001773 .. versionchanged:: 3.7
1774 The *mode* argument no longer affects the file permission bits of
1775 newly-created intermediate-level directories.
1776
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001777
Larry Hastings9cf065c2012-06-22 16:30:09 -07001778.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001779
Larry Hastings9cf065c2012-06-22 16:30:09 -07001780 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1781 The current umask value is first masked out from the mode.
1782
Georg Brandl50c40002012-06-24 11:45:20 +02001783 This function can also support :ref:`paths relative to directory descriptors
1784 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001785
1786 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1787 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1788 rendezvous between "client" and "server" type processes: the server opens the
1789 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1790 doesn't open the FIFO --- it just creates the rendezvous point.
1791
Benjamin Petersonf650e462010-05-06 23:03:05 +00001792 Availability: Unix.
1793
Larry Hastings9cf065c2012-06-22 16:30:09 -07001794 .. versionadded:: 3.3
1795 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001796
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001797 .. versionchanged:: 3.6
1798 Accepts a :term:`path-like object`.
1799
Larry Hastings9cf065c2012-06-22 16:30:09 -07001800
Martin Panterbf19d162015-09-09 01:01:13 +00001801.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001802
1803 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00001804 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00001805 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
1806 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
1807 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
1808 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00001809 :func:`os.makedev`), otherwise it is ignored.
1810
Georg Brandl50c40002012-06-24 11:45:20 +02001811 This function can also support :ref:`paths relative to directory descriptors
1812 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001813
Berker Peksag6129e142016-09-26 22:50:11 +03001814 Availability: Unix.
1815
Larry Hastings9cf065c2012-06-22 16:30:09 -07001816 .. versionadded:: 3.3
1817 The *dir_fd* argument.
1818
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001819 .. versionchanged:: 3.6
1820 Accepts a :term:`path-like object`.
1821
Georg Brandl116aa622007-08-15 14:28:22 +00001822
1823.. function:: major(device)
1824
Christian Heimesfaf2f632008-01-06 16:59:19 +00001825 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001826 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001827
Georg Brandl116aa622007-08-15 14:28:22 +00001828
1829.. function:: minor(device)
1830
Christian Heimesfaf2f632008-01-06 16:59:19 +00001831 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001832 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001833
Georg Brandl116aa622007-08-15 14:28:22 +00001834
1835.. function:: makedev(major, minor)
1836
Christian Heimesfaf2f632008-01-06 16:59:19 +00001837 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001838
Georg Brandl116aa622007-08-15 14:28:22 +00001839
Georg Brandl116aa622007-08-15 14:28:22 +00001840.. function:: pathconf(path, name)
1841
1842 Return system configuration information relevant to a named file. *name*
1843 specifies the configuration value to retrieve; it may be a string which is the
1844 name of a defined system value; these names are specified in a number of
1845 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
1846 additional names as well. The names known to the host operating system are
1847 given in the ``pathconf_names`` dictionary. For configuration variables not
1848 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00001849
1850 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
1851 specific value for *name* is not supported by the host system, even if it is
1852 included in ``pathconf_names``, an :exc:`OSError` is raised with
1853 :const:`errno.EINVAL` for the error number.
1854
Larry Hastings77892dc2012-06-25 03:27:33 -07001855 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02001856 <path_fd>`.
1857
Benjamin Petersonf650e462010-05-06 23:03:05 +00001858 Availability: Unix.
1859
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001860 .. versionchanged:: 3.6
1861 Accepts a :term:`path-like object`.
1862
Georg Brandl116aa622007-08-15 14:28:22 +00001863
1864.. data:: pathconf_names
1865
1866 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
1867 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02001868 can be used to determine the set of names known to the system.
1869
1870 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001871
1872
Larry Hastings9cf065c2012-06-22 16:30:09 -07001873.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001874
1875 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02001876 result may be either an absolute or relative pathname; if it is relative, it
1877 may be converted to an absolute pathname using
1878 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001879
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001880 If the *path* is a string object (directly or indirectly through a
1881 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00001882 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001883 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00001884
Georg Brandl50c40002012-06-24 11:45:20 +02001885 This function can also support :ref:`paths relative to directory descriptors
1886 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001887
Brian Curtinc7395692010-07-09 15:15:09 +00001888 Availability: Unix, Windows
1889
Georg Brandlb3823372010-07-10 08:58:37 +00001890 .. versionchanged:: 3.2
1891 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001892
Larry Hastings9cf065c2012-06-22 16:30:09 -07001893 .. versionadded:: 3.3
1894 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001895
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001896 .. versionchanged:: 3.6
1897 Accepts a :term:`path-like object`.
1898
Georg Brandl116aa622007-08-15 14:28:22 +00001899
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001900.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07001901
Georg Brandl50c40002012-06-24 11:45:20 +02001902 Remove (delete) the file *path*. If *path* is a directory, :exc:`OSError` is
1903 raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001904
Georg Brandl50c40002012-06-24 11:45:20 +02001905 This function can support :ref:`paths relative to directory descriptors
1906 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001907
1908 On Windows, attempting to remove a file that is in use causes an exception to
1909 be raised; on Unix, the directory entry is removed but the storage allocated
1910 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001911
Brett Cannon05039172015-12-28 17:28:19 -08001912 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001913
Larry Hastings9cf065c2012-06-22 16:30:09 -07001914 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001915 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001916
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001917 .. versionchanged:: 3.6
1918 Accepts a :term:`path-like object`.
1919
Georg Brandl116aa622007-08-15 14:28:22 +00001920
Zachary Warea22ae212014-03-20 09:42:01 -05001921.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00001922
1923 .. index:: single: directory; deleting
1924
Christian Heimesfaf2f632008-01-06 16:59:19 +00001925 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00001926 leaf directory is successfully removed, :func:`removedirs` tries to
1927 successively remove every parent directory mentioned in *path* until an error
1928 is raised (which is ignored, because it generally means that a parent directory
1929 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
1930 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
1931 they are empty. Raises :exc:`OSError` if the leaf directory could not be
1932 successfully removed.
1933
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001934 .. versionchanged:: 3.6
1935 Accepts a :term:`path-like object`.
1936
Georg Brandl116aa622007-08-15 14:28:22 +00001937
Larry Hastings9cf065c2012-06-22 16:30:09 -07001938.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001939
1940 Rename the file or directory *src* to *dst*. If *dst* is a directory,
1941 :exc:`OSError` will be raised. On Unix, if *dst* exists and is a file, it will
Christian Heimesfaf2f632008-01-06 16:59:19 +00001942 be replaced silently if the user has permission. The operation may fail on some
Georg Brandl116aa622007-08-15 14:28:22 +00001943 Unix flavors if *src* and *dst* are on different filesystems. If successful,
1944 the renaming will be an atomic operation (this is a POSIX requirement). On
1945 Windows, if *dst* already exists, :exc:`OSError` will be raised even if it is a
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001946 file.
1947
Georg Brandlaceaf902012-06-25 08:33:56 +02001948 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1949 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001950
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001951 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001952
Larry Hastings9cf065c2012-06-22 16:30:09 -07001953 .. versionadded:: 3.3
1954 The *src_dir_fd* and *dst_dir_fd* arguments.
1955
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001956 .. versionchanged:: 3.6
1957 Accepts a :term:`path-like object` for *src* and *dst*.
1958
Georg Brandl116aa622007-08-15 14:28:22 +00001959
1960.. function:: renames(old, new)
1961
1962 Recursive directory or file renaming function. Works like :func:`rename`, except
1963 creation of any intermediate directories needed to make the new pathname good is
1964 attempted first. After the rename, directories corresponding to rightmost path
1965 segments of the old name will be pruned away using :func:`removedirs`.
1966
Georg Brandl116aa622007-08-15 14:28:22 +00001967 .. note::
1968
1969 This function can fail with the new directory structure made if you lack
1970 permissions needed to remove the leaf directory or file.
1971
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001972 .. versionchanged:: 3.6
1973 Accepts a :term:`path-like object` for *old* and *new*.
1974
Georg Brandl116aa622007-08-15 14:28:22 +00001975
Larry Hastings9cf065c2012-06-22 16:30:09 -07001976.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001977
1978 Rename the file or directory *src* to *dst*. If *dst* is a directory,
1979 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
1980 be replaced silently if the user has permission. The operation may fail
1981 if *src* and *dst* are on different filesystems. If successful,
1982 the renaming will be an atomic operation (this is a POSIX requirement).
1983
Georg Brandlaceaf902012-06-25 08:33:56 +02001984 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1985 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001986
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001987 .. versionadded:: 3.3
1988
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001989 .. versionchanged:: 3.6
1990 Accepts a :term:`path-like object` for *src* and *dst*.
1991
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001992
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001993.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001994
Georg Brandla6053b42009-09-01 08:11:14 +00001995 Remove (delete) the directory *path*. Only works when the directory is
1996 empty, otherwise, :exc:`OSError` is raised. In order to remove whole
Benjamin Petersonf650e462010-05-06 23:03:05 +00001997 directory trees, :func:`shutil.rmtree` can be used.
1998
Georg Brandl50c40002012-06-24 11:45:20 +02001999 This function can support :ref:`paths relative to directory descriptors
2000 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002001
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002002 .. versionadded:: 3.3
2003 The *dir_fd* parameter.
2004
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002005 .. versionchanged:: 3.6
2006 Accepts a :term:`path-like object`.
2007
Georg Brandl116aa622007-08-15 14:28:22 +00002008
Victor Stinner6036e442015-03-08 01:58:04 +01002009.. function:: scandir(path='.')
2010
Brett Cannona32c4d02016-06-24 14:14:44 -07002011 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2012 entries in the directory given by *path*. The entries are yielded in
2013 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2014 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002015
Victor Stinner51b58322015-05-15 09:12:58 +02002016 Using :func:`scandir` instead of :func:`listdir` can significantly
2017 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002018 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002019 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002020 All :class:`os.DirEntry` methods may perform a system call, but
2021 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2022 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002023 always requires a system call on Unix but only requires one for
2024 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002025
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002026 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2027 (directly or indirectly through the :class:`PathLike` interface),
2028 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2029 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2030 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002031
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002032 This function can also support :ref:`specifying a file descriptor
2033 <path_fd>`; the file descriptor must refer to a directory.
2034
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002035 The :func:`scandir` iterator supports the :term:`context manager` protocol
2036 and has the following method:
2037
2038 .. method:: scandir.close()
2039
2040 Close the iterator and free acquired resources.
2041
2042 This is called automatically when the iterator is exhausted or garbage
2043 collected, or when an error happens during iterating. However it
2044 is advisable to call it explicitly or use the :keyword:`with`
2045 statement.
2046
2047 .. versionadded:: 3.6
2048
Victor Stinner6036e442015-03-08 01:58:04 +01002049 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002050 the files (excluding directories) in the given *path* that don't start with
2051 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2052 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002053
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002054 with os.scandir(path) as it:
2055 for entry in it:
2056 if not entry.name.startswith('.') and entry.is_file():
2057 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002058
2059 .. note::
2060
2061 On Unix-based systems, :func:`scandir` uses the system's
2062 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2063 and
2064 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2065 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002066 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002067 and
Georg Brandl5d941342016-02-26 19:37:12 +01002068 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002069 functions.
2070
Victor Stinner6036e442015-03-08 01:58:04 +01002071 .. versionadded:: 3.5
2072
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002073 .. versionadded:: 3.6
2074 Added support for the :term:`context manager` protocol and the
2075 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2076 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2077 in its destructor.
2078
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002079 The function accepts a :term:`path-like object`.
2080
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002081 .. versionchanged:: 3.7
2082 Added support for :ref:`file descriptors <path_fd>` on Unix.
2083
Victor Stinner6036e442015-03-08 01:58:04 +01002084
2085.. class:: DirEntry
2086
2087 Object yielded by :func:`scandir` to expose the file path and other file
2088 attributes of a directory entry.
2089
2090 :func:`scandir` will provide as much of this information as possible without
2091 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002092 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002093
Brett Cannona32c4d02016-06-24 14:14:44 -07002094 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002095 structures; if you know the file metadata has changed or if a long time has
2096 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2097 up-to-date information.
2098
Brett Cannona32c4d02016-06-24 14:14:44 -07002099 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002100 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002101 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002102 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002103
Brett Cannona32c4d02016-06-24 14:14:44 -07002104 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002105 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002106
Brett Cannona32c4d02016-06-24 14:14:44 -07002107 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002108
2109 .. attribute:: name
2110
2111 The entry's base filename, relative to the :func:`scandir` *path*
2112 argument.
2113
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002114 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2115 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002116 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002117
2118 .. attribute:: path
2119
2120 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2121 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2122 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002123 argument was absolute. If the :func:`scandir` *path*
2124 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2125 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002126
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002127 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2128 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002129 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002130
2131 .. method:: inode()
2132
2133 Return the inode number of the entry.
2134
Brett Cannona32c4d02016-06-24 14:14:44 -07002135 The result is cached on the ``os.DirEntry`` object. Use
2136 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2137 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002138
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002139 On the first, uncached call, a system call is required on Windows but
2140 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002141
2142 .. method:: is_dir(\*, follow_symlinks=True)
2143
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002144 Return ``True`` if this entry is a directory or a symbolic link pointing
2145 to a directory; return ``False`` if the entry is or points to any other
2146 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002147
2148 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002149 is a directory (without following symlinks); return ``False`` if the
2150 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002151
Brett Cannona32c4d02016-06-24 14:14:44 -07002152 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002153 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2154 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2155
2156 On the first, uncached call, no system call is required in most cases.
2157 Specifically, for non-symlinks, neither Windows or Unix require a system
2158 call, except on certain Unix file systems, such as network file systems,
2159 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2160 a system call will be required to follow the symlink unless
2161 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002162
Victor Stinner51b58322015-05-15 09:12:58 +02002163 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2164 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002165
Victor Stinner6036e442015-03-08 01:58:04 +01002166 .. method:: is_file(\*, follow_symlinks=True)
2167
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002168 Return ``True`` if this entry is a file or a symbolic link pointing to a
2169 file; return ``False`` if the entry is or points to a directory or other
2170 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002171
2172 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002173 is a file (without following symlinks); return ``False`` if the entry is
2174 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002175
Brett Cannona32c4d02016-06-24 14:14:44 -07002176 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2177 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002178
2179 .. method:: is_symlink()
2180
Victor Stinner51b58322015-05-15 09:12:58 +02002181 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002182 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002183 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002184
Brett Cannona32c4d02016-06-24 14:14:44 -07002185 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002186 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002187
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002188 On the first, uncached call, no system call is required in most cases.
2189 Specifically, neither Windows or Unix require a system call, except on
2190 certain Unix file systems, such as network file systems, that return
2191 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002192
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002193 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2194 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002195
2196 .. method:: stat(\*, follow_symlinks=True)
2197
Victor Stinner51b58322015-05-15 09:12:58 +02002198 Return a :class:`stat_result` object for this entry. This method
2199 follows symbolic links by default; to stat a symbolic link add the
2200 ``follow_symlinks=False`` argument.
2201
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002202 On Unix, this method always requires a system call. On Windows, it
2203 only requires a system call if *follow_symlinks* is ``True`` and the
2204 entry is a symbolic link.
Victor Stinner6036e442015-03-08 01:58:04 +01002205
2206 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2207 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2208 get these attributes.
2209
Brett Cannona32c4d02016-06-24 14:14:44 -07002210 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002211 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2212 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002213
Guido van Rossum1469d742016-01-06 11:36:03 -08002214 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002215 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002216 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002217 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2218 and ``stat()`` methods.
2219
Victor Stinner6036e442015-03-08 01:58:04 +01002220 .. versionadded:: 3.5
2221
Brett Cannon96881cd2016-06-10 14:37:21 -07002222 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002223 Added support for the :class:`~os.PathLike` interface. Added support
2224 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002225
Victor Stinner6036e442015-03-08 01:58:04 +01002226
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002227.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002228
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002229 Get the status of a file or a file descriptor. Perform the equivalent of a
2230 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002231 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002232 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002233 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002234
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002235 This function normally follows symlinks; to stat a symlink add the argument
2236 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002237
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002238 This function can support :ref:`specifying a file descriptor <path_fd>` and
2239 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002240
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002241 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002242
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002243 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002244
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002245 >>> import os
2246 >>> statinfo = os.stat('somefile.txt')
2247 >>> statinfo
2248 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2249 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2250 st_mtime=1297230027, st_ctime=1297230027)
2251 >>> statinfo.st_size
2252 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002253
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002254 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002255
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002256 :func:`fstat` and :func:`lstat` functions.
2257
2258 .. versionadded:: 3.3
2259 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2260 descriptor instead of a path.
2261
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002262 .. versionchanged:: 3.6
2263 Accepts a :term:`path-like object`.
2264
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002265
2266.. class:: stat_result
2267
2268 Object whose attributes correspond roughly to the members of the
2269 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2270 :func:`os.fstat` and :func:`os.lstat`.
2271
2272 Attributes:
2273
2274 .. attribute:: st_mode
2275
2276 File mode: file type and file mode bits (permissions).
2277
2278 .. attribute:: st_ino
2279
2280 Inode number.
2281
2282 .. attribute:: st_dev
2283
2284 Identifier of the device on which this file resides.
2285
2286 .. attribute:: st_nlink
2287
2288 Number of hard links.
2289
2290 .. attribute:: st_uid
2291
2292 User identifier of the file owner.
2293
2294 .. attribute:: st_gid
2295
2296 Group identifier of the file owner.
2297
2298 .. attribute:: st_size
2299
2300 Size of the file in bytes, if it is a regular file or a symbolic link.
2301 The size of a symbolic link is the length of the pathname it contains,
2302 without a terminating null byte.
2303
2304 Timestamps:
2305
2306 .. attribute:: st_atime
2307
2308 Time of most recent access expressed in seconds.
2309
2310 .. attribute:: st_mtime
2311
2312 Time of most recent content modification expressed in seconds.
2313
2314 .. attribute:: st_ctime
2315
2316 Platform dependent:
2317
2318 * the time of most recent metadata change on Unix,
2319 * the time of creation on Windows, expressed in seconds.
2320
2321 .. attribute:: st_atime_ns
2322
2323 Time of most recent access expressed in nanoseconds as an integer.
2324
2325 .. attribute:: st_mtime_ns
2326
2327 Time of most recent content modification expressed in nanoseconds as an
2328 integer.
2329
2330 .. attribute:: st_ctime_ns
2331
2332 Platform dependent:
2333
2334 * the time of most recent metadata change on Unix,
2335 * the time of creation on Windows, expressed in nanoseconds as an
2336 integer.
2337
Georg Brandl116aa622007-08-15 14:28:22 +00002338 .. note::
2339
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002340 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002341 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2342 system and the file system. For example, on Windows systems using the FAT
2343 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2344 :attr:`st_atime` has only 1-day resolution. See your operating system
2345 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002346
Larry Hastings6fe20b32012-04-19 15:07:49 -07002347 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2348 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2349 systems do not provide nanosecond precision. On systems that do
2350 provide nanosecond precision, the floating-point object used to
2351 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2352 cannot preserve all of it, and as such will be slightly inexact.
2353 If you need the exact timestamps you should always use
2354 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002355
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002356 On some Unix systems (such as Linux), the following attributes may also be
2357 available:
2358
2359 .. attribute:: st_blocks
2360
2361 Number of 512-byte blocks allocated for file.
2362 This may be smaller than :attr:`st_size`/512 when the file has holes.
2363
2364 .. attribute:: st_blksize
2365
2366 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2367 smaller chunks may cause an inefficient read-modify-rewrite.
2368
2369 .. attribute:: st_rdev
2370
2371 Type of device if an inode device.
2372
2373 .. attribute:: st_flags
2374
2375 User defined flags for file.
2376
2377 On other Unix systems (such as FreeBSD), the following attributes may be
2378 available (but may be only filled out if root tries to use them):
2379
2380 .. attribute:: st_gen
2381
2382 File generation number.
2383
2384 .. attribute:: st_birthtime
2385
2386 Time of file creation.
2387
2388 On Mac OS systems, the following attributes may also be available:
2389
2390 .. attribute:: st_rsize
2391
2392 Real size of the file.
2393
2394 .. attribute:: st_creator
2395
2396 Creator of the file.
2397
2398 .. attribute:: st_type
2399
2400 File type.
2401
Victor Stinnere1d24f72014-07-24 12:44:07 +02002402 On Windows systems, the following attribute is also available:
2403
2404 .. attribute:: st_file_attributes
2405
2406 Windows file attributes: ``dwFileAttributes`` member of the
2407 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2408 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2409 constants in the :mod:`stat` module.
2410
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002411 The standard module :mod:`stat` defines functions and constants that are
2412 useful for extracting information from a :c:type:`stat` structure. (On
2413 Windows, some items are filled with dummy values.)
2414
2415 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002416 accessible as a tuple of at least 10 integers giving the most important (and
2417 portable) members of the :c:type:`stat` structure, in the order
2418 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2419 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2420 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002421 some implementations. For compatibility with older Python versions,
2422 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002423
Larry Hastings6fe20b32012-04-19 15:07:49 -07002424 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002425 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2426 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002427
Zachary Ware63f277b2014-06-19 09:46:37 -05002428 .. versionadded:: 3.5
2429 Added the :attr:`st_file_attributes` member on Windows.
2430
Georg Brandl116aa622007-08-15 14:28:22 +00002431
Georg Brandl116aa622007-08-15 14:28:22 +00002432.. function:: statvfs(path)
2433
Georg Brandl60203b42010-10-06 10:11:56 +00002434 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002435 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002436 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002437 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2438 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Benjamin Petersonf650e462010-05-06 23:03:05 +00002439 :attr:`f_flag`, :attr:`f_namemax`.
2440
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002441 Two module-level constants are defined for the :attr:`f_flag` attribute's
2442 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2443 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2444 setuid/setgid bits are disabled or not supported.
2445
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002446 Additional module-level constants are defined for GNU/glibc based systems.
2447 These are :const:`ST_NODEV` (disallow access to device special files),
2448 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2449 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2450 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2451 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2452 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2453 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2454
Georg Brandl50c40002012-06-24 11:45:20 +02002455 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002456
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002457 Availability: Unix.
2458
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002459 .. versionchanged:: 3.2
2460 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2461
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002462 .. versionadded:: 3.3
2463 Added support for specifying an open file descriptor for *path*.
2464
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002465 .. versionchanged:: 3.4
2466 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2467 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2468 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2469 and :const:`ST_RELATIME` constants were added.
2470
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002471 .. versionchanged:: 3.6
2472 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002473
Larry Hastings9cf065c2012-06-22 16:30:09 -07002474
2475.. data:: supports_dir_fd
2476
Serhiy Storchakadab83542013-10-13 20:12:43 +03002477 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002478 :mod:`os` module permit use of their *dir_fd* parameter. Different platforms
Larry Hastings9cf065c2012-06-22 16:30:09 -07002479 provide different functionality, and an option that might work on one might
2480 be unsupported on another. For consistency's sakes, functions that support
Andrew Svetlov5b898402012-12-18 21:26:36 +02002481 *dir_fd* always allow specifying the parameter, but will raise an exception
Larry Hastings9cf065c2012-06-22 16:30:09 -07002482 if the functionality is not actually available.
2483
2484 To check whether a particular function permits use of its *dir_fd*
2485 parameter, use the ``in`` operator on ``supports_dir_fd``. As an example,
2486 this expression determines whether the *dir_fd* parameter of :func:`os.stat`
2487 is locally available::
2488
2489 os.stat in os.supports_dir_fd
2490
Georg Brandlf62445a2012-06-24 13:31:20 +02002491 Currently *dir_fd* parameters only work on Unix platforms; none of them work
2492 on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002493
2494 .. versionadded:: 3.3
2495
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002496
Larry Hastings9cf065c2012-06-22 16:30:09 -07002497.. data:: supports_effective_ids
2498
Serhiy Storchakadab83542013-10-13 20:12:43 +03002499 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002500 :mod:`os` module permit use of the *effective_ids* parameter for
2501 :func:`os.access`. If the local platform supports it, the collection will
2502 contain :func:`os.access`, otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002503
Georg Brandl50c40002012-06-24 11:45:20 +02002504 To check whether you can use the *effective_ids* parameter for
Berker Peksag4d6c6062015-02-16 03:36:10 +02002505 :func:`os.access`, use the ``in`` operator on ``supports_effective_ids``,
2506 like so::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002507
2508 os.access in os.supports_effective_ids
2509
Georg Brandl50c40002012-06-24 11:45:20 +02002510 Currently *effective_ids* only works on Unix platforms; it does not work on
2511 Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002512
2513 .. versionadded:: 3.3
2514
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002515
Larry Hastings9cf065c2012-06-22 16:30:09 -07002516.. data:: supports_fd
2517
Serhiy Storchakadab83542013-10-13 20:12:43 +03002518 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002519 :mod:`os` module permit specifying their *path* parameter as an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002520 descriptor. Different platforms provide different functionality, and an
2521 option that might work on one might be unsupported on another. For
2522 consistency's sakes, functions that support *fd* always allow specifying
Andrew Svetlov5b898402012-12-18 21:26:36 +02002523 the parameter, but will raise an exception if the functionality is not
Larry Hastings9cf065c2012-06-22 16:30:09 -07002524 actually available.
2525
2526 To check whether a particular function permits specifying an open file
2527 descriptor for its *path* parameter, use the ``in`` operator on
2528 ``supports_fd``. As an example, this expression determines whether
2529 :func:`os.chdir` accepts open file descriptors when called on your local
2530 platform::
2531
2532 os.chdir in os.supports_fd
2533
2534 .. versionadded:: 3.3
2535
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002536
Larry Hastings9cf065c2012-06-22 16:30:09 -07002537.. data:: supports_follow_symlinks
2538
Serhiy Storchakadab83542013-10-13 20:12:43 +03002539 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002540 :mod:`os` module permit use of their *follow_symlinks* parameter. Different
Larry Hastings9cf065c2012-06-22 16:30:09 -07002541 platforms provide different functionality, and an option that might work on
2542 one might be unsupported on another. For consistency's sakes, functions that
2543 support *follow_symlinks* always allow specifying the parameter, but will
Andrew Svetlov5b898402012-12-18 21:26:36 +02002544 raise an exception if the functionality is not actually available.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002545
2546 To check whether a particular function permits use of its *follow_symlinks*
2547 parameter, use the ``in`` operator on ``supports_follow_symlinks``. As an
2548 example, this expression determines whether the *follow_symlinks* parameter
2549 of :func:`os.stat` is locally available::
2550
2551 os.stat in os.supports_follow_symlinks
2552
2553 .. versionadded:: 3.3
2554
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002555
Martin Panterbf19d162015-09-09 01:01:13 +00002556.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002557
Martin Panterbf19d162015-09-09 01:01:13 +00002558 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002559
Larry Hastings9cf065c2012-06-22 16:30:09 -07002560 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002561 morph to the target dynamically. If the target is present, the type of the
2562 symlink will be created to match. Otherwise, the symlink will be created
2563 as a directory if *target_is_directory* is ``True`` or a file symlink (the
2564 default) otherwise. On non-Window platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002565
Georg Brandl64a41ed2010-10-06 08:52:48 +00002566 Symbolic link support was introduced in Windows 6.0 (Vista). :func:`symlink`
2567 will raise a :exc:`NotImplementedError` on Windows versions earlier than 6.0.
Brian Curtin52173d42010-12-02 18:29:18 +00002568
Georg Brandl50c40002012-06-24 11:45:20 +02002569 This function can support :ref:`paths relative to directory descriptors
2570 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002571
Brian Curtin52173d42010-12-02 18:29:18 +00002572 .. note::
2573
Larry Hastings9cf065c2012-06-22 16:30:09 -07002574 On Windows, the *SeCreateSymbolicLinkPrivilege* is required in order to
2575 successfully create symlinks. This privilege is not typically granted to
2576 regular users but is available to accounts which can escalate privileges
2577 to the administrator level. Either obtaining the privilege or running your
Brian Curtin96245592010-12-28 17:08:22 +00002578 application as an administrator are ways to successfully create symlinks.
2579
Jason R. Coombs3a092862013-05-27 23:21:28 -04002580
Brian Curtin96245592010-12-28 17:08:22 +00002581 :exc:`OSError` is raised when the function is called by an unprivileged
2582 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002583
Georg Brandl64a41ed2010-10-06 08:52:48 +00002584 Availability: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002585
Georg Brandlb3823372010-07-10 08:58:37 +00002586 .. versionchanged:: 3.2
2587 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002588
Larry Hastings9cf065c2012-06-22 16:30:09 -07002589 .. versionadded:: 3.3
2590 Added the *dir_fd* argument, and now allow *target_is_directory*
2591 on non-Windows platforms.
2592
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002593 .. versionchanged:: 3.6
2594 Accepts a :term:`path-like object` for *src* and *dst*.
2595
Georg Brandl116aa622007-08-15 14:28:22 +00002596
Ross Lagerwall7807c352011-03-17 20:20:30 +02002597.. function:: sync()
2598
2599 Force write of everything to disk.
2600
2601 Availability: Unix.
2602
2603 .. versionadded:: 3.3
2604
2605
2606.. function:: truncate(path, length)
2607
2608 Truncate the file corresponding to *path*, so that it is at most
2609 *length* bytes in size.
2610
Georg Brandl306336b2012-06-24 12:55:33 +02002611 This function can support :ref:`specifying a file descriptor <path_fd>`.
2612
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002613 Availability: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002614
2615 .. versionadded:: 3.3
2616
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002617 .. versionchanged:: 3.5
2618 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002619
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002620 .. versionchanged:: 3.6
2621 Accepts a :term:`path-like object`.
2622
2623
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002624.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002625
Brett Cannon05039172015-12-28 17:28:19 -08002626 Remove (delete) the file *path*. This function is semantically
2627 identical to :func:`remove`; the ``unlink`` name is its
2628 traditional Unix name. Please see the documentation for
2629 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002630
Larry Hastings9cf065c2012-06-22 16:30:09 -07002631 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002632 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002633
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002634 .. versionchanged:: 3.6
2635 Accepts a :term:`path-like object`.
2636
Larry Hastings9cf065c2012-06-22 16:30:09 -07002637
Martin Panterbf19d162015-09-09 01:01:13 +00002638.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002639
Larry Hastings76ad59b2012-05-03 00:30:07 -07002640 Set the access and modified times of the file specified by *path*.
2641
2642 :func:`utime` takes two optional parameters, *times* and *ns*.
2643 These specify the times set on *path* and are used as follows:
2644
Martin Panterbf19d162015-09-09 01:01:13 +00002645 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002646 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2647 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002648 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002649 it must be a 2-tuple of the form ``(atime, mtime)``
2650 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002651 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002652 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002653 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002654
Larry Hastings9cf065c2012-06-22 16:30:09 -07002655 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002656
2657 Whether a directory can be given for *path*
Brian Curtin52fbea12011-11-06 13:41:17 -06002658 depends on whether the operating system implements directories as files
2659 (for example, Windows does not). Note that the exact times you set here may
2660 not be returned by a subsequent :func:`~os.stat` call, depending on the
2661 resolution with which your operating system records access and modification
Larry Hastings76ad59b2012-05-03 00:30:07 -07002662 times; see :func:`~os.stat`. The best way to preserve exact times is to
2663 use the *st_atime_ns* and *st_mtime_ns* fields from the :func:`os.stat`
2664 result object with the *ns* parameter to `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002665
Georg Brandl50c40002012-06-24 11:45:20 +02002666 This function can support :ref:`specifying a file descriptor <path_fd>`,
2667 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2668 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002669
Larry Hastings76ad59b2012-05-03 00:30:07 -07002670 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -07002671 Added support for specifying an open file descriptor for *path*,
2672 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002673
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002674 .. versionchanged:: 3.6
2675 Accepts a :term:`path-like object`.
2676
Georg Brandl116aa622007-08-15 14:28:22 +00002677
Georg Brandl18244152009-09-02 20:34:52 +00002678.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002679
2680 .. index::
2681 single: directory; walking
2682 single: directory; traversal
2683
Christian Heimesfaf2f632008-01-06 16:59:19 +00002684 Generate the file names in a directory tree by walking the tree
2685 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002686 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2687 filenames)``.
2688
2689 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2690 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2691 *filenames* is a list of the names of the non-directory files in *dirpath*.
2692 Note that the names in the lists contain no path components. To get a full path
2693 (which begins with *top*) to a file or directory in *dirpath*, do
2694 ``os.path.join(dirpath, name)``.
2695
Christian Heimesfaf2f632008-01-06 16:59:19 +00002696 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00002697 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07002698 (directories are generated top-down). If *topdown* is ``False``, the triple
2699 for a directory is generated after the triples for all of its subdirectories
2700 (directories are generated bottom-up). No matter the value of *topdown*, the
2701 list of subdirectories is retrieved before the tuples for the directory and
2702 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002703
Christian Heimesfaf2f632008-01-06 16:59:19 +00002704 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00002705 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
2706 recurse into the subdirectories whose names remain in *dirnames*; this can be
2707 used to prune the search, impose a specific order of visiting, or even to inform
2708 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02002709 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
2710 no effect on the behavior of the walk, because in bottom-up mode the directories
2711 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002712
Ezio Melotti67494f22011-10-18 12:59:39 +03002713 By default, errors from the :func:`listdir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00002714 argument *onerror* is specified, it should be a function; it will be called with
2715 one argument, an :exc:`OSError` instance. It can report the error to continue
2716 with the walk, or raise the exception to abort the walk. Note that the filename
2717 is available as the ``filename`` attribute of the exception object.
2718
2719 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00002720 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00002721 symlinks, on systems that support them.
2722
Georg Brandl116aa622007-08-15 14:28:22 +00002723 .. note::
2724
Georg Brandl50c40002012-06-24 11:45:20 +02002725 Be aware that setting *followlinks* to ``True`` can lead to infinite
2726 recursion if a link points to a parent directory of itself. :func:`walk`
2727 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00002728
2729 .. note::
2730
2731 If you pass a relative pathname, don't change the current working directory
2732 between resumptions of :func:`walk`. :func:`walk` never changes the current
2733 directory, and assumes that its caller doesn't either.
2734
2735 This example displays the number of bytes taken by non-directory files in each
2736 directory under the starting directory, except that it doesn't look under any
2737 CVS subdirectory::
2738
2739 import os
2740 from os.path import join, getsize
2741 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00002742 print(root, "consumes", end=" ")
2743 print(sum(getsize(join(root, name)) for name in files), end=" ")
2744 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00002745 if 'CVS' in dirs:
2746 dirs.remove('CVS') # don't visit CVS directories
2747
Victor Stinner47c41b42015-03-10 13:31:47 +01002748 In the next example (simple implementation of :func:`shutil.rmtree`),
2749 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
2750 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00002751
Christian Heimesfaf2f632008-01-06 16:59:19 +00002752 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00002753 # assuming there are no symbolic links.
2754 # CAUTION: This is dangerous! For example, if top == '/', it
2755 # could delete all your disk files.
2756 import os
2757 for root, dirs, files in os.walk(top, topdown=False):
2758 for name in files:
2759 os.remove(os.path.join(root, name))
2760 for name in dirs:
2761 os.rmdir(os.path.join(root, name))
2762
Victor Stinner524a5ba2015-03-10 13:20:34 +01002763 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02002764 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
2765 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01002766
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002767 .. versionchanged:: 3.6
2768 Accepts a :term:`path-like object`.
2769
Georg Brandl116aa622007-08-15 14:28:22 +00002770
Larry Hastingsb4038062012-07-15 10:57:38 -07002771.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01002772
2773 .. index::
2774 single: directory; walking
2775 single: directory; traversal
2776
Eli Benderskyd049d5c2012-02-11 09:52:29 +02002777 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07002778 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01002779
2780 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
2781 and *dirfd* is a file descriptor referring to the directory *dirpath*.
2782
Larry Hastingsc48fe982012-06-25 04:49:05 -07002783 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07002784 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07002785 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07002786 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07002787
Charles-François Natali7372b062012-02-05 15:15:38 +01002788 .. note::
2789
2790 Since :func:`fwalk` yields file descriptors, those are only valid until
2791 the next iteration step, so you should duplicate them (e.g. with
2792 :func:`dup`) if you want to keep them longer.
2793
2794 This example displays the number of bytes taken by non-directory files in each
2795 directory under the starting directory, except that it doesn't look under any
2796 CVS subdirectory::
2797
2798 import os
2799 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
2800 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02002801 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01002802 end="")
2803 print("bytes in", len(files), "non-directory files")
2804 if 'CVS' in dirs:
2805 dirs.remove('CVS') # don't visit CVS directories
2806
2807 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002808 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01002809 empty::
2810
2811 # Delete everything reachable from the directory named in "top",
2812 # assuming there are no symbolic links.
2813 # CAUTION: This is dangerous! For example, if top == '/', it
2814 # could delete all your disk files.
2815 import os
2816 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
2817 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002818 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002819 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002820 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002821
2822 Availability: Unix.
2823
2824 .. versionadded:: 3.3
2825
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002826 .. versionchanged:: 3.6
2827 Accepts a :term:`path-like object`.
2828
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02002829 .. versionchanged:: 3.7
2830 Added support for :class:`bytes` paths.
2831
Charles-François Natali7372b062012-02-05 15:15:38 +01002832
Georg Brandlb9831ab2012-06-24 11:57:07 +02002833Linux extended attributes
2834~~~~~~~~~~~~~~~~~~~~~~~~~
2835
2836.. versionadded:: 3.3
2837
2838These functions are all available on Linux only.
2839
2840.. function:: getxattr(path, attribute, *, follow_symlinks=True)
2841
2842 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002843 *path*. *attribute* can be bytes or str (directly or indirectly through the
2844 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
2845 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002846
2847 This function can support :ref:`specifying a file descriptor <path_fd>` and
2848 :ref:`not following symlinks <follow_symlinks>`.
2849
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002850 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03002851 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002852
Georg Brandlb9831ab2012-06-24 11:57:07 +02002853
2854.. function:: listxattr(path=None, *, follow_symlinks=True)
2855
2856 Return a list of the extended filesystem attributes on *path*. The
2857 attributes in the list are represented as strings decoded with the filesystem
2858 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
2859 directory.
2860
2861 This function can support :ref:`specifying a file descriptor <path_fd>` and
2862 :ref:`not following symlinks <follow_symlinks>`.
2863
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002864 .. versionchanged:: 3.6
2865 Accepts a :term:`path-like object`.
2866
Georg Brandlb9831ab2012-06-24 11:57:07 +02002867
2868.. function:: removexattr(path, attribute, *, follow_symlinks=True)
2869
2870 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002871 *attribute* should be bytes or str (directly or indirectly through the
2872 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02002873 with the filesystem encoding.
2874
2875 This function can support :ref:`specifying a file descriptor <path_fd>` and
2876 :ref:`not following symlinks <follow_symlinks>`.
2877
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002878 .. versionchanged:: 3.6
2879 Accepts a :term:`path-like object` for *path* and *attribute*.
2880
Georg Brandlb9831ab2012-06-24 11:57:07 +02002881
2882.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
2883
2884 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002885 *attribute* must be a bytes or str with no embedded NULs (directly or
2886 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02002887 it is encoded with the filesystem encoding. *flags* may be
2888 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
2889 given and the attribute does not exist, ``EEXISTS`` will be raised.
2890 If :data:`XATTR_CREATE` is given and the attribute already exists, the
2891 attribute will not be created and ``ENODATA`` will be raised.
2892
2893 This function can support :ref:`specifying a file descriptor <path_fd>` and
2894 :ref:`not following symlinks <follow_symlinks>`.
2895
2896 .. note::
2897
2898 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
2899 to be ignored on some filesystems.
2900
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002901 .. versionchanged:: 3.6
2902 Accepts a :term:`path-like object` for *path* and *attribute*.
2903
Georg Brandlb9831ab2012-06-24 11:57:07 +02002904
2905.. data:: XATTR_SIZE_MAX
2906
2907 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02002908 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002909
2910
2911.. data:: XATTR_CREATE
2912
2913 This is a possible value for the flags argument in :func:`setxattr`. It
2914 indicates the operation must create an attribute.
2915
2916
2917.. data:: XATTR_REPLACE
2918
2919 This is a possible value for the flags argument in :func:`setxattr`. It
2920 indicates the operation must replace an existing attribute.
2921
2922
Georg Brandl116aa622007-08-15 14:28:22 +00002923.. _os-process:
2924
2925Process Management
2926------------------
2927
2928These functions may be used to create and manage processes.
2929
Serhiy Storchakadab83542013-10-13 20:12:43 +03002930The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00002931program loaded into the process. In each case, the first of these arguments is
2932passed to the new program as its own name rather than as an argument a user may
2933have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00002934passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00002935['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
2936to be ignored.
2937
2938
2939.. function:: abort()
2940
2941 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
2942 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02002943 an exit code of ``3``. Be aware that calling this function will not call the
2944 Python signal handler registered for :const:`SIGABRT` with
2945 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002946
Georg Brandl116aa622007-08-15 14:28:22 +00002947
2948.. function:: execl(path, arg0, arg1, ...)
2949 execle(path, arg0, arg1, ..., env)
2950 execlp(file, arg0, arg1, ...)
2951 execlpe(file, arg0, arg1, ..., env)
2952 execv(path, args)
2953 execve(path, args, env)
2954 execvp(file, args)
2955 execvpe(file, args, env)
2956
2957 These functions all execute a new program, replacing the current process; they
2958 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00002959 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00002960 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00002961
2962 The current process is replaced immediately. Open file objects and
2963 descriptors are not flushed, so if there may be data buffered
2964 on these open files, you should flush them using
2965 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03002966 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00002967
Serhiy Storchakadab83542013-10-13 20:12:43 +03002968 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00002969 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00002970 to work with if the number of parameters is fixed when the code is written; the
2971 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00002972 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00002973 variable, with the arguments being passed in a list or tuple as the *args*
2974 parameter. In either case, the arguments to the child process should start with
2975 the name of the command being run, but this is not enforced.
2976
Christian Heimesfaf2f632008-01-06 16:59:19 +00002977 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00002978 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
2979 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03002980 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00002981 discussed in the next paragraph), the new environment is used as the source of
2982 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
2983 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
2984 locate the executable; *path* must contain an appropriate absolute or relative
2985 path.
2986
2987 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00002988 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00002989 used to define the environment variables for the new process (these are used
2990 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00002991 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00002992 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00002993
Larry Hastings9cf065c2012-06-22 16:30:09 -07002994 For :func:`execve` on some platforms, *path* may also be specified as an open
2995 file descriptor. This functionality may not be supported on your platform;
2996 you can check whether or not it is available using :data:`os.supports_fd`.
2997 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
2998
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00002999 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003000
Larry Hastings9cf065c2012-06-22 16:30:09 -07003001 .. versionadded:: 3.3
3002 Added support for specifying an open file descriptor for *path*
3003 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003004
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003005 .. versionchanged:: 3.6
3006 Accepts a :term:`path-like object`.
3007
Georg Brandl116aa622007-08-15 14:28:22 +00003008.. function:: _exit(n)
3009
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003010 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003011 stdio buffers, etc.
3012
Georg Brandl116aa622007-08-15 14:28:22 +00003013 .. note::
3014
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003015 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3016 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003017
Christian Heimesfaf2f632008-01-06 16:59:19 +00003018The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003019although they are not required. These are typically used for system programs
3020written in Python, such as a mail server's external command delivery program.
3021
3022.. note::
3023
3024 Some of these may not be available on all Unix platforms, since there is some
3025 variation. These constants are defined where they are defined by the underlying
3026 platform.
3027
3028
3029.. data:: EX_OK
3030
Benjamin Petersonf650e462010-05-06 23:03:05 +00003031 Exit code that means no error occurred.
3032
3033 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003034
Georg Brandl116aa622007-08-15 14:28:22 +00003035
3036.. data:: EX_USAGE
3037
3038 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003039 number of arguments are given.
3040
3041 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003042
Georg Brandl116aa622007-08-15 14:28:22 +00003043
3044.. data:: EX_DATAERR
3045
Benjamin Petersonf650e462010-05-06 23:03:05 +00003046 Exit code that means the input data was incorrect.
3047
3048 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003049
Georg Brandl116aa622007-08-15 14:28:22 +00003050
3051.. data:: EX_NOINPUT
3052
3053 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003054
Georg Brandlc575c902008-09-13 17:46:05 +00003055 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003056
Georg Brandl116aa622007-08-15 14:28:22 +00003057
3058.. data:: EX_NOUSER
3059
Benjamin Petersonf650e462010-05-06 23:03:05 +00003060 Exit code that means a specified user did not exist.
3061
3062 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003063
Georg Brandl116aa622007-08-15 14:28:22 +00003064
3065.. data:: EX_NOHOST
3066
Benjamin Petersonf650e462010-05-06 23:03:05 +00003067 Exit code that means a specified host did not exist.
3068
3069 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003070
Georg Brandl116aa622007-08-15 14:28:22 +00003071
3072.. data:: EX_UNAVAILABLE
3073
Benjamin Petersonf650e462010-05-06 23:03:05 +00003074 Exit code that means that a required service is unavailable.
3075
3076 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003077
Georg Brandl116aa622007-08-15 14:28:22 +00003078
3079.. data:: EX_SOFTWARE
3080
Benjamin Petersonf650e462010-05-06 23:03:05 +00003081 Exit code that means an internal software error was detected.
3082
3083 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003084
Georg Brandl116aa622007-08-15 14:28:22 +00003085
3086.. data:: EX_OSERR
3087
3088 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003089 inability to fork or create a pipe.
3090
3091 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003092
Georg Brandl116aa622007-08-15 14:28:22 +00003093
3094.. data:: EX_OSFILE
3095
3096 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003097 some other kind of error.
3098
3099 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003100
Georg Brandl116aa622007-08-15 14:28:22 +00003101
3102.. data:: EX_CANTCREAT
3103
3104 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003105
Georg Brandlc575c902008-09-13 17:46:05 +00003106 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003107
Georg Brandl116aa622007-08-15 14:28:22 +00003108
3109.. data:: EX_IOERR
3110
3111 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003112
Georg Brandlc575c902008-09-13 17:46:05 +00003113 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003114
Georg Brandl116aa622007-08-15 14:28:22 +00003115
3116.. data:: EX_TEMPFAIL
3117
3118 Exit code that means a temporary failure occurred. This indicates something
3119 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003120 made during a retryable operation.
3121
3122 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003123
Georg Brandl116aa622007-08-15 14:28:22 +00003124
3125.. data:: EX_PROTOCOL
3126
3127 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003128 understood.
3129
3130 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003131
Georg Brandl116aa622007-08-15 14:28:22 +00003132
3133.. data:: EX_NOPERM
3134
3135 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003136 operation (but not intended for file system problems).
3137
3138 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003139
Georg Brandl116aa622007-08-15 14:28:22 +00003140
3141.. data:: EX_CONFIG
3142
3143 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003144
Georg Brandlc575c902008-09-13 17:46:05 +00003145 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003146
Georg Brandl116aa622007-08-15 14:28:22 +00003147
3148.. data:: EX_NOTFOUND
3149
Benjamin Petersonf650e462010-05-06 23:03:05 +00003150 Exit code that means something like "an entry was not found".
3151
3152 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003153
Georg Brandl116aa622007-08-15 14:28:22 +00003154
3155.. function:: fork()
3156
Christian Heimesfaf2f632008-01-06 16:59:19 +00003157 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003158 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003159
Larry Hastings3732ed22014-03-15 21:13:56 -07003160 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003161 known issues when using fork() from a thread.
3162
Christian Heimes3046fe42013-10-29 21:08:56 +01003163 .. warning::
3164
3165 See :mod:`ssl` for applications that use the SSL module with fork().
3166
Georg Brandlc575c902008-09-13 17:46:05 +00003167 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003168
3169
3170.. function:: forkpty()
3171
3172 Fork a child process, using a new pseudo-terminal as the child's controlling
3173 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3174 new child's process id in the parent, and *fd* is the file descriptor of the
3175 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003176 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003177
Georg Brandlc575c902008-09-13 17:46:05 +00003178 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003179
3180
3181.. function:: kill(pid, sig)
3182
3183 .. index::
3184 single: process; killing
3185 single: process; signalling
3186
3187 Send signal *sig* to the process *pid*. Constants for the specific signals
3188 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003189
3190 Windows: The :data:`signal.CTRL_C_EVENT` and
3191 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3192 only be sent to console processes which share a common console window,
3193 e.g., some subprocesses. Any other value for *sig* will cause the process
3194 to be unconditionally killed by the TerminateProcess API, and the exit code
3195 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3196 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003197
Victor Stinnerb3e72192011-05-08 01:46:11 +02003198 See also :func:`signal.pthread_kill`.
3199
Georg Brandl67b21b72010-08-17 15:07:14 +00003200 .. versionadded:: 3.2
3201 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003202
Georg Brandl116aa622007-08-15 14:28:22 +00003203
3204.. function:: killpg(pgid, sig)
3205
3206 .. index::
3207 single: process; killing
3208 single: process; signalling
3209
Benjamin Petersonf650e462010-05-06 23:03:05 +00003210 Send the signal *sig* to the process group *pgid*.
3211
3212 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003213
Georg Brandl116aa622007-08-15 14:28:22 +00003214
3215.. function:: nice(increment)
3216
3217 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003218
Georg Brandlc575c902008-09-13 17:46:05 +00003219 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003220
3221
3222.. function:: plock(op)
3223
3224 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003225 ``<sys/lock.h>``) determines which segments are locked.
3226
3227 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003228
3229
Martin Panterbf19d162015-09-09 01:01:13 +00003230.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003231
Martin Panterbf19d162015-09-09 01:01:13 +00003232 Open a pipe to or from command *cmd*.
3233 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003234 connected to the pipe, which can be read or written depending on whether *mode*
3235 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3236 the corresponding argument to the built-in :func:`open` function. The
3237 returned file object reads or writes text strings rather than bytes.
3238
3239 The ``close`` method returns :const:`None` if the subprocess exited
3240 successfully, or the subprocess's return code if there was an
3241 error. On POSIX systems, if the return code is positive it
3242 represents the return value of the process left-shifted by one
3243 byte. If the return code is negative, the process was terminated
3244 by the signal given by the negated value of the return code. (For
3245 example, the return value might be ``- signal.SIGKILL`` if the
3246 subprocess was killed.) On Windows systems, the return value
3247 contains the signed integer return code from the child process.
3248
3249 This is implemented using :class:`subprocess.Popen`; see that class's
3250 documentation for more powerful ways to manage and communicate with
3251 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003252
3253
Gregory P. Smith163468a2017-05-29 10:03:41 -07003254.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3255 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003256
Gregory P. Smith163468a2017-05-29 10:03:41 -07003257 Register callables to be executed when a new child process is forked
3258 using :func:`os.fork` or similar process cloning APIs.
3259 The parameters are optional and keyword-only.
3260 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003261
Gregory P. Smith163468a2017-05-29 10:03:41 -07003262 * *before* is a function called before forking a child process.
3263 * *after_in_parent* is a function called from the parent process
3264 after forking a child process.
3265 * *after_in_child* is a function called from the child process.
3266
3267 These calls are only made if control is expected to return to the
3268 Python interpreter. A typical :mod:`subprocess` launch will not
3269 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003270
3271 Functions registered for execution before forking are called in
3272 reverse registration order. Functions registered for execution
3273 after forking (either in the parent or in the child) are called
3274 in registration order.
3275
3276 Note that :c:func:`fork` calls made by third-party C code may not
3277 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3278 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3279
Gregory P. Smith163468a2017-05-29 10:03:41 -07003280 There is no way to unregister a function.
3281
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003282 Availability: Unix.
3283
3284 .. versionadded:: 3.7
3285
3286
Georg Brandl116aa622007-08-15 14:28:22 +00003287.. function:: spawnl(mode, path, ...)
3288 spawnle(mode, path, ..., env)
3289 spawnlp(mode, file, ...)
3290 spawnlpe(mode, file, ..., env)
3291 spawnv(mode, path, args)
3292 spawnve(mode, path, args, env)
3293 spawnvp(mode, file, args)
3294 spawnvpe(mode, file, args, env)
3295
3296 Execute the program *path* in a new process.
3297
3298 (Note that the :mod:`subprocess` module provides more powerful facilities for
3299 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003300 preferable to using these functions. Check especially the
3301 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003302
Christian Heimesfaf2f632008-01-06 16:59:19 +00003303 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003304 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3305 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003306 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003307 be used with the :func:`waitpid` function.
3308
Serhiy Storchakadab83542013-10-13 20:12:43 +03003309 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003310 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003311 to work with if the number of parameters is fixed when the code is written; the
3312 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003313 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003314 parameters is variable, with the arguments being passed in a list or tuple as
3315 the *args* parameter. In either case, the arguments to the child process must
3316 start with the name of the command being run.
3317
Christian Heimesfaf2f632008-01-06 16:59:19 +00003318 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003319 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3320 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003321 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003322 discussed in the next paragraph), the new environment is used as the source of
3323 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3324 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3325 :envvar:`PATH` variable to locate the executable; *path* must contain an
3326 appropriate absolute or relative path.
3327
3328 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003329 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003330 which is used to define the environment variables for the new process (they are
3331 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003332 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003333 the new process to inherit the environment of the current process. Note that
3334 keys and values in the *env* dictionary must be strings; invalid keys or
3335 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003336
3337 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3338 equivalent::
3339
3340 import os
3341 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3342
3343 L = ['cp', 'index.html', '/dev/null']
3344 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3345
3346 Availability: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
Antoine Pitrou0e752dd2011-07-19 01:26:58 +02003347 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3348 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3349 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003350
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003351 .. versionchanged:: 3.6
3352 Accepts a :term:`path-like object`.
3353
Georg Brandl116aa622007-08-15 14:28:22 +00003354
3355.. data:: P_NOWAIT
3356 P_NOWAITO
3357
Serhiy Storchakadab83542013-10-13 20:12:43 +03003358 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003359 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003360 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003361 the return value.
3362
3363 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003364
Georg Brandl116aa622007-08-15 14:28:22 +00003365
3366.. data:: P_WAIT
3367
Serhiy Storchakadab83542013-10-13 20:12:43 +03003368 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003369 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3370 return until the new process has run to completion and will return the exit code
3371 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003372 process.
3373
3374 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003375
Georg Brandl116aa622007-08-15 14:28:22 +00003376
3377.. data:: P_DETACH
3378 P_OVERLAY
3379
Serhiy Storchakadab83542013-10-13 20:12:43 +03003380 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003381 functions. These are less portable than those listed above. :const:`P_DETACH`
3382 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3383 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003384 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003385
Georg Brandl116aa622007-08-15 14:28:22 +00003386 Availability: Windows.
3387
Georg Brandl116aa622007-08-15 14:28:22 +00003388
3389.. function:: startfile(path[, operation])
3390
3391 Start a file with its associated application.
3392
3393 When *operation* is not specified or ``'open'``, this acts like double-clicking
3394 the file in Windows Explorer, or giving the file name as an argument to the
3395 :program:`start` command from the interactive command shell: the file is opened
3396 with whatever application (if any) its extension is associated.
3397
3398 When another *operation* is given, it must be a "command verb" that specifies
3399 what should be done with the file. Common verbs documented by Microsoft are
3400 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3401 ``'find'`` (to be used on directories).
3402
3403 :func:`startfile` returns as soon as the associated application is launched.
3404 There is no option to wait for the application to close, and no way to retrieve
3405 the application's exit status. The *path* parameter is relative to the current
3406 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003407 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003408 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003409 the path is properly encoded for Win32.
3410
Steve Dower7d0e0c92015-01-24 08:18:24 -08003411 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3412 function is not resolved until this function is first called. If the function
3413 cannot be resolved, :exc:`NotImplementedError` will be raised.
3414
Benjamin Petersonf650e462010-05-06 23:03:05 +00003415 Availability: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003416
Georg Brandl116aa622007-08-15 14:28:22 +00003417
3418.. function:: system(command)
3419
3420 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003421 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003422 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3423 the executed command. If *command* generates any output, it will be sent to
3424 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003425
3426 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003427 format specified for :func:`wait`. Note that POSIX does not specify the
3428 meaning of the return value of the C :c:func:`system` function, so the return
3429 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003430
Georg Brandl8f7b4272010-10-14 06:35:53 +00003431 On Windows, the return value is that returned by the system shell after
3432 running *command*. The shell is given by the Windows environment variable
3433 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3434 status of the command run; on systems using a non-native shell, consult your
3435 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003436
Georg Brandl8f7b4272010-10-14 06:35:53 +00003437 The :mod:`subprocess` module provides more powerful facilities for spawning
3438 new processes and retrieving their results; using that module is preferable
3439 to using this function. See the :ref:`subprocess-replacements` section in
3440 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003441
Benjamin Petersonf650e462010-05-06 23:03:05 +00003442 Availability: Unix, Windows.
3443
Georg Brandl116aa622007-08-15 14:28:22 +00003444
3445.. function:: times()
3446
Larry Hastings605a62d2012-06-24 04:33:36 -07003447 Returns the current global process times.
3448 The return value is an object with five attributes:
3449
3450 * :attr:`user` - user time
3451 * :attr:`system` - system time
3452 * :attr:`children_user` - user time of all child processes
3453 * :attr:`children_system` - system time of all child processes
3454 * :attr:`elapsed` - elapsed real time since a fixed point in the past
3455
3456 For backwards compatibility, this object also behaves like a five-tuple
3457 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
3458 :attr:`children_system`, and :attr:`elapsed` in that order.
3459
3460 See the Unix manual page
Benjamin Petersonf650e462010-05-06 23:03:05 +00003461 :manpage:`times(2)` or the corresponding Windows Platform API documentation.
Larry Hastings605a62d2012-06-24 04:33:36 -07003462 On Windows, only :attr:`user` and :attr:`system` are known; the other
3463 attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003464
Georg Brandl8a5555f2012-06-24 13:29:09 +02003465 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003466
Larry Hastings605a62d2012-06-24 04:33:36 -07003467 .. versionchanged:: 3.3
3468 Return type changed from a tuple to a tuple-like object
3469 with named attributes.
3470
Georg Brandl116aa622007-08-15 14:28:22 +00003471
3472.. function:: wait()
3473
3474 Wait for completion of a child process, and return a tuple containing its pid
3475 and exit status indication: a 16-bit number, whose low byte is the signal number
3476 that killed the process, and whose high byte is the exit status (if the signal
3477 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003478 produced.
3479
3480 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003481
Ross Lagerwall7807c352011-03-17 20:20:30 +02003482.. function:: waitid(idtype, id, options)
3483
3484 Wait for the completion of one or more child processes.
3485 *idtype* can be :data:`P_PID`, :data:`P_PGID` or :data:`P_ALL`.
3486 *id* specifies the pid to wait on.
3487 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
3488 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
3489 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
3490 representing the data contained in the :c:type:`siginfo_t` structure, namely:
3491 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
3492 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
3493 children in a waitable state.
3494
3495 Availability: Unix.
3496
3497 .. versionadded:: 3.3
3498
3499.. data:: P_PID
3500 P_PGID
3501 P_ALL
3502
3503 These are the possible values for *idtype* in :func:`waitid`. They affect
3504 how *id* is interpreted.
3505
3506 Availability: Unix.
3507
3508 .. versionadded:: 3.3
3509
3510.. data:: WEXITED
3511 WSTOPPED
3512 WNOWAIT
3513
3514 Flags that can be used in *options* in :func:`waitid` that specify what
3515 child signal to wait for.
3516
3517 Availability: Unix.
3518
3519 .. versionadded:: 3.3
3520
3521
3522.. data:: CLD_EXITED
3523 CLD_DUMPED
3524 CLD_TRAPPED
3525 CLD_CONTINUED
3526
3527 These are the possible values for :attr:`si_code` in the result returned by
3528 :func:`waitid`.
3529
3530 Availability: Unix.
3531
3532 .. versionadded:: 3.3
3533
Georg Brandl116aa622007-08-15 14:28:22 +00003534
3535.. function:: waitpid(pid, options)
3536
3537 The details of this function differ on Unix and Windows.
3538
3539 On Unix: Wait for completion of a child process given by process id *pid*, and
3540 return a tuple containing its process id and exit status indication (encoded as
3541 for :func:`wait`). The semantics of the call are affected by the value of the
3542 integer *options*, which should be ``0`` for normal operation.
3543
3544 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
3545 that specific process. If *pid* is ``0``, the request is for the status of any
3546 child in the process group of the current process. If *pid* is ``-1``, the
3547 request pertains to any child of the current process. If *pid* is less than
3548 ``-1``, status is requested for any process in the process group ``-pid`` (the
3549 absolute value of *pid*).
3550
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00003551 An :exc:`OSError` is raised with the value of errno when the syscall
3552 returns -1.
3553
Georg Brandl116aa622007-08-15 14:28:22 +00003554 On Windows: Wait for completion of a process given by process handle *pid*, and
3555 return a tuple containing *pid*, and its exit status shifted left by 8 bits
3556 (shifting makes cross-platform use of the function easier). A *pid* less than or
3557 equal to ``0`` has no special meaning on Windows, and raises an exception. The
3558 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03003559 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
3560 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00003561
Victor Stinnera766ddf2015-03-26 23:50:57 +01003562 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02003563 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01003564 exception, the function now retries the system call instead of raising an
3565 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
3566
Georg Brandl116aa622007-08-15 14:28:22 +00003567
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02003568.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00003569
3570 Similar to :func:`waitpid`, except no process id argument is given and a
3571 3-element tuple containing the child's process id, exit status indication, and
3572 resource usage information is returned. Refer to :mod:`resource`.\
Serhiy Storchakadab83542013-10-13 20:12:43 +03003573 :func:`~resource.getrusage` for details on resource usage information. The
3574 option argument is the same as that provided to :func:`waitpid` and
3575 :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003576
Georg Brandl116aa622007-08-15 14:28:22 +00003577 Availability: Unix.
3578
Georg Brandl116aa622007-08-15 14:28:22 +00003579
Victor Stinner4195b5c2012-02-08 23:03:19 +01003580.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00003581
3582 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
3583 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03003584 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
3585 resource usage information. The arguments to :func:`wait4` are the same
3586 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003587
3588 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003589
Georg Brandl116aa622007-08-15 14:28:22 +00003590
3591.. data:: WNOHANG
3592
3593 The option for :func:`waitpid` to return immediately if no child process status
3594 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003595
Georg Brandlc575c902008-09-13 17:46:05 +00003596 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003597
3598
3599.. data:: WCONTINUED
3600
3601 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00003602 from a job control stop since their status was last reported.
3603
Georg Brandl8a5555f2012-06-24 13:29:09 +02003604 Availability: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00003605
Georg Brandl116aa622007-08-15 14:28:22 +00003606
3607.. data:: WUNTRACED
3608
3609 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00003610 their current state has not been reported since they were stopped.
3611
3612 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003613
Georg Brandl116aa622007-08-15 14:28:22 +00003614
3615The following functions take a process status code as returned by
3616:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
3617used to determine the disposition of a process.
3618
Georg Brandl116aa622007-08-15 14:28:22 +00003619.. function:: WCOREDUMP(status)
3620
Christian Heimesfaf2f632008-01-06 16:59:19 +00003621 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00003622 return ``False``.
3623
3624 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003625
Georg Brandl116aa622007-08-15 14:28:22 +00003626
3627.. function:: WIFCONTINUED(status)
3628
Christian Heimesfaf2f632008-01-06 16:59:19 +00003629 Return ``True`` if the process has been continued from a job control stop,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003630 otherwise return ``False``.
3631
3632 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003633
Georg Brandl116aa622007-08-15 14:28:22 +00003634
3635.. function:: WIFSTOPPED(status)
3636
Christian Heimesfaf2f632008-01-06 16:59:19 +00003637 Return ``True`` if the process has been stopped, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003638 ``False``.
3639
3640 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003641
3642
3643.. function:: WIFSIGNALED(status)
3644
Christian Heimesfaf2f632008-01-06 16:59:19 +00003645 Return ``True`` if the process exited due to a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003646 ``False``.
3647
3648 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003649
3650
3651.. function:: WIFEXITED(status)
3652
Christian Heimesfaf2f632008-01-06 16:59:19 +00003653 Return ``True`` if the process exited using the :manpage:`exit(2)` system call,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003654 otherwise return ``False``.
3655
3656 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003657
3658
3659.. function:: WEXITSTATUS(status)
3660
3661 If ``WIFEXITED(status)`` is true, return the integer parameter to the
3662 :manpage:`exit(2)` system call. Otherwise, the return value is meaningless.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003663
Georg Brandlc575c902008-09-13 17:46:05 +00003664 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003665
3666
3667.. function:: WSTOPSIG(status)
3668
Benjamin Petersonf650e462010-05-06 23:03:05 +00003669 Return the signal which caused the process to stop.
3670
3671 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003672
3673
3674.. function:: WTERMSIG(status)
3675
Benjamin Petersonf650e462010-05-06 23:03:05 +00003676 Return the signal which caused the process to exit.
3677
3678 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003679
3680
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003681Interface to the scheduler
3682--------------------------
3683
3684These functions control how a process is allocated CPU time by the operating
3685system. They are only available on some Unix platforms. For more detailed
3686information, consult your Unix manpages.
3687
3688.. versionadded:: 3.3
3689
Andrew Kuchling4921a082013-06-21 11:49:57 -04003690The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003691operating system.
3692
3693.. data:: SCHED_OTHER
3694
3695 The default scheduling policy.
3696
3697.. data:: SCHED_BATCH
3698
3699 Scheduling policy for CPU-intensive processes that tries to preserve
3700 interactivity on the rest of the computer.
3701
3702.. data:: SCHED_IDLE
3703
3704 Scheduling policy for extremely low priority background tasks.
3705
3706.. data:: SCHED_SPORADIC
3707
3708 Scheduling policy for sporadic server programs.
3709
3710.. data:: SCHED_FIFO
3711
3712 A First In First Out scheduling policy.
3713
3714.. data:: SCHED_RR
3715
3716 A round-robin scheduling policy.
3717
3718.. data:: SCHED_RESET_ON_FORK
3719
Martin Panter8d56c022016-05-29 04:13:35 +00003720 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003721 this flag set forks, its child's scheduling policy and priority are reset to
3722 the default.
3723
3724
3725.. class:: sched_param(sched_priority)
3726
3727 This class represents tunable scheduling parameters used in
3728 :func:`sched_setparam`, :func:`sched_setscheduler`, and
3729 :func:`sched_getparam`. It is immutable.
3730
3731 At the moment, there is only one possible parameter:
3732
3733 .. attribute:: sched_priority
3734
3735 The scheduling priority for a scheduling policy.
3736
3737
3738.. function:: sched_get_priority_min(policy)
3739
3740 Get the minimum priority value for *policy*. *policy* is one of the
3741 scheduling policy constants above.
3742
3743
3744.. function:: sched_get_priority_max(policy)
3745
3746 Get the maximum priority value for *policy*. *policy* is one of the
3747 scheduling policy constants above.
3748
3749
3750.. function:: sched_setscheduler(pid, policy, param)
3751
3752 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
3753 the calling process. *policy* is one of the scheduling policy constants
3754 above. *param* is a :class:`sched_param` instance.
3755
3756
3757.. function:: sched_getscheduler(pid)
3758
3759 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
3760 means the calling process. The result is one of the scheduling policy
3761 constants above.
3762
3763
3764.. function:: sched_setparam(pid, param)
3765
3766 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
3767 the calling process. *param* is a :class:`sched_param` instance.
3768
3769
3770.. function:: sched_getparam(pid)
3771
3772 Return the scheduling parameters as a :class:`sched_param` instance for the
3773 process with PID *pid*. A *pid* of 0 means the calling process.
3774
3775
3776.. function:: sched_rr_get_interval(pid)
3777
3778 Return the round-robin quantum in seconds for the process with PID *pid*. A
3779 *pid* of 0 means the calling process.
3780
3781
3782.. function:: sched_yield()
3783
3784 Voluntarily relinquish the CPU.
3785
3786
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003787.. function:: sched_setaffinity(pid, mask)
3788
Antoine Pitrou84869872012-08-04 16:16:35 +02003789 Restrict the process with PID *pid* (or the current process if zero) to a
3790 set of CPUs. *mask* is an iterable of integers representing the set of
3791 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003792
3793
Antoine Pitrou84869872012-08-04 16:16:35 +02003794.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003795
Antoine Pitrou84869872012-08-04 16:16:35 +02003796 Return the set of CPUs the process with PID *pid* (or the current process
3797 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003798
3799
Georg Brandl116aa622007-08-15 14:28:22 +00003800.. _os-path:
3801
3802Miscellaneous System Information
3803--------------------------------
3804
3805
3806.. function:: confstr(name)
3807
3808 Return string-valued system configuration values. *name* specifies the
3809 configuration value to retrieve; it may be a string which is the name of a
3810 defined system value; these names are specified in a number of standards (POSIX,
3811 Unix 95, Unix 98, and others). Some platforms define additional names as well.
3812 The names known to the host operating system are given as the keys of the
3813 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003814 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00003815
3816 If the configuration value specified by *name* isn't defined, ``None`` is
3817 returned.
3818
3819 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
3820 specific value for *name* is not supported by the host system, even if it is
3821 included in ``confstr_names``, an :exc:`OSError` is raised with
3822 :const:`errno.EINVAL` for the error number.
3823
Georg Brandl8a5555f2012-06-24 13:29:09 +02003824 Availability: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003825
Georg Brandl116aa622007-08-15 14:28:22 +00003826
3827.. data:: confstr_names
3828
3829 Dictionary mapping names accepted by :func:`confstr` to the integer values
3830 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003831 determine the set of names known to the system.
3832
3833 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003834
3835
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003836.. function:: cpu_count()
3837
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03003838 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003839
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01003840 This number is not equivalent to the number of CPUs the current process can
3841 use. The number of usable CPUs can be obtained with
3842 ``len(os.sched_getaffinity(0))``
3843
3844
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003845 .. versionadded:: 3.4
3846
3847
Georg Brandl116aa622007-08-15 14:28:22 +00003848.. function:: getloadavg()
3849
Christian Heimesa62da1d2008-01-12 19:39:10 +00003850 Return the number of processes in the system run queue averaged over the last
3851 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003852 unobtainable.
3853
3854 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003855
Georg Brandl116aa622007-08-15 14:28:22 +00003856
3857.. function:: sysconf(name)
3858
3859 Return integer-valued system configuration values. If the configuration value
3860 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
3861 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
3862 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003863
Georg Brandlc575c902008-09-13 17:46:05 +00003864 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003865
3866
3867.. data:: sysconf_names
3868
3869 Dictionary mapping names accepted by :func:`sysconf` to the integer values
3870 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003871 determine the set of names known to the system.
3872
3873 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003874
Christian Heimesfaf2f632008-01-06 16:59:19 +00003875The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00003876are defined for all platforms.
3877
3878Higher-level operations on pathnames are defined in the :mod:`os.path` module.
3879
3880
3881.. data:: curdir
3882
3883 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00003884 directory. This is ``'.'`` for Windows and POSIX. Also available via
3885 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003886
3887
3888.. data:: pardir
3889
3890 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00003891 directory. This is ``'..'`` for Windows and POSIX. Also available via
3892 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003893
3894
3895.. data:: sep
3896
Georg Brandlc575c902008-09-13 17:46:05 +00003897 The character used by the operating system to separate pathname components.
3898 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
3899 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00003900 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
3901 useful. Also available via :mod:`os.path`.
3902
3903
3904.. data:: altsep
3905
3906 An alternative character used by the operating system to separate pathname
3907 components, or ``None`` if only one separator character exists. This is set to
3908 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
3909 :mod:`os.path`.
3910
3911
3912.. data:: extsep
3913
3914 The character which separates the base filename from the extension; for example,
3915 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
3916
Georg Brandl116aa622007-08-15 14:28:22 +00003917
3918.. data:: pathsep
3919
3920 The character conventionally used by the operating system to separate search
3921 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
3922 Windows. Also available via :mod:`os.path`.
3923
3924
3925.. data:: defpath
3926
Serhiy Storchakadab83542013-10-13 20:12:43 +03003927 The default search path used by :func:`exec\*p\* <execl>` and
3928 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
3929 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003930
3931
3932.. data:: linesep
3933
3934 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00003935 platform. This may be a single character, such as ``'\n'`` for POSIX, or
3936 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
3937 *os.linesep* as a line terminator when writing files opened in text mode (the
3938 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00003939
3940
3941.. data:: devnull
3942
Georg Brandl850a9902010-05-21 22:04:32 +00003943 The file path of the null device. For example: ``'/dev/null'`` for
3944 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003945
Andrew Kuchling4921a082013-06-21 11:49:57 -04003946.. data:: RTLD_LAZY
3947 RTLD_NOW
3948 RTLD_GLOBAL
3949 RTLD_LOCAL
3950 RTLD_NODELETE
3951 RTLD_NOLOAD
3952 RTLD_DEEPBIND
3953
3954 Flags for use with the :func:`~sys.setdlopenflags` and
3955 :func:`~sys.getdlopenflags` functions. See the Unix manual page
3956 :manpage:`dlopen(3)` for what the different flags mean.
3957
3958 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00003959
Georg Brandl116aa622007-08-15 14:28:22 +00003960
Victor Stinner9b1f4742016-09-06 16:18:52 -07003961Random numbers
3962--------------
Georg Brandl116aa622007-08-15 14:28:22 +00003963
3964
Victor Stinner9b1f4742016-09-06 16:18:52 -07003965.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00003966
Victor Stinner9b1f4742016-09-06 16:18:52 -07003967 Get up to *size* random bytes. The function can return less bytes than
3968 requested.
3969
3970 These bytes can be used to seed user-space random number generators or for
3971 cryptographic purposes.
3972
3973 ``getrandom()`` relies on entropy gathered from device drivers and other
3974 sources of environmental noise. Unnecessarily reading large quantities of
3975 data will have a negative impact on other users of the ``/dev/random`` and
3976 ``/dev/urandom`` devices.
3977
3978 The flags argument is a bit mask that can contain zero or more of the
3979 following values ORed together: :py:data:`os.GRND_RANDOM` and
3980 :py:data:`GRND_NONBLOCK`.
3981
3982 See also the `Linux getrandom() manual page
3983 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
3984
3985 Availability: Linux 3.17 and newer.
3986
3987 .. versionadded:: 3.6
3988
3989.. function:: urandom(size)
3990
3991 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00003992
3993 This function returns random bytes from an OS-specific randomness source. The
3994 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02003995 though its exact quality depends on the OS implementation.
3996
Victor Stinnere66987e2016-09-06 16:33:52 -07003997 On Linux, if the ``getrandom()`` syscall is available, it is used in
3998 blocking mode: block until the system urandom entropy pool is initialized
3999 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4000 the rationale. On Linux, the :func:`getrandom` function can be used to get
4001 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4002 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004003
Victor Stinnere66987e2016-09-06 16:33:52 -07004004 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4005 device. If the ``/dev/urandom`` device is not available or not readable, the
4006 :exc:`NotImplementedError` exception is raised.
4007
4008 On Windows, it will use ``CryptGenRandom()``.
4009
4010 .. seealso::
4011 The :mod:`secrets` module provides higher level functions. For an
4012 easy-to-use interface to the random number generator provided by your
4013 platform, please see :class:`random.SystemRandom`.
4014
4015 .. versionchanged:: 3.6.0
4016 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4017 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004018
Victor Stinnerdddf4842016-06-07 11:21:42 +02004019 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004020 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4021 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004022
Victor Stinnerace88482015-07-29 02:28:32 +02004023 .. versionchanged:: 3.5
4024 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4025 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4026 function is now used. These functions avoid the usage of an internal file
4027 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004028
4029.. data:: GRND_NONBLOCK
4030
4031 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4032 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4033 if the entropy pool has not yet been initialized.
4034
4035 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4036 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4037
4038 .. versionadded:: 3.6
4039
4040.. data:: GRND_RANDOM
4041
4042 If this bit is set, then random bytes are drawn from the
4043 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4044
4045 .. versionadded:: 3.6