blob: 9cb34deb0423cc9d044f817d479d8682f91e111a [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
Benjamin Peterson1baf4652009-12-31 03:11:23 +000035* An "Availability: Unix" note means that this function is commonly found on
36 Unix systems. It does not make any claims about its existence on a specific
37 operating system.
38
39* If not separately noted, all functions that claim "Availability: Unix" are
40 supported on Mac OS X, which builds on a Unix core.
41
Benjamin Petersonf650e462010-05-06 23:03:05 +000042.. Availability notes get their own line and occur at the end of the function
43.. documentation.
44
Georg Brandlc575c902008-09-13 17:46:05 +000045.. note::
46
Christian Heimesa62da1d2008-01-12 19:39:10 +000047 All functions in this module raise :exc:`OSError` in the case of invalid or
48 inaccessible file names and paths, or other arguments that have the correct
49 type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000050
Georg Brandl116aa622007-08-15 14:28:22 +000051.. exception:: error
52
Christian Heimesa62da1d2008-01-12 19:39:10 +000053 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000054
55
56.. data:: name
57
Benjamin Peterson1baf4652009-12-31 03:11:23 +000058 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070059 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070060 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000061
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020062 .. seealso::
63 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
64 system-dependent version information.
65
66 The :mod:`platform` module provides detailed checks for the
67 system's identity.
68
Georg Brandl116aa622007-08-15 14:28:22 +000069
Martin v. Löwis011e8422009-05-05 04:43:17 +000070.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020071.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000072
73File Names, Command Line Arguments, and Environment Variables
74-------------------------------------------------------------
75
Georg Brandl67b21b72010-08-17 15:07:14 +000076In Python, file names, command line arguments, and environment variables are
77represented using the string type. On some systems, decoding these strings to
78and from bytes is necessary before passing them to the operating system. Python
79uses the file system encoding to perform this conversion (see
80:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000081
82.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000083 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020084 case, Python uses the :ref:`surrogateescape encoding error handler
85 <surrogateescape>`, which means that undecodable bytes are replaced by a
86 Unicode character U+DCxx on decoding, and these are again translated to the
87 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000088
89
Georg Brandl67b21b72010-08-17 15:07:14 +000090The file system encoding must guarantee to successfully decode all bytes
91below 128. If the file system encoding fails to provide this guarantee, API
92functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000093
94
Georg Brandl116aa622007-08-15 14:28:22 +000095.. _os-procinfo:
96
97Process Parameters
98------------------
99
100These functions and data items provide information and operate on the current
101process and user.
102
103
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200104.. function:: ctermid()
105
106 Return the filename corresponding to the controlling terminal of the process.
107
108 Availability: Unix.
109
110
Georg Brandl116aa622007-08-15 14:28:22 +0000111.. data:: environ
112
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700113 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000114 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
115 and is equivalent to ``getenv("HOME")`` in C.
116
117 This mapping is captured the first time the :mod:`os` module is imported,
118 typically during Python startup as part of processing :file:`site.py`. Changes
119 to the environment made after this time are not reflected in ``os.environ``,
120 except for changes made by modifying ``os.environ`` directly.
121
122 If the platform supports the :func:`putenv` function, this mapping may be used
123 to modify the environment as well as query the environment. :func:`putenv` will
124 be called automatically when the mapping is modified.
125
Victor Stinner84ae1182010-05-06 22:05:07 +0000126 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
127 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
128 to use a different encoding.
129
Georg Brandl116aa622007-08-15 14:28:22 +0000130 .. note::
131
132 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
133 to modify ``os.environ``.
134
135 .. note::
136
Georg Brandlc575c902008-09-13 17:46:05 +0000137 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
138 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000139 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000140
141 If :func:`putenv` is not provided, a modified copy of this mapping may be
142 passed to the appropriate process-creation functions to cause child processes
143 to use a modified environment.
144
Georg Brandl9afde1c2007-11-01 20:32:30 +0000145 If the platform supports the :func:`unsetenv` function, you can delete items in
Georg Brandl116aa622007-08-15 14:28:22 +0000146 this mapping to unset environment variables. :func:`unsetenv` will be called
Georg Brandl9afde1c2007-11-01 20:32:30 +0000147 automatically when an item is deleted from ``os.environ``, and when
148 one of the :meth:`pop` or :meth:`clear` methods is called.
149
Georg Brandl116aa622007-08-15 14:28:22 +0000150
Victor Stinner84ae1182010-05-06 22:05:07 +0000151.. data:: environb
152
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700153 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000154 environment as byte strings. :data:`environ` and :data:`environb` are
155 synchronized (modify :data:`environb` updates :data:`environ`, and vice
156 versa).
157
Victor Stinnerb745a742010-05-18 17:17:23 +0000158 :data:`environb` is only available if :data:`supports_bytes_environ` is
159 True.
Victor Stinner84ae1182010-05-06 22:05:07 +0000160
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000161 .. versionadded:: 3.2
162
Victor Stinner84ae1182010-05-06 22:05:07 +0000163
Georg Brandl116aa622007-08-15 14:28:22 +0000164.. function:: chdir(path)
165 fchdir(fd)
166 getcwd()
167 :noindex:
168
169 These functions are described in :ref:`os-file-dir`.
170
171
Victor Stinnere8d51452010-08-19 01:05:19 +0000172.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000173
Brett Cannonc28592b2016-06-24 12:21:47 -0700174 Encode :term:`path-like <path-like object>` *filename* to the filesystem
175 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
176 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000177
Antoine Pitroua305ca72010-09-25 22:12:00 +0000178 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000179
180 .. versionadded:: 3.2
181
Brett Cannonb08388d2016-06-09 15:58:06 -0700182 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700183 Support added to accept objects implementing the :class:`os.PathLike`
184 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700185
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187.. function:: fsdecode(filename)
188
Brett Cannonc28592b2016-06-24 12:21:47 -0700189 Decode the :term:`path-like <path-like object>` *filename* from the
190 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
191 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000192
193 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000194
195 .. versionadded:: 3.2
196
Brett Cannonb08388d2016-06-09 15:58:06 -0700197 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700198 Support added to accept objects implementing the :class:`os.PathLike`
199 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700200
Victor Stinner449c4662010-05-08 11:10:09 +0000201
Ethan Furmancdc08792016-06-02 15:06:09 -0700202.. function:: fspath(path)
203
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700204 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700205
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700206 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
207 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
208 returned as long as it is a :class:`str` or :class:`bytes` object.
209 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700210
Brett Cannonb08388d2016-06-09 15:58:06 -0700211 .. versionadded:: 3.6
212
213
214.. class:: PathLike
215
216 An :term:`abstract base class` for objects representing a file system path,
217 e.g. :class:`pathlib.PurePath`.
218
Berker Peksagb18ffb42016-06-10 08:43:54 +0300219 .. versionadded:: 3.6
220
Brett Cannonb08388d2016-06-09 15:58:06 -0700221 .. abstractmethod:: __fspath__()
222
223 Return the file system path representation of the object.
224
225 The method should only return a :class:`str` or :class:`bytes` object,
226 with the preference being for :class:`str`.
227
Ethan Furmancdc08792016-06-02 15:06:09 -0700228
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200229.. function:: getenv(key, default=None)
230
231 Return the value of the environment variable *key* if it exists, or
232 *default* if it doesn't. *key*, *default* and the result are str.
233
234 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
235 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
236 would like to use a different encoding.
237
238 Availability: most flavors of Unix, Windows.
239
240
241.. function:: getenvb(key, default=None)
242
243 Return the value of the environment variable *key* if it exists, or
244 *default* if it doesn't. *key*, *default* and the result are bytes.
245
Berker Peksag996e5f92016-09-26 22:44:07 +0300246 :func:`getenvb` is only available if :data:`supports_bytes_environ`
247 is True.
248
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200249 Availability: most flavors of Unix.
250
251 .. versionadded:: 3.2
252
253
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000254.. function:: get_exec_path(env=None)
255
256 Returns the list of directories that will be searched for a named
257 executable, similar to a shell, when launching a process.
258 *env*, when specified, should be an environment variable dictionary
259 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300260 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000261
262 .. versionadded:: 3.2
263
264
Georg Brandl116aa622007-08-15 14:28:22 +0000265.. function:: getegid()
266
267 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000268 "set id" bit on the file being executed in the current process.
269
270 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000271
272
273.. function:: geteuid()
274
275 .. index:: single: user; effective id
276
Benjamin Petersonf650e462010-05-06 23:03:05 +0000277 Return the current process's effective user id.
278
279 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000280
281
282.. function:: getgid()
283
284 .. index:: single: process; group
285
Benjamin Petersonf650e462010-05-06 23:03:05 +0000286 Return the real group id of the current process.
287
288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000289
290
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200291.. function:: getgrouplist(user, group)
292
293 Return list of group ids that *user* belongs to. If *group* is not in the
294 list, it is included; typically, *group* is specified as the group ID
295 field from the password record for *user*.
296
297 Availability: Unix.
298
299 .. versionadded:: 3.3
300
301
Georg Brandl116aa622007-08-15 14:28:22 +0000302.. function:: getgroups()
303
304 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000305
Georg Brandl116aa622007-08-15 14:28:22 +0000306 Availability: Unix.
307
Larry Hastings3732ed22014-03-15 21:13:56 -0700308 .. note::
309
310 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700311 other Unix platforms. If the Python interpreter was built with a
312 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
313 the list of effective group ids associated with the current user process;
314 this list is limited to a system-defined number of entries, typically 16,
315 and may be modified by calls to :func:`setgroups` if suitably privileged.
316 If built with a deployment target greater than :const:`10.5`,
317 :func:`getgroups` returns the current group access list for the user
318 associated with the effective user id of the process; the group access
319 list may change over the lifetime of the process, it is not affected by
320 calls to :func:`setgroups`, and its length is not limited to 16. The
321 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
322 obtained with :func:`sysconfig.get_config_var`.
323
Georg Brandl116aa622007-08-15 14:28:22 +0000324
325.. function:: getlogin()
326
327 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500328 process. For most purposes, it is more useful to use
329 :func:`getpass.getuser` since the latter checks the environment variables
330 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
331 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
332 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000333
Brian Curtine8e4b3b2010-09-23 20:04:14 +0000334 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
336
337.. function:: getpgid(pid)
338
339 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000340 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000341
Benjamin Petersonf650e462010-05-06 23:03:05 +0000342 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000343
344.. function:: getpgrp()
345
346 .. index:: single: process; group
347
Benjamin Petersonf650e462010-05-06 23:03:05 +0000348 Return the id of the current process group.
349
350 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000351
352
353.. function:: getpid()
354
355 .. index:: single: process; id
356
Benjamin Petersonf650e462010-05-06 23:03:05 +0000357 Return the current process id.
358
Georg Brandl116aa622007-08-15 14:28:22 +0000359
360.. function:: getppid()
361
362 .. index:: single: process; id of parent
363
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000364 Return the parent's process id. When the parent process has exited, on Unix
365 the id returned is the one of the init process (1), on Windows it is still
366 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000367
Georg Brandl8a5555f2012-06-24 13:29:09 +0200368 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000369
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000370 .. versionchanged:: 3.2
371 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000372
Georg Brandl8a5555f2012-06-24 13:29:09 +0200373
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000374.. function:: getpriority(which, who)
375
376 .. index:: single: process; scheduling priority
377
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200378 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000379 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
380 is interpreted relative to *which* (a process identifier for
381 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200382 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000383 (respectively) the calling process, the process group of the calling process,
384 or the real user ID of the calling process.
385
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200386 Availability: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000387
388 .. versionadded:: 3.3
389
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200390
391.. data:: PRIO_PROCESS
392 PRIO_PGRP
393 PRIO_USER
394
395 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
396
397 Availability: Unix.
398
399 .. versionadded:: 3.3
400
401
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000402.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000403
404 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000405 real, effective, and saved user ids.
406
407 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000408
Georg Brandl1b83a452009-11-28 11:12:26 +0000409 .. versionadded:: 3.2
410
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000411
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000412.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000413
414 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000415 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000416
417 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000418
Georg Brandl1b83a452009-11-28 11:12:26 +0000419 .. versionadded:: 3.2
420
Georg Brandl116aa622007-08-15 14:28:22 +0000421
422.. function:: getuid()
423
424 .. index:: single: user; id
425
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700426 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000427
428 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000429
430
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200431.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000432
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200433 Call the system initgroups() to initialize the group access list with all of
434 the groups of which the specified username is a member, plus the specified
435 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000436
437 Availability: Unix.
438
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200439 .. versionadded:: 3.2
440
Georg Brandl116aa622007-08-15 14:28:22 +0000441
Georg Brandl18244152009-09-02 20:34:52 +0000442.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000443
444 .. index:: single: environment variables; setting
445
Georg Brandl18244152009-09-02 20:34:52 +0000446 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000447 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000448 :func:`popen` or :func:`fork` and :func:`execv`.
449
450 Availability: most flavors of Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000451
452 .. note::
453
Georg Brandlc575c902008-09-13 17:46:05 +0000454 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
455 cause memory leaks. Refer to the system documentation for putenv.
Georg Brandl116aa622007-08-15 14:28:22 +0000456
457 When :func:`putenv` is supported, assignments to items in ``os.environ`` are
458 automatically translated into corresponding calls to :func:`putenv`; however,
459 calls to :func:`putenv` don't update ``os.environ``, so it is actually
460 preferable to assign to items of ``os.environ``.
461
462
463.. function:: setegid(egid)
464
Benjamin Petersonf650e462010-05-06 23:03:05 +0000465 Set the current process's effective group id.
466
467 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000468
469
470.. function:: seteuid(euid)
471
Benjamin Petersonf650e462010-05-06 23:03:05 +0000472 Set the current process's effective user id.
473
474 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000475
476
477.. function:: setgid(gid)
478
Benjamin Petersonf650e462010-05-06 23:03:05 +0000479 Set the current process' group id.
480
481 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000482
483
484.. function:: setgroups(groups)
485
486 Set the list of supplemental group ids associated with the current process to
487 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000488 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000489
Georg Brandl116aa622007-08-15 14:28:22 +0000490 Availability: Unix.
491
Ned Deily2e209682012-04-30 11:14:02 -0700492 .. note:: On Mac OS X, the length of *groups* may not exceed the
493 system-defined maximum number of effective group ids, typically 16.
494 See the documentation for :func:`getgroups` for cases where it may not
495 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000496
497.. function:: setpgrp()
498
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300499 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000500 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000501
Georg Brandl116aa622007-08-15 14:28:22 +0000502 Availability: Unix.
503
504
505.. function:: setpgid(pid, pgrp)
506
Georg Brandl60203b42010-10-06 10:11:56 +0000507 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000508 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000509 for the semantics.
510
511 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000512
513
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000514.. function:: setpriority(which, who, priority)
515
516 .. index:: single: process; scheduling priority
517
518 Set program scheduling priority. The value *which* is one of
519 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
520 is interpreted relative to *which* (a process identifier for
521 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
522 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
523 (respectively) the calling process, the process group of the calling process,
524 or the real user ID of the calling process.
525 *priority* is a value in the range -20 to 19. The default priority is 0;
526 lower priorities cause more favorable scheduling.
527
528 Availability: Unix
529
530 .. versionadded:: 3.3
531
532
Georg Brandl116aa622007-08-15 14:28:22 +0000533.. function:: setregid(rgid, egid)
534
Benjamin Petersonf650e462010-05-06 23:03:05 +0000535 Set the current process's real and effective group ids.
536
537 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000538
Georg Brandl1b83a452009-11-28 11:12:26 +0000539
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000540.. function:: setresgid(rgid, egid, sgid)
541
542 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000543
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000544 Availability: Unix.
545
Georg Brandl1b83a452009-11-28 11:12:26 +0000546 .. versionadded:: 3.2
547
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000548
549.. function:: setresuid(ruid, euid, suid)
550
551 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000552
Georg Brandl6faee4e2010-09-21 14:48:28 +0000553 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000554
Georg Brandl1b83a452009-11-28 11:12:26 +0000555 .. versionadded:: 3.2
556
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000557
558.. function:: setreuid(ruid, euid)
559
Benjamin Petersonf650e462010-05-06 23:03:05 +0000560 Set the current process's real and effective user ids.
561
562 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000563
Georg Brandl116aa622007-08-15 14:28:22 +0000564
565.. function:: getsid(pid)
566
Georg Brandl60203b42010-10-06 10:11:56 +0000567 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000568
Georg Brandl116aa622007-08-15 14:28:22 +0000569 Availability: Unix.
570
Georg Brandl116aa622007-08-15 14:28:22 +0000571
572.. function:: setsid()
573
Georg Brandl60203b42010-10-06 10:11:56 +0000574 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000575
Georg Brandl116aa622007-08-15 14:28:22 +0000576 Availability: Unix.
577
578
579.. function:: setuid(uid)
580
581 .. index:: single: user; id, setting
582
Benjamin Petersonf650e462010-05-06 23:03:05 +0000583 Set the current process's user id.
584
585 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000586
Georg Brandl116aa622007-08-15 14:28:22 +0000587
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000588.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000589.. function:: strerror(code)
590
591 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000592 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000593 error number, :exc:`ValueError` is raised.
594
Georg Brandl116aa622007-08-15 14:28:22 +0000595
Victor Stinnerb745a742010-05-18 17:17:23 +0000596.. data:: supports_bytes_environ
597
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200598 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000599 Windows).
600
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000601 .. versionadded:: 3.2
602
Victor Stinnerb745a742010-05-18 17:17:23 +0000603
Georg Brandl116aa622007-08-15 14:28:22 +0000604.. function:: umask(mask)
605
Benjamin Petersonf650e462010-05-06 23:03:05 +0000606 Set the current numeric umask and return the previous umask.
607
Georg Brandl116aa622007-08-15 14:28:22 +0000608
609.. function:: uname()
610
611 .. index::
612 single: gethostname() (in module socket)
613 single: gethostbyaddr() (in module socket)
614
Larry Hastings605a62d2012-06-24 04:33:36 -0700615 Returns information identifying the current operating system.
616 The return value is an object with five attributes:
617
618 * :attr:`sysname` - operating system name
619 * :attr:`nodename` - name of machine on network (implementation-defined)
620 * :attr:`release` - operating system release
621 * :attr:`version` - operating system version
622 * :attr:`machine` - hardware identifier
623
624 For backwards compatibility, this object is also iterable, behaving
625 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
626 :attr:`release`, :attr:`version`, and :attr:`machine`
627 in that order.
628
629 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000630 leading component; a better way to get the hostname is
631 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000632 ``socket.gethostbyaddr(socket.gethostname())``.
633
634 Availability: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000635
Larry Hastings605a62d2012-06-24 04:33:36 -0700636 .. versionchanged:: 3.3
637 Return type changed from a tuple to a tuple-like object
638 with named attributes.
639
Georg Brandl116aa622007-08-15 14:28:22 +0000640
Georg Brandl18244152009-09-02 20:34:52 +0000641.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000642
643 .. index:: single: environment variables; deleting
644
Georg Brandl18244152009-09-02 20:34:52 +0000645 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000646 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000647 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000648
649 When :func:`unsetenv` is supported, deletion of items in ``os.environ`` is
650 automatically translated into a corresponding call to :func:`unsetenv`; however,
651 calls to :func:`unsetenv` don't update ``os.environ``, so it is actually
652 preferable to delete items of ``os.environ``.
653
Benjamin Petersonf650e462010-05-06 23:03:05 +0000654 Availability: most flavors of Unix, Windows.
655
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657.. _os-newstreams:
658
659File Object Creation
660--------------------
661
Georg Brandla570e982012-06-24 13:26:22 +0200662This function creates new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200663:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000664
665
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300666.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandlb2462e22012-06-24 13:24:56 +0200668 Return an open file object connected to the file descriptor *fd*. This is an
669 alias of the :func:`open` built-in function and accepts the same arguments.
670 The only difference is that the first argument of :func:`fdopen` must always
671 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673
Georg Brandl116aa622007-08-15 14:28:22 +0000674.. _os-fd-ops:
675
676File Descriptor Operations
677--------------------------
678
679These functions operate on I/O streams referenced using file descriptors.
680
681File descriptors are small integers corresponding to a file that has been opened
682by the current process. For example, standard input is usually file descriptor
6830, standard output is 1, and standard error is 2. Further files opened by a
684process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
685is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
686by file descriptors.
687
Serhiy Storchakadab83542013-10-13 20:12:43 +0300688The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000689associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000690descriptor directly will bypass the file object methods, ignoring aspects such
691as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000692
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000693
Georg Brandl116aa622007-08-15 14:28:22 +0000694.. function:: close(fd)
695
Benjamin Petersonf650e462010-05-06 23:03:05 +0000696 Close file descriptor *fd*.
697
Georg Brandl116aa622007-08-15 14:28:22 +0000698 .. note::
699
700 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000701 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000702 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300703 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
705
Christian Heimesfdab48e2008-01-20 09:06:41 +0000706.. function:: closerange(fd_low, fd_high)
707
708 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200709 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000710
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000711 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000712 try:
713 os.close(fd)
714 except OSError:
715 pass
716
Christian Heimesfdab48e2008-01-20 09:06:41 +0000717
Georg Brandl81f11302007-12-21 08:45:42 +0000718.. function:: device_encoding(fd)
719
720 Return a string describing the encoding of the device associated with *fd*
721 if it is connected to a terminal; else return :const:`None`.
722
723
Georg Brandl116aa622007-08-15 14:28:22 +0000724.. function:: dup(fd)
725
Victor Stinnerdaf45552013-08-28 00:53:59 +0200726 Return a duplicate of file descriptor *fd*. The new file descriptor is
727 :ref:`non-inheritable <fd_inheritance>`.
728
729 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
730 2: stderr), the new file descriptor is :ref:`inheritable
731 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000732
Victor Stinnerdaf45552013-08-28 00:53:59 +0200733 .. versionchanged:: 3.4
734 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000735
Victor Stinnerdaf45552013-08-28 00:53:59 +0200736
737.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000738
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800739 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
740 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
741 <fd_inheritance>` by default or non-inheritable if *inheritable*
742 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000743
Victor Stinnerdaf45552013-08-28 00:53:59 +0200744 .. versionchanged:: 3.4
745 Add the optional *inheritable* parameter.
746
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800747 .. versionchanged:: 3.7
748 Return *fd2* on success. Previously, ``None`` was always returned.
749
Georg Brandl116aa622007-08-15 14:28:22 +0000750
Christian Heimes4e30a842007-11-30 22:12:06 +0000751.. function:: fchmod(fd, mode)
752
Georg Brandlb9df00c2012-06-24 12:38:14 +0200753 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200754 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200755 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000756
757 Availability: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000758
759
760.. function:: fchown(fd, uid, gid)
761
762 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200763 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200764 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200765 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000766
Christian Heimes4e30a842007-11-30 22:12:06 +0000767 Availability: Unix.
768
769
Georg Brandl116aa622007-08-15 14:28:22 +0000770.. function:: fdatasync(fd)
771
772 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000773 metadata.
774
775 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000776
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000777 .. note::
778 This function is not available on MacOS.
779
Georg Brandl116aa622007-08-15 14:28:22 +0000780
781.. function:: fpathconf(fd, name)
782
783 Return system configuration information relevant to an open file. *name*
784 specifies the configuration value to retrieve; it may be a string which is the
785 name of a defined system value; these names are specified in a number of
786 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
787 additional names as well. The names known to the host operating system are
788 given in the ``pathconf_names`` dictionary. For configuration variables not
789 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000790
791 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
792 specific value for *name* is not supported by the host system, even if it is
793 included in ``pathconf_names``, an :exc:`OSError` is raised with
794 :const:`errno.EINVAL` for the error number.
795
Georg Brandl4d399a42012-06-25 07:40:32 +0200796 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200797
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700798 Availability: Unix.
799
Georg Brandl116aa622007-08-15 14:28:22 +0000800
Victor Stinner4195b5c2012-02-08 23:03:19 +0100801.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000802
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200803 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
804 object.
805
806 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
807
808 .. seealso::
809
Berker Peksag2034caa2015-04-27 13:53:28 +0300810 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000811
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200812
Georg Brandl116aa622007-08-15 14:28:22 +0000813.. function:: fstatvfs(fd)
814
Georg Brandlb9df00c2012-06-24 12:38:14 +0200815 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200816 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200817 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000818
819 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000820
821
822.. function:: fsync(fd)
823
824 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000825 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000826
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000827 If you're starting with a buffered Python :term:`file object` *f*, first do
828 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
829 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000830
Georg Brandl8a5555f2012-06-24 13:29:09 +0200831 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000832
833
834.. function:: ftruncate(fd, length)
835
Georg Brandl306336b2012-06-24 12:55:33 +0200836 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200837 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200838 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000839
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700840 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000841
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700842 .. versionchanged:: 3.5
843 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000844
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200845.. function:: get_blocking(fd)
846
847 Get the blocking mode of the file descriptor: ``False`` if the
848 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
849
850 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
851
852 Availability: Unix.
853
854 .. versionadded:: 3.5
855
Georg Brandl116aa622007-08-15 14:28:22 +0000856.. function:: isatty(fd)
857
858 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000859 tty(-like) device, else ``False``.
860
Georg Brandl116aa622007-08-15 14:28:22 +0000861
Ross Lagerwall7807c352011-03-17 20:20:30 +0200862.. function:: lockf(fd, cmd, len)
863
864 Apply, test or remove a POSIX lock on an open file descriptor.
865 *fd* is an open file descriptor.
866 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
867 :data:`F_ULOCK` or :data:`F_TEST`.
868 *len* specifies the section of the file to lock.
869
870 Availability: Unix.
871
872 .. versionadded:: 3.3
873
874
875.. data:: F_LOCK
876 F_TLOCK
877 F_ULOCK
878 F_TEST
879
880 Flags that specify what action :func:`lockf` will take.
881
882 Availability: Unix.
883
884 .. versionadded:: 3.3
885
Georg Brandlf62445a2012-06-24 13:31:20 +0200886
Georg Brandl116aa622007-08-15 14:28:22 +0000887.. function:: lseek(fd, pos, how)
888
Christian Heimesfaf2f632008-01-06 16:59:19 +0000889 Set the current position of file descriptor *fd* to position *pos*, modified
890 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
891 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300892 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100893 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000894
Georg Brandl116aa622007-08-15 14:28:22 +0000895
Georg Brandl8569e582010-05-19 20:57:08 +0000896.. data:: SEEK_SET
897 SEEK_CUR
898 SEEK_END
899
900 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200901 respectively.
902
Jesus Cea94363612012-06-22 18:32:07 +0200903 .. versionadded:: 3.3
904 Some operating systems could support additional values, like
905 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
906
Georg Brandl8569e582010-05-19 20:57:08 +0000907
Martin Panterbf19d162015-09-09 01:01:13 +0000908.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000909
Martin Panterbf19d162015-09-09 01:01:13 +0000910 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700911 its mode according to *mode*. When computing *mode*, the current umask value
912 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200913 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000914
915 For a description of the flag and mode values, see the C run-time documentation;
916 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400917 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000918 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000919
Georg Brandl50c40002012-06-24 11:45:20 +0200920 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400921 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700922
Victor Stinnerdaf45552013-08-28 00:53:59 +0200923 .. versionchanged:: 3.4
924 The new file descriptor is now non-inheritable.
925
Georg Brandl116aa622007-08-15 14:28:22 +0000926 .. note::
927
Georg Brandl502d9a52009-07-26 15:02:41 +0000928 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000929 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000930 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000931 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000932
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000933 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700934 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000935
Victor Stinnera766ddf2015-03-26 23:50:57 +0100936 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200937 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100938 exception, the function now retries the system call instead of raising an
939 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
940
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700941 .. versionchanged:: 3.6
942 Accepts a :term:`path-like object`.
943
Andrew Kuchling4921a082013-06-21 11:49:57 -0400944The following constants are options for the *flags* parameter to the
945:func:`~os.open` function. They can be combined using the bitwise OR operator
946``|``. Some of them are not available on all platforms. For descriptions of
947their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100948or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400949
950
951.. data:: O_RDONLY
952 O_WRONLY
953 O_RDWR
954 O_APPEND
955 O_CREAT
956 O_EXCL
957 O_TRUNC
958
Vinay Sajipe4946e72016-09-11 15:15:59 +0100959 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400960
961
962.. data:: O_DSYNC
963 O_RSYNC
964 O_SYNC
965 O_NDELAY
966 O_NONBLOCK
967 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -0400968 O_CLOEXEC
969
Vinay Sajipe4946e72016-09-11 15:15:59 +0100970 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400971
972 .. versionchanged:: 3.3
973 Add :data:`O_CLOEXEC` constant.
974
975.. data:: O_BINARY
976 O_NOINHERIT
977 O_SHORT_LIVED
978 O_TEMPORARY
979 O_RANDOM
980 O_SEQUENTIAL
981 O_TEXT
982
Vinay Sajipe4946e72016-09-11 15:15:59 +0100983 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400984
985
986.. data:: O_ASYNC
987 O_DIRECT
988 O_DIRECTORY
989 O_NOFOLLOW
990 O_NOATIME
991 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +0200992 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +0100993 O_SHLOCK
994 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -0400995
Vinay Sajipe4946e72016-09-11 15:15:59 +0100996 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -0400997 the C library.
998
Christian Heimesd88f7352013-08-16 14:37:50 +0200999 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001000 Add :data:`O_PATH` on systems that support it.
1001 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1002 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001003
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001004
Georg Brandl116aa622007-08-15 14:28:22 +00001005.. function:: openpty()
1006
1007 .. index:: module: pty
1008
Victor Stinnerdaf45552013-08-28 00:53:59 +02001009 Open a new pseudo-terminal pair. Return a pair of file descriptors
1010 ``(master, slave)`` for the pty and the tty, respectively. The new file
1011 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1012 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001013
1014 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001015
Victor Stinnerdaf45552013-08-28 00:53:59 +02001016 .. versionchanged:: 3.4
1017 The new file descriptors are now non-inheritable.
1018
Georg Brandl116aa622007-08-15 14:28:22 +00001019
1020.. function:: pipe()
1021
Victor Stinnerdaf45552013-08-28 00:53:59 +02001022 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001023 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001024 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001025
1026 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001027
Victor Stinnerdaf45552013-08-28 00:53:59 +02001028 .. versionchanged:: 3.4
1029 The new file descriptors are now non-inheritable.
1030
Georg Brandl116aa622007-08-15 14:28:22 +00001031
Charles-François Natali368f34b2011-06-06 19:49:47 +02001032.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001033
1034 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001035 *flags* can be constructed by ORing together one or more of these values:
1036 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001037 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1038 respectively.
1039
1040 Availability: some flavors of Unix.
1041
1042 .. versionadded:: 3.3
1043
1044
Ross Lagerwall7807c352011-03-17 20:20:30 +02001045.. function:: posix_fallocate(fd, offset, len)
1046
1047 Ensures that enough disk space is allocated for the file specified by *fd*
1048 starting from *offset* and continuing for *len* bytes.
1049
1050 Availability: Unix.
1051
1052 .. versionadded:: 3.3
1053
1054
1055.. function:: posix_fadvise(fd, offset, len, advice)
1056
1057 Announces an intention to access data in a specific pattern thus allowing
1058 the kernel to make optimizations.
1059 The advice applies to the region of the file specified by *fd* starting at
1060 *offset* and continuing for *len* bytes.
1061 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1062 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1063 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1064
1065 Availability: Unix.
1066
1067 .. versionadded:: 3.3
1068
1069
1070.. data:: POSIX_FADV_NORMAL
1071 POSIX_FADV_SEQUENTIAL
1072 POSIX_FADV_RANDOM
1073 POSIX_FADV_NOREUSE
1074 POSIX_FADV_WILLNEED
1075 POSIX_FADV_DONTNEED
1076
1077 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1078 the access pattern that is likely to be used.
1079
1080 Availability: Unix.
1081
1082 .. versionadded:: 3.3
1083
1084
1085.. function:: pread(fd, buffersize, offset)
1086
1087 Read from a file descriptor, *fd*, at a position of *offset*. It will read up
1088 to *buffersize* number of bytes. The file offset remains unchanged.
1089
1090 Availability: Unix.
1091
1092 .. versionadded:: 3.3
1093
1094
Jesus Cea67503c52014-10-20 16:18:24 +02001095.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001096
Jesus Cea67503c52014-10-20 16:18:24 +02001097 Write *bytestring* to a file descriptor, *fd*, from *offset*,
1098 leaving the file offset unchanged.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001099
1100 Availability: Unix.
1101
1102 .. versionadded:: 3.3
1103
1104
Georg Brandl116aa622007-08-15 14:28:22 +00001105.. function:: read(fd, n)
1106
Georg Brandlb90be692009-07-29 16:14:16 +00001107 Read at most *n* bytes from file descriptor *fd*. Return a bytestring containing the
Georg Brandl116aa622007-08-15 14:28:22 +00001108 bytes read. If the end of the file referred to by *fd* has been reached, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001109 empty bytes object is returned.
1110
Georg Brandl116aa622007-08-15 14:28:22 +00001111 .. note::
1112
1113 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001114 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1115 "file object" returned by the built-in function :func:`open` or by
1116 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1117 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001118
Victor Stinnera766ddf2015-03-26 23:50:57 +01001119 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001120 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001121 exception, the function now retries the system call instead of raising an
1122 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1123
Georg Brandl116aa622007-08-15 14:28:22 +00001124
Martin Panterbf19d162015-09-09 01:01:13 +00001125.. function:: sendfile(out, in, offset, count)
Martin Panter94994132015-09-09 05:29:24 +00001126 sendfile(out, in, offset, count, [headers], [trailers], flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001127
Martin Panterbf19d162015-09-09 01:01:13 +00001128 Copy *count* bytes from file descriptor *in* to file descriptor *out*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001129 starting at *offset*.
1130 Return the number of bytes sent. When EOF is reached return 0.
1131
1132 The first function notation is supported by all platforms that define
1133 :func:`sendfile`.
1134
1135 On Linux, if *offset* is given as ``None``, the bytes are read from the
1136 current position of *in* and the position of *in* is updated.
1137
1138 The second case may be used on Mac OS X and FreeBSD where *headers* and
1139 *trailers* are arbitrary sequences of buffers that are written before and
1140 after the data from *in* is written. It returns the same as the first case.
1141
Martin Panterbf19d162015-09-09 01:01:13 +00001142 On Mac OS X and FreeBSD, a value of 0 for *count* specifies to send until
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001143 the end of *in* is reached.
1144
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001145 All platforms support sockets as *out* file descriptor, and some platforms
1146 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001147
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001148 Cross-platform applications should not use *headers*, *trailers* and *flags*
1149 arguments.
1150
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001151 Availability: Unix.
1152
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001153 .. note::
1154
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001155 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001156 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001157
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001158 .. versionadded:: 3.3
1159
1160
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001161.. function:: set_blocking(fd, blocking)
1162
1163 Set the blocking mode of the specified file descriptor. Set the
1164 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1165
1166 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1167
1168 Availability: Unix.
1169
1170 .. versionadded:: 3.5
1171
1172
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001173.. data:: SF_NODISKIO
1174 SF_MNOWAIT
1175 SF_SYNC
1176
1177 Parameters to the :func:`sendfile` function, if the implementation supports
1178 them.
1179
1180 Availability: Unix.
1181
1182 .. versionadded:: 3.3
1183
1184
Ross Lagerwall7807c352011-03-17 20:20:30 +02001185.. function:: readv(fd, buffers)
1186
Benjamin Petersone83ed432014-01-18 22:54:59 -05001187 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
1188 objects <bytes-like object>` *buffers*. :func:`~os.readv` will transfer data
1189 into each buffer until it is full and then move on to the next buffer in the
1190 sequence to hold the rest of the data. :func:`~os.readv` returns the total
1191 number of bytes read (which may be less than the total capacity of all the
1192 objects).
Ross Lagerwall7807c352011-03-17 20:20:30 +02001193
1194 Availability: Unix.
1195
1196 .. versionadded:: 3.3
1197
1198
Georg Brandl116aa622007-08-15 14:28:22 +00001199.. function:: tcgetpgrp(fd)
1200
1201 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001202 file descriptor as returned by :func:`os.open`).
1203
1204 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001205
1206
1207.. function:: tcsetpgrp(fd, pg)
1208
1209 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001210 descriptor as returned by :func:`os.open`) to *pg*.
1211
1212 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001213
1214
1215.. function:: ttyname(fd)
1216
1217 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001218 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001219 exception is raised.
1220
1221 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001222
1223
1224.. function:: write(fd, str)
1225
Georg Brandlb90be692009-07-29 16:14:16 +00001226 Write the bytestring in *str* to file descriptor *fd*. Return the number of
Benjamin Petersonf650e462010-05-06 23:03:05 +00001227 bytes actually written.
1228
Georg Brandl116aa622007-08-15 14:28:22 +00001229 .. note::
1230
1231 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001232 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001233 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001234 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1235 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001236
Victor Stinnera766ddf2015-03-26 23:50:57 +01001237 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001238 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001239 exception, the function now retries the system call instead of raising an
1240 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1241
Georg Brandl8569e582010-05-19 20:57:08 +00001242
Ross Lagerwall7807c352011-03-17 20:20:30 +02001243.. function:: writev(fd, buffers)
1244
Benjamin Petersone83ed432014-01-18 22:54:59 -05001245 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be a
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001246 sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1247 processed in array order. Entire contents of first buffer is written before
1248 proceeding to second, and so on. The operating system may set a limit
1249 (sysconf() value SC_IOV_MAX) on the number of buffers that can be used.
1250
Benjamin Petersone83ed432014-01-18 22:54:59 -05001251 :func:`~os.writev` writes the contents of each object to the file descriptor
1252 and returns the total number of bytes written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001253
1254 Availability: Unix.
1255
1256 .. versionadded:: 3.3
1257
1258
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001259.. _terminal-size:
1260
1261Querying the size of a terminal
1262~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1263
1264.. versionadded:: 3.3
1265
1266.. function:: get_terminal_size(fd=STDOUT_FILENO)
1267
1268 Return the size of the terminal window as ``(columns, lines)``,
1269 tuple of type :class:`terminal_size`.
1270
1271 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1272 output) specifies which file descriptor should be queried.
1273
1274 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001275 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001276
1277 :func:`shutil.get_terminal_size` is the high-level function which
1278 should normally be used, ``os.get_terminal_size`` is the low-level
1279 implementation.
1280
1281 Availability: Unix, Windows.
1282
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001283.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001284
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001285 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001286
1287 .. attribute:: columns
1288
1289 Width of the terminal window in characters.
1290
1291 .. attribute:: lines
1292
1293 Height of the terminal window in characters.
1294
1295
Victor Stinnerdaf45552013-08-28 00:53:59 +02001296.. _fd_inheritance:
1297
1298Inheritance of File Descriptors
1299~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1300
Georg Brandl5642ff92013-09-15 10:37:57 +02001301.. versionadded:: 3.4
1302
1303A file descriptor has an "inheritable" flag which indicates if the file descriptor
1304can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001305created by Python are non-inheritable by default.
1306
1307On UNIX, non-inheritable file descriptors are closed in child processes at the
1308execution of a new program, other file descriptors are inherited.
1309
1310On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001311processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001312and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001313all inheritable handles and all inheritable file descriptors are inherited.
1314Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001315streams are closed, and inheritable handles are only inherited if the
1316*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001317
1318.. function:: get_inheritable(fd)
1319
Georg Brandl5642ff92013-09-15 10:37:57 +02001320 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001321
1322.. function:: set_inheritable(fd, inheritable)
1323
Georg Brandl5642ff92013-09-15 10:37:57 +02001324 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001325
1326.. function:: get_handle_inheritable(handle)
1327
Georg Brandl5642ff92013-09-15 10:37:57 +02001328 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001329
1330 Availability: Windows.
1331
1332.. function:: set_handle_inheritable(handle, inheritable)
1333
Georg Brandl5642ff92013-09-15 10:37:57 +02001334 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001335
1336 Availability: Windows.
1337
1338
Georg Brandl116aa622007-08-15 14:28:22 +00001339.. _os-file-dir:
1340
1341Files and Directories
1342---------------------
1343
Georg Brandl50c40002012-06-24 11:45:20 +02001344On some Unix platforms, many of these functions support one or more of these
1345features:
1346
1347.. _path_fd:
1348
Larry Hastings77892dc2012-06-25 03:27:33 -07001349* **specifying a file descriptor:**
1350 For some functions, the *path* argument can be not only a string giving a path
Georg Brandl50c40002012-06-24 11:45:20 +02001351 name, but also a file descriptor. The function will then operate on the file
Georg Brandlaceaf902012-06-25 08:33:56 +02001352 referred to by the descriptor. (For POSIX systems, Python will call the
1353 ``f...`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001354
1355 You can check whether or not *path* can be specified as a file descriptor on
1356 your platform using :data:`os.supports_fd`. If it is unavailable, using it
1357 will raise a :exc:`NotImplementedError`.
1358
1359 If the function also supports *dir_fd* or *follow_symlinks* arguments, it is
1360 an error to specify one of those when supplying *path* as a file descriptor.
1361
1362.. _dir_fd:
1363
Larry Hastings77892dc2012-06-25 03:27:33 -07001364* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001365 should be a file descriptor referring to a directory, and the path to operate
1366 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001367 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Larry Hastings77892dc2012-06-25 03:27:33 -07001368 the ``...at`` or ``f...at`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001369
1370 You can check whether or not *dir_fd* is supported on your platform using
1371 :data:`os.supports_dir_fd`. If it is unavailable, using it will raise a
1372 :exc:`NotImplementedError`.
1373
1374.. _follow_symlinks:
1375
Larry Hastings77892dc2012-06-25 03:27:33 -07001376* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001377 ``False``, and the last element of the path to operate on is a symbolic link,
1378 the function will operate on the symbolic link itself instead of the file the
Georg Brandlaceaf902012-06-25 08:33:56 +02001379 link points to. (For POSIX systems, Python will call the ``l...`` version of
Georg Brandl50c40002012-06-24 11:45:20 +02001380 the function.)
1381
1382 You can check whether or not *follow_symlinks* is supported on your platform
1383 using :data:`os.supports_follow_symlinks`. If it is unavailable, using it
1384 will raise a :exc:`NotImplementedError`.
1385
1386
1387
Larry Hastings9cf065c2012-06-22 16:30:09 -07001388.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001389
1390 Use the real uid/gid to test for access to *path*. Note that most operations
1391 will use the effective uid/gid, therefore this routine can be used in a
1392 suid/sgid environment to test if the invoking user has the specified access to
1393 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1394 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1395 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1396 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001397 information.
1398
Georg Brandl50c40002012-06-24 11:45:20 +02001399 This function can support specifying :ref:`paths relative to directory
1400 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001401
1402 If *effective_ids* is ``True``, :func:`access` will perform its access
1403 checks using the effective uid/gid instead of the real uid/gid.
1404 *effective_ids* may not be supported on your platform; you can check whether
1405 or not it is available using :data:`os.supports_effective_ids`. If it is
1406 unavailable, using it will raise a :exc:`NotImplementedError`.
1407
Georg Brandl116aa622007-08-15 14:28:22 +00001408 .. note::
1409
Georg Brandl502d9a52009-07-26 15:02:41 +00001410 Using :func:`access` to check if a user is authorized to e.g. open a file
1411 before actually doing so using :func:`open` creates a security hole,
1412 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001413 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1414 techniques. For example::
1415
1416 if os.access("myfile", os.R_OK):
1417 with open("myfile") as fp:
1418 return fp.read()
1419 return "some default data"
1420
1421 is better written as::
1422
1423 try:
1424 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001425 except PermissionError:
1426 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001427 else:
1428 with fp:
1429 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001430
1431 .. note::
1432
1433 I/O operations may fail even when :func:`access` indicates that they would
1434 succeed, particularly for operations on network filesystems which may have
1435 permissions semantics beyond the usual POSIX permission-bit model.
1436
Larry Hastings9cf065c2012-06-22 16:30:09 -07001437 .. versionchanged:: 3.3
1438 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1439
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001440 .. versionchanged:: 3.6
1441 Accepts a :term:`path-like object`.
1442
Georg Brandl116aa622007-08-15 14:28:22 +00001443
1444.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001445 R_OK
1446 W_OK
1447 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001448
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001449 Values to pass as the *mode* parameter of :func:`access` to test the
1450 existence, readability, writability and executability of *path*,
1451 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001452
1453
1454.. function:: chdir(path)
1455
1456 .. index:: single: directory; changing
1457
Benjamin Petersonf650e462010-05-06 23:03:05 +00001458 Change the current working directory to *path*.
1459
Larry Hastings77892dc2012-06-25 03:27:33 -07001460 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001461 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001462
Larry Hastings9cf065c2012-06-22 16:30:09 -07001463 .. versionadded:: 3.3
1464 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001465 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001466
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001467 .. versionchanged:: 3.6
1468 Accepts a :term:`path-like object`.
1469
Georg Brandl116aa622007-08-15 14:28:22 +00001470
Larry Hastings9cf065c2012-06-22 16:30:09 -07001471.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001472
1473 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1474 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1475
R David Murray30178062011-03-10 17:18:33 -05001476 * :data:`stat.UF_NODUMP`
1477 * :data:`stat.UF_IMMUTABLE`
1478 * :data:`stat.UF_APPEND`
1479 * :data:`stat.UF_OPAQUE`
1480 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001481 * :data:`stat.UF_COMPRESSED`
1482 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001483 * :data:`stat.SF_ARCHIVED`
1484 * :data:`stat.SF_IMMUTABLE`
1485 * :data:`stat.SF_APPEND`
1486 * :data:`stat.SF_NOUNLINK`
1487 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001488
Georg Brandl50c40002012-06-24 11:45:20 +02001489 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001490
Georg Brandlc575c902008-09-13 17:46:05 +00001491 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001492
Larry Hastings9cf065c2012-06-22 16:30:09 -07001493 .. versionadded:: 3.3
1494 The *follow_symlinks* argument.
1495
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001496 .. versionchanged:: 3.6
1497 Accepts a :term:`path-like object`.
1498
Georg Brandl116aa622007-08-15 14:28:22 +00001499
Larry Hastings9cf065c2012-06-22 16:30:09 -07001500.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001501
1502 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001503 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001504 combinations of them:
1505
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001506 * :data:`stat.S_ISUID`
1507 * :data:`stat.S_ISGID`
1508 * :data:`stat.S_ENFMT`
1509 * :data:`stat.S_ISVTX`
1510 * :data:`stat.S_IREAD`
1511 * :data:`stat.S_IWRITE`
1512 * :data:`stat.S_IEXEC`
1513 * :data:`stat.S_IRWXU`
1514 * :data:`stat.S_IRUSR`
1515 * :data:`stat.S_IWUSR`
1516 * :data:`stat.S_IXUSR`
1517 * :data:`stat.S_IRWXG`
1518 * :data:`stat.S_IRGRP`
1519 * :data:`stat.S_IWGRP`
1520 * :data:`stat.S_IXGRP`
1521 * :data:`stat.S_IRWXO`
1522 * :data:`stat.S_IROTH`
1523 * :data:`stat.S_IWOTH`
1524 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001525
Georg Brandl50c40002012-06-24 11:45:20 +02001526 This function can support :ref:`specifying a file descriptor <path_fd>`,
1527 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1528 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001529
Georg Brandl116aa622007-08-15 14:28:22 +00001530 .. note::
1531
Georg Brandl50c40002012-06-24 11:45:20 +02001532 Although Windows supports :func:`chmod`, you can only set the file's
1533 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1534 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001535
Larry Hastings9cf065c2012-06-22 16:30:09 -07001536 .. versionadded:: 3.3
1537 Added support for specifying *path* as an open file descriptor,
1538 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001539
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001540 .. versionchanged:: 3.6
1541 Accepts a :term:`path-like object`.
1542
Larry Hastings9cf065c2012-06-22 16:30:09 -07001543
1544.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001545
Georg Brandl50c40002012-06-24 11:45:20 +02001546 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1547 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001548
Georg Brandl50c40002012-06-24 11:45:20 +02001549 This function can support :ref:`specifying a file descriptor <path_fd>`,
1550 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1551 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001552
Sandro Tosid902a142011-08-22 23:28:27 +02001553 See :func:`shutil.chown` for a higher-level function that accepts names in
1554 addition to numeric ids.
1555
Benjamin Petersonf650e462010-05-06 23:03:05 +00001556 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001557
Larry Hastings9cf065c2012-06-22 16:30:09 -07001558 .. versionadded:: 3.3
1559 Added support for specifying an open file descriptor for *path*,
1560 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001561
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001562 .. versionchanged:: 3.6
1563 Supports a :term:`path-like object`.
1564
Benjamin Peterson799bd802011-08-31 22:15:17 -04001565
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001566.. function:: chroot(path)
1567
Georg Brandl8a5555f2012-06-24 13:29:09 +02001568 Change the root directory of the current process to *path*.
1569
1570 Availability: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001571
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001572 .. versionchanged:: 3.6
1573 Accepts a :term:`path-like object`.
1574
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001575
1576.. function:: fchdir(fd)
1577
1578 Change the current working directory to the directory represented by the file
1579 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001580 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001581
1582 Availability: Unix.
1583
1584
1585.. function:: getcwd()
1586
1587 Return a string representing the current working directory.
1588
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001589
1590.. function:: getcwdb()
1591
1592 Return a bytestring representing the current working directory.
1593
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001594
Georg Brandl116aa622007-08-15 14:28:22 +00001595.. function:: lchflags(path, flags)
1596
Georg Brandl50c40002012-06-24 11:45:20 +02001597 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001598 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001599 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001600
1601 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001602
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001603 .. versionchanged:: 3.6
1604 Accepts a :term:`path-like object`.
1605
Georg Brandl116aa622007-08-15 14:28:22 +00001606
Christian Heimes93852662007-12-01 12:22:32 +00001607.. function:: lchmod(path, mode)
1608
1609 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001610 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001611 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001612 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001613
1614 Availability: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001615
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001616 .. versionchanged:: 3.6
1617 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001618
Georg Brandl116aa622007-08-15 14:28:22 +00001619.. function:: lchown(path, uid, gid)
1620
Georg Brandl50c40002012-06-24 11:45:20 +02001621 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001622 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001623 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001624
1625 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001626
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001627 .. versionchanged:: 3.6
1628 Accepts a :term:`path-like object`.
1629
Georg Brandl116aa622007-08-15 14:28:22 +00001630
Larry Hastings9cf065c2012-06-22 16:30:09 -07001631.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001632
Larry Hastings9cf065c2012-06-22 16:30:09 -07001633 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001634
Georg Brandlaceaf902012-06-25 08:33:56 +02001635 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1636 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1637 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001638
Brian Curtin1b9df392010-11-24 20:24:31 +00001639 Availability: Unix, Windows.
1640
1641 .. versionchanged:: 3.2
1642 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001643
Larry Hastings9cf065c2012-06-22 16:30:09 -07001644 .. versionadded:: 3.3
1645 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1646
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001647 .. versionchanged:: 3.6
1648 Accepts a :term:`path-like object` for *src* and *dst*.
1649
Georg Brandl116aa622007-08-15 14:28:22 +00001650
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001651.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001652
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001653 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001654 *path*. The list is in arbitrary order, and does not include the special
1655 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001656
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001657 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1658 (directly or indirectly through the :class:`PathLike` interface),
1659 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001660 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001661
Larry Hastings77892dc2012-06-25 03:27:33 -07001662 This function can also support :ref:`specifying a file descriptor
1663 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001664
Larry Hastingsfdaea062012-06-25 04:42:23 -07001665 .. note::
1666 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1667
Victor Stinner6036e442015-03-08 01:58:04 +01001668 .. seealso::
1669
Victor Stinner51b58322015-05-15 09:12:58 +02001670 The :func:`scandir` function returns directory entries along with
1671 file attribute information, giving better performance for many
1672 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001673
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001674 .. versionchanged:: 3.2
1675 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001676
Larry Hastings9cf065c2012-06-22 16:30:09 -07001677 .. versionadded:: 3.3
1678 Added support for specifying an open file descriptor for *path*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001679
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001680 .. versionchanged:: 3.6
1681 Accepts a :term:`path-like object`.
1682
Georg Brandl50c40002012-06-24 11:45:20 +02001683
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001684.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001685
R. David Murray7b1aae92011-01-24 19:34:58 +00001686 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001687 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1688 :class:`stat_result` object.
1689
1690 On platforms that do not support symbolic links, this is an alias for
1691 :func:`~os.stat`.
1692
1693 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1694 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001695
Georg Brandl50c40002012-06-24 11:45:20 +02001696 This function can also support :ref:`paths relative to directory descriptors
1697 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001698
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001699 .. seealso::
1700
Berker Peksag2034caa2015-04-27 13:53:28 +03001701 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001702
Georg Brandlb3823372010-07-10 08:58:37 +00001703 .. versionchanged:: 3.2
1704 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001705
Larry Hastings9cf065c2012-06-22 16:30:09 -07001706 .. versionchanged:: 3.3
1707 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001708
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001709 .. versionchanged:: 3.6
1710 Accepts a :term:`path-like object` for *src* and *dst*.
1711
Ross Lagerwall7807c352011-03-17 20:20:30 +02001712
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001713.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1714
1715 Create a directory named *path* with numeric mode *mode*.
1716
Tommy Beadle63b91e52016-06-02 15:41:20 -04001717 If the directory already exists, :exc:`FileExistsError` is raised.
1718
1719 .. _mkdir_modebits:
1720
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001721 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001722 value is first masked out. If bits other than the last 9 (i.e. the last 3
1723 digits of the octal representation of the *mode*) are set, their meaning is
1724 platform-dependent. On some platforms, they are ignored and you should call
1725 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001726
1727 This function can also support :ref:`paths relative to directory descriptors
1728 <dir_fd>`.
1729
1730 It is also possible to create temporary directories; see the
1731 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1732
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001733 .. versionadded:: 3.3
1734 The *dir_fd* argument.
1735
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001736 .. versionchanged:: 3.6
1737 Accepts a :term:`path-like object`.
1738
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001739
Zachary Warea22ae212014-03-20 09:42:01 -05001740.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001741
1742 .. index::
1743 single: directory; creating
1744 single: UNC paths; and os.makedirs()
1745
1746 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001747 intermediate-level directories needed to contain the leaf directory.
1748
Serhiy Storchakae304e332017-03-24 13:27:42 +02001749 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1750 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1751 is interpreted. To set the file permission bits of any newly-created parent
1752 directories you can set the umask before invoking :func:`makedirs`. The
1753 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001754
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001755 If *exist_ok* is ``False`` (the default), an :exc:`OSError` is raised if the
1756 target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001757
1758 .. note::
1759
1760 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001761 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001762
1763 This function handles UNC paths correctly.
1764
1765 .. versionadded:: 3.2
1766 The *exist_ok* parameter.
1767
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001768 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001769
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001770 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001771 :func:`makedirs` would still raise an error if *mode* did not match the
1772 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001773 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001774
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001775 .. versionchanged:: 3.6
1776 Accepts a :term:`path-like object`.
1777
Serhiy Storchakae304e332017-03-24 13:27:42 +02001778 .. versionchanged:: 3.7
1779 The *mode* argument no longer affects the file permission bits of
1780 newly-created intermediate-level directories.
1781
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001782
Larry Hastings9cf065c2012-06-22 16:30:09 -07001783.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001784
Larry Hastings9cf065c2012-06-22 16:30:09 -07001785 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1786 The current umask value is first masked out from the mode.
1787
Georg Brandl50c40002012-06-24 11:45:20 +02001788 This function can also support :ref:`paths relative to directory descriptors
1789 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001790
1791 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1792 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1793 rendezvous between "client" and "server" type processes: the server opens the
1794 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1795 doesn't open the FIFO --- it just creates the rendezvous point.
1796
Benjamin Petersonf650e462010-05-06 23:03:05 +00001797 Availability: Unix.
1798
Larry Hastings9cf065c2012-06-22 16:30:09 -07001799 .. versionadded:: 3.3
1800 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001801
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001802 .. versionchanged:: 3.6
1803 Accepts a :term:`path-like object`.
1804
Larry Hastings9cf065c2012-06-22 16:30:09 -07001805
Martin Panterbf19d162015-09-09 01:01:13 +00001806.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001807
1808 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00001809 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00001810 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
1811 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
1812 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
1813 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00001814 :func:`os.makedev`), otherwise it is ignored.
1815
Georg Brandl50c40002012-06-24 11:45:20 +02001816 This function can also support :ref:`paths relative to directory descriptors
1817 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001818
Berker Peksag6129e142016-09-26 22:50:11 +03001819 Availability: Unix.
1820
Larry Hastings9cf065c2012-06-22 16:30:09 -07001821 .. versionadded:: 3.3
1822 The *dir_fd* argument.
1823
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001824 .. versionchanged:: 3.6
1825 Accepts a :term:`path-like object`.
1826
Georg Brandl116aa622007-08-15 14:28:22 +00001827
1828.. function:: major(device)
1829
Christian Heimesfaf2f632008-01-06 16:59:19 +00001830 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001831 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001832
Georg Brandl116aa622007-08-15 14:28:22 +00001833
1834.. function:: minor(device)
1835
Christian Heimesfaf2f632008-01-06 16:59:19 +00001836 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001837 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001838
Georg Brandl116aa622007-08-15 14:28:22 +00001839
1840.. function:: makedev(major, minor)
1841
Christian Heimesfaf2f632008-01-06 16:59:19 +00001842 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001843
Georg Brandl116aa622007-08-15 14:28:22 +00001844
Georg Brandl116aa622007-08-15 14:28:22 +00001845.. function:: pathconf(path, name)
1846
1847 Return system configuration information relevant to a named file. *name*
1848 specifies the configuration value to retrieve; it may be a string which is the
1849 name of a defined system value; these names are specified in a number of
1850 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
1851 additional names as well. The names known to the host operating system are
1852 given in the ``pathconf_names`` dictionary. For configuration variables not
1853 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00001854
1855 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
1856 specific value for *name* is not supported by the host system, even if it is
1857 included in ``pathconf_names``, an :exc:`OSError` is raised with
1858 :const:`errno.EINVAL` for the error number.
1859
Larry Hastings77892dc2012-06-25 03:27:33 -07001860 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02001861 <path_fd>`.
1862
Benjamin Petersonf650e462010-05-06 23:03:05 +00001863 Availability: Unix.
1864
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001865 .. versionchanged:: 3.6
1866 Accepts a :term:`path-like object`.
1867
Georg Brandl116aa622007-08-15 14:28:22 +00001868
1869.. data:: pathconf_names
1870
1871 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
1872 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02001873 can be used to determine the set of names known to the system.
1874
1875 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001876
1877
Larry Hastings9cf065c2012-06-22 16:30:09 -07001878.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001879
1880 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02001881 result may be either an absolute or relative pathname; if it is relative, it
1882 may be converted to an absolute pathname using
1883 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001884
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001885 If the *path* is a string object (directly or indirectly through a
1886 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00001887 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001888 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00001889
Georg Brandl50c40002012-06-24 11:45:20 +02001890 This function can also support :ref:`paths relative to directory descriptors
1891 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001892
Brian Curtinc7395692010-07-09 15:15:09 +00001893 Availability: Unix, Windows
1894
Georg Brandlb3823372010-07-10 08:58:37 +00001895 .. versionchanged:: 3.2
1896 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001897
Larry Hastings9cf065c2012-06-22 16:30:09 -07001898 .. versionadded:: 3.3
1899 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001900
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001901 .. versionchanged:: 3.6
1902 Accepts a :term:`path-like object`.
1903
Georg Brandl116aa622007-08-15 14:28:22 +00001904
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001905.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07001906
Georg Brandl50c40002012-06-24 11:45:20 +02001907 Remove (delete) the file *path*. If *path* is a directory, :exc:`OSError` is
1908 raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001909
Georg Brandl50c40002012-06-24 11:45:20 +02001910 This function can support :ref:`paths relative to directory descriptors
1911 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001912
1913 On Windows, attempting to remove a file that is in use causes an exception to
1914 be raised; on Unix, the directory entry is removed but the storage allocated
1915 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001916
Brett Cannon05039172015-12-28 17:28:19 -08001917 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001918
Larry Hastings9cf065c2012-06-22 16:30:09 -07001919 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001920 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001921
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001922 .. versionchanged:: 3.6
1923 Accepts a :term:`path-like object`.
1924
Georg Brandl116aa622007-08-15 14:28:22 +00001925
Zachary Warea22ae212014-03-20 09:42:01 -05001926.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00001927
1928 .. index:: single: directory; deleting
1929
Christian Heimesfaf2f632008-01-06 16:59:19 +00001930 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00001931 leaf directory is successfully removed, :func:`removedirs` tries to
1932 successively remove every parent directory mentioned in *path* until an error
1933 is raised (which is ignored, because it generally means that a parent directory
1934 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
1935 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
1936 they are empty. Raises :exc:`OSError` if the leaf directory could not be
1937 successfully removed.
1938
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001939 .. versionchanged:: 3.6
1940 Accepts a :term:`path-like object`.
1941
Georg Brandl116aa622007-08-15 14:28:22 +00001942
Larry Hastings9cf065c2012-06-22 16:30:09 -07001943.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001944
1945 Rename the file or directory *src* to *dst*. If *dst* is a directory,
1946 :exc:`OSError` will be raised. On Unix, if *dst* exists and is a file, it will
Christian Heimesfaf2f632008-01-06 16:59:19 +00001947 be replaced silently if the user has permission. The operation may fail on some
Georg Brandl116aa622007-08-15 14:28:22 +00001948 Unix flavors if *src* and *dst* are on different filesystems. If successful,
1949 the renaming will be an atomic operation (this is a POSIX requirement). On
1950 Windows, if *dst* already exists, :exc:`OSError` will be raised even if it is a
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001951 file.
1952
Georg Brandlaceaf902012-06-25 08:33:56 +02001953 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1954 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001955
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001956 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001957
Larry Hastings9cf065c2012-06-22 16:30:09 -07001958 .. versionadded:: 3.3
1959 The *src_dir_fd* and *dst_dir_fd* arguments.
1960
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001961 .. versionchanged:: 3.6
1962 Accepts a :term:`path-like object` for *src* and *dst*.
1963
Georg Brandl116aa622007-08-15 14:28:22 +00001964
1965.. function:: renames(old, new)
1966
1967 Recursive directory or file renaming function. Works like :func:`rename`, except
1968 creation of any intermediate directories needed to make the new pathname good is
1969 attempted first. After the rename, directories corresponding to rightmost path
1970 segments of the old name will be pruned away using :func:`removedirs`.
1971
Georg Brandl116aa622007-08-15 14:28:22 +00001972 .. note::
1973
1974 This function can fail with the new directory structure made if you lack
1975 permissions needed to remove the leaf directory or file.
1976
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001977 .. versionchanged:: 3.6
1978 Accepts a :term:`path-like object` for *old* and *new*.
1979
Georg Brandl116aa622007-08-15 14:28:22 +00001980
Larry Hastings9cf065c2012-06-22 16:30:09 -07001981.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001982
1983 Rename the file or directory *src* to *dst*. If *dst* is a directory,
1984 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
1985 be replaced silently if the user has permission. The operation may fail
1986 if *src* and *dst* are on different filesystems. If successful,
1987 the renaming will be an atomic operation (this is a POSIX requirement).
1988
Georg Brandlaceaf902012-06-25 08:33:56 +02001989 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1990 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001991
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001992 .. versionadded:: 3.3
1993
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001994 .. versionchanged:: 3.6
1995 Accepts a :term:`path-like object` for *src* and *dst*.
1996
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01001997
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001998.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001999
Georg Brandla6053b42009-09-01 08:11:14 +00002000 Remove (delete) the directory *path*. Only works when the directory is
2001 empty, otherwise, :exc:`OSError` is raised. In order to remove whole
Benjamin Petersonf650e462010-05-06 23:03:05 +00002002 directory trees, :func:`shutil.rmtree` can be used.
2003
Georg Brandl50c40002012-06-24 11:45:20 +02002004 This function can support :ref:`paths relative to directory descriptors
2005 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002006
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002007 .. versionadded:: 3.3
2008 The *dir_fd* parameter.
2009
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002010 .. versionchanged:: 3.6
2011 Accepts a :term:`path-like object`.
2012
Georg Brandl116aa622007-08-15 14:28:22 +00002013
Victor Stinner6036e442015-03-08 01:58:04 +01002014.. function:: scandir(path='.')
2015
Brett Cannona32c4d02016-06-24 14:14:44 -07002016 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2017 entries in the directory given by *path*. The entries are yielded in
2018 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2019 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002020
Victor Stinner51b58322015-05-15 09:12:58 +02002021 Using :func:`scandir` instead of :func:`listdir` can significantly
2022 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002023 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002024 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002025 All :class:`os.DirEntry` methods may perform a system call, but
2026 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2027 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002028 always requires a system call on Unix but only requires one for
2029 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002030
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002031 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2032 (directly or indirectly through the :class:`PathLike` interface),
2033 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2034 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2035 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002036
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002037 This function can also support :ref:`specifying a file descriptor
2038 <path_fd>`; the file descriptor must refer to a directory.
2039
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002040 The :func:`scandir` iterator supports the :term:`context manager` protocol
2041 and has the following method:
2042
2043 .. method:: scandir.close()
2044
2045 Close the iterator and free acquired resources.
2046
2047 This is called automatically when the iterator is exhausted or garbage
2048 collected, or when an error happens during iterating. However it
2049 is advisable to call it explicitly or use the :keyword:`with`
2050 statement.
2051
2052 .. versionadded:: 3.6
2053
Victor Stinner6036e442015-03-08 01:58:04 +01002054 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002055 the files (excluding directories) in the given *path* that don't start with
2056 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2057 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002058
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002059 with os.scandir(path) as it:
2060 for entry in it:
2061 if not entry.name.startswith('.') and entry.is_file():
2062 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002063
2064 .. note::
2065
2066 On Unix-based systems, :func:`scandir` uses the system's
2067 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2068 and
2069 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2070 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002071 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002072 and
Georg Brandl5d941342016-02-26 19:37:12 +01002073 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002074 functions.
2075
Victor Stinner6036e442015-03-08 01:58:04 +01002076 .. versionadded:: 3.5
2077
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002078 .. versionadded:: 3.6
2079 Added support for the :term:`context manager` protocol and the
2080 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2081 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2082 in its destructor.
2083
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002084 The function accepts a :term:`path-like object`.
2085
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002086 .. versionchanged:: 3.7
2087 Added support for :ref:`file descriptors <path_fd>` on Unix.
2088
Victor Stinner6036e442015-03-08 01:58:04 +01002089
2090.. class:: DirEntry
2091
2092 Object yielded by :func:`scandir` to expose the file path and other file
2093 attributes of a directory entry.
2094
2095 :func:`scandir` will provide as much of this information as possible without
2096 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002097 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002098
Brett Cannona32c4d02016-06-24 14:14:44 -07002099 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002100 structures; if you know the file metadata has changed or if a long time has
2101 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2102 up-to-date information.
2103
Brett Cannona32c4d02016-06-24 14:14:44 -07002104 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002105 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002106 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002107 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002108
Brett Cannona32c4d02016-06-24 14:14:44 -07002109 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002110 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002111
Brett Cannona32c4d02016-06-24 14:14:44 -07002112 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002113
2114 .. attribute:: name
2115
2116 The entry's base filename, relative to the :func:`scandir` *path*
2117 argument.
2118
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002119 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2120 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002121 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002122
2123 .. attribute:: path
2124
2125 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2126 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2127 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002128 argument was absolute. If the :func:`scandir` *path*
2129 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2130 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002131
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002132 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2133 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002134 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002135
2136 .. method:: inode()
2137
2138 Return the inode number of the entry.
2139
Brett Cannona32c4d02016-06-24 14:14:44 -07002140 The result is cached on the ``os.DirEntry`` object. Use
2141 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2142 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002143
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002144 On the first, uncached call, a system call is required on Windows but
2145 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002146
2147 .. method:: is_dir(\*, follow_symlinks=True)
2148
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002149 Return ``True`` if this entry is a directory or a symbolic link pointing
2150 to a directory; return ``False`` if the entry is or points to any other
2151 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002152
2153 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002154 is a directory (without following symlinks); return ``False`` if the
2155 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002156
Brett Cannona32c4d02016-06-24 14:14:44 -07002157 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002158 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2159 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2160
2161 On the first, uncached call, no system call is required in most cases.
2162 Specifically, for non-symlinks, neither Windows or Unix require a system
2163 call, except on certain Unix file systems, such as network file systems,
2164 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2165 a system call will be required to follow the symlink unless
2166 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002167
Victor Stinner51b58322015-05-15 09:12:58 +02002168 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2169 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002170
Victor Stinner6036e442015-03-08 01:58:04 +01002171 .. method:: is_file(\*, follow_symlinks=True)
2172
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002173 Return ``True`` if this entry is a file or a symbolic link pointing to a
2174 file; return ``False`` if the entry is or points to a directory or other
2175 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002176
2177 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002178 is a file (without following symlinks); return ``False`` if the entry is
2179 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002180
Brett Cannona32c4d02016-06-24 14:14:44 -07002181 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2182 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002183
2184 .. method:: is_symlink()
2185
Victor Stinner51b58322015-05-15 09:12:58 +02002186 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002187 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002188 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002189
Brett Cannona32c4d02016-06-24 14:14:44 -07002190 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002191 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002192
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002193 On the first, uncached call, no system call is required in most cases.
2194 Specifically, neither Windows or Unix require a system call, except on
2195 certain Unix file systems, such as network file systems, that return
2196 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002197
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002198 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2199 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002200
2201 .. method:: stat(\*, follow_symlinks=True)
2202
Victor Stinner51b58322015-05-15 09:12:58 +02002203 Return a :class:`stat_result` object for this entry. This method
2204 follows symbolic links by default; to stat a symbolic link add the
2205 ``follow_symlinks=False`` argument.
2206
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002207 On Unix, this method always requires a system call. On Windows, it
2208 only requires a system call if *follow_symlinks* is ``True`` and the
2209 entry is a symbolic link.
Victor Stinner6036e442015-03-08 01:58:04 +01002210
2211 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2212 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2213 get these attributes.
2214
Brett Cannona32c4d02016-06-24 14:14:44 -07002215 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002216 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2217 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002218
Guido van Rossum1469d742016-01-06 11:36:03 -08002219 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002220 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002221 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002222 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2223 and ``stat()`` methods.
2224
Victor Stinner6036e442015-03-08 01:58:04 +01002225 .. versionadded:: 3.5
2226
Brett Cannon96881cd2016-06-10 14:37:21 -07002227 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002228 Added support for the :class:`~os.PathLike` interface. Added support
2229 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002230
Victor Stinner6036e442015-03-08 01:58:04 +01002231
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002232.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002233
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002234 Get the status of a file or a file descriptor. Perform the equivalent of a
2235 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002236 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002237 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002238 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002239
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002240 This function normally follows symlinks; to stat a symlink add the argument
2241 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002242
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002243 This function can support :ref:`specifying a file descriptor <path_fd>` and
2244 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002245
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002246 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002247
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002248 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002249
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002250 >>> import os
2251 >>> statinfo = os.stat('somefile.txt')
2252 >>> statinfo
2253 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2254 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2255 st_mtime=1297230027, st_ctime=1297230027)
2256 >>> statinfo.st_size
2257 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002258
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002259 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002260
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002261 :func:`fstat` and :func:`lstat` functions.
2262
2263 .. versionadded:: 3.3
2264 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2265 descriptor instead of a path.
2266
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002267 .. versionchanged:: 3.6
2268 Accepts a :term:`path-like object`.
2269
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002270
2271.. class:: stat_result
2272
2273 Object whose attributes correspond roughly to the members of the
2274 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2275 :func:`os.fstat` and :func:`os.lstat`.
2276
2277 Attributes:
2278
2279 .. attribute:: st_mode
2280
2281 File mode: file type and file mode bits (permissions).
2282
2283 .. attribute:: st_ino
2284
2285 Inode number.
2286
2287 .. attribute:: st_dev
2288
2289 Identifier of the device on which this file resides.
2290
2291 .. attribute:: st_nlink
2292
2293 Number of hard links.
2294
2295 .. attribute:: st_uid
2296
2297 User identifier of the file owner.
2298
2299 .. attribute:: st_gid
2300
2301 Group identifier of the file owner.
2302
2303 .. attribute:: st_size
2304
2305 Size of the file in bytes, if it is a regular file or a symbolic link.
2306 The size of a symbolic link is the length of the pathname it contains,
2307 without a terminating null byte.
2308
2309 Timestamps:
2310
2311 .. attribute:: st_atime
2312
2313 Time of most recent access expressed in seconds.
2314
2315 .. attribute:: st_mtime
2316
2317 Time of most recent content modification expressed in seconds.
2318
2319 .. attribute:: st_ctime
2320
2321 Platform dependent:
2322
2323 * the time of most recent metadata change on Unix,
2324 * the time of creation on Windows, expressed in seconds.
2325
2326 .. attribute:: st_atime_ns
2327
2328 Time of most recent access expressed in nanoseconds as an integer.
2329
2330 .. attribute:: st_mtime_ns
2331
2332 Time of most recent content modification expressed in nanoseconds as an
2333 integer.
2334
2335 .. attribute:: st_ctime_ns
2336
2337 Platform dependent:
2338
2339 * the time of most recent metadata change on Unix,
2340 * the time of creation on Windows, expressed in nanoseconds as an
2341 integer.
2342
Georg Brandl116aa622007-08-15 14:28:22 +00002343 .. note::
2344
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002345 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002346 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2347 system and the file system. For example, on Windows systems using the FAT
2348 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2349 :attr:`st_atime` has only 1-day resolution. See your operating system
2350 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002351
Larry Hastings6fe20b32012-04-19 15:07:49 -07002352 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2353 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2354 systems do not provide nanosecond precision. On systems that do
2355 provide nanosecond precision, the floating-point object used to
2356 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2357 cannot preserve all of it, and as such will be slightly inexact.
2358 If you need the exact timestamps you should always use
2359 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002360
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002361 On some Unix systems (such as Linux), the following attributes may also be
2362 available:
2363
2364 .. attribute:: st_blocks
2365
2366 Number of 512-byte blocks allocated for file.
2367 This may be smaller than :attr:`st_size`/512 when the file has holes.
2368
2369 .. attribute:: st_blksize
2370
2371 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2372 smaller chunks may cause an inefficient read-modify-rewrite.
2373
2374 .. attribute:: st_rdev
2375
2376 Type of device if an inode device.
2377
2378 .. attribute:: st_flags
2379
2380 User defined flags for file.
2381
2382 On other Unix systems (such as FreeBSD), the following attributes may be
2383 available (but may be only filled out if root tries to use them):
2384
2385 .. attribute:: st_gen
2386
2387 File generation number.
2388
2389 .. attribute:: st_birthtime
2390
2391 Time of file creation.
2392
2393 On Mac OS systems, the following attributes may also be available:
2394
2395 .. attribute:: st_rsize
2396
2397 Real size of the file.
2398
2399 .. attribute:: st_creator
2400
2401 Creator of the file.
2402
2403 .. attribute:: st_type
2404
2405 File type.
2406
Victor Stinnere1d24f72014-07-24 12:44:07 +02002407 On Windows systems, the following attribute is also available:
2408
2409 .. attribute:: st_file_attributes
2410
2411 Windows file attributes: ``dwFileAttributes`` member of the
2412 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2413 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2414 constants in the :mod:`stat` module.
2415
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002416 The standard module :mod:`stat` defines functions and constants that are
2417 useful for extracting information from a :c:type:`stat` structure. (On
2418 Windows, some items are filled with dummy values.)
2419
2420 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002421 accessible as a tuple of at least 10 integers giving the most important (and
2422 portable) members of the :c:type:`stat` structure, in the order
2423 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2424 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2425 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002426 some implementations. For compatibility with older Python versions,
2427 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002428
Larry Hastings6fe20b32012-04-19 15:07:49 -07002429 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002430 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2431 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002432
Zachary Ware63f277b2014-06-19 09:46:37 -05002433 .. versionadded:: 3.5
2434 Added the :attr:`st_file_attributes` member on Windows.
2435
Georg Brandl116aa622007-08-15 14:28:22 +00002436
Georg Brandl116aa622007-08-15 14:28:22 +00002437.. function:: statvfs(path)
2438
Georg Brandl60203b42010-10-06 10:11:56 +00002439 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002440 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002441 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002442 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2443 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002444 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002445
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002446 Two module-level constants are defined for the :attr:`f_flag` attribute's
2447 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2448 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2449 setuid/setgid bits are disabled or not supported.
2450
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002451 Additional module-level constants are defined for GNU/glibc based systems.
2452 These are :const:`ST_NODEV` (disallow access to device special files),
2453 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2454 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2455 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2456 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2457 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2458 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2459
Georg Brandl50c40002012-06-24 11:45:20 +02002460 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002461
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002462 Availability: Unix.
2463
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002464 .. versionchanged:: 3.2
2465 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2466
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002467 .. versionadded:: 3.3
2468 Added support for specifying an open file descriptor for *path*.
2469
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002470 .. versionchanged:: 3.4
2471 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2472 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2473 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2474 and :const:`ST_RELATIME` constants were added.
2475
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002476 .. versionchanged:: 3.6
2477 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002478
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002479 .. versionadded:: 3.7
2480 Added :attr:`f_fsid`.
2481
Larry Hastings9cf065c2012-06-22 16:30:09 -07002482
2483.. data:: supports_dir_fd
2484
Serhiy Storchakadab83542013-10-13 20:12:43 +03002485 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002486 :mod:`os` module permit use of their *dir_fd* parameter. Different platforms
Larry Hastings9cf065c2012-06-22 16:30:09 -07002487 provide different functionality, and an option that might work on one might
2488 be unsupported on another. For consistency's sakes, functions that support
Andrew Svetlov5b898402012-12-18 21:26:36 +02002489 *dir_fd* always allow specifying the parameter, but will raise an exception
Larry Hastings9cf065c2012-06-22 16:30:09 -07002490 if the functionality is not actually available.
2491
2492 To check whether a particular function permits use of its *dir_fd*
2493 parameter, use the ``in`` operator on ``supports_dir_fd``. As an example,
2494 this expression determines whether the *dir_fd* parameter of :func:`os.stat`
2495 is locally available::
2496
2497 os.stat in os.supports_dir_fd
2498
Georg Brandlf62445a2012-06-24 13:31:20 +02002499 Currently *dir_fd* parameters only work on Unix platforms; none of them work
2500 on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002501
2502 .. versionadded:: 3.3
2503
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002504
Larry Hastings9cf065c2012-06-22 16:30:09 -07002505.. data:: supports_effective_ids
2506
Serhiy Storchakadab83542013-10-13 20:12:43 +03002507 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002508 :mod:`os` module permit use of the *effective_ids* parameter for
2509 :func:`os.access`. If the local platform supports it, the collection will
2510 contain :func:`os.access`, otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002511
Georg Brandl50c40002012-06-24 11:45:20 +02002512 To check whether you can use the *effective_ids* parameter for
Berker Peksag4d6c6062015-02-16 03:36:10 +02002513 :func:`os.access`, use the ``in`` operator on ``supports_effective_ids``,
2514 like so::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002515
2516 os.access in os.supports_effective_ids
2517
Georg Brandl50c40002012-06-24 11:45:20 +02002518 Currently *effective_ids* only works on Unix platforms; it does not work on
2519 Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002520
2521 .. versionadded:: 3.3
2522
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002523
Larry Hastings9cf065c2012-06-22 16:30:09 -07002524.. data:: supports_fd
2525
Serhiy Storchakadab83542013-10-13 20:12:43 +03002526 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002527 :mod:`os` module permit specifying their *path* parameter as an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002528 descriptor. Different platforms provide different functionality, and an
2529 option that might work on one might be unsupported on another. For
2530 consistency's sakes, functions that support *fd* always allow specifying
Andrew Svetlov5b898402012-12-18 21:26:36 +02002531 the parameter, but will raise an exception if the functionality is not
Larry Hastings9cf065c2012-06-22 16:30:09 -07002532 actually available.
2533
2534 To check whether a particular function permits specifying an open file
2535 descriptor for its *path* parameter, use the ``in`` operator on
2536 ``supports_fd``. As an example, this expression determines whether
2537 :func:`os.chdir` accepts open file descriptors when called on your local
2538 platform::
2539
2540 os.chdir in os.supports_fd
2541
2542 .. versionadded:: 3.3
2543
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002544
Larry Hastings9cf065c2012-06-22 16:30:09 -07002545.. data:: supports_follow_symlinks
2546
Serhiy Storchakadab83542013-10-13 20:12:43 +03002547 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002548 :mod:`os` module permit use of their *follow_symlinks* parameter. Different
Larry Hastings9cf065c2012-06-22 16:30:09 -07002549 platforms provide different functionality, and an option that might work on
2550 one might be unsupported on another. For consistency's sakes, functions that
2551 support *follow_symlinks* always allow specifying the parameter, but will
Andrew Svetlov5b898402012-12-18 21:26:36 +02002552 raise an exception if the functionality is not actually available.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002553
2554 To check whether a particular function permits use of its *follow_symlinks*
2555 parameter, use the ``in`` operator on ``supports_follow_symlinks``. As an
2556 example, this expression determines whether the *follow_symlinks* parameter
2557 of :func:`os.stat` is locally available::
2558
2559 os.stat in os.supports_follow_symlinks
2560
2561 .. versionadded:: 3.3
2562
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002563
Martin Panterbf19d162015-09-09 01:01:13 +00002564.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002565
Martin Panterbf19d162015-09-09 01:01:13 +00002566 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002567
Larry Hastings9cf065c2012-06-22 16:30:09 -07002568 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002569 morph to the target dynamically. If the target is present, the type of the
2570 symlink will be created to match. Otherwise, the symlink will be created
2571 as a directory if *target_is_directory* is ``True`` or a file symlink (the
2572 default) otherwise. On non-Window platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002573
Georg Brandl64a41ed2010-10-06 08:52:48 +00002574 Symbolic link support was introduced in Windows 6.0 (Vista). :func:`symlink`
2575 will raise a :exc:`NotImplementedError` on Windows versions earlier than 6.0.
Brian Curtin52173d42010-12-02 18:29:18 +00002576
Georg Brandl50c40002012-06-24 11:45:20 +02002577 This function can support :ref:`paths relative to directory descriptors
2578 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002579
Brian Curtin52173d42010-12-02 18:29:18 +00002580 .. note::
2581
Larry Hastings9cf065c2012-06-22 16:30:09 -07002582 On Windows, the *SeCreateSymbolicLinkPrivilege* is required in order to
2583 successfully create symlinks. This privilege is not typically granted to
2584 regular users but is available to accounts which can escalate privileges
2585 to the administrator level. Either obtaining the privilege or running your
Brian Curtin96245592010-12-28 17:08:22 +00002586 application as an administrator are ways to successfully create symlinks.
2587
Jason R. Coombs3a092862013-05-27 23:21:28 -04002588
Brian Curtin96245592010-12-28 17:08:22 +00002589 :exc:`OSError` is raised when the function is called by an unprivileged
2590 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002591
Georg Brandl64a41ed2010-10-06 08:52:48 +00002592 Availability: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002593
Georg Brandlb3823372010-07-10 08:58:37 +00002594 .. versionchanged:: 3.2
2595 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002596
Larry Hastings9cf065c2012-06-22 16:30:09 -07002597 .. versionadded:: 3.3
2598 Added the *dir_fd* argument, and now allow *target_is_directory*
2599 on non-Windows platforms.
2600
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002601 .. versionchanged:: 3.6
2602 Accepts a :term:`path-like object` for *src* and *dst*.
2603
Georg Brandl116aa622007-08-15 14:28:22 +00002604
Ross Lagerwall7807c352011-03-17 20:20:30 +02002605.. function:: sync()
2606
2607 Force write of everything to disk.
2608
2609 Availability: Unix.
2610
2611 .. versionadded:: 3.3
2612
2613
2614.. function:: truncate(path, length)
2615
2616 Truncate the file corresponding to *path*, so that it is at most
2617 *length* bytes in size.
2618
Georg Brandl306336b2012-06-24 12:55:33 +02002619 This function can support :ref:`specifying a file descriptor <path_fd>`.
2620
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002621 Availability: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002622
2623 .. versionadded:: 3.3
2624
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002625 .. versionchanged:: 3.5
2626 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002627
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002628 .. versionchanged:: 3.6
2629 Accepts a :term:`path-like object`.
2630
2631
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002632.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002633
Brett Cannon05039172015-12-28 17:28:19 -08002634 Remove (delete) the file *path*. This function is semantically
2635 identical to :func:`remove`; the ``unlink`` name is its
2636 traditional Unix name. Please see the documentation for
2637 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002638
Larry Hastings9cf065c2012-06-22 16:30:09 -07002639 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002640 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002641
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002642 .. versionchanged:: 3.6
2643 Accepts a :term:`path-like object`.
2644
Larry Hastings9cf065c2012-06-22 16:30:09 -07002645
Martin Panterbf19d162015-09-09 01:01:13 +00002646.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002647
Larry Hastings76ad59b2012-05-03 00:30:07 -07002648 Set the access and modified times of the file specified by *path*.
2649
2650 :func:`utime` takes two optional parameters, *times* and *ns*.
2651 These specify the times set on *path* and are used as follows:
2652
Martin Panterbf19d162015-09-09 01:01:13 +00002653 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002654 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2655 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002656 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002657 it must be a 2-tuple of the form ``(atime, mtime)``
2658 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002659 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002660 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002661 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002662
Larry Hastings9cf065c2012-06-22 16:30:09 -07002663 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002664
2665 Whether a directory can be given for *path*
Brian Curtin52fbea12011-11-06 13:41:17 -06002666 depends on whether the operating system implements directories as files
2667 (for example, Windows does not). Note that the exact times you set here may
2668 not be returned by a subsequent :func:`~os.stat` call, depending on the
2669 resolution with which your operating system records access and modification
Larry Hastings76ad59b2012-05-03 00:30:07 -07002670 times; see :func:`~os.stat`. The best way to preserve exact times is to
2671 use the *st_atime_ns* and *st_mtime_ns* fields from the :func:`os.stat`
2672 result object with the *ns* parameter to `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002673
Georg Brandl50c40002012-06-24 11:45:20 +02002674 This function can support :ref:`specifying a file descriptor <path_fd>`,
2675 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2676 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002677
Larry Hastings76ad59b2012-05-03 00:30:07 -07002678 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -07002679 Added support for specifying an open file descriptor for *path*,
2680 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002681
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002682 .. versionchanged:: 3.6
2683 Accepts a :term:`path-like object`.
2684
Georg Brandl116aa622007-08-15 14:28:22 +00002685
Georg Brandl18244152009-09-02 20:34:52 +00002686.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002687
2688 .. index::
2689 single: directory; walking
2690 single: directory; traversal
2691
Christian Heimesfaf2f632008-01-06 16:59:19 +00002692 Generate the file names in a directory tree by walking the tree
2693 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002694 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2695 filenames)``.
2696
2697 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2698 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2699 *filenames* is a list of the names of the non-directory files in *dirpath*.
2700 Note that the names in the lists contain no path components. To get a full path
2701 (which begins with *top*) to a file or directory in *dirpath*, do
2702 ``os.path.join(dirpath, name)``.
2703
Christian Heimesfaf2f632008-01-06 16:59:19 +00002704 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00002705 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07002706 (directories are generated top-down). If *topdown* is ``False``, the triple
2707 for a directory is generated after the triples for all of its subdirectories
2708 (directories are generated bottom-up). No matter the value of *topdown*, the
2709 list of subdirectories is retrieved before the tuples for the directory and
2710 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002711
Christian Heimesfaf2f632008-01-06 16:59:19 +00002712 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00002713 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
2714 recurse into the subdirectories whose names remain in *dirnames*; this can be
2715 used to prune the search, impose a specific order of visiting, or even to inform
2716 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02002717 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
2718 no effect on the behavior of the walk, because in bottom-up mode the directories
2719 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002720
Ezio Melotti67494f22011-10-18 12:59:39 +03002721 By default, errors from the :func:`listdir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00002722 argument *onerror* is specified, it should be a function; it will be called with
2723 one argument, an :exc:`OSError` instance. It can report the error to continue
2724 with the walk, or raise the exception to abort the walk. Note that the filename
2725 is available as the ``filename`` attribute of the exception object.
2726
2727 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00002728 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00002729 symlinks, on systems that support them.
2730
Georg Brandl116aa622007-08-15 14:28:22 +00002731 .. note::
2732
Georg Brandl50c40002012-06-24 11:45:20 +02002733 Be aware that setting *followlinks* to ``True`` can lead to infinite
2734 recursion if a link points to a parent directory of itself. :func:`walk`
2735 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00002736
2737 .. note::
2738
2739 If you pass a relative pathname, don't change the current working directory
2740 between resumptions of :func:`walk`. :func:`walk` never changes the current
2741 directory, and assumes that its caller doesn't either.
2742
2743 This example displays the number of bytes taken by non-directory files in each
2744 directory under the starting directory, except that it doesn't look under any
2745 CVS subdirectory::
2746
2747 import os
2748 from os.path import join, getsize
2749 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00002750 print(root, "consumes", end=" ")
2751 print(sum(getsize(join(root, name)) for name in files), end=" ")
2752 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00002753 if 'CVS' in dirs:
2754 dirs.remove('CVS') # don't visit CVS directories
2755
Victor Stinner47c41b42015-03-10 13:31:47 +01002756 In the next example (simple implementation of :func:`shutil.rmtree`),
2757 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
2758 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00002759
Christian Heimesfaf2f632008-01-06 16:59:19 +00002760 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00002761 # assuming there are no symbolic links.
2762 # CAUTION: This is dangerous! For example, if top == '/', it
2763 # could delete all your disk files.
2764 import os
2765 for root, dirs, files in os.walk(top, topdown=False):
2766 for name in files:
2767 os.remove(os.path.join(root, name))
2768 for name in dirs:
2769 os.rmdir(os.path.join(root, name))
2770
Victor Stinner524a5ba2015-03-10 13:20:34 +01002771 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02002772 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
2773 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01002774
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002775 .. versionchanged:: 3.6
2776 Accepts a :term:`path-like object`.
2777
Georg Brandl116aa622007-08-15 14:28:22 +00002778
Larry Hastingsb4038062012-07-15 10:57:38 -07002779.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01002780
2781 .. index::
2782 single: directory; walking
2783 single: directory; traversal
2784
Eli Benderskyd049d5c2012-02-11 09:52:29 +02002785 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07002786 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01002787
2788 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
2789 and *dirfd* is a file descriptor referring to the directory *dirpath*.
2790
Larry Hastingsc48fe982012-06-25 04:49:05 -07002791 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07002792 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07002793 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07002794 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07002795
Charles-François Natali7372b062012-02-05 15:15:38 +01002796 .. note::
2797
2798 Since :func:`fwalk` yields file descriptors, those are only valid until
2799 the next iteration step, so you should duplicate them (e.g. with
2800 :func:`dup`) if you want to keep them longer.
2801
2802 This example displays the number of bytes taken by non-directory files in each
2803 directory under the starting directory, except that it doesn't look under any
2804 CVS subdirectory::
2805
2806 import os
2807 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
2808 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02002809 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01002810 end="")
2811 print("bytes in", len(files), "non-directory files")
2812 if 'CVS' in dirs:
2813 dirs.remove('CVS') # don't visit CVS directories
2814
2815 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002816 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01002817 empty::
2818
2819 # Delete everything reachable from the directory named in "top",
2820 # assuming there are no symbolic links.
2821 # CAUTION: This is dangerous! For example, if top == '/', it
2822 # could delete all your disk files.
2823 import os
2824 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
2825 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002826 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002827 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002828 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002829
2830 Availability: Unix.
2831
2832 .. versionadded:: 3.3
2833
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002834 .. versionchanged:: 3.6
2835 Accepts a :term:`path-like object`.
2836
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02002837 .. versionchanged:: 3.7
2838 Added support for :class:`bytes` paths.
2839
Charles-François Natali7372b062012-02-05 15:15:38 +01002840
Georg Brandlb9831ab2012-06-24 11:57:07 +02002841Linux extended attributes
2842~~~~~~~~~~~~~~~~~~~~~~~~~
2843
2844.. versionadded:: 3.3
2845
2846These functions are all available on Linux only.
2847
2848.. function:: getxattr(path, attribute, *, follow_symlinks=True)
2849
2850 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002851 *path*. *attribute* can be bytes or str (directly or indirectly through the
2852 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
2853 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002854
2855 This function can support :ref:`specifying a file descriptor <path_fd>` and
2856 :ref:`not following symlinks <follow_symlinks>`.
2857
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002858 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03002859 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002860
Georg Brandlb9831ab2012-06-24 11:57:07 +02002861
2862.. function:: listxattr(path=None, *, follow_symlinks=True)
2863
2864 Return a list of the extended filesystem attributes on *path*. The
2865 attributes in the list are represented as strings decoded with the filesystem
2866 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
2867 directory.
2868
2869 This function can support :ref:`specifying a file descriptor <path_fd>` and
2870 :ref:`not following symlinks <follow_symlinks>`.
2871
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002872 .. versionchanged:: 3.6
2873 Accepts a :term:`path-like object`.
2874
Georg Brandlb9831ab2012-06-24 11:57:07 +02002875
2876.. function:: removexattr(path, attribute, *, follow_symlinks=True)
2877
2878 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002879 *attribute* should be bytes or str (directly or indirectly through the
2880 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02002881 with the filesystem encoding.
2882
2883 This function can support :ref:`specifying a file descriptor <path_fd>` and
2884 :ref:`not following symlinks <follow_symlinks>`.
2885
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002886 .. versionchanged:: 3.6
2887 Accepts a :term:`path-like object` for *path* and *attribute*.
2888
Georg Brandlb9831ab2012-06-24 11:57:07 +02002889
2890.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
2891
2892 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002893 *attribute* must be a bytes or str with no embedded NULs (directly or
2894 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02002895 it is encoded with the filesystem encoding. *flags* may be
2896 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
2897 given and the attribute does not exist, ``EEXISTS`` will be raised.
2898 If :data:`XATTR_CREATE` is given and the attribute already exists, the
2899 attribute will not be created and ``ENODATA`` will be raised.
2900
2901 This function can support :ref:`specifying a file descriptor <path_fd>` and
2902 :ref:`not following symlinks <follow_symlinks>`.
2903
2904 .. note::
2905
2906 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
2907 to be ignored on some filesystems.
2908
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002909 .. versionchanged:: 3.6
2910 Accepts a :term:`path-like object` for *path* and *attribute*.
2911
Georg Brandlb9831ab2012-06-24 11:57:07 +02002912
2913.. data:: XATTR_SIZE_MAX
2914
2915 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02002916 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002917
2918
2919.. data:: XATTR_CREATE
2920
2921 This is a possible value for the flags argument in :func:`setxattr`. It
2922 indicates the operation must create an attribute.
2923
2924
2925.. data:: XATTR_REPLACE
2926
2927 This is a possible value for the flags argument in :func:`setxattr`. It
2928 indicates the operation must replace an existing attribute.
2929
2930
Georg Brandl116aa622007-08-15 14:28:22 +00002931.. _os-process:
2932
2933Process Management
2934------------------
2935
2936These functions may be used to create and manage processes.
2937
Serhiy Storchakadab83542013-10-13 20:12:43 +03002938The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00002939program loaded into the process. In each case, the first of these arguments is
2940passed to the new program as its own name rather than as an argument a user may
2941have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00002942passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00002943['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
2944to be ignored.
2945
2946
2947.. function:: abort()
2948
2949 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
2950 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02002951 an exit code of ``3``. Be aware that calling this function will not call the
2952 Python signal handler registered for :const:`SIGABRT` with
2953 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002954
Georg Brandl116aa622007-08-15 14:28:22 +00002955
2956.. function:: execl(path, arg0, arg1, ...)
2957 execle(path, arg0, arg1, ..., env)
2958 execlp(file, arg0, arg1, ...)
2959 execlpe(file, arg0, arg1, ..., env)
2960 execv(path, args)
2961 execve(path, args, env)
2962 execvp(file, args)
2963 execvpe(file, args, env)
2964
2965 These functions all execute a new program, replacing the current process; they
2966 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00002967 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00002968 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00002969
2970 The current process is replaced immediately. Open file objects and
2971 descriptors are not flushed, so if there may be data buffered
2972 on these open files, you should flush them using
2973 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03002974 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00002975
Serhiy Storchakadab83542013-10-13 20:12:43 +03002976 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00002977 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00002978 to work with if the number of parameters is fixed when the code is written; the
2979 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00002980 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00002981 variable, with the arguments being passed in a list or tuple as the *args*
2982 parameter. In either case, the arguments to the child process should start with
2983 the name of the command being run, but this is not enforced.
2984
Christian Heimesfaf2f632008-01-06 16:59:19 +00002985 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00002986 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
2987 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03002988 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00002989 discussed in the next paragraph), the new environment is used as the source of
2990 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
2991 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
2992 locate the executable; *path* must contain an appropriate absolute or relative
2993 path.
2994
2995 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00002996 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00002997 used to define the environment variables for the new process (these are used
2998 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00002999 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003000 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003001
Larry Hastings9cf065c2012-06-22 16:30:09 -07003002 For :func:`execve` on some platforms, *path* may also be specified as an open
3003 file descriptor. This functionality may not be supported on your platform;
3004 you can check whether or not it is available using :data:`os.supports_fd`.
3005 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3006
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003007 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003008
Larry Hastings9cf065c2012-06-22 16:30:09 -07003009 .. versionadded:: 3.3
3010 Added support for specifying an open file descriptor for *path*
3011 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003012
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003013 .. versionchanged:: 3.6
3014 Accepts a :term:`path-like object`.
3015
Georg Brandl116aa622007-08-15 14:28:22 +00003016.. function:: _exit(n)
3017
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003018 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003019 stdio buffers, etc.
3020
Georg Brandl116aa622007-08-15 14:28:22 +00003021 .. note::
3022
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003023 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3024 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003025
Christian Heimesfaf2f632008-01-06 16:59:19 +00003026The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003027although they are not required. These are typically used for system programs
3028written in Python, such as a mail server's external command delivery program.
3029
3030.. note::
3031
3032 Some of these may not be available on all Unix platforms, since there is some
3033 variation. These constants are defined where they are defined by the underlying
3034 platform.
3035
3036
3037.. data:: EX_OK
3038
Benjamin Petersonf650e462010-05-06 23:03:05 +00003039 Exit code that means no error occurred.
3040
3041 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003042
Georg Brandl116aa622007-08-15 14:28:22 +00003043
3044.. data:: EX_USAGE
3045
3046 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003047 number of arguments are given.
3048
3049 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003050
Georg Brandl116aa622007-08-15 14:28:22 +00003051
3052.. data:: EX_DATAERR
3053
Benjamin Petersonf650e462010-05-06 23:03:05 +00003054 Exit code that means the input data was incorrect.
3055
3056 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003057
Georg Brandl116aa622007-08-15 14:28:22 +00003058
3059.. data:: EX_NOINPUT
3060
3061 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003062
Georg Brandlc575c902008-09-13 17:46:05 +00003063 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003064
Georg Brandl116aa622007-08-15 14:28:22 +00003065
3066.. data:: EX_NOUSER
3067
Benjamin Petersonf650e462010-05-06 23:03:05 +00003068 Exit code that means a specified user did not exist.
3069
3070 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003071
Georg Brandl116aa622007-08-15 14:28:22 +00003072
3073.. data:: EX_NOHOST
3074
Benjamin Petersonf650e462010-05-06 23:03:05 +00003075 Exit code that means a specified host did not exist.
3076
3077 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003078
Georg Brandl116aa622007-08-15 14:28:22 +00003079
3080.. data:: EX_UNAVAILABLE
3081
Benjamin Petersonf650e462010-05-06 23:03:05 +00003082 Exit code that means that a required service is unavailable.
3083
3084 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003085
Georg Brandl116aa622007-08-15 14:28:22 +00003086
3087.. data:: EX_SOFTWARE
3088
Benjamin Petersonf650e462010-05-06 23:03:05 +00003089 Exit code that means an internal software error was detected.
3090
3091 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003092
Georg Brandl116aa622007-08-15 14:28:22 +00003093
3094.. data:: EX_OSERR
3095
3096 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003097 inability to fork or create a pipe.
3098
3099 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003100
Georg Brandl116aa622007-08-15 14:28:22 +00003101
3102.. data:: EX_OSFILE
3103
3104 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003105 some other kind of error.
3106
3107 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003108
Georg Brandl116aa622007-08-15 14:28:22 +00003109
3110.. data:: EX_CANTCREAT
3111
3112 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003113
Georg Brandlc575c902008-09-13 17:46:05 +00003114 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003115
Georg Brandl116aa622007-08-15 14:28:22 +00003116
3117.. data:: EX_IOERR
3118
3119 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003120
Georg Brandlc575c902008-09-13 17:46:05 +00003121 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003122
Georg Brandl116aa622007-08-15 14:28:22 +00003123
3124.. data:: EX_TEMPFAIL
3125
3126 Exit code that means a temporary failure occurred. This indicates something
3127 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003128 made during a retryable operation.
3129
3130 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003131
Georg Brandl116aa622007-08-15 14:28:22 +00003132
3133.. data:: EX_PROTOCOL
3134
3135 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003136 understood.
3137
3138 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003139
Georg Brandl116aa622007-08-15 14:28:22 +00003140
3141.. data:: EX_NOPERM
3142
3143 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003144 operation (but not intended for file system problems).
3145
3146 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003147
Georg Brandl116aa622007-08-15 14:28:22 +00003148
3149.. data:: EX_CONFIG
3150
3151 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003152
Georg Brandlc575c902008-09-13 17:46:05 +00003153 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003154
Georg Brandl116aa622007-08-15 14:28:22 +00003155
3156.. data:: EX_NOTFOUND
3157
Benjamin Petersonf650e462010-05-06 23:03:05 +00003158 Exit code that means something like "an entry was not found".
3159
3160 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003161
Georg Brandl116aa622007-08-15 14:28:22 +00003162
3163.. function:: fork()
3164
Christian Heimesfaf2f632008-01-06 16:59:19 +00003165 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003166 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003167
Larry Hastings3732ed22014-03-15 21:13:56 -07003168 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003169 known issues when using fork() from a thread.
3170
Christian Heimes3046fe42013-10-29 21:08:56 +01003171 .. warning::
3172
3173 See :mod:`ssl` for applications that use the SSL module with fork().
3174
Georg Brandlc575c902008-09-13 17:46:05 +00003175 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003176
3177
3178.. function:: forkpty()
3179
3180 Fork a child process, using a new pseudo-terminal as the child's controlling
3181 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3182 new child's process id in the parent, and *fd* is the file descriptor of the
3183 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003184 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003185
Georg Brandlc575c902008-09-13 17:46:05 +00003186 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003187
3188
3189.. function:: kill(pid, sig)
3190
3191 .. index::
3192 single: process; killing
3193 single: process; signalling
3194
3195 Send signal *sig* to the process *pid*. Constants for the specific signals
3196 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003197
3198 Windows: The :data:`signal.CTRL_C_EVENT` and
3199 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3200 only be sent to console processes which share a common console window,
3201 e.g., some subprocesses. Any other value for *sig* will cause the process
3202 to be unconditionally killed by the TerminateProcess API, and the exit code
3203 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3204 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003205
Victor Stinnerb3e72192011-05-08 01:46:11 +02003206 See also :func:`signal.pthread_kill`.
3207
Georg Brandl67b21b72010-08-17 15:07:14 +00003208 .. versionadded:: 3.2
3209 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003210
Georg Brandl116aa622007-08-15 14:28:22 +00003211
3212.. function:: killpg(pgid, sig)
3213
3214 .. index::
3215 single: process; killing
3216 single: process; signalling
3217
Benjamin Petersonf650e462010-05-06 23:03:05 +00003218 Send the signal *sig* to the process group *pgid*.
3219
3220 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003221
Georg Brandl116aa622007-08-15 14:28:22 +00003222
3223.. function:: nice(increment)
3224
3225 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003226
Georg Brandlc575c902008-09-13 17:46:05 +00003227 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003228
3229
3230.. function:: plock(op)
3231
3232 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003233 ``<sys/lock.h>``) determines which segments are locked.
3234
3235 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003236
3237
Martin Panterbf19d162015-09-09 01:01:13 +00003238.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003239
Martin Panterbf19d162015-09-09 01:01:13 +00003240 Open a pipe to or from command *cmd*.
3241 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003242 connected to the pipe, which can be read or written depending on whether *mode*
3243 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3244 the corresponding argument to the built-in :func:`open` function. The
3245 returned file object reads or writes text strings rather than bytes.
3246
3247 The ``close`` method returns :const:`None` if the subprocess exited
3248 successfully, or the subprocess's return code if there was an
3249 error. On POSIX systems, if the return code is positive it
3250 represents the return value of the process left-shifted by one
3251 byte. If the return code is negative, the process was terminated
3252 by the signal given by the negated value of the return code. (For
3253 example, the return value might be ``- signal.SIGKILL`` if the
3254 subprocess was killed.) On Windows systems, the return value
3255 contains the signed integer return code from the child process.
3256
3257 This is implemented using :class:`subprocess.Popen`; see that class's
3258 documentation for more powerful ways to manage and communicate with
3259 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003260
3261
Gregory P. Smith163468a2017-05-29 10:03:41 -07003262.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3263 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003264
Gregory P. Smith163468a2017-05-29 10:03:41 -07003265 Register callables to be executed when a new child process is forked
3266 using :func:`os.fork` or similar process cloning APIs.
3267 The parameters are optional and keyword-only.
3268 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003269
Gregory P. Smith163468a2017-05-29 10:03:41 -07003270 * *before* is a function called before forking a child process.
3271 * *after_in_parent* is a function called from the parent process
3272 after forking a child process.
3273 * *after_in_child* is a function called from the child process.
3274
3275 These calls are only made if control is expected to return to the
3276 Python interpreter. A typical :mod:`subprocess` launch will not
3277 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003278
3279 Functions registered for execution before forking are called in
3280 reverse registration order. Functions registered for execution
3281 after forking (either in the parent or in the child) are called
3282 in registration order.
3283
3284 Note that :c:func:`fork` calls made by third-party C code may not
3285 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3286 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3287
Gregory P. Smith163468a2017-05-29 10:03:41 -07003288 There is no way to unregister a function.
3289
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003290 Availability: Unix.
3291
3292 .. versionadded:: 3.7
3293
3294
Georg Brandl116aa622007-08-15 14:28:22 +00003295.. function:: spawnl(mode, path, ...)
3296 spawnle(mode, path, ..., env)
3297 spawnlp(mode, file, ...)
3298 spawnlpe(mode, file, ..., env)
3299 spawnv(mode, path, args)
3300 spawnve(mode, path, args, env)
3301 spawnvp(mode, file, args)
3302 spawnvpe(mode, file, args, env)
3303
3304 Execute the program *path* in a new process.
3305
3306 (Note that the :mod:`subprocess` module provides more powerful facilities for
3307 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003308 preferable to using these functions. Check especially the
3309 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003310
Christian Heimesfaf2f632008-01-06 16:59:19 +00003311 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003312 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3313 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003314 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003315 be used with the :func:`waitpid` function.
3316
Serhiy Storchakadab83542013-10-13 20:12:43 +03003317 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003318 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003319 to work with if the number of parameters is fixed when the code is written; the
3320 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003321 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003322 parameters is variable, with the arguments being passed in a list or tuple as
3323 the *args* parameter. In either case, the arguments to the child process must
3324 start with the name of the command being run.
3325
Christian Heimesfaf2f632008-01-06 16:59:19 +00003326 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003327 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3328 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003329 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003330 discussed in the next paragraph), the new environment is used as the source of
3331 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3332 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3333 :envvar:`PATH` variable to locate the executable; *path* must contain an
3334 appropriate absolute or relative path.
3335
3336 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003337 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003338 which is used to define the environment variables for the new process (they are
3339 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003340 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003341 the new process to inherit the environment of the current process. Note that
3342 keys and values in the *env* dictionary must be strings; invalid keys or
3343 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003344
3345 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3346 equivalent::
3347
3348 import os
3349 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3350
3351 L = ['cp', 'index.html', '/dev/null']
3352 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3353
3354 Availability: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
Antoine Pitrou0e752dd2011-07-19 01:26:58 +02003355 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3356 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3357 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003358
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003359 .. versionchanged:: 3.6
3360 Accepts a :term:`path-like object`.
3361
Georg Brandl116aa622007-08-15 14:28:22 +00003362
3363.. data:: P_NOWAIT
3364 P_NOWAITO
3365
Serhiy Storchakadab83542013-10-13 20:12:43 +03003366 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003367 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003368 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003369 the return value.
3370
3371 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003372
Georg Brandl116aa622007-08-15 14:28:22 +00003373
3374.. data:: P_WAIT
3375
Serhiy Storchakadab83542013-10-13 20:12:43 +03003376 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003377 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3378 return until the new process has run to completion and will return the exit code
3379 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003380 process.
3381
3382 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003383
Georg Brandl116aa622007-08-15 14:28:22 +00003384
3385.. data:: P_DETACH
3386 P_OVERLAY
3387
Serhiy Storchakadab83542013-10-13 20:12:43 +03003388 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003389 functions. These are less portable than those listed above. :const:`P_DETACH`
3390 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3391 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003392 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003393
Georg Brandl116aa622007-08-15 14:28:22 +00003394 Availability: Windows.
3395
Georg Brandl116aa622007-08-15 14:28:22 +00003396
3397.. function:: startfile(path[, operation])
3398
3399 Start a file with its associated application.
3400
3401 When *operation* is not specified or ``'open'``, this acts like double-clicking
3402 the file in Windows Explorer, or giving the file name as an argument to the
3403 :program:`start` command from the interactive command shell: the file is opened
3404 with whatever application (if any) its extension is associated.
3405
3406 When another *operation* is given, it must be a "command verb" that specifies
3407 what should be done with the file. Common verbs documented by Microsoft are
3408 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3409 ``'find'`` (to be used on directories).
3410
3411 :func:`startfile` returns as soon as the associated application is launched.
3412 There is no option to wait for the application to close, and no way to retrieve
3413 the application's exit status. The *path* parameter is relative to the current
3414 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003415 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003416 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003417 the path is properly encoded for Win32.
3418
Steve Dower7d0e0c92015-01-24 08:18:24 -08003419 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3420 function is not resolved until this function is first called. If the function
3421 cannot be resolved, :exc:`NotImplementedError` will be raised.
3422
Benjamin Petersonf650e462010-05-06 23:03:05 +00003423 Availability: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003424
Georg Brandl116aa622007-08-15 14:28:22 +00003425
3426.. function:: system(command)
3427
3428 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003429 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003430 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3431 the executed command. If *command* generates any output, it will be sent to
3432 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003433
3434 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003435 format specified for :func:`wait`. Note that POSIX does not specify the
3436 meaning of the return value of the C :c:func:`system` function, so the return
3437 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003438
Georg Brandl8f7b4272010-10-14 06:35:53 +00003439 On Windows, the return value is that returned by the system shell after
3440 running *command*. The shell is given by the Windows environment variable
3441 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3442 status of the command run; on systems using a non-native shell, consult your
3443 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003444
Georg Brandl8f7b4272010-10-14 06:35:53 +00003445 The :mod:`subprocess` module provides more powerful facilities for spawning
3446 new processes and retrieving their results; using that module is preferable
3447 to using this function. See the :ref:`subprocess-replacements` section in
3448 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003449
Benjamin Petersonf650e462010-05-06 23:03:05 +00003450 Availability: Unix, Windows.
3451
Georg Brandl116aa622007-08-15 14:28:22 +00003452
3453.. function:: times()
3454
Larry Hastings605a62d2012-06-24 04:33:36 -07003455 Returns the current global process times.
3456 The return value is an object with five attributes:
3457
3458 * :attr:`user` - user time
3459 * :attr:`system` - system time
3460 * :attr:`children_user` - user time of all child processes
3461 * :attr:`children_system` - system time of all child processes
3462 * :attr:`elapsed` - elapsed real time since a fixed point in the past
3463
3464 For backwards compatibility, this object also behaves like a five-tuple
3465 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
3466 :attr:`children_system`, and :attr:`elapsed` in that order.
3467
3468 See the Unix manual page
Benjamin Petersonf650e462010-05-06 23:03:05 +00003469 :manpage:`times(2)` or the corresponding Windows Platform API documentation.
Larry Hastings605a62d2012-06-24 04:33:36 -07003470 On Windows, only :attr:`user` and :attr:`system` are known; the other
3471 attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003472
Georg Brandl8a5555f2012-06-24 13:29:09 +02003473 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003474
Larry Hastings605a62d2012-06-24 04:33:36 -07003475 .. versionchanged:: 3.3
3476 Return type changed from a tuple to a tuple-like object
3477 with named attributes.
3478
Georg Brandl116aa622007-08-15 14:28:22 +00003479
3480.. function:: wait()
3481
3482 Wait for completion of a child process, and return a tuple containing its pid
3483 and exit status indication: a 16-bit number, whose low byte is the signal number
3484 that killed the process, and whose high byte is the exit status (if the signal
3485 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003486 produced.
3487
3488 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003489
Ross Lagerwall7807c352011-03-17 20:20:30 +02003490.. function:: waitid(idtype, id, options)
3491
3492 Wait for the completion of one or more child processes.
3493 *idtype* can be :data:`P_PID`, :data:`P_PGID` or :data:`P_ALL`.
3494 *id* specifies the pid to wait on.
3495 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
3496 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
3497 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
3498 representing the data contained in the :c:type:`siginfo_t` structure, namely:
3499 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
3500 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
3501 children in a waitable state.
3502
3503 Availability: Unix.
3504
3505 .. versionadded:: 3.3
3506
3507.. data:: P_PID
3508 P_PGID
3509 P_ALL
3510
3511 These are the possible values for *idtype* in :func:`waitid`. They affect
3512 how *id* is interpreted.
3513
3514 Availability: Unix.
3515
3516 .. versionadded:: 3.3
3517
3518.. data:: WEXITED
3519 WSTOPPED
3520 WNOWAIT
3521
3522 Flags that can be used in *options* in :func:`waitid` that specify what
3523 child signal to wait for.
3524
3525 Availability: Unix.
3526
3527 .. versionadded:: 3.3
3528
3529
3530.. data:: CLD_EXITED
3531 CLD_DUMPED
3532 CLD_TRAPPED
3533 CLD_CONTINUED
3534
3535 These are the possible values for :attr:`si_code` in the result returned by
3536 :func:`waitid`.
3537
3538 Availability: Unix.
3539
3540 .. versionadded:: 3.3
3541
Georg Brandl116aa622007-08-15 14:28:22 +00003542
3543.. function:: waitpid(pid, options)
3544
3545 The details of this function differ on Unix and Windows.
3546
3547 On Unix: Wait for completion of a child process given by process id *pid*, and
3548 return a tuple containing its process id and exit status indication (encoded as
3549 for :func:`wait`). The semantics of the call are affected by the value of the
3550 integer *options*, which should be ``0`` for normal operation.
3551
3552 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
3553 that specific process. If *pid* is ``0``, the request is for the status of any
3554 child in the process group of the current process. If *pid* is ``-1``, the
3555 request pertains to any child of the current process. If *pid* is less than
3556 ``-1``, status is requested for any process in the process group ``-pid`` (the
3557 absolute value of *pid*).
3558
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00003559 An :exc:`OSError` is raised with the value of errno when the syscall
3560 returns -1.
3561
Georg Brandl116aa622007-08-15 14:28:22 +00003562 On Windows: Wait for completion of a process given by process handle *pid*, and
3563 return a tuple containing *pid*, and its exit status shifted left by 8 bits
3564 (shifting makes cross-platform use of the function easier). A *pid* less than or
3565 equal to ``0`` has no special meaning on Windows, and raises an exception. The
3566 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03003567 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
3568 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00003569
Victor Stinnera766ddf2015-03-26 23:50:57 +01003570 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02003571 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01003572 exception, the function now retries the system call instead of raising an
3573 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
3574
Georg Brandl116aa622007-08-15 14:28:22 +00003575
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02003576.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00003577
3578 Similar to :func:`waitpid`, except no process id argument is given and a
3579 3-element tuple containing the child's process id, exit status indication, and
3580 resource usage information is returned. Refer to :mod:`resource`.\
Serhiy Storchakadab83542013-10-13 20:12:43 +03003581 :func:`~resource.getrusage` for details on resource usage information. The
3582 option argument is the same as that provided to :func:`waitpid` and
3583 :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003584
Georg Brandl116aa622007-08-15 14:28:22 +00003585 Availability: Unix.
3586
Georg Brandl116aa622007-08-15 14:28:22 +00003587
Victor Stinner4195b5c2012-02-08 23:03:19 +01003588.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00003589
3590 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
3591 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03003592 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
3593 resource usage information. The arguments to :func:`wait4` are the same
3594 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003595
3596 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003597
Georg Brandl116aa622007-08-15 14:28:22 +00003598
3599.. data:: WNOHANG
3600
3601 The option for :func:`waitpid` to return immediately if no child process status
3602 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003603
Georg Brandlc575c902008-09-13 17:46:05 +00003604 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003605
3606
3607.. data:: WCONTINUED
3608
3609 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00003610 from a job control stop since their status was last reported.
3611
Georg Brandl8a5555f2012-06-24 13:29:09 +02003612 Availability: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00003613
Georg Brandl116aa622007-08-15 14:28:22 +00003614
3615.. data:: WUNTRACED
3616
3617 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00003618 their current state has not been reported since they were stopped.
3619
3620 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003621
Georg Brandl116aa622007-08-15 14:28:22 +00003622
3623The following functions take a process status code as returned by
3624:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
3625used to determine the disposition of a process.
3626
Georg Brandl116aa622007-08-15 14:28:22 +00003627.. function:: WCOREDUMP(status)
3628
Christian Heimesfaf2f632008-01-06 16:59:19 +00003629 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00003630 return ``False``.
3631
3632 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003633
Georg Brandl116aa622007-08-15 14:28:22 +00003634
3635.. function:: WIFCONTINUED(status)
3636
Christian Heimesfaf2f632008-01-06 16:59:19 +00003637 Return ``True`` if the process has been continued from a job control stop,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003638 otherwise return ``False``.
3639
3640 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003641
Georg Brandl116aa622007-08-15 14:28:22 +00003642
3643.. function:: WIFSTOPPED(status)
3644
Christian Heimesfaf2f632008-01-06 16:59:19 +00003645 Return ``True`` if the process has been stopped, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003646 ``False``.
3647
3648 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003649
3650
3651.. function:: WIFSIGNALED(status)
3652
Christian Heimesfaf2f632008-01-06 16:59:19 +00003653 Return ``True`` if the process exited due to a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003654 ``False``.
3655
3656 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003657
3658
3659.. function:: WIFEXITED(status)
3660
Christian Heimesfaf2f632008-01-06 16:59:19 +00003661 Return ``True`` if the process exited using the :manpage:`exit(2)` system call,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003662 otherwise return ``False``.
3663
3664 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003665
3666
3667.. function:: WEXITSTATUS(status)
3668
3669 If ``WIFEXITED(status)`` is true, return the integer parameter to the
3670 :manpage:`exit(2)` system call. Otherwise, the return value is meaningless.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003671
Georg Brandlc575c902008-09-13 17:46:05 +00003672 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003673
3674
3675.. function:: WSTOPSIG(status)
3676
Benjamin Petersonf650e462010-05-06 23:03:05 +00003677 Return the signal which caused the process to stop.
3678
3679 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003680
3681
3682.. function:: WTERMSIG(status)
3683
Benjamin Petersonf650e462010-05-06 23:03:05 +00003684 Return the signal which caused the process to exit.
3685
3686 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003687
3688
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003689Interface to the scheduler
3690--------------------------
3691
3692These functions control how a process is allocated CPU time by the operating
3693system. They are only available on some Unix platforms. For more detailed
3694information, consult your Unix manpages.
3695
3696.. versionadded:: 3.3
3697
Andrew Kuchling4921a082013-06-21 11:49:57 -04003698The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003699operating system.
3700
3701.. data:: SCHED_OTHER
3702
3703 The default scheduling policy.
3704
3705.. data:: SCHED_BATCH
3706
3707 Scheduling policy for CPU-intensive processes that tries to preserve
3708 interactivity on the rest of the computer.
3709
3710.. data:: SCHED_IDLE
3711
3712 Scheduling policy for extremely low priority background tasks.
3713
3714.. data:: SCHED_SPORADIC
3715
3716 Scheduling policy for sporadic server programs.
3717
3718.. data:: SCHED_FIFO
3719
3720 A First In First Out scheduling policy.
3721
3722.. data:: SCHED_RR
3723
3724 A round-robin scheduling policy.
3725
3726.. data:: SCHED_RESET_ON_FORK
3727
Martin Panter8d56c022016-05-29 04:13:35 +00003728 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003729 this flag set forks, its child's scheduling policy and priority are reset to
3730 the default.
3731
3732
3733.. class:: sched_param(sched_priority)
3734
3735 This class represents tunable scheduling parameters used in
3736 :func:`sched_setparam`, :func:`sched_setscheduler`, and
3737 :func:`sched_getparam`. It is immutable.
3738
3739 At the moment, there is only one possible parameter:
3740
3741 .. attribute:: sched_priority
3742
3743 The scheduling priority for a scheduling policy.
3744
3745
3746.. function:: sched_get_priority_min(policy)
3747
3748 Get the minimum priority value for *policy*. *policy* is one of the
3749 scheduling policy constants above.
3750
3751
3752.. function:: sched_get_priority_max(policy)
3753
3754 Get the maximum priority value for *policy*. *policy* is one of the
3755 scheduling policy constants above.
3756
3757
3758.. function:: sched_setscheduler(pid, policy, param)
3759
3760 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
3761 the calling process. *policy* is one of the scheduling policy constants
3762 above. *param* is a :class:`sched_param` instance.
3763
3764
3765.. function:: sched_getscheduler(pid)
3766
3767 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
3768 means the calling process. The result is one of the scheduling policy
3769 constants above.
3770
3771
3772.. function:: sched_setparam(pid, param)
3773
3774 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
3775 the calling process. *param* is a :class:`sched_param` instance.
3776
3777
3778.. function:: sched_getparam(pid)
3779
3780 Return the scheduling parameters as a :class:`sched_param` instance for the
3781 process with PID *pid*. A *pid* of 0 means the calling process.
3782
3783
3784.. function:: sched_rr_get_interval(pid)
3785
3786 Return the round-robin quantum in seconds for the process with PID *pid*. A
3787 *pid* of 0 means the calling process.
3788
3789
3790.. function:: sched_yield()
3791
3792 Voluntarily relinquish the CPU.
3793
3794
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003795.. function:: sched_setaffinity(pid, mask)
3796
Antoine Pitrou84869872012-08-04 16:16:35 +02003797 Restrict the process with PID *pid* (or the current process if zero) to a
3798 set of CPUs. *mask* is an iterable of integers representing the set of
3799 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003800
3801
Antoine Pitrou84869872012-08-04 16:16:35 +02003802.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003803
Antoine Pitrou84869872012-08-04 16:16:35 +02003804 Return the set of CPUs the process with PID *pid* (or the current process
3805 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003806
3807
Georg Brandl116aa622007-08-15 14:28:22 +00003808.. _os-path:
3809
3810Miscellaneous System Information
3811--------------------------------
3812
3813
3814.. function:: confstr(name)
3815
3816 Return string-valued system configuration values. *name* specifies the
3817 configuration value to retrieve; it may be a string which is the name of a
3818 defined system value; these names are specified in a number of standards (POSIX,
3819 Unix 95, Unix 98, and others). Some platforms define additional names as well.
3820 The names known to the host operating system are given as the keys of the
3821 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003822 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00003823
3824 If the configuration value specified by *name* isn't defined, ``None`` is
3825 returned.
3826
3827 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
3828 specific value for *name* is not supported by the host system, even if it is
3829 included in ``confstr_names``, an :exc:`OSError` is raised with
3830 :const:`errno.EINVAL` for the error number.
3831
Georg Brandl8a5555f2012-06-24 13:29:09 +02003832 Availability: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003833
Georg Brandl116aa622007-08-15 14:28:22 +00003834
3835.. data:: confstr_names
3836
3837 Dictionary mapping names accepted by :func:`confstr` to the integer values
3838 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003839 determine the set of names known to the system.
3840
3841 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003842
3843
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003844.. function:: cpu_count()
3845
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03003846 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003847
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01003848 This number is not equivalent to the number of CPUs the current process can
3849 use. The number of usable CPUs can be obtained with
3850 ``len(os.sched_getaffinity(0))``
3851
3852
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003853 .. versionadded:: 3.4
3854
3855
Georg Brandl116aa622007-08-15 14:28:22 +00003856.. function:: getloadavg()
3857
Christian Heimesa62da1d2008-01-12 19:39:10 +00003858 Return the number of processes in the system run queue averaged over the last
3859 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003860 unobtainable.
3861
3862 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003863
Georg Brandl116aa622007-08-15 14:28:22 +00003864
3865.. function:: sysconf(name)
3866
3867 Return integer-valued system configuration values. If the configuration value
3868 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
3869 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
3870 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003871
Georg Brandlc575c902008-09-13 17:46:05 +00003872 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003873
3874
3875.. data:: sysconf_names
3876
3877 Dictionary mapping names accepted by :func:`sysconf` to the integer values
3878 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003879 determine the set of names known to the system.
3880
3881 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003882
Christian Heimesfaf2f632008-01-06 16:59:19 +00003883The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00003884are defined for all platforms.
3885
3886Higher-level operations on pathnames are defined in the :mod:`os.path` module.
3887
3888
3889.. data:: curdir
3890
3891 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00003892 directory. This is ``'.'`` for Windows and POSIX. Also available via
3893 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003894
3895
3896.. data:: pardir
3897
3898 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00003899 directory. This is ``'..'`` for Windows and POSIX. Also available via
3900 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003901
3902
3903.. data:: sep
3904
Georg Brandlc575c902008-09-13 17:46:05 +00003905 The character used by the operating system to separate pathname components.
3906 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
3907 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00003908 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
3909 useful. Also available via :mod:`os.path`.
3910
3911
3912.. data:: altsep
3913
3914 An alternative character used by the operating system to separate pathname
3915 components, or ``None`` if only one separator character exists. This is set to
3916 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
3917 :mod:`os.path`.
3918
3919
3920.. data:: extsep
3921
3922 The character which separates the base filename from the extension; for example,
3923 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
3924
Georg Brandl116aa622007-08-15 14:28:22 +00003925
3926.. data:: pathsep
3927
3928 The character conventionally used by the operating system to separate search
3929 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
3930 Windows. Also available via :mod:`os.path`.
3931
3932
3933.. data:: defpath
3934
Serhiy Storchakadab83542013-10-13 20:12:43 +03003935 The default search path used by :func:`exec\*p\* <execl>` and
3936 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
3937 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003938
3939
3940.. data:: linesep
3941
3942 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00003943 platform. This may be a single character, such as ``'\n'`` for POSIX, or
3944 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
3945 *os.linesep* as a line terminator when writing files opened in text mode (the
3946 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00003947
3948
3949.. data:: devnull
3950
Georg Brandl850a9902010-05-21 22:04:32 +00003951 The file path of the null device. For example: ``'/dev/null'`` for
3952 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00003953
Andrew Kuchling4921a082013-06-21 11:49:57 -04003954.. data:: RTLD_LAZY
3955 RTLD_NOW
3956 RTLD_GLOBAL
3957 RTLD_LOCAL
3958 RTLD_NODELETE
3959 RTLD_NOLOAD
3960 RTLD_DEEPBIND
3961
3962 Flags for use with the :func:`~sys.setdlopenflags` and
3963 :func:`~sys.getdlopenflags` functions. See the Unix manual page
3964 :manpage:`dlopen(3)` for what the different flags mean.
3965
3966 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00003967
Georg Brandl116aa622007-08-15 14:28:22 +00003968
Victor Stinner9b1f4742016-09-06 16:18:52 -07003969Random numbers
3970--------------
Georg Brandl116aa622007-08-15 14:28:22 +00003971
3972
Victor Stinner9b1f4742016-09-06 16:18:52 -07003973.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00003974
Victor Stinner9b1f4742016-09-06 16:18:52 -07003975 Get up to *size* random bytes. The function can return less bytes than
3976 requested.
3977
3978 These bytes can be used to seed user-space random number generators or for
3979 cryptographic purposes.
3980
3981 ``getrandom()`` relies on entropy gathered from device drivers and other
3982 sources of environmental noise. Unnecessarily reading large quantities of
3983 data will have a negative impact on other users of the ``/dev/random`` and
3984 ``/dev/urandom`` devices.
3985
3986 The flags argument is a bit mask that can contain zero or more of the
3987 following values ORed together: :py:data:`os.GRND_RANDOM` and
3988 :py:data:`GRND_NONBLOCK`.
3989
3990 See also the `Linux getrandom() manual page
3991 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
3992
3993 Availability: Linux 3.17 and newer.
3994
3995 .. versionadded:: 3.6
3996
3997.. function:: urandom(size)
3998
3999 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004000
4001 This function returns random bytes from an OS-specific randomness source. The
4002 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004003 though its exact quality depends on the OS implementation.
4004
Victor Stinnere66987e2016-09-06 16:33:52 -07004005 On Linux, if the ``getrandom()`` syscall is available, it is used in
4006 blocking mode: block until the system urandom entropy pool is initialized
4007 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4008 the rationale. On Linux, the :func:`getrandom` function can be used to get
4009 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4010 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004011
Victor Stinnere66987e2016-09-06 16:33:52 -07004012 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4013 device. If the ``/dev/urandom`` device is not available or not readable, the
4014 :exc:`NotImplementedError` exception is raised.
4015
4016 On Windows, it will use ``CryptGenRandom()``.
4017
4018 .. seealso::
4019 The :mod:`secrets` module provides higher level functions. For an
4020 easy-to-use interface to the random number generator provided by your
4021 platform, please see :class:`random.SystemRandom`.
4022
4023 .. versionchanged:: 3.6.0
4024 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4025 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004026
Victor Stinnerdddf4842016-06-07 11:21:42 +02004027 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004028 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4029 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004030
Victor Stinnerace88482015-07-29 02:28:32 +02004031 .. versionchanged:: 3.5
4032 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4033 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4034 function is now used. These functions avoid the usage of an internal file
4035 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004036
4037.. data:: GRND_NONBLOCK
4038
4039 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4040 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4041 if the entropy pool has not yet been initialized.
4042
4043 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4044 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4045
4046 .. versionadded:: 3.6
4047
4048.. data:: GRND_RANDOM
4049
4050 If this bit is set, then random bytes are drawn from the
4051 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4052
4053 .. versionadded:: 3.6