blob: 60ab94f4769ef263f4bd5e065f00dd3f665d60f7 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
Benjamin Peterson1baf4652009-12-31 03:11:23 +000035* An "Availability: Unix" note means that this function is commonly found on
36 Unix systems. It does not make any claims about its existence on a specific
37 operating system.
38
39* If not separately noted, all functions that claim "Availability: Unix" are
40 supported on Mac OS X, which builds on a Unix core.
41
Benjamin Petersonf650e462010-05-06 23:03:05 +000042.. Availability notes get their own line and occur at the end of the function
43.. documentation.
44
Georg Brandlc575c902008-09-13 17:46:05 +000045.. note::
46
Christian Heimesa62da1d2008-01-12 19:39:10 +000047 All functions in this module raise :exc:`OSError` in the case of invalid or
48 inaccessible file names and paths, or other arguments that have the correct
49 type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000050
Georg Brandl116aa622007-08-15 14:28:22 +000051.. exception:: error
52
Christian Heimesa62da1d2008-01-12 19:39:10 +000053 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000054
55
56.. data:: name
57
Benjamin Peterson1baf4652009-12-31 03:11:23 +000058 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070059 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070060 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000061
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020062 .. seealso::
63 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
64 system-dependent version information.
65
66 The :mod:`platform` module provides detailed checks for the
67 system's identity.
68
Georg Brandl116aa622007-08-15 14:28:22 +000069
Martin v. Löwis011e8422009-05-05 04:43:17 +000070.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020071.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000072
73File Names, Command Line Arguments, and Environment Variables
74-------------------------------------------------------------
75
Georg Brandl67b21b72010-08-17 15:07:14 +000076In Python, file names, command line arguments, and environment variables are
77represented using the string type. On some systems, decoding these strings to
78and from bytes is necessary before passing them to the operating system. Python
79uses the file system encoding to perform this conversion (see
80:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000081
82.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000083 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020084 case, Python uses the :ref:`surrogateescape encoding error handler
85 <surrogateescape>`, which means that undecodable bytes are replaced by a
86 Unicode character U+DCxx on decoding, and these are again translated to the
87 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000088
89
Georg Brandl67b21b72010-08-17 15:07:14 +000090The file system encoding must guarantee to successfully decode all bytes
91below 128. If the file system encoding fails to provide this guarantee, API
92functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000093
94
Georg Brandl116aa622007-08-15 14:28:22 +000095.. _os-procinfo:
96
97Process Parameters
98------------------
99
100These functions and data items provide information and operate on the current
101process and user.
102
103
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200104.. function:: ctermid()
105
106 Return the filename corresponding to the controlling terminal of the process.
107
108 Availability: Unix.
109
110
Georg Brandl116aa622007-08-15 14:28:22 +0000111.. data:: environ
112
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700113 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000114 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
115 and is equivalent to ``getenv("HOME")`` in C.
116
117 This mapping is captured the first time the :mod:`os` module is imported,
118 typically during Python startup as part of processing :file:`site.py`. Changes
119 to the environment made after this time are not reflected in ``os.environ``,
120 except for changes made by modifying ``os.environ`` directly.
121
122 If the platform supports the :func:`putenv` function, this mapping may be used
123 to modify the environment as well as query the environment. :func:`putenv` will
124 be called automatically when the mapping is modified.
125
Victor Stinner84ae1182010-05-06 22:05:07 +0000126 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
127 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
128 to use a different encoding.
129
Georg Brandl116aa622007-08-15 14:28:22 +0000130 .. note::
131
132 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
133 to modify ``os.environ``.
134
135 .. note::
136
Georg Brandlc575c902008-09-13 17:46:05 +0000137 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
138 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000139 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000140
141 If :func:`putenv` is not provided, a modified copy of this mapping may be
142 passed to the appropriate process-creation functions to cause child processes
143 to use a modified environment.
144
Georg Brandl9afde1c2007-11-01 20:32:30 +0000145 If the platform supports the :func:`unsetenv` function, you can delete items in
Georg Brandl116aa622007-08-15 14:28:22 +0000146 this mapping to unset environment variables. :func:`unsetenv` will be called
Georg Brandl9afde1c2007-11-01 20:32:30 +0000147 automatically when an item is deleted from ``os.environ``, and when
148 one of the :meth:`pop` or :meth:`clear` methods is called.
149
Georg Brandl116aa622007-08-15 14:28:22 +0000150
Victor Stinner84ae1182010-05-06 22:05:07 +0000151.. data:: environb
152
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700153 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000154 environment as byte strings. :data:`environ` and :data:`environb` are
155 synchronized (modify :data:`environb` updates :data:`environ`, and vice
156 versa).
157
Victor Stinnerb745a742010-05-18 17:17:23 +0000158 :data:`environb` is only available if :data:`supports_bytes_environ` is
159 True.
Victor Stinner84ae1182010-05-06 22:05:07 +0000160
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000161 .. versionadded:: 3.2
162
Victor Stinner84ae1182010-05-06 22:05:07 +0000163
Georg Brandl116aa622007-08-15 14:28:22 +0000164.. function:: chdir(path)
165 fchdir(fd)
166 getcwd()
167 :noindex:
168
169 These functions are described in :ref:`os-file-dir`.
170
171
Victor Stinnere8d51452010-08-19 01:05:19 +0000172.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000173
Brett Cannonc28592b2016-06-24 12:21:47 -0700174 Encode :term:`path-like <path-like object>` *filename* to the filesystem
175 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
176 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000177
Antoine Pitroua305ca72010-09-25 22:12:00 +0000178 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000179
180 .. versionadded:: 3.2
181
Brett Cannonb08388d2016-06-09 15:58:06 -0700182 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700183 Support added to accept objects implementing the :class:`os.PathLike`
184 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700185
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187.. function:: fsdecode(filename)
188
Brett Cannonc28592b2016-06-24 12:21:47 -0700189 Decode the :term:`path-like <path-like object>` *filename* from the
190 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
191 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000192
193 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000194
195 .. versionadded:: 3.2
196
Brett Cannonb08388d2016-06-09 15:58:06 -0700197 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700198 Support added to accept objects implementing the :class:`os.PathLike`
199 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700200
Victor Stinner449c4662010-05-08 11:10:09 +0000201
Ethan Furmancdc08792016-06-02 15:06:09 -0700202.. function:: fspath(path)
203
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700204 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700205
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700206 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
207 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
208 returned as long as it is a :class:`str` or :class:`bytes` object.
209 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700210
Brett Cannonb08388d2016-06-09 15:58:06 -0700211 .. versionadded:: 3.6
212
213
214.. class:: PathLike
215
216 An :term:`abstract base class` for objects representing a file system path,
217 e.g. :class:`pathlib.PurePath`.
218
Berker Peksagb18ffb42016-06-10 08:43:54 +0300219 .. versionadded:: 3.6
220
Brett Cannonb08388d2016-06-09 15:58:06 -0700221 .. abstractmethod:: __fspath__()
222
223 Return the file system path representation of the object.
224
225 The method should only return a :class:`str` or :class:`bytes` object,
226 with the preference being for :class:`str`.
227
Ethan Furmancdc08792016-06-02 15:06:09 -0700228
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200229.. function:: getenv(key, default=None)
230
231 Return the value of the environment variable *key* if it exists, or
232 *default* if it doesn't. *key*, *default* and the result are str.
233
234 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
235 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
236 would like to use a different encoding.
237
238 Availability: most flavors of Unix, Windows.
239
240
241.. function:: getenvb(key, default=None)
242
243 Return the value of the environment variable *key* if it exists, or
244 *default* if it doesn't. *key*, *default* and the result are bytes.
245
Berker Peksag996e5f92016-09-26 22:44:07 +0300246 :func:`getenvb` is only available if :data:`supports_bytes_environ`
247 is True.
248
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200249 Availability: most flavors of Unix.
250
251 .. versionadded:: 3.2
252
253
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000254.. function:: get_exec_path(env=None)
255
256 Returns the list of directories that will be searched for a named
257 executable, similar to a shell, when launching a process.
258 *env*, when specified, should be an environment variable dictionary
259 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300260 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000261
262 .. versionadded:: 3.2
263
264
Georg Brandl116aa622007-08-15 14:28:22 +0000265.. function:: getegid()
266
267 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000268 "set id" bit on the file being executed in the current process.
269
270 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000271
272
273.. function:: geteuid()
274
275 .. index:: single: user; effective id
276
Benjamin Petersonf650e462010-05-06 23:03:05 +0000277 Return the current process's effective user id.
278
279 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000280
281
282.. function:: getgid()
283
284 .. index:: single: process; group
285
Benjamin Petersonf650e462010-05-06 23:03:05 +0000286 Return the real group id of the current process.
287
288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000289
290
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200291.. function:: getgrouplist(user, group)
292
293 Return list of group ids that *user* belongs to. If *group* is not in the
294 list, it is included; typically, *group* is specified as the group ID
295 field from the password record for *user*.
296
297 Availability: Unix.
298
299 .. versionadded:: 3.3
300
301
Georg Brandl116aa622007-08-15 14:28:22 +0000302.. function:: getgroups()
303
304 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000305
Georg Brandl116aa622007-08-15 14:28:22 +0000306 Availability: Unix.
307
Larry Hastings3732ed22014-03-15 21:13:56 -0700308 .. note::
309
310 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700311 other Unix platforms. If the Python interpreter was built with a
312 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
313 the list of effective group ids associated with the current user process;
314 this list is limited to a system-defined number of entries, typically 16,
315 and may be modified by calls to :func:`setgroups` if suitably privileged.
316 If built with a deployment target greater than :const:`10.5`,
317 :func:`getgroups` returns the current group access list for the user
318 associated with the effective user id of the process; the group access
319 list may change over the lifetime of the process, it is not affected by
320 calls to :func:`setgroups`, and its length is not limited to 16. The
321 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
322 obtained with :func:`sysconfig.get_config_var`.
323
Georg Brandl116aa622007-08-15 14:28:22 +0000324
325.. function:: getlogin()
326
327 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500328 process. For most purposes, it is more useful to use
329 :func:`getpass.getuser` since the latter checks the environment variables
330 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
331 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
332 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000333
Brian Curtine8e4b3b2010-09-23 20:04:14 +0000334 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
336
337.. function:: getpgid(pid)
338
339 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000340 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000341
Benjamin Petersonf650e462010-05-06 23:03:05 +0000342 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000343
344.. function:: getpgrp()
345
346 .. index:: single: process; group
347
Benjamin Petersonf650e462010-05-06 23:03:05 +0000348 Return the id of the current process group.
349
350 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000351
352
353.. function:: getpid()
354
355 .. index:: single: process; id
356
Benjamin Petersonf650e462010-05-06 23:03:05 +0000357 Return the current process id.
358
Georg Brandl116aa622007-08-15 14:28:22 +0000359
360.. function:: getppid()
361
362 .. index:: single: process; id of parent
363
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000364 Return the parent's process id. When the parent process has exited, on Unix
365 the id returned is the one of the init process (1), on Windows it is still
366 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000367
Georg Brandl8a5555f2012-06-24 13:29:09 +0200368 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000369
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000370 .. versionchanged:: 3.2
371 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000372
Georg Brandl8a5555f2012-06-24 13:29:09 +0200373
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000374.. function:: getpriority(which, who)
375
376 .. index:: single: process; scheduling priority
377
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200378 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000379 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
380 is interpreted relative to *which* (a process identifier for
381 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200382 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000383 (respectively) the calling process, the process group of the calling process,
384 or the real user ID of the calling process.
385
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200386 Availability: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000387
388 .. versionadded:: 3.3
389
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200390
391.. data:: PRIO_PROCESS
392 PRIO_PGRP
393 PRIO_USER
394
395 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
396
397 Availability: Unix.
398
399 .. versionadded:: 3.3
400
401
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000402.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000403
404 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000405 real, effective, and saved user ids.
406
407 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000408
Georg Brandl1b83a452009-11-28 11:12:26 +0000409 .. versionadded:: 3.2
410
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000411
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000412.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000413
414 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000415 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000416
417 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000418
Georg Brandl1b83a452009-11-28 11:12:26 +0000419 .. versionadded:: 3.2
420
Georg Brandl116aa622007-08-15 14:28:22 +0000421
422.. function:: getuid()
423
424 .. index:: single: user; id
425
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700426 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000427
428 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000429
430
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200431.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000432
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200433 Call the system initgroups() to initialize the group access list with all of
434 the groups of which the specified username is a member, plus the specified
435 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000436
437 Availability: Unix.
438
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200439 .. versionadded:: 3.2
440
Georg Brandl116aa622007-08-15 14:28:22 +0000441
Georg Brandl18244152009-09-02 20:34:52 +0000442.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000443
444 .. index:: single: environment variables; setting
445
Georg Brandl18244152009-09-02 20:34:52 +0000446 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000447 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000448 :func:`popen` or :func:`fork` and :func:`execv`.
449
450 Availability: most flavors of Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000451
452 .. note::
453
Georg Brandlc575c902008-09-13 17:46:05 +0000454 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
455 cause memory leaks. Refer to the system documentation for putenv.
Georg Brandl116aa622007-08-15 14:28:22 +0000456
457 When :func:`putenv` is supported, assignments to items in ``os.environ`` are
458 automatically translated into corresponding calls to :func:`putenv`; however,
459 calls to :func:`putenv` don't update ``os.environ``, so it is actually
460 preferable to assign to items of ``os.environ``.
461
462
463.. function:: setegid(egid)
464
Benjamin Petersonf650e462010-05-06 23:03:05 +0000465 Set the current process's effective group id.
466
467 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000468
469
470.. function:: seteuid(euid)
471
Benjamin Petersonf650e462010-05-06 23:03:05 +0000472 Set the current process's effective user id.
473
474 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000475
476
477.. function:: setgid(gid)
478
Benjamin Petersonf650e462010-05-06 23:03:05 +0000479 Set the current process' group id.
480
481 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000482
483
484.. function:: setgroups(groups)
485
486 Set the list of supplemental group ids associated with the current process to
487 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000488 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000489
Georg Brandl116aa622007-08-15 14:28:22 +0000490 Availability: Unix.
491
Ned Deily2e209682012-04-30 11:14:02 -0700492 .. note:: On Mac OS X, the length of *groups* may not exceed the
493 system-defined maximum number of effective group ids, typically 16.
494 See the documentation for :func:`getgroups` for cases where it may not
495 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000496
497.. function:: setpgrp()
498
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300499 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000500 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000501
Georg Brandl116aa622007-08-15 14:28:22 +0000502 Availability: Unix.
503
504
505.. function:: setpgid(pid, pgrp)
506
Georg Brandl60203b42010-10-06 10:11:56 +0000507 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000508 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000509 for the semantics.
510
511 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000512
513
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000514.. function:: setpriority(which, who, priority)
515
516 .. index:: single: process; scheduling priority
517
518 Set program scheduling priority. The value *which* is one of
519 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
520 is interpreted relative to *which* (a process identifier for
521 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
522 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
523 (respectively) the calling process, the process group of the calling process,
524 or the real user ID of the calling process.
525 *priority* is a value in the range -20 to 19. The default priority is 0;
526 lower priorities cause more favorable scheduling.
527
528 Availability: Unix
529
530 .. versionadded:: 3.3
531
532
Georg Brandl116aa622007-08-15 14:28:22 +0000533.. function:: setregid(rgid, egid)
534
Benjamin Petersonf650e462010-05-06 23:03:05 +0000535 Set the current process's real and effective group ids.
536
537 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000538
Georg Brandl1b83a452009-11-28 11:12:26 +0000539
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000540.. function:: setresgid(rgid, egid, sgid)
541
542 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000543
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000544 Availability: Unix.
545
Georg Brandl1b83a452009-11-28 11:12:26 +0000546 .. versionadded:: 3.2
547
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000548
549.. function:: setresuid(ruid, euid, suid)
550
551 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000552
Georg Brandl6faee4e2010-09-21 14:48:28 +0000553 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000554
Georg Brandl1b83a452009-11-28 11:12:26 +0000555 .. versionadded:: 3.2
556
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000557
558.. function:: setreuid(ruid, euid)
559
Benjamin Petersonf650e462010-05-06 23:03:05 +0000560 Set the current process's real and effective user ids.
561
562 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000563
Georg Brandl116aa622007-08-15 14:28:22 +0000564
565.. function:: getsid(pid)
566
Georg Brandl60203b42010-10-06 10:11:56 +0000567 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000568
Georg Brandl116aa622007-08-15 14:28:22 +0000569 Availability: Unix.
570
Georg Brandl116aa622007-08-15 14:28:22 +0000571
572.. function:: setsid()
573
Georg Brandl60203b42010-10-06 10:11:56 +0000574 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000575
Georg Brandl116aa622007-08-15 14:28:22 +0000576 Availability: Unix.
577
578
579.. function:: setuid(uid)
580
581 .. index:: single: user; id, setting
582
Benjamin Petersonf650e462010-05-06 23:03:05 +0000583 Set the current process's user id.
584
585 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000586
Georg Brandl116aa622007-08-15 14:28:22 +0000587
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000588.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000589.. function:: strerror(code)
590
591 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000592 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000593 error number, :exc:`ValueError` is raised.
594
Georg Brandl116aa622007-08-15 14:28:22 +0000595
Victor Stinnerb745a742010-05-18 17:17:23 +0000596.. data:: supports_bytes_environ
597
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200598 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000599 Windows).
600
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000601 .. versionadded:: 3.2
602
Victor Stinnerb745a742010-05-18 17:17:23 +0000603
Georg Brandl116aa622007-08-15 14:28:22 +0000604.. function:: umask(mask)
605
Benjamin Petersonf650e462010-05-06 23:03:05 +0000606 Set the current numeric umask and return the previous umask.
607
Georg Brandl116aa622007-08-15 14:28:22 +0000608
609.. function:: uname()
610
611 .. index::
612 single: gethostname() (in module socket)
613 single: gethostbyaddr() (in module socket)
614
Larry Hastings605a62d2012-06-24 04:33:36 -0700615 Returns information identifying the current operating system.
616 The return value is an object with five attributes:
617
618 * :attr:`sysname` - operating system name
619 * :attr:`nodename` - name of machine on network (implementation-defined)
620 * :attr:`release` - operating system release
621 * :attr:`version` - operating system version
622 * :attr:`machine` - hardware identifier
623
624 For backwards compatibility, this object is also iterable, behaving
625 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
626 :attr:`release`, :attr:`version`, and :attr:`machine`
627 in that order.
628
629 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000630 leading component; a better way to get the hostname is
631 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000632 ``socket.gethostbyaddr(socket.gethostname())``.
633
634 Availability: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000635
Larry Hastings605a62d2012-06-24 04:33:36 -0700636 .. versionchanged:: 3.3
637 Return type changed from a tuple to a tuple-like object
638 with named attributes.
639
Georg Brandl116aa622007-08-15 14:28:22 +0000640
Georg Brandl18244152009-09-02 20:34:52 +0000641.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000642
643 .. index:: single: environment variables; deleting
644
Georg Brandl18244152009-09-02 20:34:52 +0000645 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000646 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000647 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000648
649 When :func:`unsetenv` is supported, deletion of items in ``os.environ`` is
650 automatically translated into a corresponding call to :func:`unsetenv`; however,
651 calls to :func:`unsetenv` don't update ``os.environ``, so it is actually
652 preferable to delete items of ``os.environ``.
653
Benjamin Petersonf650e462010-05-06 23:03:05 +0000654 Availability: most flavors of Unix, Windows.
655
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657.. _os-newstreams:
658
659File Object Creation
660--------------------
661
Georg Brandla570e982012-06-24 13:26:22 +0200662This function creates new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200663:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000664
665
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300666.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandlb2462e22012-06-24 13:24:56 +0200668 Return an open file object connected to the file descriptor *fd*. This is an
669 alias of the :func:`open` built-in function and accepts the same arguments.
670 The only difference is that the first argument of :func:`fdopen` must always
671 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673
Georg Brandl116aa622007-08-15 14:28:22 +0000674.. _os-fd-ops:
675
676File Descriptor Operations
677--------------------------
678
679These functions operate on I/O streams referenced using file descriptors.
680
681File descriptors are small integers corresponding to a file that has been opened
682by the current process. For example, standard input is usually file descriptor
6830, standard output is 1, and standard error is 2. Further files opened by a
684process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
685is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
686by file descriptors.
687
Serhiy Storchakadab83542013-10-13 20:12:43 +0300688The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000689associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000690descriptor directly will bypass the file object methods, ignoring aspects such
691as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000692
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000693
Georg Brandl116aa622007-08-15 14:28:22 +0000694.. function:: close(fd)
695
Benjamin Petersonf650e462010-05-06 23:03:05 +0000696 Close file descriptor *fd*.
697
Georg Brandl116aa622007-08-15 14:28:22 +0000698 .. note::
699
700 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000701 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000702 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300703 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
705
Christian Heimesfdab48e2008-01-20 09:06:41 +0000706.. function:: closerange(fd_low, fd_high)
707
708 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200709 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000710
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000711 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000712 try:
713 os.close(fd)
714 except OSError:
715 pass
716
Christian Heimesfdab48e2008-01-20 09:06:41 +0000717
Georg Brandl81f11302007-12-21 08:45:42 +0000718.. function:: device_encoding(fd)
719
720 Return a string describing the encoding of the device associated with *fd*
721 if it is connected to a terminal; else return :const:`None`.
722
723
Georg Brandl116aa622007-08-15 14:28:22 +0000724.. function:: dup(fd)
725
Victor Stinnerdaf45552013-08-28 00:53:59 +0200726 Return a duplicate of file descriptor *fd*. The new file descriptor is
727 :ref:`non-inheritable <fd_inheritance>`.
728
729 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
730 2: stderr), the new file descriptor is :ref:`inheritable
731 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000732
Victor Stinnerdaf45552013-08-28 00:53:59 +0200733 .. versionchanged:: 3.4
734 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000735
Victor Stinnerdaf45552013-08-28 00:53:59 +0200736
737.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000738
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800739 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
740 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
741 <fd_inheritance>` by default or non-inheritable if *inheritable*
742 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000743
Victor Stinnerdaf45552013-08-28 00:53:59 +0200744 .. versionchanged:: 3.4
745 Add the optional *inheritable* parameter.
746
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800747 .. versionchanged:: 3.7
748 Return *fd2* on success. Previously, ``None`` was always returned.
749
Georg Brandl116aa622007-08-15 14:28:22 +0000750
Christian Heimes4e30a842007-11-30 22:12:06 +0000751.. function:: fchmod(fd, mode)
752
Georg Brandlb9df00c2012-06-24 12:38:14 +0200753 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200754 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200755 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000756
757 Availability: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000758
759
760.. function:: fchown(fd, uid, gid)
761
762 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200763 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200764 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200765 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000766
Christian Heimes4e30a842007-11-30 22:12:06 +0000767 Availability: Unix.
768
769
Georg Brandl116aa622007-08-15 14:28:22 +0000770.. function:: fdatasync(fd)
771
772 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000773 metadata.
774
775 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000776
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000777 .. note::
778 This function is not available on MacOS.
779
Georg Brandl116aa622007-08-15 14:28:22 +0000780
781.. function:: fpathconf(fd, name)
782
783 Return system configuration information relevant to an open file. *name*
784 specifies the configuration value to retrieve; it may be a string which is the
785 name of a defined system value; these names are specified in a number of
786 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
787 additional names as well. The names known to the host operating system are
788 given in the ``pathconf_names`` dictionary. For configuration variables not
789 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000790
791 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
792 specific value for *name* is not supported by the host system, even if it is
793 included in ``pathconf_names``, an :exc:`OSError` is raised with
794 :const:`errno.EINVAL` for the error number.
795
Georg Brandl4d399a42012-06-25 07:40:32 +0200796 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200797
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700798 Availability: Unix.
799
Georg Brandl116aa622007-08-15 14:28:22 +0000800
Victor Stinner4195b5c2012-02-08 23:03:19 +0100801.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000802
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200803 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
804 object.
805
806 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
807
808 .. seealso::
809
Berker Peksag2034caa2015-04-27 13:53:28 +0300810 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000811
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200812
Georg Brandl116aa622007-08-15 14:28:22 +0000813.. function:: fstatvfs(fd)
814
Georg Brandlb9df00c2012-06-24 12:38:14 +0200815 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200816 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200817 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000818
819 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000820
821
822.. function:: fsync(fd)
823
824 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000825 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000826
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000827 If you're starting with a buffered Python :term:`file object` *f*, first do
828 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
829 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000830
Georg Brandl8a5555f2012-06-24 13:29:09 +0200831 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000832
833
834.. function:: ftruncate(fd, length)
835
Georg Brandl306336b2012-06-24 12:55:33 +0200836 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200837 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200838 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000839
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700840 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000841
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700842 .. versionchanged:: 3.5
843 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000844
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200845.. function:: get_blocking(fd)
846
847 Get the blocking mode of the file descriptor: ``False`` if the
848 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
849
850 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
851
852 Availability: Unix.
853
854 .. versionadded:: 3.5
855
Georg Brandl116aa622007-08-15 14:28:22 +0000856.. function:: isatty(fd)
857
858 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000859 tty(-like) device, else ``False``.
860
Georg Brandl116aa622007-08-15 14:28:22 +0000861
Ross Lagerwall7807c352011-03-17 20:20:30 +0200862.. function:: lockf(fd, cmd, len)
863
864 Apply, test or remove a POSIX lock on an open file descriptor.
865 *fd* is an open file descriptor.
866 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
867 :data:`F_ULOCK` or :data:`F_TEST`.
868 *len* specifies the section of the file to lock.
869
870 Availability: Unix.
871
872 .. versionadded:: 3.3
873
874
875.. data:: F_LOCK
876 F_TLOCK
877 F_ULOCK
878 F_TEST
879
880 Flags that specify what action :func:`lockf` will take.
881
882 Availability: Unix.
883
884 .. versionadded:: 3.3
885
Georg Brandlf62445a2012-06-24 13:31:20 +0200886
Georg Brandl116aa622007-08-15 14:28:22 +0000887.. function:: lseek(fd, pos, how)
888
Christian Heimesfaf2f632008-01-06 16:59:19 +0000889 Set the current position of file descriptor *fd* to position *pos*, modified
890 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
891 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300892 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100893 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000894
Georg Brandl116aa622007-08-15 14:28:22 +0000895
Georg Brandl8569e582010-05-19 20:57:08 +0000896.. data:: SEEK_SET
897 SEEK_CUR
898 SEEK_END
899
900 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200901 respectively.
902
Jesus Cea94363612012-06-22 18:32:07 +0200903 .. versionadded:: 3.3
904 Some operating systems could support additional values, like
905 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
906
Georg Brandl8569e582010-05-19 20:57:08 +0000907
Martin Panterbf19d162015-09-09 01:01:13 +0000908.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000909
Martin Panterbf19d162015-09-09 01:01:13 +0000910 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700911 its mode according to *mode*. When computing *mode*, the current umask value
912 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200913 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000914
915 For a description of the flag and mode values, see the C run-time documentation;
916 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400917 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000918 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000919
Georg Brandl50c40002012-06-24 11:45:20 +0200920 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400921 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700922
Victor Stinnerdaf45552013-08-28 00:53:59 +0200923 .. versionchanged:: 3.4
924 The new file descriptor is now non-inheritable.
925
Georg Brandl116aa622007-08-15 14:28:22 +0000926 .. note::
927
Georg Brandl502d9a52009-07-26 15:02:41 +0000928 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000929 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000930 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000931 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000932
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000933 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700934 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000935
Victor Stinnera766ddf2015-03-26 23:50:57 +0100936 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200937 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100938 exception, the function now retries the system call instead of raising an
939 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
940
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700941 .. versionchanged:: 3.6
942 Accepts a :term:`path-like object`.
943
Andrew Kuchling4921a082013-06-21 11:49:57 -0400944The following constants are options for the *flags* parameter to the
945:func:`~os.open` function. They can be combined using the bitwise OR operator
946``|``. Some of them are not available on all platforms. For descriptions of
947their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100948or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400949
950
951.. data:: O_RDONLY
952 O_WRONLY
953 O_RDWR
954 O_APPEND
955 O_CREAT
956 O_EXCL
957 O_TRUNC
958
Vinay Sajipe4946e72016-09-11 15:15:59 +0100959 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400960
961
962.. data:: O_DSYNC
963 O_RSYNC
964 O_SYNC
965 O_NDELAY
966 O_NONBLOCK
967 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -0400968 O_CLOEXEC
969
Vinay Sajipe4946e72016-09-11 15:15:59 +0100970 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400971
972 .. versionchanged:: 3.3
973 Add :data:`O_CLOEXEC` constant.
974
975.. data:: O_BINARY
976 O_NOINHERIT
977 O_SHORT_LIVED
978 O_TEMPORARY
979 O_RANDOM
980 O_SEQUENTIAL
981 O_TEXT
982
Vinay Sajipe4946e72016-09-11 15:15:59 +0100983 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400984
985
986.. data:: O_ASYNC
987 O_DIRECT
988 O_DIRECTORY
989 O_NOFOLLOW
990 O_NOATIME
991 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +0200992 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +0100993 O_SHLOCK
994 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -0400995
Vinay Sajipe4946e72016-09-11 15:15:59 +0100996 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -0400997 the C library.
998
Christian Heimesd88f7352013-08-16 14:37:50 +0200999 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001000 Add :data:`O_PATH` on systems that support it.
1001 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1002 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001003
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001004
Georg Brandl116aa622007-08-15 14:28:22 +00001005.. function:: openpty()
1006
1007 .. index:: module: pty
1008
Victor Stinnerdaf45552013-08-28 00:53:59 +02001009 Open a new pseudo-terminal pair. Return a pair of file descriptors
1010 ``(master, slave)`` for the pty and the tty, respectively. The new file
1011 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1012 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001013
1014 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001015
Victor Stinnerdaf45552013-08-28 00:53:59 +02001016 .. versionchanged:: 3.4
1017 The new file descriptors are now non-inheritable.
1018
Georg Brandl116aa622007-08-15 14:28:22 +00001019
1020.. function:: pipe()
1021
Victor Stinnerdaf45552013-08-28 00:53:59 +02001022 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001023 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001024 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001025
1026 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001027
Victor Stinnerdaf45552013-08-28 00:53:59 +02001028 .. versionchanged:: 3.4
1029 The new file descriptors are now non-inheritable.
1030
Georg Brandl116aa622007-08-15 14:28:22 +00001031
Charles-François Natali368f34b2011-06-06 19:49:47 +02001032.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001033
1034 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001035 *flags* can be constructed by ORing together one or more of these values:
1036 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001037 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1038 respectively.
1039
1040 Availability: some flavors of Unix.
1041
1042 .. versionadded:: 3.3
1043
1044
Ross Lagerwall7807c352011-03-17 20:20:30 +02001045.. function:: posix_fallocate(fd, offset, len)
1046
1047 Ensures that enough disk space is allocated for the file specified by *fd*
1048 starting from *offset* and continuing for *len* bytes.
1049
1050 Availability: Unix.
1051
1052 .. versionadded:: 3.3
1053
1054
1055.. function:: posix_fadvise(fd, offset, len, advice)
1056
1057 Announces an intention to access data in a specific pattern thus allowing
1058 the kernel to make optimizations.
1059 The advice applies to the region of the file specified by *fd* starting at
1060 *offset* and continuing for *len* bytes.
1061 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1062 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1063 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1064
1065 Availability: Unix.
1066
1067 .. versionadded:: 3.3
1068
1069
1070.. data:: POSIX_FADV_NORMAL
1071 POSIX_FADV_SEQUENTIAL
1072 POSIX_FADV_RANDOM
1073 POSIX_FADV_NOREUSE
1074 POSIX_FADV_WILLNEED
1075 POSIX_FADV_DONTNEED
1076
1077 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1078 the access pattern that is likely to be used.
1079
1080 Availability: Unix.
1081
1082 .. versionadded:: 3.3
1083
1084
1085.. function:: pread(fd, buffersize, offset)
1086
1087 Read from a file descriptor, *fd*, at a position of *offset*. It will read up
1088 to *buffersize* number of bytes. The file offset remains unchanged.
1089
1090 Availability: Unix.
1091
1092 .. versionadded:: 3.3
1093
1094
Jesus Cea67503c52014-10-20 16:18:24 +02001095.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001096
Jesus Cea67503c52014-10-20 16:18:24 +02001097 Write *bytestring* to a file descriptor, *fd*, from *offset*,
1098 leaving the file offset unchanged.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001099
1100 Availability: Unix.
1101
1102 .. versionadded:: 3.3
1103
1104
Pablo Galindo4defba32018-01-27 16:16:37 +00001105.. function:: pwritev(fd, buffers, offset, flags=0)
1106
1107 Combines the functionality of :func:`os.writev` and :func:`os.pwrite`. It
1108 writes the contents of *buffers* to file descriptor *fd* at offset *offset*.
1109 *buffers* must be a sequence of :term:`bytes-like objects <bytes-like object>`.
1110 Buffers are processed in array order. Entire contents of first buffer is written
1111 before proceeding to second, and so on. The operating system may set a limit
1112 (sysconf() value SC_IOV_MAX) on the number of buffers that can be used.
1113 :func:`~os.pwritev` writes the contents of each object to the file descriptor
1114 and returns the total number of bytes written.
1115
1116 The *flags* argument contains a bitwise OR of zero or more of the following
1117 flags:
1118
1119 - RWF_DSYNC
1120 - RWF_SYNC
1121
1122 Using non-zero flags requires Linux 4.7 or newer.
1123
1124 Availability: Linux (version 2.6.30), FreeBSD 6.0 and newer,
1125 OpenBSD (version 2.7 and newer).
1126
1127 .. versionadded:: 3.7
1128
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001129.. data:: RWF_DSYNC
1130
Pablo Galindo4defba32018-01-27 16:16:37 +00001131 Provide a per-write equivalent of the O_DSYNC open(2) flag. This flag
1132 is meaningful only for pwritev2(), and its effect applies only to the
1133 data range written by the system call.
1134
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001135 Availability: Linux (version 4.7).
1136
Pablo Galindo4defba32018-01-27 16:16:37 +00001137 .. versionadded:: 3.7
1138
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001139.. data:: RWF_SYNC
1140
Pablo Galindo4defba32018-01-27 16:16:37 +00001141 Provide a per-write equivalent of the O_SYNC open(2) flag. This flag is
1142 meaningful only for pwritev2(), and its effect applies only to the data
1143 range written by the system call.
1144
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001145 Availability: Linux (version 4.7).
1146
Pablo Galindo4defba32018-01-27 16:16:37 +00001147 .. versionadded:: 3.7
1148
1149
Georg Brandl116aa622007-08-15 14:28:22 +00001150.. function:: read(fd, n)
1151
Georg Brandlb90be692009-07-29 16:14:16 +00001152 Read at most *n* bytes from file descriptor *fd*. Return a bytestring containing the
Georg Brandl116aa622007-08-15 14:28:22 +00001153 bytes read. If the end of the file referred to by *fd* has been reached, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001154 empty bytes object is returned.
1155
Georg Brandl116aa622007-08-15 14:28:22 +00001156 .. note::
1157
1158 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001159 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1160 "file object" returned by the built-in function :func:`open` or by
1161 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1162 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001163
Victor Stinnera766ddf2015-03-26 23:50:57 +01001164 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001165 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001166 exception, the function now retries the system call instead of raising an
1167 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1168
Georg Brandl116aa622007-08-15 14:28:22 +00001169
Martin Panterbf19d162015-09-09 01:01:13 +00001170.. function:: sendfile(out, in, offset, count)
Martin Panter94994132015-09-09 05:29:24 +00001171 sendfile(out, in, offset, count, [headers], [trailers], flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001172
Martin Panterbf19d162015-09-09 01:01:13 +00001173 Copy *count* bytes from file descriptor *in* to file descriptor *out*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001174 starting at *offset*.
1175 Return the number of bytes sent. When EOF is reached return 0.
1176
1177 The first function notation is supported by all platforms that define
1178 :func:`sendfile`.
1179
1180 On Linux, if *offset* is given as ``None``, the bytes are read from the
1181 current position of *in* and the position of *in* is updated.
1182
1183 The second case may be used on Mac OS X and FreeBSD where *headers* and
1184 *trailers* are arbitrary sequences of buffers that are written before and
1185 after the data from *in* is written. It returns the same as the first case.
1186
Martin Panterbf19d162015-09-09 01:01:13 +00001187 On Mac OS X and FreeBSD, a value of 0 for *count* specifies to send until
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001188 the end of *in* is reached.
1189
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001190 All platforms support sockets as *out* file descriptor, and some platforms
1191 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001192
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001193 Cross-platform applications should not use *headers*, *trailers* and *flags*
1194 arguments.
1195
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001196 Availability: Unix.
1197
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001198 .. note::
1199
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001200 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001201 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001202
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001203 .. versionadded:: 3.3
1204
1205
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001206.. function:: set_blocking(fd, blocking)
1207
1208 Set the blocking mode of the specified file descriptor. Set the
1209 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1210
1211 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1212
1213 Availability: Unix.
1214
1215 .. versionadded:: 3.5
1216
1217
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001218.. data:: SF_NODISKIO
1219 SF_MNOWAIT
1220 SF_SYNC
1221
1222 Parameters to the :func:`sendfile` function, if the implementation supports
1223 them.
1224
1225 Availability: Unix.
1226
1227 .. versionadded:: 3.3
1228
1229
Ross Lagerwall7807c352011-03-17 20:20:30 +02001230.. function:: readv(fd, buffers)
1231
Benjamin Petersone83ed432014-01-18 22:54:59 -05001232 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
1233 objects <bytes-like object>` *buffers*. :func:`~os.readv` will transfer data
1234 into each buffer until it is full and then move on to the next buffer in the
1235 sequence to hold the rest of the data. :func:`~os.readv` returns the total
1236 number of bytes read (which may be less than the total capacity of all the
1237 objects).
Ross Lagerwall7807c352011-03-17 20:20:30 +02001238
1239 Availability: Unix.
1240
1241 .. versionadded:: 3.3
1242
1243
Pablo Galindo4defba32018-01-27 16:16:37 +00001244.. function:: preadv(fd, buffers, offset, flags=0)
1245
1246 Combines the functionality of :func:`os.readv` and :func:`os.pread`. It
1247 reads from a file descriptor *fd* into a number of mutable :term:`bytes-like
1248 objects <bytes-like object>` *buffers*. As :func:`os.readv`, it will transfer
1249 data into each buffer until it is full and then move on to the next buffer in
1250 the sequence to hold the rest of the data. Its fourth argument, *offset*,
1251 specifies the file offset at which the input operation is to be performed.
1252 :func:`~os.preadv` return the total number of bytes read (which can be less than
1253 the total capacity of all the objects).
1254
1255 The flags argument contains a bitwise OR of zero or more of the following
1256 flags:
1257
1258 - RWF_HIPRI
1259 - RWF_NOWAIT
1260
1261 Using non-zero flags requires Linux 4.6 or newer.
1262
1263 Availability: Linux (version 2.6.30), FreeBSD 6.0 and newer,
1264 OpenBSD (version 2.7 and newer).
1265
1266 .. versionadded:: 3.7
1267
1268
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001269.. data:: RWF_HIPRI
1270
Pablo Galindo4defba32018-01-27 16:16:37 +00001271 High priority read/write. Allows block-based filesystems to use polling
1272 of the device, which provides lower latency, but may use additional
1273 resources. (Currently, this feature is usable only on a file descriptor
1274 opened using the O_DIRECT flag.)
1275
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001276 Availability: Linux (version 4.6).
1277
Pablo Galindo4defba32018-01-27 16:16:37 +00001278 .. versionadded:: 3.7
1279
1280
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001281.. data:: RWF_NOWAIT
1282
Pablo Galindo4defba32018-01-27 16:16:37 +00001283 Do not wait for data which is not immediately available. If this flag
1284 is specified, the preadv2() system call will return instantly
1285 if it would have to read data from the backing storage or wait for a lock.
1286 If some data was successfully read, it will return the number of bytes
1287 read. If no bytes were read, it will return -1 and set errno to EAGAIN.
1288 Currently, this flag is meaningful only for preadv2().
1289
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001290 Availability: Linux (version 4.14).
1291
Pablo Galindo4defba32018-01-27 16:16:37 +00001292 .. versionadded:: 3.7
1293
1294
Georg Brandl116aa622007-08-15 14:28:22 +00001295.. function:: tcgetpgrp(fd)
1296
1297 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001298 file descriptor as returned by :func:`os.open`).
1299
1300 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001301
1302
1303.. function:: tcsetpgrp(fd, pg)
1304
1305 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001306 descriptor as returned by :func:`os.open`) to *pg*.
1307
1308 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001309
1310
1311.. function:: ttyname(fd)
1312
1313 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001314 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001315 exception is raised.
1316
1317 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001318
1319
1320.. function:: write(fd, str)
1321
Georg Brandlb90be692009-07-29 16:14:16 +00001322 Write the bytestring in *str* to file descriptor *fd*. Return the number of
Benjamin Petersonf650e462010-05-06 23:03:05 +00001323 bytes actually written.
1324
Georg Brandl116aa622007-08-15 14:28:22 +00001325 .. note::
1326
1327 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001328 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001329 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001330 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1331 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001332
Victor Stinnera766ddf2015-03-26 23:50:57 +01001333 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001334 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001335 exception, the function now retries the system call instead of raising an
1336 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1337
Georg Brandl8569e582010-05-19 20:57:08 +00001338
Ross Lagerwall7807c352011-03-17 20:20:30 +02001339.. function:: writev(fd, buffers)
1340
Benjamin Petersone83ed432014-01-18 22:54:59 -05001341 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be a
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001342 sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1343 processed in array order. Entire contents of first buffer is written before
1344 proceeding to second, and so on. The operating system may set a limit
1345 (sysconf() value SC_IOV_MAX) on the number of buffers that can be used.
1346
Benjamin Petersone83ed432014-01-18 22:54:59 -05001347 :func:`~os.writev` writes the contents of each object to the file descriptor
1348 and returns the total number of bytes written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001349
1350 Availability: Unix.
1351
1352 .. versionadded:: 3.3
1353
1354
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001355.. _terminal-size:
1356
1357Querying the size of a terminal
1358~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1359
1360.. versionadded:: 3.3
1361
1362.. function:: get_terminal_size(fd=STDOUT_FILENO)
1363
1364 Return the size of the terminal window as ``(columns, lines)``,
1365 tuple of type :class:`terminal_size`.
1366
1367 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1368 output) specifies which file descriptor should be queried.
1369
1370 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001371 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001372
1373 :func:`shutil.get_terminal_size` is the high-level function which
1374 should normally be used, ``os.get_terminal_size`` is the low-level
1375 implementation.
1376
1377 Availability: Unix, Windows.
1378
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001379.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001380
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001381 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001382
1383 .. attribute:: columns
1384
1385 Width of the terminal window in characters.
1386
1387 .. attribute:: lines
1388
1389 Height of the terminal window in characters.
1390
1391
Victor Stinnerdaf45552013-08-28 00:53:59 +02001392.. _fd_inheritance:
1393
1394Inheritance of File Descriptors
1395~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1396
Georg Brandl5642ff92013-09-15 10:37:57 +02001397.. versionadded:: 3.4
1398
1399A file descriptor has an "inheritable" flag which indicates if the file descriptor
1400can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001401created by Python are non-inheritable by default.
1402
1403On UNIX, non-inheritable file descriptors are closed in child processes at the
1404execution of a new program, other file descriptors are inherited.
1405
1406On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001407processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001408and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001409all inheritable handles and all inheritable file descriptors are inherited.
1410Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001411streams are closed, and inheritable handles are only inherited if the
1412*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001413
1414.. function:: get_inheritable(fd)
1415
Georg Brandl5642ff92013-09-15 10:37:57 +02001416 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001417
1418.. function:: set_inheritable(fd, inheritable)
1419
Georg Brandl5642ff92013-09-15 10:37:57 +02001420 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001421
1422.. function:: get_handle_inheritable(handle)
1423
Georg Brandl5642ff92013-09-15 10:37:57 +02001424 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001425
1426 Availability: Windows.
1427
1428.. function:: set_handle_inheritable(handle, inheritable)
1429
Georg Brandl5642ff92013-09-15 10:37:57 +02001430 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001431
1432 Availability: Windows.
1433
1434
Georg Brandl116aa622007-08-15 14:28:22 +00001435.. _os-file-dir:
1436
1437Files and Directories
1438---------------------
1439
Georg Brandl50c40002012-06-24 11:45:20 +02001440On some Unix platforms, many of these functions support one or more of these
1441features:
1442
1443.. _path_fd:
1444
Larry Hastings77892dc2012-06-25 03:27:33 -07001445* **specifying a file descriptor:**
1446 For some functions, the *path* argument can be not only a string giving a path
Georg Brandl50c40002012-06-24 11:45:20 +02001447 name, but also a file descriptor. The function will then operate on the file
Georg Brandlaceaf902012-06-25 08:33:56 +02001448 referred to by the descriptor. (For POSIX systems, Python will call the
1449 ``f...`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001450
1451 You can check whether or not *path* can be specified as a file descriptor on
1452 your platform using :data:`os.supports_fd`. If it is unavailable, using it
1453 will raise a :exc:`NotImplementedError`.
1454
1455 If the function also supports *dir_fd* or *follow_symlinks* arguments, it is
1456 an error to specify one of those when supplying *path* as a file descriptor.
1457
1458.. _dir_fd:
1459
Larry Hastings77892dc2012-06-25 03:27:33 -07001460* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001461 should be a file descriptor referring to a directory, and the path to operate
1462 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001463 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Larry Hastings77892dc2012-06-25 03:27:33 -07001464 the ``...at`` or ``f...at`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001465
1466 You can check whether or not *dir_fd* is supported on your platform using
1467 :data:`os.supports_dir_fd`. If it is unavailable, using it will raise a
1468 :exc:`NotImplementedError`.
1469
1470.. _follow_symlinks:
1471
Larry Hastings77892dc2012-06-25 03:27:33 -07001472* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001473 ``False``, and the last element of the path to operate on is a symbolic link,
1474 the function will operate on the symbolic link itself instead of the file the
Georg Brandlaceaf902012-06-25 08:33:56 +02001475 link points to. (For POSIX systems, Python will call the ``l...`` version of
Georg Brandl50c40002012-06-24 11:45:20 +02001476 the function.)
1477
1478 You can check whether or not *follow_symlinks* is supported on your platform
1479 using :data:`os.supports_follow_symlinks`. If it is unavailable, using it
1480 will raise a :exc:`NotImplementedError`.
1481
1482
1483
Larry Hastings9cf065c2012-06-22 16:30:09 -07001484.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001485
1486 Use the real uid/gid to test for access to *path*. Note that most operations
1487 will use the effective uid/gid, therefore this routine can be used in a
1488 suid/sgid environment to test if the invoking user has the specified access to
1489 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1490 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1491 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1492 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001493 information.
1494
Georg Brandl50c40002012-06-24 11:45:20 +02001495 This function can support specifying :ref:`paths relative to directory
1496 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001497
1498 If *effective_ids* is ``True``, :func:`access` will perform its access
1499 checks using the effective uid/gid instead of the real uid/gid.
1500 *effective_ids* may not be supported on your platform; you can check whether
1501 or not it is available using :data:`os.supports_effective_ids`. If it is
1502 unavailable, using it will raise a :exc:`NotImplementedError`.
1503
Georg Brandl116aa622007-08-15 14:28:22 +00001504 .. note::
1505
Georg Brandl502d9a52009-07-26 15:02:41 +00001506 Using :func:`access` to check if a user is authorized to e.g. open a file
1507 before actually doing so using :func:`open` creates a security hole,
1508 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001509 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1510 techniques. For example::
1511
1512 if os.access("myfile", os.R_OK):
1513 with open("myfile") as fp:
1514 return fp.read()
1515 return "some default data"
1516
1517 is better written as::
1518
1519 try:
1520 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001521 except PermissionError:
1522 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001523 else:
1524 with fp:
1525 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001526
1527 .. note::
1528
1529 I/O operations may fail even when :func:`access` indicates that they would
1530 succeed, particularly for operations on network filesystems which may have
1531 permissions semantics beyond the usual POSIX permission-bit model.
1532
Larry Hastings9cf065c2012-06-22 16:30:09 -07001533 .. versionchanged:: 3.3
1534 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1535
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001536 .. versionchanged:: 3.6
1537 Accepts a :term:`path-like object`.
1538
Georg Brandl116aa622007-08-15 14:28:22 +00001539
1540.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001541 R_OK
1542 W_OK
1543 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001544
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001545 Values to pass as the *mode* parameter of :func:`access` to test the
1546 existence, readability, writability and executability of *path*,
1547 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001548
1549
1550.. function:: chdir(path)
1551
1552 .. index:: single: directory; changing
1553
Benjamin Petersonf650e462010-05-06 23:03:05 +00001554 Change the current working directory to *path*.
1555
Larry Hastings77892dc2012-06-25 03:27:33 -07001556 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001557 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001558
Larry Hastings9cf065c2012-06-22 16:30:09 -07001559 .. versionadded:: 3.3
1560 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001561 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001562
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001563 .. versionchanged:: 3.6
1564 Accepts a :term:`path-like object`.
1565
Georg Brandl116aa622007-08-15 14:28:22 +00001566
Larry Hastings9cf065c2012-06-22 16:30:09 -07001567.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001568
1569 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1570 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1571
R David Murray30178062011-03-10 17:18:33 -05001572 * :data:`stat.UF_NODUMP`
1573 * :data:`stat.UF_IMMUTABLE`
1574 * :data:`stat.UF_APPEND`
1575 * :data:`stat.UF_OPAQUE`
1576 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001577 * :data:`stat.UF_COMPRESSED`
1578 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001579 * :data:`stat.SF_ARCHIVED`
1580 * :data:`stat.SF_IMMUTABLE`
1581 * :data:`stat.SF_APPEND`
1582 * :data:`stat.SF_NOUNLINK`
1583 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001584
Georg Brandl50c40002012-06-24 11:45:20 +02001585 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001586
Georg Brandlc575c902008-09-13 17:46:05 +00001587 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001588
Larry Hastings9cf065c2012-06-22 16:30:09 -07001589 .. versionadded:: 3.3
1590 The *follow_symlinks* argument.
1591
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001592 .. versionchanged:: 3.6
1593 Accepts a :term:`path-like object`.
1594
Georg Brandl116aa622007-08-15 14:28:22 +00001595
Larry Hastings9cf065c2012-06-22 16:30:09 -07001596.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001597
1598 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001599 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001600 combinations of them:
1601
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001602 * :data:`stat.S_ISUID`
1603 * :data:`stat.S_ISGID`
1604 * :data:`stat.S_ENFMT`
1605 * :data:`stat.S_ISVTX`
1606 * :data:`stat.S_IREAD`
1607 * :data:`stat.S_IWRITE`
1608 * :data:`stat.S_IEXEC`
1609 * :data:`stat.S_IRWXU`
1610 * :data:`stat.S_IRUSR`
1611 * :data:`stat.S_IWUSR`
1612 * :data:`stat.S_IXUSR`
1613 * :data:`stat.S_IRWXG`
1614 * :data:`stat.S_IRGRP`
1615 * :data:`stat.S_IWGRP`
1616 * :data:`stat.S_IXGRP`
1617 * :data:`stat.S_IRWXO`
1618 * :data:`stat.S_IROTH`
1619 * :data:`stat.S_IWOTH`
1620 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001621
Georg Brandl50c40002012-06-24 11:45:20 +02001622 This function can support :ref:`specifying a file descriptor <path_fd>`,
1623 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1624 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001625
Georg Brandl116aa622007-08-15 14:28:22 +00001626 .. note::
1627
Georg Brandl50c40002012-06-24 11:45:20 +02001628 Although Windows supports :func:`chmod`, you can only set the file's
1629 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1630 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001631
Larry Hastings9cf065c2012-06-22 16:30:09 -07001632 .. versionadded:: 3.3
1633 Added support for specifying *path* as an open file descriptor,
1634 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001635
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001636 .. versionchanged:: 3.6
1637 Accepts a :term:`path-like object`.
1638
Larry Hastings9cf065c2012-06-22 16:30:09 -07001639
1640.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001641
Georg Brandl50c40002012-06-24 11:45:20 +02001642 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1643 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001644
Georg Brandl50c40002012-06-24 11:45:20 +02001645 This function can support :ref:`specifying a file descriptor <path_fd>`,
1646 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1647 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001648
Sandro Tosid902a142011-08-22 23:28:27 +02001649 See :func:`shutil.chown` for a higher-level function that accepts names in
1650 addition to numeric ids.
1651
Benjamin Petersonf650e462010-05-06 23:03:05 +00001652 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001653
Larry Hastings9cf065c2012-06-22 16:30:09 -07001654 .. versionadded:: 3.3
1655 Added support for specifying an open file descriptor for *path*,
1656 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001657
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001658 .. versionchanged:: 3.6
1659 Supports a :term:`path-like object`.
1660
Benjamin Peterson799bd802011-08-31 22:15:17 -04001661
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001662.. function:: chroot(path)
1663
Georg Brandl8a5555f2012-06-24 13:29:09 +02001664 Change the root directory of the current process to *path*.
1665
1666 Availability: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001667
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001668 .. versionchanged:: 3.6
1669 Accepts a :term:`path-like object`.
1670
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001671
1672.. function:: fchdir(fd)
1673
1674 Change the current working directory to the directory represented by the file
1675 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001676 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001677
1678 Availability: Unix.
1679
1680
1681.. function:: getcwd()
1682
1683 Return a string representing the current working directory.
1684
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001685
1686.. function:: getcwdb()
1687
1688 Return a bytestring representing the current working directory.
1689
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001690
Georg Brandl116aa622007-08-15 14:28:22 +00001691.. function:: lchflags(path, flags)
1692
Georg Brandl50c40002012-06-24 11:45:20 +02001693 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001694 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001695 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001696
1697 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001698
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001699 .. versionchanged:: 3.6
1700 Accepts a :term:`path-like object`.
1701
Georg Brandl116aa622007-08-15 14:28:22 +00001702
Christian Heimes93852662007-12-01 12:22:32 +00001703.. function:: lchmod(path, mode)
1704
1705 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001706 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001707 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001708 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001709
1710 Availability: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001711
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001712 .. versionchanged:: 3.6
1713 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001714
Georg Brandl116aa622007-08-15 14:28:22 +00001715.. function:: lchown(path, uid, gid)
1716
Georg Brandl50c40002012-06-24 11:45:20 +02001717 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001718 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001719 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001720
1721 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001722
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001723 .. versionchanged:: 3.6
1724 Accepts a :term:`path-like object`.
1725
Georg Brandl116aa622007-08-15 14:28:22 +00001726
Larry Hastings9cf065c2012-06-22 16:30:09 -07001727.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001728
Larry Hastings9cf065c2012-06-22 16:30:09 -07001729 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001730
Georg Brandlaceaf902012-06-25 08:33:56 +02001731 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1732 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1733 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001734
Brian Curtin1b9df392010-11-24 20:24:31 +00001735 Availability: Unix, Windows.
1736
1737 .. versionchanged:: 3.2
1738 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001739
Larry Hastings9cf065c2012-06-22 16:30:09 -07001740 .. versionadded:: 3.3
1741 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1742
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001743 .. versionchanged:: 3.6
1744 Accepts a :term:`path-like object` for *src* and *dst*.
1745
Georg Brandl116aa622007-08-15 14:28:22 +00001746
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001747.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001748
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001749 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001750 *path*. The list is in arbitrary order, and does not include the special
1751 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001752
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001753 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1754 (directly or indirectly through the :class:`PathLike` interface),
1755 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001756 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001757
Larry Hastings77892dc2012-06-25 03:27:33 -07001758 This function can also support :ref:`specifying a file descriptor
1759 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001760
Larry Hastingsfdaea062012-06-25 04:42:23 -07001761 .. note::
1762 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1763
Victor Stinner6036e442015-03-08 01:58:04 +01001764 .. seealso::
1765
Victor Stinner51b58322015-05-15 09:12:58 +02001766 The :func:`scandir` function returns directory entries along with
1767 file attribute information, giving better performance for many
1768 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001769
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001770 .. versionchanged:: 3.2
1771 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001772
Larry Hastings9cf065c2012-06-22 16:30:09 -07001773 .. versionadded:: 3.3
1774 Added support for specifying an open file descriptor for *path*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001775
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001776 .. versionchanged:: 3.6
1777 Accepts a :term:`path-like object`.
1778
Georg Brandl50c40002012-06-24 11:45:20 +02001779
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001780.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001781
R. David Murray7b1aae92011-01-24 19:34:58 +00001782 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001783 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1784 :class:`stat_result` object.
1785
1786 On platforms that do not support symbolic links, this is an alias for
1787 :func:`~os.stat`.
1788
1789 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1790 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001791
Georg Brandl50c40002012-06-24 11:45:20 +02001792 This function can also support :ref:`paths relative to directory descriptors
1793 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001794
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001795 .. seealso::
1796
Berker Peksag2034caa2015-04-27 13:53:28 +03001797 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001798
Georg Brandlb3823372010-07-10 08:58:37 +00001799 .. versionchanged:: 3.2
1800 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001801
Larry Hastings9cf065c2012-06-22 16:30:09 -07001802 .. versionchanged:: 3.3
1803 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001804
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001805 .. versionchanged:: 3.6
1806 Accepts a :term:`path-like object` for *src* and *dst*.
1807
Ross Lagerwall7807c352011-03-17 20:20:30 +02001808
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001809.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1810
1811 Create a directory named *path* with numeric mode *mode*.
1812
Tommy Beadle63b91e52016-06-02 15:41:20 -04001813 If the directory already exists, :exc:`FileExistsError` is raised.
1814
1815 .. _mkdir_modebits:
1816
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001817 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001818 value is first masked out. If bits other than the last 9 (i.e. the last 3
1819 digits of the octal representation of the *mode*) are set, their meaning is
1820 platform-dependent. On some platforms, they are ignored and you should call
1821 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001822
1823 This function can also support :ref:`paths relative to directory descriptors
1824 <dir_fd>`.
1825
1826 It is also possible to create temporary directories; see the
1827 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1828
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001829 .. versionadded:: 3.3
1830 The *dir_fd* argument.
1831
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001832 .. versionchanged:: 3.6
1833 Accepts a :term:`path-like object`.
1834
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001835
Zachary Warea22ae212014-03-20 09:42:01 -05001836.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001837
1838 .. index::
1839 single: directory; creating
1840 single: UNC paths; and os.makedirs()
1841
1842 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001843 intermediate-level directories needed to contain the leaf directory.
1844
Serhiy Storchakae304e332017-03-24 13:27:42 +02001845 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1846 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1847 is interpreted. To set the file permission bits of any newly-created parent
1848 directories you can set the umask before invoking :func:`makedirs`. The
1849 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001850
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001851 If *exist_ok* is ``False`` (the default), an :exc:`OSError` is raised if the
1852 target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001853
1854 .. note::
1855
1856 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001857 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001858
1859 This function handles UNC paths correctly.
1860
1861 .. versionadded:: 3.2
1862 The *exist_ok* parameter.
1863
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001864 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001865
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001866 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001867 :func:`makedirs` would still raise an error if *mode* did not match the
1868 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001869 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001870
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001871 .. versionchanged:: 3.6
1872 Accepts a :term:`path-like object`.
1873
Serhiy Storchakae304e332017-03-24 13:27:42 +02001874 .. versionchanged:: 3.7
1875 The *mode* argument no longer affects the file permission bits of
1876 newly-created intermediate-level directories.
1877
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001878
Larry Hastings9cf065c2012-06-22 16:30:09 -07001879.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001880
Larry Hastings9cf065c2012-06-22 16:30:09 -07001881 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1882 The current umask value is first masked out from the mode.
1883
Georg Brandl50c40002012-06-24 11:45:20 +02001884 This function can also support :ref:`paths relative to directory descriptors
1885 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001886
1887 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1888 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1889 rendezvous between "client" and "server" type processes: the server opens the
1890 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1891 doesn't open the FIFO --- it just creates the rendezvous point.
1892
Benjamin Petersonf650e462010-05-06 23:03:05 +00001893 Availability: Unix.
1894
Larry Hastings9cf065c2012-06-22 16:30:09 -07001895 .. versionadded:: 3.3
1896 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001897
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001898 .. versionchanged:: 3.6
1899 Accepts a :term:`path-like object`.
1900
Larry Hastings9cf065c2012-06-22 16:30:09 -07001901
Martin Panterbf19d162015-09-09 01:01:13 +00001902.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001903
1904 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00001905 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00001906 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
1907 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
1908 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
1909 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00001910 :func:`os.makedev`), otherwise it is ignored.
1911
Georg Brandl50c40002012-06-24 11:45:20 +02001912 This function can also support :ref:`paths relative to directory descriptors
1913 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001914
Berker Peksag6129e142016-09-26 22:50:11 +03001915 Availability: Unix.
1916
Larry Hastings9cf065c2012-06-22 16:30:09 -07001917 .. versionadded:: 3.3
1918 The *dir_fd* argument.
1919
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001920 .. versionchanged:: 3.6
1921 Accepts a :term:`path-like object`.
1922
Georg Brandl116aa622007-08-15 14:28:22 +00001923
1924.. function:: major(device)
1925
Christian Heimesfaf2f632008-01-06 16:59:19 +00001926 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001927 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001928
Georg Brandl116aa622007-08-15 14:28:22 +00001929
1930.. function:: minor(device)
1931
Christian Heimesfaf2f632008-01-06 16:59:19 +00001932 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001933 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001934
Georg Brandl116aa622007-08-15 14:28:22 +00001935
1936.. function:: makedev(major, minor)
1937
Christian Heimesfaf2f632008-01-06 16:59:19 +00001938 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001939
Georg Brandl116aa622007-08-15 14:28:22 +00001940
Georg Brandl116aa622007-08-15 14:28:22 +00001941.. function:: pathconf(path, name)
1942
1943 Return system configuration information relevant to a named file. *name*
1944 specifies the configuration value to retrieve; it may be a string which is the
1945 name of a defined system value; these names are specified in a number of
1946 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
1947 additional names as well. The names known to the host operating system are
1948 given in the ``pathconf_names`` dictionary. For configuration variables not
1949 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00001950
1951 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
1952 specific value for *name* is not supported by the host system, even if it is
1953 included in ``pathconf_names``, an :exc:`OSError` is raised with
1954 :const:`errno.EINVAL` for the error number.
1955
Larry Hastings77892dc2012-06-25 03:27:33 -07001956 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02001957 <path_fd>`.
1958
Benjamin Petersonf650e462010-05-06 23:03:05 +00001959 Availability: Unix.
1960
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001961 .. versionchanged:: 3.6
1962 Accepts a :term:`path-like object`.
1963
Georg Brandl116aa622007-08-15 14:28:22 +00001964
1965.. data:: pathconf_names
1966
1967 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
1968 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02001969 can be used to determine the set of names known to the system.
1970
1971 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001972
1973
Larry Hastings9cf065c2012-06-22 16:30:09 -07001974.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001975
1976 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02001977 result may be either an absolute or relative pathname; if it is relative, it
1978 may be converted to an absolute pathname using
1979 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001980
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001981 If the *path* is a string object (directly or indirectly through a
1982 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00001983 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001984 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00001985
Georg Brandl50c40002012-06-24 11:45:20 +02001986 This function can also support :ref:`paths relative to directory descriptors
1987 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001988
Brian Curtinc7395692010-07-09 15:15:09 +00001989 Availability: Unix, Windows
1990
Georg Brandlb3823372010-07-10 08:58:37 +00001991 .. versionchanged:: 3.2
1992 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001993
Larry Hastings9cf065c2012-06-22 16:30:09 -07001994 .. versionadded:: 3.3
1995 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001996
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001997 .. versionchanged:: 3.6
1998 Accepts a :term:`path-like object`.
1999
Georg Brandl116aa622007-08-15 14:28:22 +00002000
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002001.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002002
Georg Brandl50c40002012-06-24 11:45:20 +02002003 Remove (delete) the file *path*. If *path* is a directory, :exc:`OSError` is
2004 raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002005
Georg Brandl50c40002012-06-24 11:45:20 +02002006 This function can support :ref:`paths relative to directory descriptors
2007 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002008
2009 On Windows, attempting to remove a file that is in use causes an exception to
2010 be raised; on Unix, the directory entry is removed but the storage allocated
2011 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002012
Brett Cannon05039172015-12-28 17:28:19 -08002013 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002014
Larry Hastings9cf065c2012-06-22 16:30:09 -07002015 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002016 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002017
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002018 .. versionchanged:: 3.6
2019 Accepts a :term:`path-like object`.
2020
Georg Brandl116aa622007-08-15 14:28:22 +00002021
Zachary Warea22ae212014-03-20 09:42:01 -05002022.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00002023
2024 .. index:: single: directory; deleting
2025
Christian Heimesfaf2f632008-01-06 16:59:19 +00002026 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00002027 leaf directory is successfully removed, :func:`removedirs` tries to
2028 successively remove every parent directory mentioned in *path* until an error
2029 is raised (which is ignored, because it generally means that a parent directory
2030 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
2031 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
2032 they are empty. Raises :exc:`OSError` if the leaf directory could not be
2033 successfully removed.
2034
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002035 .. versionchanged:: 3.6
2036 Accepts a :term:`path-like object`.
2037
Georg Brandl116aa622007-08-15 14:28:22 +00002038
Larry Hastings9cf065c2012-06-22 16:30:09 -07002039.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002040
2041 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2042 :exc:`OSError` will be raised. On Unix, if *dst* exists and is a file, it will
Christian Heimesfaf2f632008-01-06 16:59:19 +00002043 be replaced silently if the user has permission. The operation may fail on some
Georg Brandl116aa622007-08-15 14:28:22 +00002044 Unix flavors if *src* and *dst* are on different filesystems. If successful,
2045 the renaming will be an atomic operation (this is a POSIX requirement). On
2046 Windows, if *dst* already exists, :exc:`OSError` will be raised even if it is a
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002047 file.
2048
Georg Brandlaceaf902012-06-25 08:33:56 +02002049 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2050 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002051
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002052 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002053
Larry Hastings9cf065c2012-06-22 16:30:09 -07002054 .. versionadded:: 3.3
2055 The *src_dir_fd* and *dst_dir_fd* arguments.
2056
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002057 .. versionchanged:: 3.6
2058 Accepts a :term:`path-like object` for *src* and *dst*.
2059
Georg Brandl116aa622007-08-15 14:28:22 +00002060
2061.. function:: renames(old, new)
2062
2063 Recursive directory or file renaming function. Works like :func:`rename`, except
2064 creation of any intermediate directories needed to make the new pathname good is
2065 attempted first. After the rename, directories corresponding to rightmost path
2066 segments of the old name will be pruned away using :func:`removedirs`.
2067
Georg Brandl116aa622007-08-15 14:28:22 +00002068 .. note::
2069
2070 This function can fail with the new directory structure made if you lack
2071 permissions needed to remove the leaf directory or file.
2072
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002073 .. versionchanged:: 3.6
2074 Accepts a :term:`path-like object` for *old* and *new*.
2075
Georg Brandl116aa622007-08-15 14:28:22 +00002076
Larry Hastings9cf065c2012-06-22 16:30:09 -07002077.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002078
2079 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2080 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
2081 be replaced silently if the user has permission. The operation may fail
2082 if *src* and *dst* are on different filesystems. If successful,
2083 the renaming will be an atomic operation (this is a POSIX requirement).
2084
Georg Brandlaceaf902012-06-25 08:33:56 +02002085 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2086 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002087
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002088 .. versionadded:: 3.3
2089
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002090 .. versionchanged:: 3.6
2091 Accepts a :term:`path-like object` for *src* and *dst*.
2092
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002093
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002094.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002095
Georg Brandla6053b42009-09-01 08:11:14 +00002096 Remove (delete) the directory *path*. Only works when the directory is
2097 empty, otherwise, :exc:`OSError` is raised. In order to remove whole
Benjamin Petersonf650e462010-05-06 23:03:05 +00002098 directory trees, :func:`shutil.rmtree` can be used.
2099
Georg Brandl50c40002012-06-24 11:45:20 +02002100 This function can support :ref:`paths relative to directory descriptors
2101 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002102
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002103 .. versionadded:: 3.3
2104 The *dir_fd* parameter.
2105
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002106 .. versionchanged:: 3.6
2107 Accepts a :term:`path-like object`.
2108
Georg Brandl116aa622007-08-15 14:28:22 +00002109
Victor Stinner6036e442015-03-08 01:58:04 +01002110.. function:: scandir(path='.')
2111
Brett Cannona32c4d02016-06-24 14:14:44 -07002112 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2113 entries in the directory given by *path*. The entries are yielded in
2114 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2115 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002116
Victor Stinner51b58322015-05-15 09:12:58 +02002117 Using :func:`scandir` instead of :func:`listdir` can significantly
2118 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002119 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002120 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002121 All :class:`os.DirEntry` methods may perform a system call, but
2122 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2123 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002124 always requires a system call on Unix but only requires one for
2125 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002126
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002127 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2128 (directly or indirectly through the :class:`PathLike` interface),
2129 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2130 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2131 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002132
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002133 This function can also support :ref:`specifying a file descriptor
2134 <path_fd>`; the file descriptor must refer to a directory.
2135
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002136 The :func:`scandir` iterator supports the :term:`context manager` protocol
2137 and has the following method:
2138
2139 .. method:: scandir.close()
2140
2141 Close the iterator and free acquired resources.
2142
2143 This is called automatically when the iterator is exhausted or garbage
2144 collected, or when an error happens during iterating. However it
2145 is advisable to call it explicitly or use the :keyword:`with`
2146 statement.
2147
2148 .. versionadded:: 3.6
2149
Victor Stinner6036e442015-03-08 01:58:04 +01002150 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002151 the files (excluding directories) in the given *path* that don't start with
2152 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2153 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002154
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002155 with os.scandir(path) as it:
2156 for entry in it:
2157 if not entry.name.startswith('.') and entry.is_file():
2158 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002159
2160 .. note::
2161
2162 On Unix-based systems, :func:`scandir` uses the system's
2163 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2164 and
2165 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2166 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002167 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002168 and
Georg Brandl5d941342016-02-26 19:37:12 +01002169 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002170 functions.
2171
Victor Stinner6036e442015-03-08 01:58:04 +01002172 .. versionadded:: 3.5
2173
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002174 .. versionadded:: 3.6
2175 Added support for the :term:`context manager` protocol and the
2176 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2177 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2178 in its destructor.
2179
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002180 The function accepts a :term:`path-like object`.
2181
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002182 .. versionchanged:: 3.7
2183 Added support for :ref:`file descriptors <path_fd>` on Unix.
2184
Victor Stinner6036e442015-03-08 01:58:04 +01002185
2186.. class:: DirEntry
2187
2188 Object yielded by :func:`scandir` to expose the file path and other file
2189 attributes of a directory entry.
2190
2191 :func:`scandir` will provide as much of this information as possible without
2192 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002193 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002194
Brett Cannona32c4d02016-06-24 14:14:44 -07002195 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002196 structures; if you know the file metadata has changed or if a long time has
2197 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2198 up-to-date information.
2199
Brett Cannona32c4d02016-06-24 14:14:44 -07002200 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002201 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002202 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002203 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002204
Brett Cannona32c4d02016-06-24 14:14:44 -07002205 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002206 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002207
Brett Cannona32c4d02016-06-24 14:14:44 -07002208 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002209
2210 .. attribute:: name
2211
2212 The entry's base filename, relative to the :func:`scandir` *path*
2213 argument.
2214
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002215 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2216 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002217 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002218
2219 .. attribute:: path
2220
2221 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2222 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2223 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002224 argument was absolute. If the :func:`scandir` *path*
2225 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2226 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002227
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002228 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2229 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002230 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002231
2232 .. method:: inode()
2233
2234 Return the inode number of the entry.
2235
Brett Cannona32c4d02016-06-24 14:14:44 -07002236 The result is cached on the ``os.DirEntry`` object. Use
2237 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2238 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002239
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002240 On the first, uncached call, a system call is required on Windows but
2241 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002242
2243 .. method:: is_dir(\*, follow_symlinks=True)
2244
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002245 Return ``True`` if this entry is a directory or a symbolic link pointing
2246 to a directory; return ``False`` if the entry is or points to any other
2247 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002248
2249 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002250 is a directory (without following symlinks); return ``False`` if the
2251 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002252
Brett Cannona32c4d02016-06-24 14:14:44 -07002253 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002254 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2255 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2256
2257 On the first, uncached call, no system call is required in most cases.
2258 Specifically, for non-symlinks, neither Windows or Unix require a system
2259 call, except on certain Unix file systems, such as network file systems,
2260 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2261 a system call will be required to follow the symlink unless
2262 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002263
Victor Stinner51b58322015-05-15 09:12:58 +02002264 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2265 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002266
Victor Stinner6036e442015-03-08 01:58:04 +01002267 .. method:: is_file(\*, follow_symlinks=True)
2268
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002269 Return ``True`` if this entry is a file or a symbolic link pointing to a
2270 file; return ``False`` if the entry is or points to a directory or other
2271 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002272
2273 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002274 is a file (without following symlinks); return ``False`` if the entry is
2275 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002276
Brett Cannona32c4d02016-06-24 14:14:44 -07002277 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2278 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002279
2280 .. method:: is_symlink()
2281
Victor Stinner51b58322015-05-15 09:12:58 +02002282 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002283 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002284 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002285
Brett Cannona32c4d02016-06-24 14:14:44 -07002286 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002287 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002288
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002289 On the first, uncached call, no system call is required in most cases.
2290 Specifically, neither Windows or Unix require a system call, except on
2291 certain Unix file systems, such as network file systems, that return
2292 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002293
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002294 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2295 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002296
2297 .. method:: stat(\*, follow_symlinks=True)
2298
Victor Stinner51b58322015-05-15 09:12:58 +02002299 Return a :class:`stat_result` object for this entry. This method
2300 follows symbolic links by default; to stat a symbolic link add the
2301 ``follow_symlinks=False`` argument.
2302
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002303 On Unix, this method always requires a system call. On Windows, it
2304 only requires a system call if *follow_symlinks* is ``True`` and the
2305 entry is a symbolic link.
Victor Stinner6036e442015-03-08 01:58:04 +01002306
2307 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2308 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2309 get these attributes.
2310
Brett Cannona32c4d02016-06-24 14:14:44 -07002311 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002312 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2313 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002314
Guido van Rossum1469d742016-01-06 11:36:03 -08002315 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002316 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002317 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002318 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2319 and ``stat()`` methods.
2320
Victor Stinner6036e442015-03-08 01:58:04 +01002321 .. versionadded:: 3.5
2322
Brett Cannon96881cd2016-06-10 14:37:21 -07002323 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002324 Added support for the :class:`~os.PathLike` interface. Added support
2325 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002326
Victor Stinner6036e442015-03-08 01:58:04 +01002327
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002328.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002329
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002330 Get the status of a file or a file descriptor. Perform the equivalent of a
2331 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002332 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002333 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002334 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002335
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002336 This function normally follows symlinks; to stat a symlink add the argument
2337 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002338
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002339 This function can support :ref:`specifying a file descriptor <path_fd>` and
2340 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002341
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002342 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002343
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002344 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002345
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002346 >>> import os
2347 >>> statinfo = os.stat('somefile.txt')
2348 >>> statinfo
2349 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2350 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2351 st_mtime=1297230027, st_ctime=1297230027)
2352 >>> statinfo.st_size
2353 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002354
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002355 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002356
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002357 :func:`fstat` and :func:`lstat` functions.
2358
2359 .. versionadded:: 3.3
2360 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2361 descriptor instead of a path.
2362
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002363 .. versionchanged:: 3.6
2364 Accepts a :term:`path-like object`.
2365
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002366
2367.. class:: stat_result
2368
2369 Object whose attributes correspond roughly to the members of the
2370 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2371 :func:`os.fstat` and :func:`os.lstat`.
2372
2373 Attributes:
2374
2375 .. attribute:: st_mode
2376
2377 File mode: file type and file mode bits (permissions).
2378
2379 .. attribute:: st_ino
2380
Miss Islington (bot)78e14f82018-05-28 18:49:42 -07002381 Platform dependent, but if non-zero, uniquely identifies the
2382 file for a given value of ``st_dev``. Typically:
2383
2384 * the inode number on Unix,
2385 * the `file index
2386 <https://msdn.microsoft.com/en-us/library/aa363788>`_ on
2387 Windows
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002388
2389 .. attribute:: st_dev
2390
2391 Identifier of the device on which this file resides.
2392
2393 .. attribute:: st_nlink
2394
2395 Number of hard links.
2396
2397 .. attribute:: st_uid
2398
2399 User identifier of the file owner.
2400
2401 .. attribute:: st_gid
2402
2403 Group identifier of the file owner.
2404
2405 .. attribute:: st_size
2406
2407 Size of the file in bytes, if it is a regular file or a symbolic link.
2408 The size of a symbolic link is the length of the pathname it contains,
2409 without a terminating null byte.
2410
2411 Timestamps:
2412
2413 .. attribute:: st_atime
2414
2415 Time of most recent access expressed in seconds.
2416
2417 .. attribute:: st_mtime
2418
2419 Time of most recent content modification expressed in seconds.
2420
2421 .. attribute:: st_ctime
2422
2423 Platform dependent:
2424
2425 * the time of most recent metadata change on Unix,
2426 * the time of creation on Windows, expressed in seconds.
2427
2428 .. attribute:: st_atime_ns
2429
2430 Time of most recent access expressed in nanoseconds as an integer.
2431
2432 .. attribute:: st_mtime_ns
2433
2434 Time of most recent content modification expressed in nanoseconds as an
2435 integer.
2436
2437 .. attribute:: st_ctime_ns
2438
2439 Platform dependent:
2440
2441 * the time of most recent metadata change on Unix,
2442 * the time of creation on Windows, expressed in nanoseconds as an
2443 integer.
2444
Georg Brandl116aa622007-08-15 14:28:22 +00002445 .. note::
2446
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002447 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002448 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2449 system and the file system. For example, on Windows systems using the FAT
2450 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2451 :attr:`st_atime` has only 1-day resolution. See your operating system
2452 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002453
Larry Hastings6fe20b32012-04-19 15:07:49 -07002454 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2455 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2456 systems do not provide nanosecond precision. On systems that do
2457 provide nanosecond precision, the floating-point object used to
2458 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2459 cannot preserve all of it, and as such will be slightly inexact.
2460 If you need the exact timestamps you should always use
2461 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002462
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002463 On some Unix systems (such as Linux), the following attributes may also be
2464 available:
2465
2466 .. attribute:: st_blocks
2467
2468 Number of 512-byte blocks allocated for file.
2469 This may be smaller than :attr:`st_size`/512 when the file has holes.
2470
2471 .. attribute:: st_blksize
2472
2473 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2474 smaller chunks may cause an inefficient read-modify-rewrite.
2475
2476 .. attribute:: st_rdev
2477
2478 Type of device if an inode device.
2479
2480 .. attribute:: st_flags
2481
2482 User defined flags for file.
2483
2484 On other Unix systems (such as FreeBSD), the following attributes may be
2485 available (but may be only filled out if root tries to use them):
2486
2487 .. attribute:: st_gen
2488
2489 File generation number.
2490
2491 .. attribute:: st_birthtime
2492
2493 Time of file creation.
2494
jcea6c51d512018-01-28 14:00:08 +01002495 On Solaris and derivatives, the following attributes may also be
2496 available:
2497
2498 .. attribute:: st_fstype
2499
2500 String that uniquely identifies the type of the filesystem that
2501 contains the file.
2502
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002503 On Mac OS systems, the following attributes may also be available:
2504
2505 .. attribute:: st_rsize
2506
2507 Real size of the file.
2508
2509 .. attribute:: st_creator
2510
2511 Creator of the file.
2512
2513 .. attribute:: st_type
2514
2515 File type.
2516
Victor Stinnere1d24f72014-07-24 12:44:07 +02002517 On Windows systems, the following attribute is also available:
2518
2519 .. attribute:: st_file_attributes
2520
2521 Windows file attributes: ``dwFileAttributes`` member of the
2522 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2523 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2524 constants in the :mod:`stat` module.
2525
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002526 The standard module :mod:`stat` defines functions and constants that are
2527 useful for extracting information from a :c:type:`stat` structure. (On
2528 Windows, some items are filled with dummy values.)
2529
2530 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002531 accessible as a tuple of at least 10 integers giving the most important (and
2532 portable) members of the :c:type:`stat` structure, in the order
2533 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2534 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2535 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002536 some implementations. For compatibility with older Python versions,
2537 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002538
Larry Hastings6fe20b32012-04-19 15:07:49 -07002539 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002540 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2541 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002542
Zachary Ware63f277b2014-06-19 09:46:37 -05002543 .. versionadded:: 3.5
2544 Added the :attr:`st_file_attributes` member on Windows.
2545
Miss Islington (bot)78e14f82018-05-28 18:49:42 -07002546 .. versionchanged:: 3.5
2547 Windows now returns the file index as :attr:`st_ino` when
2548 available.
2549
jcea6c51d512018-01-28 14:00:08 +01002550 .. versionadded:: 3.7
2551 Added the :attr:`st_fstype` member to Solaris/derivatives.
Georg Brandl116aa622007-08-15 14:28:22 +00002552
Georg Brandl116aa622007-08-15 14:28:22 +00002553.. function:: statvfs(path)
2554
Georg Brandl60203b42010-10-06 10:11:56 +00002555 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002556 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002557 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002558 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2559 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002560 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002561
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002562 Two module-level constants are defined for the :attr:`f_flag` attribute's
2563 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2564 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2565 setuid/setgid bits are disabled or not supported.
2566
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002567 Additional module-level constants are defined for GNU/glibc based systems.
2568 These are :const:`ST_NODEV` (disallow access to device special files),
2569 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2570 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2571 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2572 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2573 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2574 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2575
Georg Brandl50c40002012-06-24 11:45:20 +02002576 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002577
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002578 Availability: Unix.
2579
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002580 .. versionchanged:: 3.2
2581 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2582
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002583 .. versionadded:: 3.3
2584 Added support for specifying an open file descriptor for *path*.
2585
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002586 .. versionchanged:: 3.4
2587 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2588 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2589 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2590 and :const:`ST_RELATIME` constants were added.
2591
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002592 .. versionchanged:: 3.6
2593 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002594
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002595 .. versionadded:: 3.7
2596 Added :attr:`f_fsid`.
2597
Larry Hastings9cf065c2012-06-22 16:30:09 -07002598
2599.. data:: supports_dir_fd
2600
Serhiy Storchakadab83542013-10-13 20:12:43 +03002601 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002602 :mod:`os` module permit use of their *dir_fd* parameter. Different platforms
Larry Hastings9cf065c2012-06-22 16:30:09 -07002603 provide different functionality, and an option that might work on one might
2604 be unsupported on another. For consistency's sakes, functions that support
Andrew Svetlov5b898402012-12-18 21:26:36 +02002605 *dir_fd* always allow specifying the parameter, but will raise an exception
Larry Hastings9cf065c2012-06-22 16:30:09 -07002606 if the functionality is not actually available.
2607
2608 To check whether a particular function permits use of its *dir_fd*
2609 parameter, use the ``in`` operator on ``supports_dir_fd``. As an example,
2610 this expression determines whether the *dir_fd* parameter of :func:`os.stat`
2611 is locally available::
2612
2613 os.stat in os.supports_dir_fd
2614
Georg Brandlf62445a2012-06-24 13:31:20 +02002615 Currently *dir_fd* parameters only work on Unix platforms; none of them work
2616 on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002617
2618 .. versionadded:: 3.3
2619
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002620
Larry Hastings9cf065c2012-06-22 16:30:09 -07002621.. data:: supports_effective_ids
2622
Serhiy Storchakadab83542013-10-13 20:12:43 +03002623 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002624 :mod:`os` module permit use of the *effective_ids* parameter for
2625 :func:`os.access`. If the local platform supports it, the collection will
2626 contain :func:`os.access`, otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002627
Georg Brandl50c40002012-06-24 11:45:20 +02002628 To check whether you can use the *effective_ids* parameter for
Berker Peksag4d6c6062015-02-16 03:36:10 +02002629 :func:`os.access`, use the ``in`` operator on ``supports_effective_ids``,
2630 like so::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002631
2632 os.access in os.supports_effective_ids
2633
Georg Brandl50c40002012-06-24 11:45:20 +02002634 Currently *effective_ids* only works on Unix platforms; it does not work on
2635 Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002636
2637 .. versionadded:: 3.3
2638
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002639
Larry Hastings9cf065c2012-06-22 16:30:09 -07002640.. data:: supports_fd
2641
Serhiy Storchakadab83542013-10-13 20:12:43 +03002642 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002643 :mod:`os` module permit specifying their *path* parameter as an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002644 descriptor. Different platforms provide different functionality, and an
2645 option that might work on one might be unsupported on another. For
2646 consistency's sakes, functions that support *fd* always allow specifying
Andrew Svetlov5b898402012-12-18 21:26:36 +02002647 the parameter, but will raise an exception if the functionality is not
Larry Hastings9cf065c2012-06-22 16:30:09 -07002648 actually available.
2649
2650 To check whether a particular function permits specifying an open file
2651 descriptor for its *path* parameter, use the ``in`` operator on
2652 ``supports_fd``. As an example, this expression determines whether
2653 :func:`os.chdir` accepts open file descriptors when called on your local
2654 platform::
2655
2656 os.chdir in os.supports_fd
2657
2658 .. versionadded:: 3.3
2659
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002660
Larry Hastings9cf065c2012-06-22 16:30:09 -07002661.. data:: supports_follow_symlinks
2662
Serhiy Storchakadab83542013-10-13 20:12:43 +03002663 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002664 :mod:`os` module permit use of their *follow_symlinks* parameter. Different
Larry Hastings9cf065c2012-06-22 16:30:09 -07002665 platforms provide different functionality, and an option that might work on
2666 one might be unsupported on another. For consistency's sakes, functions that
2667 support *follow_symlinks* always allow specifying the parameter, but will
Andrew Svetlov5b898402012-12-18 21:26:36 +02002668 raise an exception if the functionality is not actually available.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002669
2670 To check whether a particular function permits use of its *follow_symlinks*
2671 parameter, use the ``in`` operator on ``supports_follow_symlinks``. As an
2672 example, this expression determines whether the *follow_symlinks* parameter
2673 of :func:`os.stat` is locally available::
2674
2675 os.stat in os.supports_follow_symlinks
2676
2677 .. versionadded:: 3.3
2678
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002679
Martin Panterbf19d162015-09-09 01:01:13 +00002680.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002681
Martin Panterbf19d162015-09-09 01:01:13 +00002682 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002683
Larry Hastings9cf065c2012-06-22 16:30:09 -07002684 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002685 morph to the target dynamically. If the target is present, the type of the
2686 symlink will be created to match. Otherwise, the symlink will be created
2687 as a directory if *target_is_directory* is ``True`` or a file symlink (the
2688 default) otherwise. On non-Window platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002689
Georg Brandl64a41ed2010-10-06 08:52:48 +00002690 Symbolic link support was introduced in Windows 6.0 (Vista). :func:`symlink`
2691 will raise a :exc:`NotImplementedError` on Windows versions earlier than 6.0.
Brian Curtin52173d42010-12-02 18:29:18 +00002692
Georg Brandl50c40002012-06-24 11:45:20 +02002693 This function can support :ref:`paths relative to directory descriptors
2694 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002695
Brian Curtin52173d42010-12-02 18:29:18 +00002696 .. note::
2697
Larry Hastings9cf065c2012-06-22 16:30:09 -07002698 On Windows, the *SeCreateSymbolicLinkPrivilege* is required in order to
2699 successfully create symlinks. This privilege is not typically granted to
2700 regular users but is available to accounts which can escalate privileges
2701 to the administrator level. Either obtaining the privilege or running your
Brian Curtin96245592010-12-28 17:08:22 +00002702 application as an administrator are ways to successfully create symlinks.
2703
Jason R. Coombs3a092862013-05-27 23:21:28 -04002704
Brian Curtin96245592010-12-28 17:08:22 +00002705 :exc:`OSError` is raised when the function is called by an unprivileged
2706 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002707
Georg Brandl64a41ed2010-10-06 08:52:48 +00002708 Availability: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002709
Georg Brandlb3823372010-07-10 08:58:37 +00002710 .. versionchanged:: 3.2
2711 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002712
Larry Hastings9cf065c2012-06-22 16:30:09 -07002713 .. versionadded:: 3.3
2714 Added the *dir_fd* argument, and now allow *target_is_directory*
2715 on non-Windows platforms.
2716
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002717 .. versionchanged:: 3.6
2718 Accepts a :term:`path-like object` for *src* and *dst*.
2719
Georg Brandl116aa622007-08-15 14:28:22 +00002720
Ross Lagerwall7807c352011-03-17 20:20:30 +02002721.. function:: sync()
2722
2723 Force write of everything to disk.
2724
2725 Availability: Unix.
2726
2727 .. versionadded:: 3.3
2728
2729
2730.. function:: truncate(path, length)
2731
2732 Truncate the file corresponding to *path*, so that it is at most
2733 *length* bytes in size.
2734
Georg Brandl306336b2012-06-24 12:55:33 +02002735 This function can support :ref:`specifying a file descriptor <path_fd>`.
2736
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002737 Availability: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002738
2739 .. versionadded:: 3.3
2740
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002741 .. versionchanged:: 3.5
2742 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002743
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002744 .. versionchanged:: 3.6
2745 Accepts a :term:`path-like object`.
2746
2747
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002748.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002749
Brett Cannon05039172015-12-28 17:28:19 -08002750 Remove (delete) the file *path*. This function is semantically
2751 identical to :func:`remove`; the ``unlink`` name is its
2752 traditional Unix name. Please see the documentation for
2753 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002754
Larry Hastings9cf065c2012-06-22 16:30:09 -07002755 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002756 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002757
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002758 .. versionchanged:: 3.6
2759 Accepts a :term:`path-like object`.
2760
Larry Hastings9cf065c2012-06-22 16:30:09 -07002761
Martin Panterbf19d162015-09-09 01:01:13 +00002762.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002763
Larry Hastings76ad59b2012-05-03 00:30:07 -07002764 Set the access and modified times of the file specified by *path*.
2765
2766 :func:`utime` takes two optional parameters, *times* and *ns*.
2767 These specify the times set on *path* and are used as follows:
2768
Martin Panterbf19d162015-09-09 01:01:13 +00002769 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002770 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2771 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002772 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002773 it must be a 2-tuple of the form ``(atime, mtime)``
2774 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002775 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002776 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002777 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002778
Larry Hastings9cf065c2012-06-22 16:30:09 -07002779 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002780
2781 Whether a directory can be given for *path*
Brian Curtin52fbea12011-11-06 13:41:17 -06002782 depends on whether the operating system implements directories as files
2783 (for example, Windows does not). Note that the exact times you set here may
2784 not be returned by a subsequent :func:`~os.stat` call, depending on the
2785 resolution with which your operating system records access and modification
Larry Hastings76ad59b2012-05-03 00:30:07 -07002786 times; see :func:`~os.stat`. The best way to preserve exact times is to
2787 use the *st_atime_ns* and *st_mtime_ns* fields from the :func:`os.stat`
2788 result object with the *ns* parameter to `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002789
Georg Brandl50c40002012-06-24 11:45:20 +02002790 This function can support :ref:`specifying a file descriptor <path_fd>`,
2791 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2792 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002793
Larry Hastings76ad59b2012-05-03 00:30:07 -07002794 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -07002795 Added support for specifying an open file descriptor for *path*,
2796 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002797
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002798 .. versionchanged:: 3.6
2799 Accepts a :term:`path-like object`.
2800
Georg Brandl116aa622007-08-15 14:28:22 +00002801
Georg Brandl18244152009-09-02 20:34:52 +00002802.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002803
2804 .. index::
2805 single: directory; walking
2806 single: directory; traversal
2807
Christian Heimesfaf2f632008-01-06 16:59:19 +00002808 Generate the file names in a directory tree by walking the tree
2809 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002810 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2811 filenames)``.
2812
2813 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2814 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2815 *filenames* is a list of the names of the non-directory files in *dirpath*.
2816 Note that the names in the lists contain no path components. To get a full path
2817 (which begins with *top*) to a file or directory in *dirpath*, do
2818 ``os.path.join(dirpath, name)``.
2819
Christian Heimesfaf2f632008-01-06 16:59:19 +00002820 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00002821 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07002822 (directories are generated top-down). If *topdown* is ``False``, the triple
2823 for a directory is generated after the triples for all of its subdirectories
2824 (directories are generated bottom-up). No matter the value of *topdown*, the
2825 list of subdirectories is retrieved before the tuples for the directory and
2826 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002827
Christian Heimesfaf2f632008-01-06 16:59:19 +00002828 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00002829 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
2830 recurse into the subdirectories whose names remain in *dirnames*; this can be
2831 used to prune the search, impose a specific order of visiting, or even to inform
2832 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02002833 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
2834 no effect on the behavior of the walk, because in bottom-up mode the directories
2835 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002836
Miss Islington (bot)f6d1d652018-04-02 20:33:38 -07002837 By default, errors from the :func:`scandir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00002838 argument *onerror* is specified, it should be a function; it will be called with
2839 one argument, an :exc:`OSError` instance. It can report the error to continue
2840 with the walk, or raise the exception to abort the walk. Note that the filename
2841 is available as the ``filename`` attribute of the exception object.
2842
2843 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00002844 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00002845 symlinks, on systems that support them.
2846
Georg Brandl116aa622007-08-15 14:28:22 +00002847 .. note::
2848
Georg Brandl50c40002012-06-24 11:45:20 +02002849 Be aware that setting *followlinks* to ``True`` can lead to infinite
2850 recursion if a link points to a parent directory of itself. :func:`walk`
2851 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00002852
2853 .. note::
2854
2855 If you pass a relative pathname, don't change the current working directory
2856 between resumptions of :func:`walk`. :func:`walk` never changes the current
2857 directory, and assumes that its caller doesn't either.
2858
2859 This example displays the number of bytes taken by non-directory files in each
2860 directory under the starting directory, except that it doesn't look under any
2861 CVS subdirectory::
2862
2863 import os
2864 from os.path import join, getsize
2865 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00002866 print(root, "consumes", end=" ")
2867 print(sum(getsize(join(root, name)) for name in files), end=" ")
2868 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00002869 if 'CVS' in dirs:
2870 dirs.remove('CVS') # don't visit CVS directories
2871
Victor Stinner47c41b42015-03-10 13:31:47 +01002872 In the next example (simple implementation of :func:`shutil.rmtree`),
2873 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
2874 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00002875
Christian Heimesfaf2f632008-01-06 16:59:19 +00002876 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00002877 # assuming there are no symbolic links.
2878 # CAUTION: This is dangerous! For example, if top == '/', it
2879 # could delete all your disk files.
2880 import os
2881 for root, dirs, files in os.walk(top, topdown=False):
2882 for name in files:
2883 os.remove(os.path.join(root, name))
2884 for name in dirs:
2885 os.rmdir(os.path.join(root, name))
2886
Victor Stinner524a5ba2015-03-10 13:20:34 +01002887 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02002888 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
2889 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01002890
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002891 .. versionchanged:: 3.6
2892 Accepts a :term:`path-like object`.
2893
Georg Brandl116aa622007-08-15 14:28:22 +00002894
Larry Hastingsb4038062012-07-15 10:57:38 -07002895.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01002896
2897 .. index::
2898 single: directory; walking
2899 single: directory; traversal
2900
Eli Benderskyd049d5c2012-02-11 09:52:29 +02002901 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07002902 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01002903
2904 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
2905 and *dirfd* is a file descriptor referring to the directory *dirpath*.
2906
Larry Hastingsc48fe982012-06-25 04:49:05 -07002907 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07002908 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07002909 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07002910 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07002911
Charles-François Natali7372b062012-02-05 15:15:38 +01002912 .. note::
2913
2914 Since :func:`fwalk` yields file descriptors, those are only valid until
2915 the next iteration step, so you should duplicate them (e.g. with
2916 :func:`dup`) if you want to keep them longer.
2917
2918 This example displays the number of bytes taken by non-directory files in each
2919 directory under the starting directory, except that it doesn't look under any
2920 CVS subdirectory::
2921
2922 import os
2923 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
2924 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02002925 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01002926 end="")
2927 print("bytes in", len(files), "non-directory files")
2928 if 'CVS' in dirs:
2929 dirs.remove('CVS') # don't visit CVS directories
2930
2931 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002932 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01002933 empty::
2934
2935 # Delete everything reachable from the directory named in "top",
2936 # assuming there are no symbolic links.
2937 # CAUTION: This is dangerous! For example, if top == '/', it
2938 # could delete all your disk files.
2939 import os
2940 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
2941 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002942 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002943 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002944 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002945
2946 Availability: Unix.
2947
2948 .. versionadded:: 3.3
2949
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002950 .. versionchanged:: 3.6
2951 Accepts a :term:`path-like object`.
2952
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02002953 .. versionchanged:: 3.7
2954 Added support for :class:`bytes` paths.
2955
Charles-François Natali7372b062012-02-05 15:15:38 +01002956
Georg Brandlb9831ab2012-06-24 11:57:07 +02002957Linux extended attributes
2958~~~~~~~~~~~~~~~~~~~~~~~~~
2959
2960.. versionadded:: 3.3
2961
2962These functions are all available on Linux only.
2963
2964.. function:: getxattr(path, attribute, *, follow_symlinks=True)
2965
2966 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002967 *path*. *attribute* can be bytes or str (directly or indirectly through the
2968 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
2969 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002970
2971 This function can support :ref:`specifying a file descriptor <path_fd>` and
2972 :ref:`not following symlinks <follow_symlinks>`.
2973
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002974 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03002975 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002976
Georg Brandlb9831ab2012-06-24 11:57:07 +02002977
2978.. function:: listxattr(path=None, *, follow_symlinks=True)
2979
2980 Return a list of the extended filesystem attributes on *path*. The
2981 attributes in the list are represented as strings decoded with the filesystem
2982 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
2983 directory.
2984
2985 This function can support :ref:`specifying a file descriptor <path_fd>` and
2986 :ref:`not following symlinks <follow_symlinks>`.
2987
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002988 .. versionchanged:: 3.6
2989 Accepts a :term:`path-like object`.
2990
Georg Brandlb9831ab2012-06-24 11:57:07 +02002991
2992.. function:: removexattr(path, attribute, *, follow_symlinks=True)
2993
2994 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002995 *attribute* should be bytes or str (directly or indirectly through the
2996 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02002997 with the filesystem encoding.
2998
2999 This function can support :ref:`specifying a file descriptor <path_fd>` and
3000 :ref:`not following symlinks <follow_symlinks>`.
3001
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003002 .. versionchanged:: 3.6
3003 Accepts a :term:`path-like object` for *path* and *attribute*.
3004
Georg Brandlb9831ab2012-06-24 11:57:07 +02003005
3006.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
3007
3008 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003009 *attribute* must be a bytes or str with no embedded NULs (directly or
3010 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02003011 it is encoded with the filesystem encoding. *flags* may be
3012 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
3013 given and the attribute does not exist, ``EEXISTS`` will be raised.
3014 If :data:`XATTR_CREATE` is given and the attribute already exists, the
3015 attribute will not be created and ``ENODATA`` will be raised.
3016
3017 This function can support :ref:`specifying a file descriptor <path_fd>` and
3018 :ref:`not following symlinks <follow_symlinks>`.
3019
3020 .. note::
3021
3022 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
3023 to be ignored on some filesystems.
3024
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003025 .. versionchanged:: 3.6
3026 Accepts a :term:`path-like object` for *path* and *attribute*.
3027
Georg Brandlb9831ab2012-06-24 11:57:07 +02003028
3029.. data:: XATTR_SIZE_MAX
3030
3031 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02003032 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003033
3034
3035.. data:: XATTR_CREATE
3036
3037 This is a possible value for the flags argument in :func:`setxattr`. It
3038 indicates the operation must create an attribute.
3039
3040
3041.. data:: XATTR_REPLACE
3042
3043 This is a possible value for the flags argument in :func:`setxattr`. It
3044 indicates the operation must replace an existing attribute.
3045
3046
Georg Brandl116aa622007-08-15 14:28:22 +00003047.. _os-process:
3048
3049Process Management
3050------------------
3051
3052These functions may be used to create and manage processes.
3053
Serhiy Storchakadab83542013-10-13 20:12:43 +03003054The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00003055program loaded into the process. In each case, the first of these arguments is
3056passed to the new program as its own name rather than as an argument a user may
3057have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00003058passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00003059['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
3060to be ignored.
3061
3062
3063.. function:: abort()
3064
3065 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
3066 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02003067 an exit code of ``3``. Be aware that calling this function will not call the
3068 Python signal handler registered for :const:`SIGABRT` with
3069 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003070
Georg Brandl116aa622007-08-15 14:28:22 +00003071
3072.. function:: execl(path, arg0, arg1, ...)
3073 execle(path, arg0, arg1, ..., env)
3074 execlp(file, arg0, arg1, ...)
3075 execlpe(file, arg0, arg1, ..., env)
3076 execv(path, args)
3077 execve(path, args, env)
3078 execvp(file, args)
3079 execvpe(file, args, env)
3080
3081 These functions all execute a new program, replacing the current process; they
3082 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00003083 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00003084 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003085
3086 The current process is replaced immediately. Open file objects and
3087 descriptors are not flushed, so if there may be data buffered
3088 on these open files, you should flush them using
3089 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03003090 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00003091
Serhiy Storchakadab83542013-10-13 20:12:43 +03003092 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003093 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003094 to work with if the number of parameters is fixed when the code is written; the
3095 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003096 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00003097 variable, with the arguments being passed in a list or tuple as the *args*
3098 parameter. In either case, the arguments to the child process should start with
3099 the name of the command being run, but this is not enforced.
3100
Christian Heimesfaf2f632008-01-06 16:59:19 +00003101 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003102 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
3103 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003104 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003105 discussed in the next paragraph), the new environment is used as the source of
3106 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
3107 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
3108 locate the executable; *path* must contain an appropriate absolute or relative
3109 path.
3110
3111 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00003112 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00003113 used to define the environment variables for the new process (these are used
3114 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00003115 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003116 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003117
Larry Hastings9cf065c2012-06-22 16:30:09 -07003118 For :func:`execve` on some platforms, *path* may also be specified as an open
3119 file descriptor. This functionality may not be supported on your platform;
3120 you can check whether or not it is available using :data:`os.supports_fd`.
3121 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3122
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003123 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003124
Larry Hastings9cf065c2012-06-22 16:30:09 -07003125 .. versionadded:: 3.3
3126 Added support for specifying an open file descriptor for *path*
3127 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003128
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003129 .. versionchanged:: 3.6
3130 Accepts a :term:`path-like object`.
3131
Georg Brandl116aa622007-08-15 14:28:22 +00003132.. function:: _exit(n)
3133
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003134 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003135 stdio buffers, etc.
3136
Georg Brandl116aa622007-08-15 14:28:22 +00003137 .. note::
3138
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003139 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3140 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003141
Christian Heimesfaf2f632008-01-06 16:59:19 +00003142The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003143although they are not required. These are typically used for system programs
3144written in Python, such as a mail server's external command delivery program.
3145
3146.. note::
3147
3148 Some of these may not be available on all Unix platforms, since there is some
3149 variation. These constants are defined where they are defined by the underlying
3150 platform.
3151
3152
3153.. data:: EX_OK
3154
Benjamin Petersonf650e462010-05-06 23:03:05 +00003155 Exit code that means no error occurred.
3156
3157 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003158
Georg Brandl116aa622007-08-15 14:28:22 +00003159
3160.. data:: EX_USAGE
3161
3162 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003163 number of arguments are given.
3164
3165 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003166
Georg Brandl116aa622007-08-15 14:28:22 +00003167
3168.. data:: EX_DATAERR
3169
Benjamin Petersonf650e462010-05-06 23:03:05 +00003170 Exit code that means the input data was incorrect.
3171
3172 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003173
Georg Brandl116aa622007-08-15 14:28:22 +00003174
3175.. data:: EX_NOINPUT
3176
3177 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003178
Georg Brandlc575c902008-09-13 17:46:05 +00003179 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003180
Georg Brandl116aa622007-08-15 14:28:22 +00003181
3182.. data:: EX_NOUSER
3183
Benjamin Petersonf650e462010-05-06 23:03:05 +00003184 Exit code that means a specified user did not exist.
3185
3186 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003187
Georg Brandl116aa622007-08-15 14:28:22 +00003188
3189.. data:: EX_NOHOST
3190
Benjamin Petersonf650e462010-05-06 23:03:05 +00003191 Exit code that means a specified host did not exist.
3192
3193 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003194
Georg Brandl116aa622007-08-15 14:28:22 +00003195
3196.. data:: EX_UNAVAILABLE
3197
Benjamin Petersonf650e462010-05-06 23:03:05 +00003198 Exit code that means that a required service is unavailable.
3199
3200 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003201
Georg Brandl116aa622007-08-15 14:28:22 +00003202
3203.. data:: EX_SOFTWARE
3204
Benjamin Petersonf650e462010-05-06 23:03:05 +00003205 Exit code that means an internal software error was detected.
3206
3207 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003208
Georg Brandl116aa622007-08-15 14:28:22 +00003209
3210.. data:: EX_OSERR
3211
3212 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003213 inability to fork or create a pipe.
3214
3215 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003216
Georg Brandl116aa622007-08-15 14:28:22 +00003217
3218.. data:: EX_OSFILE
3219
3220 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003221 some other kind of error.
3222
3223 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003224
Georg Brandl116aa622007-08-15 14:28:22 +00003225
3226.. data:: EX_CANTCREAT
3227
3228 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003229
Georg Brandlc575c902008-09-13 17:46:05 +00003230 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003231
Georg Brandl116aa622007-08-15 14:28:22 +00003232
3233.. data:: EX_IOERR
3234
3235 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003236
Georg Brandlc575c902008-09-13 17:46:05 +00003237 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003238
Georg Brandl116aa622007-08-15 14:28:22 +00003239
3240.. data:: EX_TEMPFAIL
3241
3242 Exit code that means a temporary failure occurred. This indicates something
3243 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003244 made during a retryable operation.
3245
3246 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003247
Georg Brandl116aa622007-08-15 14:28:22 +00003248
3249.. data:: EX_PROTOCOL
3250
3251 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003252 understood.
3253
3254 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003255
Georg Brandl116aa622007-08-15 14:28:22 +00003256
3257.. data:: EX_NOPERM
3258
3259 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003260 operation (but not intended for file system problems).
3261
3262 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003263
Georg Brandl116aa622007-08-15 14:28:22 +00003264
3265.. data:: EX_CONFIG
3266
3267 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003268
Georg Brandlc575c902008-09-13 17:46:05 +00003269 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003270
Georg Brandl116aa622007-08-15 14:28:22 +00003271
3272.. data:: EX_NOTFOUND
3273
Benjamin Petersonf650e462010-05-06 23:03:05 +00003274 Exit code that means something like "an entry was not found".
3275
3276 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003277
Georg Brandl116aa622007-08-15 14:28:22 +00003278
3279.. function:: fork()
3280
Christian Heimesfaf2f632008-01-06 16:59:19 +00003281 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003282 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003283
Larry Hastings3732ed22014-03-15 21:13:56 -07003284 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003285 known issues when using fork() from a thread.
3286
Christian Heimes3046fe42013-10-29 21:08:56 +01003287 .. warning::
3288
3289 See :mod:`ssl` for applications that use the SSL module with fork().
3290
Georg Brandlc575c902008-09-13 17:46:05 +00003291 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003292
3293
3294.. function:: forkpty()
3295
3296 Fork a child process, using a new pseudo-terminal as the child's controlling
3297 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3298 new child's process id in the parent, and *fd* is the file descriptor of the
3299 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003300 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003301
Georg Brandlc575c902008-09-13 17:46:05 +00003302 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003303
3304
3305.. function:: kill(pid, sig)
3306
3307 .. index::
3308 single: process; killing
3309 single: process; signalling
3310
3311 Send signal *sig* to the process *pid*. Constants for the specific signals
3312 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003313
3314 Windows: The :data:`signal.CTRL_C_EVENT` and
3315 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3316 only be sent to console processes which share a common console window,
3317 e.g., some subprocesses. Any other value for *sig* will cause the process
3318 to be unconditionally killed by the TerminateProcess API, and the exit code
3319 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3320 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003321
Victor Stinnerb3e72192011-05-08 01:46:11 +02003322 See also :func:`signal.pthread_kill`.
3323
Georg Brandl67b21b72010-08-17 15:07:14 +00003324 .. versionadded:: 3.2
3325 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003326
Georg Brandl116aa622007-08-15 14:28:22 +00003327
3328.. function:: killpg(pgid, sig)
3329
3330 .. index::
3331 single: process; killing
3332 single: process; signalling
3333
Benjamin Petersonf650e462010-05-06 23:03:05 +00003334 Send the signal *sig* to the process group *pgid*.
3335
3336 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003337
Georg Brandl116aa622007-08-15 14:28:22 +00003338
3339.. function:: nice(increment)
3340
3341 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003342
Georg Brandlc575c902008-09-13 17:46:05 +00003343 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003344
3345
3346.. function:: plock(op)
3347
3348 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003349 ``<sys/lock.h>``) determines which segments are locked.
3350
3351 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003352
3353
Martin Panterbf19d162015-09-09 01:01:13 +00003354.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003355
Martin Panterbf19d162015-09-09 01:01:13 +00003356 Open a pipe to or from command *cmd*.
3357 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003358 connected to the pipe, which can be read or written depending on whether *mode*
3359 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3360 the corresponding argument to the built-in :func:`open` function. The
3361 returned file object reads or writes text strings rather than bytes.
3362
3363 The ``close`` method returns :const:`None` if the subprocess exited
3364 successfully, or the subprocess's return code if there was an
3365 error. On POSIX systems, if the return code is positive it
3366 represents the return value of the process left-shifted by one
3367 byte. If the return code is negative, the process was terminated
3368 by the signal given by the negated value of the return code. (For
3369 example, the return value might be ``- signal.SIGKILL`` if the
3370 subprocess was killed.) On Windows systems, the return value
3371 contains the signed integer return code from the child process.
3372
3373 This is implemented using :class:`subprocess.Popen`; see that class's
3374 documentation for more powerful ways to manage and communicate with
3375 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003376
3377
Gregory P. Smith163468a2017-05-29 10:03:41 -07003378.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3379 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003380
Gregory P. Smith163468a2017-05-29 10:03:41 -07003381 Register callables to be executed when a new child process is forked
3382 using :func:`os.fork` or similar process cloning APIs.
3383 The parameters are optional and keyword-only.
3384 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003385
Gregory P. Smith163468a2017-05-29 10:03:41 -07003386 * *before* is a function called before forking a child process.
3387 * *after_in_parent* is a function called from the parent process
3388 after forking a child process.
3389 * *after_in_child* is a function called from the child process.
3390
3391 These calls are only made if control is expected to return to the
3392 Python interpreter. A typical :mod:`subprocess` launch will not
3393 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003394
3395 Functions registered for execution before forking are called in
3396 reverse registration order. Functions registered for execution
3397 after forking (either in the parent or in the child) are called
3398 in registration order.
3399
3400 Note that :c:func:`fork` calls made by third-party C code may not
3401 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3402 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3403
Gregory P. Smith163468a2017-05-29 10:03:41 -07003404 There is no way to unregister a function.
3405
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003406 Availability: Unix.
3407
3408 .. versionadded:: 3.7
3409
3410
Georg Brandl116aa622007-08-15 14:28:22 +00003411.. function:: spawnl(mode, path, ...)
3412 spawnle(mode, path, ..., env)
3413 spawnlp(mode, file, ...)
3414 spawnlpe(mode, file, ..., env)
3415 spawnv(mode, path, args)
3416 spawnve(mode, path, args, env)
3417 spawnvp(mode, file, args)
3418 spawnvpe(mode, file, args, env)
3419
3420 Execute the program *path* in a new process.
3421
3422 (Note that the :mod:`subprocess` module provides more powerful facilities for
3423 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003424 preferable to using these functions. Check especially the
3425 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003426
Christian Heimesfaf2f632008-01-06 16:59:19 +00003427 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003428 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3429 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003430 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003431 be used with the :func:`waitpid` function.
3432
Serhiy Storchakadab83542013-10-13 20:12:43 +03003433 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003434 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003435 to work with if the number of parameters is fixed when the code is written; the
3436 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003437 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003438 parameters is variable, with the arguments being passed in a list or tuple as
3439 the *args* parameter. In either case, the arguments to the child process must
3440 start with the name of the command being run.
3441
Christian Heimesfaf2f632008-01-06 16:59:19 +00003442 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003443 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3444 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003445 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003446 discussed in the next paragraph), the new environment is used as the source of
3447 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3448 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3449 :envvar:`PATH` variable to locate the executable; *path* must contain an
3450 appropriate absolute or relative path.
3451
3452 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003453 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003454 which is used to define the environment variables for the new process (they are
3455 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003456 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003457 the new process to inherit the environment of the current process. Note that
3458 keys and values in the *env* dictionary must be strings; invalid keys or
3459 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003460
3461 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3462 equivalent::
3463
3464 import os
3465 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3466
3467 L = ['cp', 'index.html', '/dev/null']
3468 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3469
3470 Availability: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
Antoine Pitrou0e752dd2011-07-19 01:26:58 +02003471 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3472 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3473 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003474
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003475 .. versionchanged:: 3.6
3476 Accepts a :term:`path-like object`.
3477
Georg Brandl116aa622007-08-15 14:28:22 +00003478
3479.. data:: P_NOWAIT
3480 P_NOWAITO
3481
Serhiy Storchakadab83542013-10-13 20:12:43 +03003482 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003483 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003484 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003485 the return value.
3486
3487 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003488
Georg Brandl116aa622007-08-15 14:28:22 +00003489
3490.. data:: P_WAIT
3491
Serhiy Storchakadab83542013-10-13 20:12:43 +03003492 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003493 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3494 return until the new process has run to completion and will return the exit code
3495 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003496 process.
3497
3498 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003499
Georg Brandl116aa622007-08-15 14:28:22 +00003500
3501.. data:: P_DETACH
3502 P_OVERLAY
3503
Serhiy Storchakadab83542013-10-13 20:12:43 +03003504 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003505 functions. These are less portable than those listed above. :const:`P_DETACH`
3506 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3507 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003508 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003509
Georg Brandl116aa622007-08-15 14:28:22 +00003510 Availability: Windows.
3511
Georg Brandl116aa622007-08-15 14:28:22 +00003512
3513.. function:: startfile(path[, operation])
3514
3515 Start a file with its associated application.
3516
3517 When *operation* is not specified or ``'open'``, this acts like double-clicking
3518 the file in Windows Explorer, or giving the file name as an argument to the
3519 :program:`start` command from the interactive command shell: the file is opened
3520 with whatever application (if any) its extension is associated.
3521
3522 When another *operation* is given, it must be a "command verb" that specifies
3523 what should be done with the file. Common verbs documented by Microsoft are
3524 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3525 ``'find'`` (to be used on directories).
3526
3527 :func:`startfile` returns as soon as the associated application is launched.
3528 There is no option to wait for the application to close, and no way to retrieve
3529 the application's exit status. The *path* parameter is relative to the current
3530 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003531 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003532 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003533 the path is properly encoded for Win32.
3534
Steve Dower7d0e0c92015-01-24 08:18:24 -08003535 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3536 function is not resolved until this function is first called. If the function
3537 cannot be resolved, :exc:`NotImplementedError` will be raised.
3538
Benjamin Petersonf650e462010-05-06 23:03:05 +00003539 Availability: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003540
Georg Brandl116aa622007-08-15 14:28:22 +00003541
3542.. function:: system(command)
3543
3544 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003545 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003546 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3547 the executed command. If *command* generates any output, it will be sent to
3548 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003549
3550 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003551 format specified for :func:`wait`. Note that POSIX does not specify the
3552 meaning of the return value of the C :c:func:`system` function, so the return
3553 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003554
Georg Brandl8f7b4272010-10-14 06:35:53 +00003555 On Windows, the return value is that returned by the system shell after
3556 running *command*. The shell is given by the Windows environment variable
3557 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3558 status of the command run; on systems using a non-native shell, consult your
3559 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003560
Georg Brandl8f7b4272010-10-14 06:35:53 +00003561 The :mod:`subprocess` module provides more powerful facilities for spawning
3562 new processes and retrieving their results; using that module is preferable
3563 to using this function. See the :ref:`subprocess-replacements` section in
3564 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003565
Benjamin Petersonf650e462010-05-06 23:03:05 +00003566 Availability: Unix, Windows.
3567
Georg Brandl116aa622007-08-15 14:28:22 +00003568
3569.. function:: times()
3570
Larry Hastings605a62d2012-06-24 04:33:36 -07003571 Returns the current global process times.
3572 The return value is an object with five attributes:
3573
3574 * :attr:`user` - user time
3575 * :attr:`system` - system time
3576 * :attr:`children_user` - user time of all child processes
3577 * :attr:`children_system` - system time of all child processes
3578 * :attr:`elapsed` - elapsed real time since a fixed point in the past
3579
3580 For backwards compatibility, this object also behaves like a five-tuple
3581 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
3582 :attr:`children_system`, and :attr:`elapsed` in that order.
3583
3584 See the Unix manual page
Benjamin Petersonf650e462010-05-06 23:03:05 +00003585 :manpage:`times(2)` or the corresponding Windows Platform API documentation.
Larry Hastings605a62d2012-06-24 04:33:36 -07003586 On Windows, only :attr:`user` and :attr:`system` are known; the other
3587 attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003588
Georg Brandl8a5555f2012-06-24 13:29:09 +02003589 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003590
Larry Hastings605a62d2012-06-24 04:33:36 -07003591 .. versionchanged:: 3.3
3592 Return type changed from a tuple to a tuple-like object
3593 with named attributes.
3594
Georg Brandl116aa622007-08-15 14:28:22 +00003595
3596.. function:: wait()
3597
3598 Wait for completion of a child process, and return a tuple containing its pid
3599 and exit status indication: a 16-bit number, whose low byte is the signal number
3600 that killed the process, and whose high byte is the exit status (if the signal
3601 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003602 produced.
3603
3604 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003605
Ross Lagerwall7807c352011-03-17 20:20:30 +02003606.. function:: waitid(idtype, id, options)
3607
3608 Wait for the completion of one or more child processes.
3609 *idtype* can be :data:`P_PID`, :data:`P_PGID` or :data:`P_ALL`.
3610 *id* specifies the pid to wait on.
3611 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
3612 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
3613 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
3614 representing the data contained in the :c:type:`siginfo_t` structure, namely:
3615 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
3616 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
3617 children in a waitable state.
3618
3619 Availability: Unix.
3620
3621 .. versionadded:: 3.3
3622
3623.. data:: P_PID
3624 P_PGID
3625 P_ALL
3626
3627 These are the possible values for *idtype* in :func:`waitid`. They affect
3628 how *id* is interpreted.
3629
3630 Availability: Unix.
3631
3632 .. versionadded:: 3.3
3633
3634.. data:: WEXITED
3635 WSTOPPED
3636 WNOWAIT
3637
3638 Flags that can be used in *options* in :func:`waitid` that specify what
3639 child signal to wait for.
3640
3641 Availability: Unix.
3642
3643 .. versionadded:: 3.3
3644
3645
3646.. data:: CLD_EXITED
3647 CLD_DUMPED
3648 CLD_TRAPPED
3649 CLD_CONTINUED
3650
3651 These are the possible values for :attr:`si_code` in the result returned by
3652 :func:`waitid`.
3653
3654 Availability: Unix.
3655
3656 .. versionadded:: 3.3
3657
Georg Brandl116aa622007-08-15 14:28:22 +00003658
3659.. function:: waitpid(pid, options)
3660
3661 The details of this function differ on Unix and Windows.
3662
3663 On Unix: Wait for completion of a child process given by process id *pid*, and
3664 return a tuple containing its process id and exit status indication (encoded as
3665 for :func:`wait`). The semantics of the call are affected by the value of the
3666 integer *options*, which should be ``0`` for normal operation.
3667
3668 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
3669 that specific process. If *pid* is ``0``, the request is for the status of any
3670 child in the process group of the current process. If *pid* is ``-1``, the
3671 request pertains to any child of the current process. If *pid* is less than
3672 ``-1``, status is requested for any process in the process group ``-pid`` (the
3673 absolute value of *pid*).
3674
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00003675 An :exc:`OSError` is raised with the value of errno when the syscall
3676 returns -1.
3677
Georg Brandl116aa622007-08-15 14:28:22 +00003678 On Windows: Wait for completion of a process given by process handle *pid*, and
3679 return a tuple containing *pid*, and its exit status shifted left by 8 bits
3680 (shifting makes cross-platform use of the function easier). A *pid* less than or
3681 equal to ``0`` has no special meaning on Windows, and raises an exception. The
3682 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03003683 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
3684 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00003685
Victor Stinnera766ddf2015-03-26 23:50:57 +01003686 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02003687 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01003688 exception, the function now retries the system call instead of raising an
3689 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
3690
Georg Brandl116aa622007-08-15 14:28:22 +00003691
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02003692.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00003693
3694 Similar to :func:`waitpid`, except no process id argument is given and a
3695 3-element tuple containing the child's process id, exit status indication, and
3696 resource usage information is returned. Refer to :mod:`resource`.\
Serhiy Storchakadab83542013-10-13 20:12:43 +03003697 :func:`~resource.getrusage` for details on resource usage information. The
3698 option argument is the same as that provided to :func:`waitpid` and
3699 :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003700
Georg Brandl116aa622007-08-15 14:28:22 +00003701 Availability: Unix.
3702
Georg Brandl116aa622007-08-15 14:28:22 +00003703
Victor Stinner4195b5c2012-02-08 23:03:19 +01003704.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00003705
3706 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
3707 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03003708 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
3709 resource usage information. The arguments to :func:`wait4` are the same
3710 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003711
3712 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003713
Georg Brandl116aa622007-08-15 14:28:22 +00003714
3715.. data:: WNOHANG
3716
3717 The option for :func:`waitpid` to return immediately if no child process status
3718 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003719
Georg Brandlc575c902008-09-13 17:46:05 +00003720 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003721
3722
3723.. data:: WCONTINUED
3724
3725 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00003726 from a job control stop since their status was last reported.
3727
Georg Brandl8a5555f2012-06-24 13:29:09 +02003728 Availability: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00003729
Georg Brandl116aa622007-08-15 14:28:22 +00003730
3731.. data:: WUNTRACED
3732
3733 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00003734 their current state has not been reported since they were stopped.
3735
3736 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003737
Georg Brandl116aa622007-08-15 14:28:22 +00003738
3739The following functions take a process status code as returned by
3740:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
3741used to determine the disposition of a process.
3742
Georg Brandl116aa622007-08-15 14:28:22 +00003743.. function:: WCOREDUMP(status)
3744
Christian Heimesfaf2f632008-01-06 16:59:19 +00003745 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00003746 return ``False``.
3747
3748 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003749
Georg Brandl116aa622007-08-15 14:28:22 +00003750
3751.. function:: WIFCONTINUED(status)
3752
Christian Heimesfaf2f632008-01-06 16:59:19 +00003753 Return ``True`` if the process has been continued from a job control stop,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003754 otherwise return ``False``.
3755
3756 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003757
Georg Brandl116aa622007-08-15 14:28:22 +00003758
3759.. function:: WIFSTOPPED(status)
3760
Christian Heimesfaf2f632008-01-06 16:59:19 +00003761 Return ``True`` if the process has been stopped, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003762 ``False``.
3763
3764 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003765
3766
3767.. function:: WIFSIGNALED(status)
3768
Christian Heimesfaf2f632008-01-06 16:59:19 +00003769 Return ``True`` if the process exited due to a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003770 ``False``.
3771
3772 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003773
3774
3775.. function:: WIFEXITED(status)
3776
Christian Heimesfaf2f632008-01-06 16:59:19 +00003777 Return ``True`` if the process exited using the :manpage:`exit(2)` system call,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003778 otherwise return ``False``.
3779
3780 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003781
3782
3783.. function:: WEXITSTATUS(status)
3784
3785 If ``WIFEXITED(status)`` is true, return the integer parameter to the
3786 :manpage:`exit(2)` system call. Otherwise, the return value is meaningless.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003787
Georg Brandlc575c902008-09-13 17:46:05 +00003788 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003789
3790
3791.. function:: WSTOPSIG(status)
3792
Benjamin Petersonf650e462010-05-06 23:03:05 +00003793 Return the signal which caused the process to stop.
3794
3795 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003796
3797
3798.. function:: WTERMSIG(status)
3799
Benjamin Petersonf650e462010-05-06 23:03:05 +00003800 Return the signal which caused the process to exit.
3801
3802 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003803
3804
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003805Interface to the scheduler
3806--------------------------
3807
3808These functions control how a process is allocated CPU time by the operating
3809system. They are only available on some Unix platforms. For more detailed
3810information, consult your Unix manpages.
3811
3812.. versionadded:: 3.3
3813
Andrew Kuchling4921a082013-06-21 11:49:57 -04003814The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003815operating system.
3816
3817.. data:: SCHED_OTHER
3818
3819 The default scheduling policy.
3820
3821.. data:: SCHED_BATCH
3822
3823 Scheduling policy for CPU-intensive processes that tries to preserve
3824 interactivity on the rest of the computer.
3825
3826.. data:: SCHED_IDLE
3827
3828 Scheduling policy for extremely low priority background tasks.
3829
3830.. data:: SCHED_SPORADIC
3831
3832 Scheduling policy for sporadic server programs.
3833
3834.. data:: SCHED_FIFO
3835
3836 A First In First Out scheduling policy.
3837
3838.. data:: SCHED_RR
3839
3840 A round-robin scheduling policy.
3841
3842.. data:: SCHED_RESET_ON_FORK
3843
Martin Panter8d56c022016-05-29 04:13:35 +00003844 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003845 this flag set forks, its child's scheduling policy and priority are reset to
3846 the default.
3847
3848
3849.. class:: sched_param(sched_priority)
3850
3851 This class represents tunable scheduling parameters used in
3852 :func:`sched_setparam`, :func:`sched_setscheduler`, and
3853 :func:`sched_getparam`. It is immutable.
3854
3855 At the moment, there is only one possible parameter:
3856
3857 .. attribute:: sched_priority
3858
3859 The scheduling priority for a scheduling policy.
3860
3861
3862.. function:: sched_get_priority_min(policy)
3863
3864 Get the minimum priority value for *policy*. *policy* is one of the
3865 scheduling policy constants above.
3866
3867
3868.. function:: sched_get_priority_max(policy)
3869
3870 Get the maximum priority value for *policy*. *policy* is one of the
3871 scheduling policy constants above.
3872
3873
3874.. function:: sched_setscheduler(pid, policy, param)
3875
3876 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
3877 the calling process. *policy* is one of the scheduling policy constants
3878 above. *param* is a :class:`sched_param` instance.
3879
3880
3881.. function:: sched_getscheduler(pid)
3882
3883 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
3884 means the calling process. The result is one of the scheduling policy
3885 constants above.
3886
3887
3888.. function:: sched_setparam(pid, param)
3889
3890 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
3891 the calling process. *param* is a :class:`sched_param` instance.
3892
3893
3894.. function:: sched_getparam(pid)
3895
3896 Return the scheduling parameters as a :class:`sched_param` instance for the
3897 process with PID *pid*. A *pid* of 0 means the calling process.
3898
3899
3900.. function:: sched_rr_get_interval(pid)
3901
3902 Return the round-robin quantum in seconds for the process with PID *pid*. A
3903 *pid* of 0 means the calling process.
3904
3905
3906.. function:: sched_yield()
3907
3908 Voluntarily relinquish the CPU.
3909
3910
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003911.. function:: sched_setaffinity(pid, mask)
3912
Antoine Pitrou84869872012-08-04 16:16:35 +02003913 Restrict the process with PID *pid* (or the current process if zero) to a
3914 set of CPUs. *mask* is an iterable of integers representing the set of
3915 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003916
3917
Antoine Pitrou84869872012-08-04 16:16:35 +02003918.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003919
Antoine Pitrou84869872012-08-04 16:16:35 +02003920 Return the set of CPUs the process with PID *pid* (or the current process
3921 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003922
3923
Georg Brandl116aa622007-08-15 14:28:22 +00003924.. _os-path:
3925
3926Miscellaneous System Information
3927--------------------------------
3928
3929
3930.. function:: confstr(name)
3931
3932 Return string-valued system configuration values. *name* specifies the
3933 configuration value to retrieve; it may be a string which is the name of a
3934 defined system value; these names are specified in a number of standards (POSIX,
3935 Unix 95, Unix 98, and others). Some platforms define additional names as well.
3936 The names known to the host operating system are given as the keys of the
3937 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003938 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00003939
3940 If the configuration value specified by *name* isn't defined, ``None`` is
3941 returned.
3942
3943 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
3944 specific value for *name* is not supported by the host system, even if it is
3945 included in ``confstr_names``, an :exc:`OSError` is raised with
3946 :const:`errno.EINVAL` for the error number.
3947
Georg Brandl8a5555f2012-06-24 13:29:09 +02003948 Availability: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003949
Georg Brandl116aa622007-08-15 14:28:22 +00003950
3951.. data:: confstr_names
3952
3953 Dictionary mapping names accepted by :func:`confstr` to the integer values
3954 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003955 determine the set of names known to the system.
3956
3957 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003958
3959
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003960.. function:: cpu_count()
3961
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03003962 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003963
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01003964 This number is not equivalent to the number of CPUs the current process can
3965 use. The number of usable CPUs can be obtained with
3966 ``len(os.sched_getaffinity(0))``
3967
3968
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003969 .. versionadded:: 3.4
3970
3971
Georg Brandl116aa622007-08-15 14:28:22 +00003972.. function:: getloadavg()
3973
Christian Heimesa62da1d2008-01-12 19:39:10 +00003974 Return the number of processes in the system run queue averaged over the last
3975 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003976 unobtainable.
3977
3978 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003979
Georg Brandl116aa622007-08-15 14:28:22 +00003980
3981.. function:: sysconf(name)
3982
3983 Return integer-valued system configuration values. If the configuration value
3984 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
3985 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
3986 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003987
Georg Brandlc575c902008-09-13 17:46:05 +00003988 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003989
3990
3991.. data:: sysconf_names
3992
3993 Dictionary mapping names accepted by :func:`sysconf` to the integer values
3994 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003995 determine the set of names known to the system.
3996
3997 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003998
Christian Heimesfaf2f632008-01-06 16:59:19 +00003999The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00004000are defined for all platforms.
4001
4002Higher-level operations on pathnames are defined in the :mod:`os.path` module.
4003
4004
4005.. data:: curdir
4006
4007 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00004008 directory. This is ``'.'`` for Windows and POSIX. Also available via
4009 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004010
4011
4012.. data:: pardir
4013
4014 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00004015 directory. This is ``'..'`` for Windows and POSIX. Also available via
4016 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004017
4018
4019.. data:: sep
4020
Georg Brandlc575c902008-09-13 17:46:05 +00004021 The character used by the operating system to separate pathname components.
4022 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
4023 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00004024 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
4025 useful. Also available via :mod:`os.path`.
4026
4027
4028.. data:: altsep
4029
4030 An alternative character used by the operating system to separate pathname
4031 components, or ``None`` if only one separator character exists. This is set to
4032 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
4033 :mod:`os.path`.
4034
4035
4036.. data:: extsep
4037
4038 The character which separates the base filename from the extension; for example,
4039 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
4040
Georg Brandl116aa622007-08-15 14:28:22 +00004041
4042.. data:: pathsep
4043
4044 The character conventionally used by the operating system to separate search
4045 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
4046 Windows. Also available via :mod:`os.path`.
4047
4048
4049.. data:: defpath
4050
Serhiy Storchakadab83542013-10-13 20:12:43 +03004051 The default search path used by :func:`exec\*p\* <execl>` and
4052 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
4053 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004054
4055
4056.. data:: linesep
4057
4058 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00004059 platform. This may be a single character, such as ``'\n'`` for POSIX, or
4060 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
4061 *os.linesep* as a line terminator when writing files opened in text mode (the
4062 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00004063
4064
4065.. data:: devnull
4066
Georg Brandl850a9902010-05-21 22:04:32 +00004067 The file path of the null device. For example: ``'/dev/null'`` for
4068 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004069
Andrew Kuchling4921a082013-06-21 11:49:57 -04004070.. data:: RTLD_LAZY
4071 RTLD_NOW
4072 RTLD_GLOBAL
4073 RTLD_LOCAL
4074 RTLD_NODELETE
4075 RTLD_NOLOAD
4076 RTLD_DEEPBIND
4077
4078 Flags for use with the :func:`~sys.setdlopenflags` and
4079 :func:`~sys.getdlopenflags` functions. See the Unix manual page
4080 :manpage:`dlopen(3)` for what the different flags mean.
4081
4082 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00004083
Georg Brandl116aa622007-08-15 14:28:22 +00004084
Victor Stinner9b1f4742016-09-06 16:18:52 -07004085Random numbers
4086--------------
Georg Brandl116aa622007-08-15 14:28:22 +00004087
4088
Victor Stinner9b1f4742016-09-06 16:18:52 -07004089.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00004090
Victor Stinner9b1f4742016-09-06 16:18:52 -07004091 Get up to *size* random bytes. The function can return less bytes than
4092 requested.
4093
4094 These bytes can be used to seed user-space random number generators or for
4095 cryptographic purposes.
4096
4097 ``getrandom()`` relies on entropy gathered from device drivers and other
4098 sources of environmental noise. Unnecessarily reading large quantities of
4099 data will have a negative impact on other users of the ``/dev/random`` and
4100 ``/dev/urandom`` devices.
4101
4102 The flags argument is a bit mask that can contain zero or more of the
4103 following values ORed together: :py:data:`os.GRND_RANDOM` and
4104 :py:data:`GRND_NONBLOCK`.
4105
4106 See also the `Linux getrandom() manual page
4107 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
4108
4109 Availability: Linux 3.17 and newer.
4110
4111 .. versionadded:: 3.6
4112
4113.. function:: urandom(size)
4114
4115 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004116
4117 This function returns random bytes from an OS-specific randomness source. The
4118 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004119 though its exact quality depends on the OS implementation.
4120
Victor Stinnere66987e2016-09-06 16:33:52 -07004121 On Linux, if the ``getrandom()`` syscall is available, it is used in
4122 blocking mode: block until the system urandom entropy pool is initialized
4123 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4124 the rationale. On Linux, the :func:`getrandom` function can be used to get
4125 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4126 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004127
Victor Stinnere66987e2016-09-06 16:33:52 -07004128 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4129 device. If the ``/dev/urandom`` device is not available or not readable, the
4130 :exc:`NotImplementedError` exception is raised.
4131
4132 On Windows, it will use ``CryptGenRandom()``.
4133
4134 .. seealso::
4135 The :mod:`secrets` module provides higher level functions. For an
4136 easy-to-use interface to the random number generator provided by your
4137 platform, please see :class:`random.SystemRandom`.
4138
4139 .. versionchanged:: 3.6.0
4140 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4141 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004142
Victor Stinnerdddf4842016-06-07 11:21:42 +02004143 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004144 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4145 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004146
Victor Stinnerace88482015-07-29 02:28:32 +02004147 .. versionchanged:: 3.5
4148 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4149 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4150 function is now used. These functions avoid the usage of an internal file
4151 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004152
4153.. data:: GRND_NONBLOCK
4154
4155 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4156 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4157 if the entropy pool has not yet been initialized.
4158
4159 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4160 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4161
4162 .. versionadded:: 3.6
4163
4164.. data:: GRND_RANDOM
4165
4166 If this bit is set, then random bytes are drawn from the
4167 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4168
4169 .. versionadded:: 3.6