blob: d937451be51e6e6b4eb8d8d2a2528f2ad3905a14 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
Benjamin Peterson1baf4652009-12-31 03:11:23 +000035* An "Availability: Unix" note means that this function is commonly found on
36 Unix systems. It does not make any claims about its existence on a specific
37 operating system.
38
39* If not separately noted, all functions that claim "Availability: Unix" are
40 supported on Mac OS X, which builds on a Unix core.
41
Benjamin Petersonf650e462010-05-06 23:03:05 +000042.. Availability notes get their own line and occur at the end of the function
43.. documentation.
44
Georg Brandlc575c902008-09-13 17:46:05 +000045.. note::
46
Christian Heimesa62da1d2008-01-12 19:39:10 +000047 All functions in this module raise :exc:`OSError` in the case of invalid or
48 inaccessible file names and paths, or other arguments that have the correct
49 type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000050
Georg Brandl116aa622007-08-15 14:28:22 +000051.. exception:: error
52
Christian Heimesa62da1d2008-01-12 19:39:10 +000053 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000054
55
56.. data:: name
57
Benjamin Peterson1baf4652009-12-31 03:11:23 +000058 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070059 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070060 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000061
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020062 .. seealso::
63 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
64 system-dependent version information.
65
66 The :mod:`platform` module provides detailed checks for the
67 system's identity.
68
Georg Brandl116aa622007-08-15 14:28:22 +000069
Martin v. Löwis011e8422009-05-05 04:43:17 +000070.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020071.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000072
73File Names, Command Line Arguments, and Environment Variables
74-------------------------------------------------------------
75
Georg Brandl67b21b72010-08-17 15:07:14 +000076In Python, file names, command line arguments, and environment variables are
77represented using the string type. On some systems, decoding these strings to
78and from bytes is necessary before passing them to the operating system. Python
79uses the file system encoding to perform this conversion (see
80:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000081
82.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000083 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020084 case, Python uses the :ref:`surrogateescape encoding error handler
85 <surrogateescape>`, which means that undecodable bytes are replaced by a
86 Unicode character U+DCxx on decoding, and these are again translated to the
87 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000088
89
Georg Brandl67b21b72010-08-17 15:07:14 +000090The file system encoding must guarantee to successfully decode all bytes
91below 128. If the file system encoding fails to provide this guarantee, API
92functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000093
94
Georg Brandl116aa622007-08-15 14:28:22 +000095.. _os-procinfo:
96
97Process Parameters
98------------------
99
100These functions and data items provide information and operate on the current
101process and user.
102
103
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200104.. function:: ctermid()
105
106 Return the filename corresponding to the controlling terminal of the process.
107
108 Availability: Unix.
109
110
Georg Brandl116aa622007-08-15 14:28:22 +0000111.. data:: environ
112
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700113 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000114 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
115 and is equivalent to ``getenv("HOME")`` in C.
116
117 This mapping is captured the first time the :mod:`os` module is imported,
118 typically during Python startup as part of processing :file:`site.py`. Changes
119 to the environment made after this time are not reflected in ``os.environ``,
120 except for changes made by modifying ``os.environ`` directly.
121
122 If the platform supports the :func:`putenv` function, this mapping may be used
123 to modify the environment as well as query the environment. :func:`putenv` will
124 be called automatically when the mapping is modified.
125
Victor Stinner84ae1182010-05-06 22:05:07 +0000126 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
127 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
128 to use a different encoding.
129
Georg Brandl116aa622007-08-15 14:28:22 +0000130 .. note::
131
132 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
133 to modify ``os.environ``.
134
135 .. note::
136
Georg Brandlc575c902008-09-13 17:46:05 +0000137 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
138 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000139 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000140
141 If :func:`putenv` is not provided, a modified copy of this mapping may be
142 passed to the appropriate process-creation functions to cause child processes
143 to use a modified environment.
144
Georg Brandl9afde1c2007-11-01 20:32:30 +0000145 If the platform supports the :func:`unsetenv` function, you can delete items in
Georg Brandl116aa622007-08-15 14:28:22 +0000146 this mapping to unset environment variables. :func:`unsetenv` will be called
Georg Brandl9afde1c2007-11-01 20:32:30 +0000147 automatically when an item is deleted from ``os.environ``, and when
148 one of the :meth:`pop` or :meth:`clear` methods is called.
149
Georg Brandl116aa622007-08-15 14:28:22 +0000150
Victor Stinner84ae1182010-05-06 22:05:07 +0000151.. data:: environb
152
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700153 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000154 environment as byte strings. :data:`environ` and :data:`environb` are
155 synchronized (modify :data:`environb` updates :data:`environ`, and vice
156 versa).
157
Victor Stinnerb745a742010-05-18 17:17:23 +0000158 :data:`environb` is only available if :data:`supports_bytes_environ` is
159 True.
Victor Stinner84ae1182010-05-06 22:05:07 +0000160
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000161 .. versionadded:: 3.2
162
Victor Stinner84ae1182010-05-06 22:05:07 +0000163
Georg Brandl116aa622007-08-15 14:28:22 +0000164.. function:: chdir(path)
165 fchdir(fd)
166 getcwd()
167 :noindex:
168
169 These functions are described in :ref:`os-file-dir`.
170
171
Victor Stinnere8d51452010-08-19 01:05:19 +0000172.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000173
Brett Cannonc28592b2016-06-24 12:21:47 -0700174 Encode :term:`path-like <path-like object>` *filename* to the filesystem
175 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
176 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000177
Antoine Pitroua305ca72010-09-25 22:12:00 +0000178 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000179
180 .. versionadded:: 3.2
181
Brett Cannonb08388d2016-06-09 15:58:06 -0700182 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700183 Support added to accept objects implementing the :class:`os.PathLike`
184 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700185
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187.. function:: fsdecode(filename)
188
Brett Cannonc28592b2016-06-24 12:21:47 -0700189 Decode the :term:`path-like <path-like object>` *filename* from the
190 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
191 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000192
193 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000194
195 .. versionadded:: 3.2
196
Brett Cannonb08388d2016-06-09 15:58:06 -0700197 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700198 Support added to accept objects implementing the :class:`os.PathLike`
199 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700200
Victor Stinner449c4662010-05-08 11:10:09 +0000201
Ethan Furmancdc08792016-06-02 15:06:09 -0700202.. function:: fspath(path)
203
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700204 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700205
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700206 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
207 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
208 returned as long as it is a :class:`str` or :class:`bytes` object.
209 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700210
Brett Cannonb08388d2016-06-09 15:58:06 -0700211 .. versionadded:: 3.6
212
213
214.. class:: PathLike
215
216 An :term:`abstract base class` for objects representing a file system path,
217 e.g. :class:`pathlib.PurePath`.
218
Berker Peksagb18ffb42016-06-10 08:43:54 +0300219 .. versionadded:: 3.6
220
Brett Cannonb08388d2016-06-09 15:58:06 -0700221 .. abstractmethod:: __fspath__()
222
223 Return the file system path representation of the object.
224
225 The method should only return a :class:`str` or :class:`bytes` object,
226 with the preference being for :class:`str`.
227
Ethan Furmancdc08792016-06-02 15:06:09 -0700228
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200229.. function:: getenv(key, default=None)
230
231 Return the value of the environment variable *key* if it exists, or
232 *default* if it doesn't. *key*, *default* and the result are str.
233
234 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
235 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
236 would like to use a different encoding.
237
238 Availability: most flavors of Unix, Windows.
239
240
241.. function:: getenvb(key, default=None)
242
243 Return the value of the environment variable *key* if it exists, or
244 *default* if it doesn't. *key*, *default* and the result are bytes.
245
Berker Peksag996e5f92016-09-26 22:44:07 +0300246 :func:`getenvb` is only available if :data:`supports_bytes_environ`
247 is True.
248
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200249 Availability: most flavors of Unix.
250
251 .. versionadded:: 3.2
252
253
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000254.. function:: get_exec_path(env=None)
255
256 Returns the list of directories that will be searched for a named
257 executable, similar to a shell, when launching a process.
258 *env*, when specified, should be an environment variable dictionary
259 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300260 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000261
262 .. versionadded:: 3.2
263
264
Georg Brandl116aa622007-08-15 14:28:22 +0000265.. function:: getegid()
266
267 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000268 "set id" bit on the file being executed in the current process.
269
270 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000271
272
273.. function:: geteuid()
274
275 .. index:: single: user; effective id
276
Benjamin Petersonf650e462010-05-06 23:03:05 +0000277 Return the current process's effective user id.
278
279 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000280
281
282.. function:: getgid()
283
284 .. index:: single: process; group
285
Benjamin Petersonf650e462010-05-06 23:03:05 +0000286 Return the real group id of the current process.
287
288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000289
290
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200291.. function:: getgrouplist(user, group)
292
293 Return list of group ids that *user* belongs to. If *group* is not in the
294 list, it is included; typically, *group* is specified as the group ID
295 field from the password record for *user*.
296
297 Availability: Unix.
298
299 .. versionadded:: 3.3
300
301
Georg Brandl116aa622007-08-15 14:28:22 +0000302.. function:: getgroups()
303
304 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000305
Georg Brandl116aa622007-08-15 14:28:22 +0000306 Availability: Unix.
307
Larry Hastings3732ed22014-03-15 21:13:56 -0700308 .. note::
309
310 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700311 other Unix platforms. If the Python interpreter was built with a
312 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
313 the list of effective group ids associated with the current user process;
314 this list is limited to a system-defined number of entries, typically 16,
315 and may be modified by calls to :func:`setgroups` if suitably privileged.
316 If built with a deployment target greater than :const:`10.5`,
317 :func:`getgroups` returns the current group access list for the user
318 associated with the effective user id of the process; the group access
319 list may change over the lifetime of the process, it is not affected by
320 calls to :func:`setgroups`, and its length is not limited to 16. The
321 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
322 obtained with :func:`sysconfig.get_config_var`.
323
Georg Brandl116aa622007-08-15 14:28:22 +0000324
325.. function:: getlogin()
326
327 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500328 process. For most purposes, it is more useful to use
329 :func:`getpass.getuser` since the latter checks the environment variables
330 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
331 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
332 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000333
Brian Curtine8e4b3b2010-09-23 20:04:14 +0000334 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
336
337.. function:: getpgid(pid)
338
339 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000340 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000341
Benjamin Petersonf650e462010-05-06 23:03:05 +0000342 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000343
344.. function:: getpgrp()
345
346 .. index:: single: process; group
347
Benjamin Petersonf650e462010-05-06 23:03:05 +0000348 Return the id of the current process group.
349
350 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000351
352
353.. function:: getpid()
354
355 .. index:: single: process; id
356
Benjamin Petersonf650e462010-05-06 23:03:05 +0000357 Return the current process id.
358
Georg Brandl116aa622007-08-15 14:28:22 +0000359
360.. function:: getppid()
361
362 .. index:: single: process; id of parent
363
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000364 Return the parent's process id. When the parent process has exited, on Unix
365 the id returned is the one of the init process (1), on Windows it is still
366 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000367
Georg Brandl8a5555f2012-06-24 13:29:09 +0200368 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000369
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000370 .. versionchanged:: 3.2
371 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000372
Georg Brandl8a5555f2012-06-24 13:29:09 +0200373
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000374.. function:: getpriority(which, who)
375
376 .. index:: single: process; scheduling priority
377
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200378 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000379 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
380 is interpreted relative to *which* (a process identifier for
381 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200382 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000383 (respectively) the calling process, the process group of the calling process,
384 or the real user ID of the calling process.
385
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200386 Availability: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000387
388 .. versionadded:: 3.3
389
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200390
391.. data:: PRIO_PROCESS
392 PRIO_PGRP
393 PRIO_USER
394
395 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
396
397 Availability: Unix.
398
399 .. versionadded:: 3.3
400
401
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000402.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000403
404 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000405 real, effective, and saved user ids.
406
407 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000408
Georg Brandl1b83a452009-11-28 11:12:26 +0000409 .. versionadded:: 3.2
410
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000411
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000412.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000413
414 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000415 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000416
417 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000418
Georg Brandl1b83a452009-11-28 11:12:26 +0000419 .. versionadded:: 3.2
420
Georg Brandl116aa622007-08-15 14:28:22 +0000421
422.. function:: getuid()
423
424 .. index:: single: user; id
425
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700426 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000427
428 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000429
430
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200431.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000432
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200433 Call the system initgroups() to initialize the group access list with all of
434 the groups of which the specified username is a member, plus the specified
435 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000436
437 Availability: Unix.
438
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200439 .. versionadded:: 3.2
440
Georg Brandl116aa622007-08-15 14:28:22 +0000441
Georg Brandl18244152009-09-02 20:34:52 +0000442.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000443
444 .. index:: single: environment variables; setting
445
Georg Brandl18244152009-09-02 20:34:52 +0000446 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000447 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000448 :func:`popen` or :func:`fork` and :func:`execv`.
449
450 Availability: most flavors of Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000451
452 .. note::
453
Georg Brandlc575c902008-09-13 17:46:05 +0000454 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
455 cause memory leaks. Refer to the system documentation for putenv.
Georg Brandl116aa622007-08-15 14:28:22 +0000456
457 When :func:`putenv` is supported, assignments to items in ``os.environ`` are
458 automatically translated into corresponding calls to :func:`putenv`; however,
459 calls to :func:`putenv` don't update ``os.environ``, so it is actually
460 preferable to assign to items of ``os.environ``.
461
462
463.. function:: setegid(egid)
464
Benjamin Petersonf650e462010-05-06 23:03:05 +0000465 Set the current process's effective group id.
466
467 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000468
469
470.. function:: seteuid(euid)
471
Benjamin Petersonf650e462010-05-06 23:03:05 +0000472 Set the current process's effective user id.
473
474 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000475
476
477.. function:: setgid(gid)
478
Benjamin Petersonf650e462010-05-06 23:03:05 +0000479 Set the current process' group id.
480
481 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000482
483
484.. function:: setgroups(groups)
485
486 Set the list of supplemental group ids associated with the current process to
487 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000488 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000489
Georg Brandl116aa622007-08-15 14:28:22 +0000490 Availability: Unix.
491
Ned Deily2e209682012-04-30 11:14:02 -0700492 .. note:: On Mac OS X, the length of *groups* may not exceed the
493 system-defined maximum number of effective group ids, typically 16.
494 See the documentation for :func:`getgroups` for cases where it may not
495 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000496
497.. function:: setpgrp()
498
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300499 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000500 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000501
Georg Brandl116aa622007-08-15 14:28:22 +0000502 Availability: Unix.
503
504
505.. function:: setpgid(pid, pgrp)
506
Georg Brandl60203b42010-10-06 10:11:56 +0000507 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000508 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000509 for the semantics.
510
511 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000512
513
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000514.. function:: setpriority(which, who, priority)
515
516 .. index:: single: process; scheduling priority
517
518 Set program scheduling priority. The value *which* is one of
519 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
520 is interpreted relative to *which* (a process identifier for
521 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
522 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
523 (respectively) the calling process, the process group of the calling process,
524 or the real user ID of the calling process.
525 *priority* is a value in the range -20 to 19. The default priority is 0;
526 lower priorities cause more favorable scheduling.
527
528 Availability: Unix
529
530 .. versionadded:: 3.3
531
532
Georg Brandl116aa622007-08-15 14:28:22 +0000533.. function:: setregid(rgid, egid)
534
Benjamin Petersonf650e462010-05-06 23:03:05 +0000535 Set the current process's real and effective group ids.
536
537 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000538
Georg Brandl1b83a452009-11-28 11:12:26 +0000539
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000540.. function:: setresgid(rgid, egid, sgid)
541
542 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000543
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000544 Availability: Unix.
545
Georg Brandl1b83a452009-11-28 11:12:26 +0000546 .. versionadded:: 3.2
547
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000548
549.. function:: setresuid(ruid, euid, suid)
550
551 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000552
Georg Brandl6faee4e2010-09-21 14:48:28 +0000553 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000554
Georg Brandl1b83a452009-11-28 11:12:26 +0000555 .. versionadded:: 3.2
556
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000557
558.. function:: setreuid(ruid, euid)
559
Benjamin Petersonf650e462010-05-06 23:03:05 +0000560 Set the current process's real and effective user ids.
561
562 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000563
Georg Brandl116aa622007-08-15 14:28:22 +0000564
565.. function:: getsid(pid)
566
Georg Brandl60203b42010-10-06 10:11:56 +0000567 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000568
Georg Brandl116aa622007-08-15 14:28:22 +0000569 Availability: Unix.
570
Georg Brandl116aa622007-08-15 14:28:22 +0000571
572.. function:: setsid()
573
Georg Brandl60203b42010-10-06 10:11:56 +0000574 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000575
Georg Brandl116aa622007-08-15 14:28:22 +0000576 Availability: Unix.
577
578
579.. function:: setuid(uid)
580
581 .. index:: single: user; id, setting
582
Benjamin Petersonf650e462010-05-06 23:03:05 +0000583 Set the current process's user id.
584
585 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000586
Georg Brandl116aa622007-08-15 14:28:22 +0000587
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000588.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000589.. function:: strerror(code)
590
591 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000592 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000593 error number, :exc:`ValueError` is raised.
594
Georg Brandl116aa622007-08-15 14:28:22 +0000595
Victor Stinnerb745a742010-05-18 17:17:23 +0000596.. data:: supports_bytes_environ
597
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200598 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000599 Windows).
600
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000601 .. versionadded:: 3.2
602
Victor Stinnerb745a742010-05-18 17:17:23 +0000603
Georg Brandl116aa622007-08-15 14:28:22 +0000604.. function:: umask(mask)
605
Benjamin Petersonf650e462010-05-06 23:03:05 +0000606 Set the current numeric umask and return the previous umask.
607
Georg Brandl116aa622007-08-15 14:28:22 +0000608
609.. function:: uname()
610
611 .. index::
612 single: gethostname() (in module socket)
613 single: gethostbyaddr() (in module socket)
614
Larry Hastings605a62d2012-06-24 04:33:36 -0700615 Returns information identifying the current operating system.
616 The return value is an object with five attributes:
617
618 * :attr:`sysname` - operating system name
619 * :attr:`nodename` - name of machine on network (implementation-defined)
620 * :attr:`release` - operating system release
621 * :attr:`version` - operating system version
622 * :attr:`machine` - hardware identifier
623
624 For backwards compatibility, this object is also iterable, behaving
625 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
626 :attr:`release`, :attr:`version`, and :attr:`machine`
627 in that order.
628
629 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000630 leading component; a better way to get the hostname is
631 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000632 ``socket.gethostbyaddr(socket.gethostname())``.
633
634 Availability: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000635
Larry Hastings605a62d2012-06-24 04:33:36 -0700636 .. versionchanged:: 3.3
637 Return type changed from a tuple to a tuple-like object
638 with named attributes.
639
Georg Brandl116aa622007-08-15 14:28:22 +0000640
Georg Brandl18244152009-09-02 20:34:52 +0000641.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000642
643 .. index:: single: environment variables; deleting
644
Georg Brandl18244152009-09-02 20:34:52 +0000645 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000646 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000647 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000648
649 When :func:`unsetenv` is supported, deletion of items in ``os.environ`` is
650 automatically translated into a corresponding call to :func:`unsetenv`; however,
651 calls to :func:`unsetenv` don't update ``os.environ``, so it is actually
652 preferable to delete items of ``os.environ``.
653
Benjamin Petersonf650e462010-05-06 23:03:05 +0000654 Availability: most flavors of Unix, Windows.
655
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657.. _os-newstreams:
658
659File Object Creation
660--------------------
661
Georg Brandla570e982012-06-24 13:26:22 +0200662This function creates new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200663:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000664
665
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300666.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandlb2462e22012-06-24 13:24:56 +0200668 Return an open file object connected to the file descriptor *fd*. This is an
669 alias of the :func:`open` built-in function and accepts the same arguments.
670 The only difference is that the first argument of :func:`fdopen` must always
671 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673
Georg Brandl116aa622007-08-15 14:28:22 +0000674.. _os-fd-ops:
675
676File Descriptor Operations
677--------------------------
678
679These functions operate on I/O streams referenced using file descriptors.
680
681File descriptors are small integers corresponding to a file that has been opened
682by the current process. For example, standard input is usually file descriptor
6830, standard output is 1, and standard error is 2. Further files opened by a
684process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
685is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
686by file descriptors.
687
Serhiy Storchakadab83542013-10-13 20:12:43 +0300688The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000689associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000690descriptor directly will bypass the file object methods, ignoring aspects such
691as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000692
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000693
Georg Brandl116aa622007-08-15 14:28:22 +0000694.. function:: close(fd)
695
Benjamin Petersonf650e462010-05-06 23:03:05 +0000696 Close file descriptor *fd*.
697
Georg Brandl116aa622007-08-15 14:28:22 +0000698 .. note::
699
700 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000701 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000702 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300703 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
705
Christian Heimesfdab48e2008-01-20 09:06:41 +0000706.. function:: closerange(fd_low, fd_high)
707
708 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200709 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000710
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000711 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000712 try:
713 os.close(fd)
714 except OSError:
715 pass
716
Christian Heimesfdab48e2008-01-20 09:06:41 +0000717
Georg Brandl81f11302007-12-21 08:45:42 +0000718.. function:: device_encoding(fd)
719
720 Return a string describing the encoding of the device associated with *fd*
721 if it is connected to a terminal; else return :const:`None`.
722
723
Georg Brandl116aa622007-08-15 14:28:22 +0000724.. function:: dup(fd)
725
Victor Stinnerdaf45552013-08-28 00:53:59 +0200726 Return a duplicate of file descriptor *fd*. The new file descriptor is
727 :ref:`non-inheritable <fd_inheritance>`.
728
729 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
730 2: stderr), the new file descriptor is :ref:`inheritable
731 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000732
Victor Stinnerdaf45552013-08-28 00:53:59 +0200733 .. versionchanged:: 3.4
734 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000735
Victor Stinnerdaf45552013-08-28 00:53:59 +0200736
737.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000738
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800739 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
740 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
741 <fd_inheritance>` by default or non-inheritable if *inheritable*
742 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000743
Victor Stinnerdaf45552013-08-28 00:53:59 +0200744 .. versionchanged:: 3.4
745 Add the optional *inheritable* parameter.
746
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800747 .. versionchanged:: 3.7
748 Return *fd2* on success. Previously, ``None`` was always returned.
749
Georg Brandl116aa622007-08-15 14:28:22 +0000750
Christian Heimes4e30a842007-11-30 22:12:06 +0000751.. function:: fchmod(fd, mode)
752
Georg Brandlb9df00c2012-06-24 12:38:14 +0200753 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200754 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200755 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000756
757 Availability: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000758
759
760.. function:: fchown(fd, uid, gid)
761
762 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200763 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200764 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200765 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000766
Christian Heimes4e30a842007-11-30 22:12:06 +0000767 Availability: Unix.
768
769
Georg Brandl116aa622007-08-15 14:28:22 +0000770.. function:: fdatasync(fd)
771
772 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000773 metadata.
774
775 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000776
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000777 .. note::
778 This function is not available on MacOS.
779
Georg Brandl116aa622007-08-15 14:28:22 +0000780
781.. function:: fpathconf(fd, name)
782
783 Return system configuration information relevant to an open file. *name*
784 specifies the configuration value to retrieve; it may be a string which is the
785 name of a defined system value; these names are specified in a number of
786 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
787 additional names as well. The names known to the host operating system are
788 given in the ``pathconf_names`` dictionary. For configuration variables not
789 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000790
791 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
792 specific value for *name* is not supported by the host system, even if it is
793 included in ``pathconf_names``, an :exc:`OSError` is raised with
794 :const:`errno.EINVAL` for the error number.
795
Georg Brandl4d399a42012-06-25 07:40:32 +0200796 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200797
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700798 Availability: Unix.
799
Georg Brandl116aa622007-08-15 14:28:22 +0000800
Victor Stinner4195b5c2012-02-08 23:03:19 +0100801.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000802
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200803 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
804 object.
805
806 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
807
808 .. seealso::
809
Berker Peksag2034caa2015-04-27 13:53:28 +0300810 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000811
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200812
Georg Brandl116aa622007-08-15 14:28:22 +0000813.. function:: fstatvfs(fd)
814
Georg Brandlb9df00c2012-06-24 12:38:14 +0200815 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200816 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200817 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000818
819 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000820
821
822.. function:: fsync(fd)
823
824 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000825 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000826
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000827 If you're starting with a buffered Python :term:`file object` *f*, first do
828 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
829 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000830
Georg Brandl8a5555f2012-06-24 13:29:09 +0200831 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000832
833
834.. function:: ftruncate(fd, length)
835
Georg Brandl306336b2012-06-24 12:55:33 +0200836 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200837 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200838 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000839
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700840 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000841
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700842 .. versionchanged:: 3.5
843 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000844
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200845.. function:: get_blocking(fd)
846
847 Get the blocking mode of the file descriptor: ``False`` if the
848 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
849
850 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
851
852 Availability: Unix.
853
854 .. versionadded:: 3.5
855
Georg Brandl116aa622007-08-15 14:28:22 +0000856.. function:: isatty(fd)
857
858 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000859 tty(-like) device, else ``False``.
860
Georg Brandl116aa622007-08-15 14:28:22 +0000861
Ross Lagerwall7807c352011-03-17 20:20:30 +0200862.. function:: lockf(fd, cmd, len)
863
864 Apply, test or remove a POSIX lock on an open file descriptor.
865 *fd* is an open file descriptor.
866 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
867 :data:`F_ULOCK` or :data:`F_TEST`.
868 *len* specifies the section of the file to lock.
869
870 Availability: Unix.
871
872 .. versionadded:: 3.3
873
874
875.. data:: F_LOCK
876 F_TLOCK
877 F_ULOCK
878 F_TEST
879
880 Flags that specify what action :func:`lockf` will take.
881
882 Availability: Unix.
883
884 .. versionadded:: 3.3
885
Georg Brandlf62445a2012-06-24 13:31:20 +0200886
Georg Brandl116aa622007-08-15 14:28:22 +0000887.. function:: lseek(fd, pos, how)
888
Christian Heimesfaf2f632008-01-06 16:59:19 +0000889 Set the current position of file descriptor *fd* to position *pos*, modified
890 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
891 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300892 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100893 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000894
Georg Brandl116aa622007-08-15 14:28:22 +0000895
Georg Brandl8569e582010-05-19 20:57:08 +0000896.. data:: SEEK_SET
897 SEEK_CUR
898 SEEK_END
899
900 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200901 respectively.
902
Jesus Cea94363612012-06-22 18:32:07 +0200903 .. versionadded:: 3.3
904 Some operating systems could support additional values, like
905 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
906
Georg Brandl8569e582010-05-19 20:57:08 +0000907
Martin Panterbf19d162015-09-09 01:01:13 +0000908.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000909
Martin Panterbf19d162015-09-09 01:01:13 +0000910 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700911 its mode according to *mode*. When computing *mode*, the current umask value
912 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200913 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000914
915 For a description of the flag and mode values, see the C run-time documentation;
916 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400917 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000918 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000919
Georg Brandl50c40002012-06-24 11:45:20 +0200920 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400921 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700922
Victor Stinnerdaf45552013-08-28 00:53:59 +0200923 .. versionchanged:: 3.4
924 The new file descriptor is now non-inheritable.
925
Georg Brandl116aa622007-08-15 14:28:22 +0000926 .. note::
927
Georg Brandl502d9a52009-07-26 15:02:41 +0000928 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000929 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000930 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000931 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000932
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000933 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700934 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000935
Victor Stinnera766ddf2015-03-26 23:50:57 +0100936 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200937 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100938 exception, the function now retries the system call instead of raising an
939 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
940
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700941 .. versionchanged:: 3.6
942 Accepts a :term:`path-like object`.
943
Andrew Kuchling4921a082013-06-21 11:49:57 -0400944The following constants are options for the *flags* parameter to the
945:func:`~os.open` function. They can be combined using the bitwise OR operator
946``|``. Some of them are not available on all platforms. For descriptions of
947their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100948or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400949
950
951.. data:: O_RDONLY
952 O_WRONLY
953 O_RDWR
954 O_APPEND
955 O_CREAT
956 O_EXCL
957 O_TRUNC
958
Vinay Sajipe4946e72016-09-11 15:15:59 +0100959 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400960
961
962.. data:: O_DSYNC
963 O_RSYNC
964 O_SYNC
965 O_NDELAY
966 O_NONBLOCK
967 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -0400968 O_CLOEXEC
969
Vinay Sajipe4946e72016-09-11 15:15:59 +0100970 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400971
972 .. versionchanged:: 3.3
973 Add :data:`O_CLOEXEC` constant.
974
975.. data:: O_BINARY
976 O_NOINHERIT
977 O_SHORT_LIVED
978 O_TEMPORARY
979 O_RANDOM
980 O_SEQUENTIAL
981 O_TEXT
982
Vinay Sajipe4946e72016-09-11 15:15:59 +0100983 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400984
985
986.. data:: O_ASYNC
987 O_DIRECT
988 O_DIRECTORY
989 O_NOFOLLOW
990 O_NOATIME
991 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +0200992 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +0100993 O_SHLOCK
994 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -0400995
Vinay Sajipe4946e72016-09-11 15:15:59 +0100996 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -0400997 the C library.
998
Christian Heimesd88f7352013-08-16 14:37:50 +0200999 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001000 Add :data:`O_PATH` on systems that support it.
1001 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1002 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001003
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001004
Georg Brandl116aa622007-08-15 14:28:22 +00001005.. function:: openpty()
1006
1007 .. index:: module: pty
1008
Victor Stinnerdaf45552013-08-28 00:53:59 +02001009 Open a new pseudo-terminal pair. Return a pair of file descriptors
1010 ``(master, slave)`` for the pty and the tty, respectively. The new file
1011 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1012 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001013
1014 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001015
Victor Stinnerdaf45552013-08-28 00:53:59 +02001016 .. versionchanged:: 3.4
1017 The new file descriptors are now non-inheritable.
1018
Georg Brandl116aa622007-08-15 14:28:22 +00001019
1020.. function:: pipe()
1021
Victor Stinnerdaf45552013-08-28 00:53:59 +02001022 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001023 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001024 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001025
1026 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001027
Victor Stinnerdaf45552013-08-28 00:53:59 +02001028 .. versionchanged:: 3.4
1029 The new file descriptors are now non-inheritable.
1030
Georg Brandl116aa622007-08-15 14:28:22 +00001031
Charles-François Natali368f34b2011-06-06 19:49:47 +02001032.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001033
1034 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001035 *flags* can be constructed by ORing together one or more of these values:
1036 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001037 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1038 respectively.
1039
1040 Availability: some flavors of Unix.
1041
1042 .. versionadded:: 3.3
1043
1044
Ross Lagerwall7807c352011-03-17 20:20:30 +02001045.. function:: posix_fallocate(fd, offset, len)
1046
1047 Ensures that enough disk space is allocated for the file specified by *fd*
1048 starting from *offset* and continuing for *len* bytes.
1049
1050 Availability: Unix.
1051
1052 .. versionadded:: 3.3
1053
1054
1055.. function:: posix_fadvise(fd, offset, len, advice)
1056
1057 Announces an intention to access data in a specific pattern thus allowing
1058 the kernel to make optimizations.
1059 The advice applies to the region of the file specified by *fd* starting at
1060 *offset* and continuing for *len* bytes.
1061 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1062 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1063 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1064
1065 Availability: Unix.
1066
1067 .. versionadded:: 3.3
1068
1069
1070.. data:: POSIX_FADV_NORMAL
1071 POSIX_FADV_SEQUENTIAL
1072 POSIX_FADV_RANDOM
1073 POSIX_FADV_NOREUSE
1074 POSIX_FADV_WILLNEED
1075 POSIX_FADV_DONTNEED
1076
1077 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1078 the access pattern that is likely to be used.
1079
1080 Availability: Unix.
1081
1082 .. versionadded:: 3.3
1083
1084
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001085.. function:: pread(fd, n, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001086
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001087 Read at most *n* bytes from file descriptor *fd* at a position of *offset*,
1088 leaving the file offset unchanged.
1089
1090 Return a bytestring containing the bytes read. If the end of the file
1091 referred to by *fd* has been reached, an empty bytes object is returned.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001092
1093 Availability: Unix.
1094
1095 .. versionadded:: 3.3
1096
1097
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001098.. function:: preadv(fd, buffers, offset, flags=0)
1099
1100 Read from a file descriptor *fd* at a position of *offset* into mutable
1101 :term:`bytes-like objects <bytes-like object>` *buffers*, leaving the file
1102 offset unchanged. Transfer data into each buffer until it is full and then
1103 move on to the next buffer in the sequence to hold the rest of the data.
1104
1105 The flags argument contains a bitwise OR of zero or more of the following
1106 flags:
1107
1108 - :data:`RWF_HIPRI`
1109 - :data:`RWF_NOWAIT`
1110
1111 Return the total number of bytes actually read which can be less than the
1112 total capacity of all the objects.
1113
1114 The operating system may set a limit (:func:`sysconf` value
1115 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1116
1117 Combine the functionality of :func:`os.readv` and :func:`os.pread`.
1118
1119 Availability: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
1120 OpenBSD 2.7 and newer. Using flags requires Linux 4.6 or newer.
1121
1122 .. versionadded:: 3.7
1123
1124
1125.. data:: RWF_NOWAIT
1126
1127 Do not wait for data which is not immediately available. If this flag is
1128 specified, the system call will return instantly if it would have to read
1129 data from the backing storage or wait for a lock.
1130
1131 If some data was successfully read, it will return the number of bytes read.
1132 If no bytes were read, it will return ``-1`` and set errno to
1133 :data:`errno.EAGAIN`.
1134
1135 Availability: Linux 4.14 and newer.
1136
1137 .. versionadded:: 3.7
1138
1139
1140.. data:: RWF_HIPRI
1141
1142 High priority read/write. Allows block-based filesystems to use polling
1143 of the device, which provides lower latency, but may use additional
1144 resources.
1145
1146 Currently, on Linux, this feature is usable only on a file descriptor opened
1147 using the :data:`O_DIRECT` flag.
1148
1149 Availability: Linux 4.6 and newer.
1150
1151 .. versionadded:: 3.7
1152
1153
Jesus Cea67503c52014-10-20 16:18:24 +02001154.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001155
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001156 Write the bytestring in *str* to file descriptor *fd* at position of
1157 *offset*, leaving the file offset unchanged.
1158
1159 Return the number of bytes actually written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001160
1161 Availability: Unix.
1162
1163 .. versionadded:: 3.3
1164
1165
Pablo Galindo4defba32018-01-27 16:16:37 +00001166.. function:: pwritev(fd, buffers, offset, flags=0)
1167
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001168 Write the *buffers* contents to file descriptor *fd* at a offset *offset*,
1169 leaving the file offset unchanged. *buffers* must be a sequence of
1170 :term:`bytes-like objects <bytes-like object>`. Buffers are processed in
1171 array order. Entire contents of the first buffer is written before
1172 proceeding to the second, and so on.
Pablo Galindo4defba32018-01-27 16:16:37 +00001173
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001174 The flags argument contains a bitwise OR of zero or more of the following
Pablo Galindo4defba32018-01-27 16:16:37 +00001175 flags:
1176
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001177 - :data:`RWF_DSYNC`
1178 - :data:`RWF_SYNC`
Pablo Galindo4defba32018-01-27 16:16:37 +00001179
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001180 Return the total number of bytes actually written.
Pablo Galindo4defba32018-01-27 16:16:37 +00001181
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001182 The operating system may set a limit (:func:`sysconf` value
1183 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
1184
1185 Combine the functionality of :func:`os.writev` and :func:`os.pwrite`.
1186
1187 Availability: Linux 2.6.30 and newer, FreeBSD 6.0 and newer,
1188 OpenBSD 2.7 and newer. Using flags requires Linux 4.7 or newer.
Pablo Galindo4defba32018-01-27 16:16:37 +00001189
1190 .. versionadded:: 3.7
1191
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001192
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001193.. data:: RWF_DSYNC
1194
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001195 Provide a per-write equivalent of the :data:`O_DSYNC` ``open(2)`` flag. This
1196 flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001197
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001198 Availability: Linux 4.7 and newer.
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001199
Pablo Galindo4defba32018-01-27 16:16:37 +00001200 .. versionadded:: 3.7
1201
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001202
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001203.. data:: RWF_SYNC
1204
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001205 Provide a per-write equivalent of the :data:`O_SYNC` ``open(2)`` flag. This
1206 flag effect applies only to the data range written by the system call.
Pablo Galindo4defba32018-01-27 16:16:37 +00001207
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001208 Availability: Linux 4.7 and newer.
Miss Islington (bot)6a1799e2018-04-25 11:30:43 -07001209
Pablo Galindo4defba32018-01-27 16:16:37 +00001210 .. versionadded:: 3.7
1211
1212
Georg Brandl116aa622007-08-15 14:28:22 +00001213.. function:: read(fd, n)
1214
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001215 Read at most *n* bytes from file descriptor *fd*.
1216
1217 Return a bytestring containing the bytes read. If the end of the file
1218 referred to by *fd* has been reached, an empty bytes object is returned.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001219
Georg Brandl116aa622007-08-15 14:28:22 +00001220 .. note::
1221
1222 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001223 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1224 "file object" returned by the built-in function :func:`open` or by
1225 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1226 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001227
Victor Stinnera766ddf2015-03-26 23:50:57 +01001228 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001229 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001230 exception, the function now retries the system call instead of raising an
1231 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1232
Georg Brandl116aa622007-08-15 14:28:22 +00001233
Martin Panterbf19d162015-09-09 01:01:13 +00001234.. function:: sendfile(out, in, offset, count)
Martin Panter94994132015-09-09 05:29:24 +00001235 sendfile(out, in, offset, count, [headers], [trailers], flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001236
Martin Panterbf19d162015-09-09 01:01:13 +00001237 Copy *count* bytes from file descriptor *in* to file descriptor *out*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001238 starting at *offset*.
1239 Return the number of bytes sent. When EOF is reached return 0.
1240
1241 The first function notation is supported by all platforms that define
1242 :func:`sendfile`.
1243
1244 On Linux, if *offset* is given as ``None``, the bytes are read from the
1245 current position of *in* and the position of *in* is updated.
1246
1247 The second case may be used on Mac OS X and FreeBSD where *headers* and
1248 *trailers* are arbitrary sequences of buffers that are written before and
1249 after the data from *in* is written. It returns the same as the first case.
1250
Martin Panterbf19d162015-09-09 01:01:13 +00001251 On Mac OS X and FreeBSD, a value of 0 for *count* specifies to send until
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001252 the end of *in* is reached.
1253
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001254 All platforms support sockets as *out* file descriptor, and some platforms
1255 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001256
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001257 Cross-platform applications should not use *headers*, *trailers* and *flags*
1258 arguments.
1259
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001260 Availability: Unix.
1261
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001262 .. note::
1263
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001264 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001265 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001266
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001267 .. versionadded:: 3.3
1268
1269
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001270.. function:: set_blocking(fd, blocking)
1271
1272 Set the blocking mode of the specified file descriptor. Set the
1273 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1274
1275 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1276
1277 Availability: Unix.
1278
1279 .. versionadded:: 3.5
1280
1281
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001282.. data:: SF_NODISKIO
1283 SF_MNOWAIT
1284 SF_SYNC
1285
1286 Parameters to the :func:`sendfile` function, if the implementation supports
1287 them.
1288
1289 Availability: Unix.
1290
1291 .. versionadded:: 3.3
1292
1293
Ross Lagerwall7807c352011-03-17 20:20:30 +02001294.. function:: readv(fd, buffers)
1295
Benjamin Petersone83ed432014-01-18 22:54:59 -05001296 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001297 objects <bytes-like object>` *buffers*. Transfer data into each buffer until
1298 it is full and then move on to the next buffer in the sequence to hold the
1299 rest of the data.
1300
1301 Return the total number of bytes actually read which can be less than the
1302 total capacity of all the objects.
1303
1304 The operating system may set a limit (:func:`sysconf` value
1305 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001306
1307 Availability: Unix.
1308
1309 .. versionadded:: 3.3
1310
1311
Georg Brandl116aa622007-08-15 14:28:22 +00001312.. function:: tcgetpgrp(fd)
1313
1314 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001315 file descriptor as returned by :func:`os.open`).
1316
1317 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001318
1319
1320.. function:: tcsetpgrp(fd, pg)
1321
1322 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001323 descriptor as returned by :func:`os.open`) to *pg*.
1324
1325 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001326
1327
1328.. function:: ttyname(fd)
1329
1330 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001331 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001332 exception is raised.
1333
1334 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001335
1336
1337.. function:: write(fd, str)
1338
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001339 Write the bytestring in *str* to file descriptor *fd*.
1340
1341 Return the number of bytes actually written.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001342
Georg Brandl116aa622007-08-15 14:28:22 +00001343 .. note::
1344
1345 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001346 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001347 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001348 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1349 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001350
Victor Stinnera766ddf2015-03-26 23:50:57 +01001351 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001352 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001353 exception, the function now retries the system call instead of raising an
1354 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1355
Georg Brandl8569e582010-05-19 20:57:08 +00001356
Ross Lagerwall7807c352011-03-17 20:20:30 +02001357.. function:: writev(fd, buffers)
1358
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001359 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be
1360 a sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1361 processed in array order. Entire contents of the first buffer is written
1362 before proceeding to the second, and so on.
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001363
Miss Islington (bot)0e823c62018-05-30 16:22:13 -07001364 Returns the total number of bytes actually written.
1365
1366 The operating system may set a limit (:func:`sysconf` value
1367 ``'SC_IOV_MAX'``) on the number of buffers that can be used.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001368
1369 Availability: Unix.
1370
1371 .. versionadded:: 3.3
1372
1373
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001374.. _terminal-size:
1375
1376Querying the size of a terminal
1377~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1378
1379.. versionadded:: 3.3
1380
1381.. function:: get_terminal_size(fd=STDOUT_FILENO)
1382
1383 Return the size of the terminal window as ``(columns, lines)``,
1384 tuple of type :class:`terminal_size`.
1385
1386 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1387 output) specifies which file descriptor should be queried.
1388
1389 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001390 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001391
1392 :func:`shutil.get_terminal_size` is the high-level function which
1393 should normally be used, ``os.get_terminal_size`` is the low-level
1394 implementation.
1395
1396 Availability: Unix, Windows.
1397
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001398.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001399
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001400 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001401
1402 .. attribute:: columns
1403
1404 Width of the terminal window in characters.
1405
1406 .. attribute:: lines
1407
1408 Height of the terminal window in characters.
1409
1410
Victor Stinnerdaf45552013-08-28 00:53:59 +02001411.. _fd_inheritance:
1412
1413Inheritance of File Descriptors
1414~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1415
Georg Brandl5642ff92013-09-15 10:37:57 +02001416.. versionadded:: 3.4
1417
1418A file descriptor has an "inheritable" flag which indicates if the file descriptor
1419can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001420created by Python are non-inheritable by default.
1421
1422On UNIX, non-inheritable file descriptors are closed in child processes at the
1423execution of a new program, other file descriptors are inherited.
1424
1425On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001426processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001427and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001428all inheritable handles and all inheritable file descriptors are inherited.
1429Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001430streams are closed, and inheritable handles are only inherited if the
1431*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001432
1433.. function:: get_inheritable(fd)
1434
Georg Brandl5642ff92013-09-15 10:37:57 +02001435 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001436
1437.. function:: set_inheritable(fd, inheritable)
1438
Georg Brandl5642ff92013-09-15 10:37:57 +02001439 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001440
1441.. function:: get_handle_inheritable(handle)
1442
Georg Brandl5642ff92013-09-15 10:37:57 +02001443 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001444
1445 Availability: Windows.
1446
1447.. function:: set_handle_inheritable(handle, inheritable)
1448
Georg Brandl5642ff92013-09-15 10:37:57 +02001449 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001450
1451 Availability: Windows.
1452
1453
Georg Brandl116aa622007-08-15 14:28:22 +00001454.. _os-file-dir:
1455
1456Files and Directories
1457---------------------
1458
Georg Brandl50c40002012-06-24 11:45:20 +02001459On some Unix platforms, many of these functions support one or more of these
1460features:
1461
1462.. _path_fd:
1463
Larry Hastings77892dc2012-06-25 03:27:33 -07001464* **specifying a file descriptor:**
1465 For some functions, the *path* argument can be not only a string giving a path
Georg Brandl50c40002012-06-24 11:45:20 +02001466 name, but also a file descriptor. The function will then operate on the file
Georg Brandlaceaf902012-06-25 08:33:56 +02001467 referred to by the descriptor. (For POSIX systems, Python will call the
1468 ``f...`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001469
1470 You can check whether or not *path* can be specified as a file descriptor on
1471 your platform using :data:`os.supports_fd`. If it is unavailable, using it
1472 will raise a :exc:`NotImplementedError`.
1473
1474 If the function also supports *dir_fd* or *follow_symlinks* arguments, it is
1475 an error to specify one of those when supplying *path* as a file descriptor.
1476
1477.. _dir_fd:
1478
Larry Hastings77892dc2012-06-25 03:27:33 -07001479* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001480 should be a file descriptor referring to a directory, and the path to operate
1481 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001482 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Larry Hastings77892dc2012-06-25 03:27:33 -07001483 the ``...at`` or ``f...at`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001484
1485 You can check whether or not *dir_fd* is supported on your platform using
1486 :data:`os.supports_dir_fd`. If it is unavailable, using it will raise a
1487 :exc:`NotImplementedError`.
1488
1489.. _follow_symlinks:
1490
Larry Hastings77892dc2012-06-25 03:27:33 -07001491* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001492 ``False``, and the last element of the path to operate on is a symbolic link,
1493 the function will operate on the symbolic link itself instead of the file the
Georg Brandlaceaf902012-06-25 08:33:56 +02001494 link points to. (For POSIX systems, Python will call the ``l...`` version of
Georg Brandl50c40002012-06-24 11:45:20 +02001495 the function.)
1496
1497 You can check whether or not *follow_symlinks* is supported on your platform
1498 using :data:`os.supports_follow_symlinks`. If it is unavailable, using it
1499 will raise a :exc:`NotImplementedError`.
1500
1501
1502
Larry Hastings9cf065c2012-06-22 16:30:09 -07001503.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001504
1505 Use the real uid/gid to test for access to *path*. Note that most operations
1506 will use the effective uid/gid, therefore this routine can be used in a
1507 suid/sgid environment to test if the invoking user has the specified access to
1508 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1509 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1510 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1511 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001512 information.
1513
Georg Brandl50c40002012-06-24 11:45:20 +02001514 This function can support specifying :ref:`paths relative to directory
1515 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001516
1517 If *effective_ids* is ``True``, :func:`access` will perform its access
1518 checks using the effective uid/gid instead of the real uid/gid.
1519 *effective_ids* may not be supported on your platform; you can check whether
1520 or not it is available using :data:`os.supports_effective_ids`. If it is
1521 unavailable, using it will raise a :exc:`NotImplementedError`.
1522
Georg Brandl116aa622007-08-15 14:28:22 +00001523 .. note::
1524
Georg Brandl502d9a52009-07-26 15:02:41 +00001525 Using :func:`access` to check if a user is authorized to e.g. open a file
1526 before actually doing so using :func:`open` creates a security hole,
1527 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001528 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1529 techniques. For example::
1530
1531 if os.access("myfile", os.R_OK):
1532 with open("myfile") as fp:
1533 return fp.read()
1534 return "some default data"
1535
1536 is better written as::
1537
1538 try:
1539 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001540 except PermissionError:
1541 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001542 else:
1543 with fp:
1544 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001545
1546 .. note::
1547
1548 I/O operations may fail even when :func:`access` indicates that they would
1549 succeed, particularly for operations on network filesystems which may have
1550 permissions semantics beyond the usual POSIX permission-bit model.
1551
Larry Hastings9cf065c2012-06-22 16:30:09 -07001552 .. versionchanged:: 3.3
1553 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1554
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001555 .. versionchanged:: 3.6
1556 Accepts a :term:`path-like object`.
1557
Georg Brandl116aa622007-08-15 14:28:22 +00001558
1559.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001560 R_OK
1561 W_OK
1562 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001563
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001564 Values to pass as the *mode* parameter of :func:`access` to test the
1565 existence, readability, writability and executability of *path*,
1566 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001567
1568
1569.. function:: chdir(path)
1570
1571 .. index:: single: directory; changing
1572
Benjamin Petersonf650e462010-05-06 23:03:05 +00001573 Change the current working directory to *path*.
1574
Larry Hastings77892dc2012-06-25 03:27:33 -07001575 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001576 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001577
Larry Hastings9cf065c2012-06-22 16:30:09 -07001578 .. versionadded:: 3.3
1579 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001580 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001581
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001582 .. versionchanged:: 3.6
1583 Accepts a :term:`path-like object`.
1584
Georg Brandl116aa622007-08-15 14:28:22 +00001585
Larry Hastings9cf065c2012-06-22 16:30:09 -07001586.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001587
1588 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1589 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1590
R David Murray30178062011-03-10 17:18:33 -05001591 * :data:`stat.UF_NODUMP`
1592 * :data:`stat.UF_IMMUTABLE`
1593 * :data:`stat.UF_APPEND`
1594 * :data:`stat.UF_OPAQUE`
1595 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001596 * :data:`stat.UF_COMPRESSED`
1597 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001598 * :data:`stat.SF_ARCHIVED`
1599 * :data:`stat.SF_IMMUTABLE`
1600 * :data:`stat.SF_APPEND`
1601 * :data:`stat.SF_NOUNLINK`
1602 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001603
Georg Brandl50c40002012-06-24 11:45:20 +02001604 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001605
Georg Brandlc575c902008-09-13 17:46:05 +00001606 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001607
Larry Hastings9cf065c2012-06-22 16:30:09 -07001608 .. versionadded:: 3.3
1609 The *follow_symlinks* argument.
1610
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001611 .. versionchanged:: 3.6
1612 Accepts a :term:`path-like object`.
1613
Georg Brandl116aa622007-08-15 14:28:22 +00001614
Larry Hastings9cf065c2012-06-22 16:30:09 -07001615.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001616
1617 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001618 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001619 combinations of them:
1620
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001621 * :data:`stat.S_ISUID`
1622 * :data:`stat.S_ISGID`
1623 * :data:`stat.S_ENFMT`
1624 * :data:`stat.S_ISVTX`
1625 * :data:`stat.S_IREAD`
1626 * :data:`stat.S_IWRITE`
1627 * :data:`stat.S_IEXEC`
1628 * :data:`stat.S_IRWXU`
1629 * :data:`stat.S_IRUSR`
1630 * :data:`stat.S_IWUSR`
1631 * :data:`stat.S_IXUSR`
1632 * :data:`stat.S_IRWXG`
1633 * :data:`stat.S_IRGRP`
1634 * :data:`stat.S_IWGRP`
1635 * :data:`stat.S_IXGRP`
1636 * :data:`stat.S_IRWXO`
1637 * :data:`stat.S_IROTH`
1638 * :data:`stat.S_IWOTH`
1639 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001640
Georg Brandl50c40002012-06-24 11:45:20 +02001641 This function can support :ref:`specifying a file descriptor <path_fd>`,
1642 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1643 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001644
Georg Brandl116aa622007-08-15 14:28:22 +00001645 .. note::
1646
Georg Brandl50c40002012-06-24 11:45:20 +02001647 Although Windows supports :func:`chmod`, you can only set the file's
1648 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1649 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001650
Larry Hastings9cf065c2012-06-22 16:30:09 -07001651 .. versionadded:: 3.3
1652 Added support for specifying *path* as an open file descriptor,
1653 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001654
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001655 .. versionchanged:: 3.6
1656 Accepts a :term:`path-like object`.
1657
Larry Hastings9cf065c2012-06-22 16:30:09 -07001658
1659.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001660
Georg Brandl50c40002012-06-24 11:45:20 +02001661 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1662 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001663
Georg Brandl50c40002012-06-24 11:45:20 +02001664 This function can support :ref:`specifying a file descriptor <path_fd>`,
1665 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1666 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001667
Sandro Tosid902a142011-08-22 23:28:27 +02001668 See :func:`shutil.chown` for a higher-level function that accepts names in
1669 addition to numeric ids.
1670
Benjamin Petersonf650e462010-05-06 23:03:05 +00001671 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001672
Larry Hastings9cf065c2012-06-22 16:30:09 -07001673 .. versionadded:: 3.3
1674 Added support for specifying an open file descriptor for *path*,
1675 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001676
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001677 .. versionchanged:: 3.6
1678 Supports a :term:`path-like object`.
1679
Benjamin Peterson799bd802011-08-31 22:15:17 -04001680
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001681.. function:: chroot(path)
1682
Georg Brandl8a5555f2012-06-24 13:29:09 +02001683 Change the root directory of the current process to *path*.
1684
1685 Availability: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001686
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001687 .. versionchanged:: 3.6
1688 Accepts a :term:`path-like object`.
1689
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001690
1691.. function:: fchdir(fd)
1692
1693 Change the current working directory to the directory represented by the file
1694 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001695 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001696
1697 Availability: Unix.
1698
1699
1700.. function:: getcwd()
1701
1702 Return a string representing the current working directory.
1703
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001704
1705.. function:: getcwdb()
1706
1707 Return a bytestring representing the current working directory.
1708
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001709
Georg Brandl116aa622007-08-15 14:28:22 +00001710.. function:: lchflags(path, flags)
1711
Georg Brandl50c40002012-06-24 11:45:20 +02001712 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001713 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001714 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001715
1716 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001717
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001718 .. versionchanged:: 3.6
1719 Accepts a :term:`path-like object`.
1720
Georg Brandl116aa622007-08-15 14:28:22 +00001721
Christian Heimes93852662007-12-01 12:22:32 +00001722.. function:: lchmod(path, mode)
1723
1724 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001725 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001726 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001727 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001728
1729 Availability: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001730
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001731 .. versionchanged:: 3.6
1732 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001733
Georg Brandl116aa622007-08-15 14:28:22 +00001734.. function:: lchown(path, uid, gid)
1735
Georg Brandl50c40002012-06-24 11:45:20 +02001736 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001737 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001738 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001739
1740 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001741
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001742 .. versionchanged:: 3.6
1743 Accepts a :term:`path-like object`.
1744
Georg Brandl116aa622007-08-15 14:28:22 +00001745
Larry Hastings9cf065c2012-06-22 16:30:09 -07001746.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001747
Larry Hastings9cf065c2012-06-22 16:30:09 -07001748 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001749
Georg Brandlaceaf902012-06-25 08:33:56 +02001750 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1751 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1752 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001753
Brian Curtin1b9df392010-11-24 20:24:31 +00001754 Availability: Unix, Windows.
1755
1756 .. versionchanged:: 3.2
1757 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001758
Larry Hastings9cf065c2012-06-22 16:30:09 -07001759 .. versionadded:: 3.3
1760 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1761
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001762 .. versionchanged:: 3.6
1763 Accepts a :term:`path-like object` for *src* and *dst*.
1764
Georg Brandl116aa622007-08-15 14:28:22 +00001765
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001766.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001767
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001768 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001769 *path*. The list is in arbitrary order, and does not include the special
1770 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001771
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001772 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1773 (directly or indirectly through the :class:`PathLike` interface),
1774 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001775 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001776
Larry Hastings77892dc2012-06-25 03:27:33 -07001777 This function can also support :ref:`specifying a file descriptor
1778 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001779
Larry Hastingsfdaea062012-06-25 04:42:23 -07001780 .. note::
1781 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1782
Victor Stinner6036e442015-03-08 01:58:04 +01001783 .. seealso::
1784
Victor Stinner51b58322015-05-15 09:12:58 +02001785 The :func:`scandir` function returns directory entries along with
1786 file attribute information, giving better performance for many
1787 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001788
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001789 .. versionchanged:: 3.2
1790 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001791
Larry Hastings9cf065c2012-06-22 16:30:09 -07001792 .. versionadded:: 3.3
1793 Added support for specifying an open file descriptor for *path*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001794
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001795 .. versionchanged:: 3.6
1796 Accepts a :term:`path-like object`.
1797
Georg Brandl50c40002012-06-24 11:45:20 +02001798
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001799.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001800
R. David Murray7b1aae92011-01-24 19:34:58 +00001801 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001802 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1803 :class:`stat_result` object.
1804
1805 On platforms that do not support symbolic links, this is an alias for
1806 :func:`~os.stat`.
1807
1808 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1809 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001810
Georg Brandl50c40002012-06-24 11:45:20 +02001811 This function can also support :ref:`paths relative to directory descriptors
1812 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001813
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001814 .. seealso::
1815
Berker Peksag2034caa2015-04-27 13:53:28 +03001816 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001817
Georg Brandlb3823372010-07-10 08:58:37 +00001818 .. versionchanged:: 3.2
1819 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001820
Larry Hastings9cf065c2012-06-22 16:30:09 -07001821 .. versionchanged:: 3.3
1822 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001823
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001824 .. versionchanged:: 3.6
1825 Accepts a :term:`path-like object` for *src* and *dst*.
1826
Ross Lagerwall7807c352011-03-17 20:20:30 +02001827
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001828.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1829
1830 Create a directory named *path* with numeric mode *mode*.
1831
Tommy Beadle63b91e52016-06-02 15:41:20 -04001832 If the directory already exists, :exc:`FileExistsError` is raised.
1833
1834 .. _mkdir_modebits:
1835
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001836 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001837 value is first masked out. If bits other than the last 9 (i.e. the last 3
1838 digits of the octal representation of the *mode*) are set, their meaning is
1839 platform-dependent. On some platforms, they are ignored and you should call
1840 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001841
1842 This function can also support :ref:`paths relative to directory descriptors
1843 <dir_fd>`.
1844
1845 It is also possible to create temporary directories; see the
1846 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1847
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001848 .. versionadded:: 3.3
1849 The *dir_fd* argument.
1850
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001851 .. versionchanged:: 3.6
1852 Accepts a :term:`path-like object`.
1853
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001854
Zachary Warea22ae212014-03-20 09:42:01 -05001855.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001856
1857 .. index::
1858 single: directory; creating
1859 single: UNC paths; and os.makedirs()
1860
1861 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001862 intermediate-level directories needed to contain the leaf directory.
1863
Serhiy Storchakae304e332017-03-24 13:27:42 +02001864 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1865 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1866 is interpreted. To set the file permission bits of any newly-created parent
1867 directories you can set the umask before invoking :func:`makedirs`. The
1868 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001869
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001870 If *exist_ok* is ``False`` (the default), an :exc:`OSError` is raised if the
1871 target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001872
1873 .. note::
1874
1875 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001876 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001877
1878 This function handles UNC paths correctly.
1879
1880 .. versionadded:: 3.2
1881 The *exist_ok* parameter.
1882
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001883 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001884
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001885 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001886 :func:`makedirs` would still raise an error if *mode* did not match the
1887 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001888 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001889
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001890 .. versionchanged:: 3.6
1891 Accepts a :term:`path-like object`.
1892
Serhiy Storchakae304e332017-03-24 13:27:42 +02001893 .. versionchanged:: 3.7
1894 The *mode* argument no longer affects the file permission bits of
1895 newly-created intermediate-level directories.
1896
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001897
Larry Hastings9cf065c2012-06-22 16:30:09 -07001898.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001899
Larry Hastings9cf065c2012-06-22 16:30:09 -07001900 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1901 The current umask value is first masked out from the mode.
1902
Georg Brandl50c40002012-06-24 11:45:20 +02001903 This function can also support :ref:`paths relative to directory descriptors
1904 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001905
1906 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1907 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1908 rendezvous between "client" and "server" type processes: the server opens the
1909 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1910 doesn't open the FIFO --- it just creates the rendezvous point.
1911
Benjamin Petersonf650e462010-05-06 23:03:05 +00001912 Availability: Unix.
1913
Larry Hastings9cf065c2012-06-22 16:30:09 -07001914 .. versionadded:: 3.3
1915 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001916
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001917 .. versionchanged:: 3.6
1918 Accepts a :term:`path-like object`.
1919
Larry Hastings9cf065c2012-06-22 16:30:09 -07001920
Martin Panterbf19d162015-09-09 01:01:13 +00001921.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001922
1923 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00001924 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00001925 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
1926 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
1927 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
1928 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00001929 :func:`os.makedev`), otherwise it is ignored.
1930
Georg Brandl50c40002012-06-24 11:45:20 +02001931 This function can also support :ref:`paths relative to directory descriptors
1932 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001933
Berker Peksag6129e142016-09-26 22:50:11 +03001934 Availability: Unix.
1935
Larry Hastings9cf065c2012-06-22 16:30:09 -07001936 .. versionadded:: 3.3
1937 The *dir_fd* argument.
1938
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001939 .. versionchanged:: 3.6
1940 Accepts a :term:`path-like object`.
1941
Georg Brandl116aa622007-08-15 14:28:22 +00001942
1943.. function:: major(device)
1944
Christian Heimesfaf2f632008-01-06 16:59:19 +00001945 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001946 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001947
Georg Brandl116aa622007-08-15 14:28:22 +00001948
1949.. function:: minor(device)
1950
Christian Heimesfaf2f632008-01-06 16:59:19 +00001951 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001952 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001953
Georg Brandl116aa622007-08-15 14:28:22 +00001954
1955.. function:: makedev(major, minor)
1956
Christian Heimesfaf2f632008-01-06 16:59:19 +00001957 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001958
Georg Brandl116aa622007-08-15 14:28:22 +00001959
Georg Brandl116aa622007-08-15 14:28:22 +00001960.. function:: pathconf(path, name)
1961
1962 Return system configuration information relevant to a named file. *name*
1963 specifies the configuration value to retrieve; it may be a string which is the
1964 name of a defined system value; these names are specified in a number of
1965 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
1966 additional names as well. The names known to the host operating system are
1967 given in the ``pathconf_names`` dictionary. For configuration variables not
1968 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00001969
1970 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
1971 specific value for *name* is not supported by the host system, even if it is
1972 included in ``pathconf_names``, an :exc:`OSError` is raised with
1973 :const:`errno.EINVAL` for the error number.
1974
Larry Hastings77892dc2012-06-25 03:27:33 -07001975 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02001976 <path_fd>`.
1977
Benjamin Petersonf650e462010-05-06 23:03:05 +00001978 Availability: Unix.
1979
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001980 .. versionchanged:: 3.6
1981 Accepts a :term:`path-like object`.
1982
Georg Brandl116aa622007-08-15 14:28:22 +00001983
1984.. data:: pathconf_names
1985
1986 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
1987 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02001988 can be used to determine the set of names known to the system.
1989
1990 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001991
1992
Larry Hastings9cf065c2012-06-22 16:30:09 -07001993.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001994
1995 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02001996 result may be either an absolute or relative pathname; if it is relative, it
1997 may be converted to an absolute pathname using
1998 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001999
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002000 If the *path* is a string object (directly or indirectly through a
2001 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00002002 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002003 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00002004
Georg Brandl50c40002012-06-24 11:45:20 +02002005 This function can also support :ref:`paths relative to directory descriptors
2006 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002007
Brian Curtinc7395692010-07-09 15:15:09 +00002008 Availability: Unix, Windows
2009
Georg Brandlb3823372010-07-10 08:58:37 +00002010 .. versionchanged:: 3.2
2011 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002012
Larry Hastings9cf065c2012-06-22 16:30:09 -07002013 .. versionadded:: 3.3
2014 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00002015
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002016 .. versionchanged:: 3.6
2017 Accepts a :term:`path-like object`.
2018
Georg Brandl116aa622007-08-15 14:28:22 +00002019
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002020.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07002021
Georg Brandl50c40002012-06-24 11:45:20 +02002022 Remove (delete) the file *path*. If *path* is a directory, :exc:`OSError` is
2023 raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002024
Georg Brandl50c40002012-06-24 11:45:20 +02002025 This function can support :ref:`paths relative to directory descriptors
2026 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002027
2028 On Windows, attempting to remove a file that is in use causes an exception to
2029 be raised; on Unix, the directory entry is removed but the storage allocated
2030 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002031
Brett Cannon05039172015-12-28 17:28:19 -08002032 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002033
Larry Hastings9cf065c2012-06-22 16:30:09 -07002034 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002035 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002036
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002037 .. versionchanged:: 3.6
2038 Accepts a :term:`path-like object`.
2039
Georg Brandl116aa622007-08-15 14:28:22 +00002040
Zachary Warea22ae212014-03-20 09:42:01 -05002041.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00002042
2043 .. index:: single: directory; deleting
2044
Christian Heimesfaf2f632008-01-06 16:59:19 +00002045 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00002046 leaf directory is successfully removed, :func:`removedirs` tries to
2047 successively remove every parent directory mentioned in *path* until an error
2048 is raised (which is ignored, because it generally means that a parent directory
2049 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
2050 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
2051 they are empty. Raises :exc:`OSError` if the leaf directory could not be
2052 successfully removed.
2053
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002054 .. versionchanged:: 3.6
2055 Accepts a :term:`path-like object`.
2056
Georg Brandl116aa622007-08-15 14:28:22 +00002057
Larry Hastings9cf065c2012-06-22 16:30:09 -07002058.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002059
2060 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2061 :exc:`OSError` will be raised. On Unix, if *dst* exists and is a file, it will
Christian Heimesfaf2f632008-01-06 16:59:19 +00002062 be replaced silently if the user has permission. The operation may fail on some
Georg Brandl116aa622007-08-15 14:28:22 +00002063 Unix flavors if *src* and *dst* are on different filesystems. If successful,
2064 the renaming will be an atomic operation (this is a POSIX requirement). On
2065 Windows, if *dst* already exists, :exc:`OSError` will be raised even if it is a
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002066 file.
2067
Georg Brandlaceaf902012-06-25 08:33:56 +02002068 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2069 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002070
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002071 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002072
Larry Hastings9cf065c2012-06-22 16:30:09 -07002073 .. versionadded:: 3.3
2074 The *src_dir_fd* and *dst_dir_fd* arguments.
2075
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002076 .. versionchanged:: 3.6
2077 Accepts a :term:`path-like object` for *src* and *dst*.
2078
Georg Brandl116aa622007-08-15 14:28:22 +00002079
2080.. function:: renames(old, new)
2081
2082 Recursive directory or file renaming function. Works like :func:`rename`, except
2083 creation of any intermediate directories needed to make the new pathname good is
2084 attempted first. After the rename, directories corresponding to rightmost path
2085 segments of the old name will be pruned away using :func:`removedirs`.
2086
Georg Brandl116aa622007-08-15 14:28:22 +00002087 .. note::
2088
2089 This function can fail with the new directory structure made if you lack
2090 permissions needed to remove the leaf directory or file.
2091
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002092 .. versionchanged:: 3.6
2093 Accepts a :term:`path-like object` for *old* and *new*.
2094
Georg Brandl116aa622007-08-15 14:28:22 +00002095
Larry Hastings9cf065c2012-06-22 16:30:09 -07002096.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002097
2098 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2099 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
2100 be replaced silently if the user has permission. The operation may fail
2101 if *src* and *dst* are on different filesystems. If successful,
2102 the renaming will be an atomic operation (this is a POSIX requirement).
2103
Georg Brandlaceaf902012-06-25 08:33:56 +02002104 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2105 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002106
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002107 .. versionadded:: 3.3
2108
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002109 .. versionchanged:: 3.6
2110 Accepts a :term:`path-like object` for *src* and *dst*.
2111
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002112
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002113.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002114
Georg Brandla6053b42009-09-01 08:11:14 +00002115 Remove (delete) the directory *path*. Only works when the directory is
2116 empty, otherwise, :exc:`OSError` is raised. In order to remove whole
Benjamin Petersonf650e462010-05-06 23:03:05 +00002117 directory trees, :func:`shutil.rmtree` can be used.
2118
Georg Brandl50c40002012-06-24 11:45:20 +02002119 This function can support :ref:`paths relative to directory descriptors
2120 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002121
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002122 .. versionadded:: 3.3
2123 The *dir_fd* parameter.
2124
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002125 .. versionchanged:: 3.6
2126 Accepts a :term:`path-like object`.
2127
Georg Brandl116aa622007-08-15 14:28:22 +00002128
Victor Stinner6036e442015-03-08 01:58:04 +01002129.. function:: scandir(path='.')
2130
Brett Cannona32c4d02016-06-24 14:14:44 -07002131 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2132 entries in the directory given by *path*. The entries are yielded in
2133 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2134 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002135
Victor Stinner51b58322015-05-15 09:12:58 +02002136 Using :func:`scandir` instead of :func:`listdir` can significantly
2137 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002138 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002139 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002140 All :class:`os.DirEntry` methods may perform a system call, but
2141 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2142 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002143 always requires a system call on Unix but only requires one for
2144 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002145
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002146 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2147 (directly or indirectly through the :class:`PathLike` interface),
2148 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2149 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2150 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002151
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002152 This function can also support :ref:`specifying a file descriptor
2153 <path_fd>`; the file descriptor must refer to a directory.
2154
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002155 The :func:`scandir` iterator supports the :term:`context manager` protocol
2156 and has the following method:
2157
2158 .. method:: scandir.close()
2159
2160 Close the iterator and free acquired resources.
2161
2162 This is called automatically when the iterator is exhausted or garbage
2163 collected, or when an error happens during iterating. However it
2164 is advisable to call it explicitly or use the :keyword:`with`
2165 statement.
2166
2167 .. versionadded:: 3.6
2168
Victor Stinner6036e442015-03-08 01:58:04 +01002169 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002170 the files (excluding directories) in the given *path* that don't start with
2171 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2172 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002173
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002174 with os.scandir(path) as it:
2175 for entry in it:
2176 if not entry.name.startswith('.') and entry.is_file():
2177 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002178
2179 .. note::
2180
2181 On Unix-based systems, :func:`scandir` uses the system's
2182 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2183 and
2184 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2185 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002186 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002187 and
Georg Brandl5d941342016-02-26 19:37:12 +01002188 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002189 functions.
2190
Victor Stinner6036e442015-03-08 01:58:04 +01002191 .. versionadded:: 3.5
2192
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002193 .. versionadded:: 3.6
2194 Added support for the :term:`context manager` protocol and the
2195 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2196 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2197 in its destructor.
2198
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002199 The function accepts a :term:`path-like object`.
2200
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002201 .. versionchanged:: 3.7
2202 Added support for :ref:`file descriptors <path_fd>` on Unix.
2203
Victor Stinner6036e442015-03-08 01:58:04 +01002204
2205.. class:: DirEntry
2206
2207 Object yielded by :func:`scandir` to expose the file path and other file
2208 attributes of a directory entry.
2209
2210 :func:`scandir` will provide as much of this information as possible without
2211 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002212 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002213
Brett Cannona32c4d02016-06-24 14:14:44 -07002214 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002215 structures; if you know the file metadata has changed or if a long time has
2216 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2217 up-to-date information.
2218
Brett Cannona32c4d02016-06-24 14:14:44 -07002219 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002220 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002221 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002222 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002223
Brett Cannona32c4d02016-06-24 14:14:44 -07002224 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002225 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002226
Brett Cannona32c4d02016-06-24 14:14:44 -07002227 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002228
2229 .. attribute:: name
2230
2231 The entry's base filename, relative to the :func:`scandir` *path*
2232 argument.
2233
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002234 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2235 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002236 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002237
2238 .. attribute:: path
2239
2240 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2241 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2242 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002243 argument was absolute. If the :func:`scandir` *path*
2244 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2245 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002246
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002247 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2248 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002249 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002250
2251 .. method:: inode()
2252
2253 Return the inode number of the entry.
2254
Brett Cannona32c4d02016-06-24 14:14:44 -07002255 The result is cached on the ``os.DirEntry`` object. Use
2256 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2257 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002258
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002259 On the first, uncached call, a system call is required on Windows but
2260 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002261
2262 .. method:: is_dir(\*, follow_symlinks=True)
2263
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002264 Return ``True`` if this entry is a directory or a symbolic link pointing
2265 to a directory; return ``False`` if the entry is or points to any other
2266 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002267
2268 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002269 is a directory (without following symlinks); return ``False`` if the
2270 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002271
Brett Cannona32c4d02016-06-24 14:14:44 -07002272 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002273 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2274 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2275
2276 On the first, uncached call, no system call is required in most cases.
2277 Specifically, for non-symlinks, neither Windows or Unix require a system
2278 call, except on certain Unix file systems, such as network file systems,
2279 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2280 a system call will be required to follow the symlink unless
2281 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002282
Victor Stinner51b58322015-05-15 09:12:58 +02002283 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2284 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002285
Victor Stinner6036e442015-03-08 01:58:04 +01002286 .. method:: is_file(\*, follow_symlinks=True)
2287
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002288 Return ``True`` if this entry is a file or a symbolic link pointing to a
2289 file; return ``False`` if the entry is or points to a directory or other
2290 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002291
2292 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002293 is a file (without following symlinks); return ``False`` if the entry is
2294 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002295
Brett Cannona32c4d02016-06-24 14:14:44 -07002296 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2297 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002298
2299 .. method:: is_symlink()
2300
Victor Stinner51b58322015-05-15 09:12:58 +02002301 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002302 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002303 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002304
Brett Cannona32c4d02016-06-24 14:14:44 -07002305 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002306 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002307
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002308 On the first, uncached call, no system call is required in most cases.
2309 Specifically, neither Windows or Unix require a system call, except on
2310 certain Unix file systems, such as network file systems, that return
2311 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002312
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002313 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2314 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002315
2316 .. method:: stat(\*, follow_symlinks=True)
2317
Victor Stinner51b58322015-05-15 09:12:58 +02002318 Return a :class:`stat_result` object for this entry. This method
2319 follows symbolic links by default; to stat a symbolic link add the
2320 ``follow_symlinks=False`` argument.
2321
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002322 On Unix, this method always requires a system call. On Windows, it
2323 only requires a system call if *follow_symlinks* is ``True`` and the
2324 entry is a symbolic link.
Victor Stinner6036e442015-03-08 01:58:04 +01002325
2326 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2327 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2328 get these attributes.
2329
Brett Cannona32c4d02016-06-24 14:14:44 -07002330 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002331 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2332 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002333
Guido van Rossum1469d742016-01-06 11:36:03 -08002334 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002335 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002336 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002337 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2338 and ``stat()`` methods.
2339
Victor Stinner6036e442015-03-08 01:58:04 +01002340 .. versionadded:: 3.5
2341
Brett Cannon96881cd2016-06-10 14:37:21 -07002342 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002343 Added support for the :class:`~os.PathLike` interface. Added support
2344 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002345
Victor Stinner6036e442015-03-08 01:58:04 +01002346
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002347.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002348
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002349 Get the status of a file or a file descriptor. Perform the equivalent of a
2350 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002351 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002352 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002353 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002354
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002355 This function normally follows symlinks; to stat a symlink add the argument
2356 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002357
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002358 This function can support :ref:`specifying a file descriptor <path_fd>` and
2359 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002360
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002361 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002362
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002363 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002364
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002365 >>> import os
2366 >>> statinfo = os.stat('somefile.txt')
2367 >>> statinfo
2368 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2369 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2370 st_mtime=1297230027, st_ctime=1297230027)
2371 >>> statinfo.st_size
2372 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002373
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002374 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002375
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002376 :func:`fstat` and :func:`lstat` functions.
2377
2378 .. versionadded:: 3.3
2379 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2380 descriptor instead of a path.
2381
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002382 .. versionchanged:: 3.6
2383 Accepts a :term:`path-like object`.
2384
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002385
2386.. class:: stat_result
2387
2388 Object whose attributes correspond roughly to the members of the
2389 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2390 :func:`os.fstat` and :func:`os.lstat`.
2391
2392 Attributes:
2393
2394 .. attribute:: st_mode
2395
2396 File mode: file type and file mode bits (permissions).
2397
2398 .. attribute:: st_ino
2399
Miss Islington (bot)78e14f82018-05-28 18:49:42 -07002400 Platform dependent, but if non-zero, uniquely identifies the
2401 file for a given value of ``st_dev``. Typically:
2402
2403 * the inode number on Unix,
2404 * the `file index
2405 <https://msdn.microsoft.com/en-us/library/aa363788>`_ on
2406 Windows
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002407
2408 .. attribute:: st_dev
2409
2410 Identifier of the device on which this file resides.
2411
2412 .. attribute:: st_nlink
2413
2414 Number of hard links.
2415
2416 .. attribute:: st_uid
2417
2418 User identifier of the file owner.
2419
2420 .. attribute:: st_gid
2421
2422 Group identifier of the file owner.
2423
2424 .. attribute:: st_size
2425
2426 Size of the file in bytes, if it is a regular file or a symbolic link.
2427 The size of a symbolic link is the length of the pathname it contains,
2428 without a terminating null byte.
2429
2430 Timestamps:
2431
2432 .. attribute:: st_atime
2433
2434 Time of most recent access expressed in seconds.
2435
2436 .. attribute:: st_mtime
2437
2438 Time of most recent content modification expressed in seconds.
2439
2440 .. attribute:: st_ctime
2441
2442 Platform dependent:
2443
2444 * the time of most recent metadata change on Unix,
2445 * the time of creation on Windows, expressed in seconds.
2446
2447 .. attribute:: st_atime_ns
2448
2449 Time of most recent access expressed in nanoseconds as an integer.
2450
2451 .. attribute:: st_mtime_ns
2452
2453 Time of most recent content modification expressed in nanoseconds as an
2454 integer.
2455
2456 .. attribute:: st_ctime_ns
2457
2458 Platform dependent:
2459
2460 * the time of most recent metadata change on Unix,
2461 * the time of creation on Windows, expressed in nanoseconds as an
2462 integer.
2463
Georg Brandl116aa622007-08-15 14:28:22 +00002464 .. note::
2465
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002466 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002467 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2468 system and the file system. For example, on Windows systems using the FAT
2469 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2470 :attr:`st_atime` has only 1-day resolution. See your operating system
2471 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002472
Larry Hastings6fe20b32012-04-19 15:07:49 -07002473 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2474 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2475 systems do not provide nanosecond precision. On systems that do
2476 provide nanosecond precision, the floating-point object used to
2477 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2478 cannot preserve all of it, and as such will be slightly inexact.
2479 If you need the exact timestamps you should always use
2480 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002481
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002482 On some Unix systems (such as Linux), the following attributes may also be
2483 available:
2484
2485 .. attribute:: st_blocks
2486
2487 Number of 512-byte blocks allocated for file.
2488 This may be smaller than :attr:`st_size`/512 when the file has holes.
2489
2490 .. attribute:: st_blksize
2491
2492 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2493 smaller chunks may cause an inefficient read-modify-rewrite.
2494
2495 .. attribute:: st_rdev
2496
2497 Type of device if an inode device.
2498
2499 .. attribute:: st_flags
2500
2501 User defined flags for file.
2502
2503 On other Unix systems (such as FreeBSD), the following attributes may be
2504 available (but may be only filled out if root tries to use them):
2505
2506 .. attribute:: st_gen
2507
2508 File generation number.
2509
2510 .. attribute:: st_birthtime
2511
2512 Time of file creation.
2513
jcea6c51d512018-01-28 14:00:08 +01002514 On Solaris and derivatives, the following attributes may also be
2515 available:
2516
2517 .. attribute:: st_fstype
2518
2519 String that uniquely identifies the type of the filesystem that
2520 contains the file.
2521
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002522 On Mac OS systems, the following attributes may also be available:
2523
2524 .. attribute:: st_rsize
2525
2526 Real size of the file.
2527
2528 .. attribute:: st_creator
2529
2530 Creator of the file.
2531
2532 .. attribute:: st_type
2533
2534 File type.
2535
Victor Stinnere1d24f72014-07-24 12:44:07 +02002536 On Windows systems, the following attribute is also available:
2537
2538 .. attribute:: st_file_attributes
2539
2540 Windows file attributes: ``dwFileAttributes`` member of the
2541 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2542 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2543 constants in the :mod:`stat` module.
2544
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002545 The standard module :mod:`stat` defines functions and constants that are
2546 useful for extracting information from a :c:type:`stat` structure. (On
2547 Windows, some items are filled with dummy values.)
2548
2549 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002550 accessible as a tuple of at least 10 integers giving the most important (and
2551 portable) members of the :c:type:`stat` structure, in the order
2552 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2553 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2554 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002555 some implementations. For compatibility with older Python versions,
2556 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002557
Larry Hastings6fe20b32012-04-19 15:07:49 -07002558 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002559 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2560 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002561
Zachary Ware63f277b2014-06-19 09:46:37 -05002562 .. versionadded:: 3.5
2563 Added the :attr:`st_file_attributes` member on Windows.
2564
Miss Islington (bot)78e14f82018-05-28 18:49:42 -07002565 .. versionchanged:: 3.5
2566 Windows now returns the file index as :attr:`st_ino` when
2567 available.
2568
jcea6c51d512018-01-28 14:00:08 +01002569 .. versionadded:: 3.7
2570 Added the :attr:`st_fstype` member to Solaris/derivatives.
Georg Brandl116aa622007-08-15 14:28:22 +00002571
Georg Brandl116aa622007-08-15 14:28:22 +00002572.. function:: statvfs(path)
2573
Georg Brandl60203b42010-10-06 10:11:56 +00002574 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002575 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002576 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002577 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2578 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002579 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002580
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002581 Two module-level constants are defined for the :attr:`f_flag` attribute's
2582 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2583 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2584 setuid/setgid bits are disabled or not supported.
2585
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002586 Additional module-level constants are defined for GNU/glibc based systems.
2587 These are :const:`ST_NODEV` (disallow access to device special files),
2588 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2589 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2590 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2591 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2592 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2593 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2594
Georg Brandl50c40002012-06-24 11:45:20 +02002595 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002596
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002597 Availability: Unix.
2598
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002599 .. versionchanged:: 3.2
2600 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2601
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002602 .. versionadded:: 3.3
2603 Added support for specifying an open file descriptor for *path*.
2604
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002605 .. versionchanged:: 3.4
2606 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2607 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2608 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2609 and :const:`ST_RELATIME` constants were added.
2610
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002611 .. versionchanged:: 3.6
2612 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002613
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002614 .. versionadded:: 3.7
2615 Added :attr:`f_fsid`.
2616
Larry Hastings9cf065c2012-06-22 16:30:09 -07002617
2618.. data:: supports_dir_fd
2619
Serhiy Storchakadab83542013-10-13 20:12:43 +03002620 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002621 :mod:`os` module permit use of their *dir_fd* parameter. Different platforms
Larry Hastings9cf065c2012-06-22 16:30:09 -07002622 provide different functionality, and an option that might work on one might
2623 be unsupported on another. For consistency's sakes, functions that support
Andrew Svetlov5b898402012-12-18 21:26:36 +02002624 *dir_fd* always allow specifying the parameter, but will raise an exception
Larry Hastings9cf065c2012-06-22 16:30:09 -07002625 if the functionality is not actually available.
2626
2627 To check whether a particular function permits use of its *dir_fd*
2628 parameter, use the ``in`` operator on ``supports_dir_fd``. As an example,
2629 this expression determines whether the *dir_fd* parameter of :func:`os.stat`
2630 is locally available::
2631
2632 os.stat in os.supports_dir_fd
2633
Georg Brandlf62445a2012-06-24 13:31:20 +02002634 Currently *dir_fd* parameters only work on Unix platforms; none of them work
2635 on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002636
2637 .. versionadded:: 3.3
2638
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002639
Larry Hastings9cf065c2012-06-22 16:30:09 -07002640.. data:: supports_effective_ids
2641
Serhiy Storchakadab83542013-10-13 20:12:43 +03002642 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002643 :mod:`os` module permit use of the *effective_ids* parameter for
2644 :func:`os.access`. If the local platform supports it, the collection will
2645 contain :func:`os.access`, otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002646
Georg Brandl50c40002012-06-24 11:45:20 +02002647 To check whether you can use the *effective_ids* parameter for
Berker Peksag4d6c6062015-02-16 03:36:10 +02002648 :func:`os.access`, use the ``in`` operator on ``supports_effective_ids``,
2649 like so::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002650
2651 os.access in os.supports_effective_ids
2652
Georg Brandl50c40002012-06-24 11:45:20 +02002653 Currently *effective_ids* only works on Unix platforms; it does not work on
2654 Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002655
2656 .. versionadded:: 3.3
2657
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002658
Larry Hastings9cf065c2012-06-22 16:30:09 -07002659.. data:: supports_fd
2660
Serhiy Storchakadab83542013-10-13 20:12:43 +03002661 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002662 :mod:`os` module permit specifying their *path* parameter as an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002663 descriptor. Different platforms provide different functionality, and an
2664 option that might work on one might be unsupported on another. For
2665 consistency's sakes, functions that support *fd* always allow specifying
Andrew Svetlov5b898402012-12-18 21:26:36 +02002666 the parameter, but will raise an exception if the functionality is not
Larry Hastings9cf065c2012-06-22 16:30:09 -07002667 actually available.
2668
2669 To check whether a particular function permits specifying an open file
2670 descriptor for its *path* parameter, use the ``in`` operator on
2671 ``supports_fd``. As an example, this expression determines whether
2672 :func:`os.chdir` accepts open file descriptors when called on your local
2673 platform::
2674
2675 os.chdir in os.supports_fd
2676
2677 .. versionadded:: 3.3
2678
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002679
Larry Hastings9cf065c2012-06-22 16:30:09 -07002680.. data:: supports_follow_symlinks
2681
Serhiy Storchakadab83542013-10-13 20:12:43 +03002682 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002683 :mod:`os` module permit use of their *follow_symlinks* parameter. Different
Larry Hastings9cf065c2012-06-22 16:30:09 -07002684 platforms provide different functionality, and an option that might work on
2685 one might be unsupported on another. For consistency's sakes, functions that
2686 support *follow_symlinks* always allow specifying the parameter, but will
Andrew Svetlov5b898402012-12-18 21:26:36 +02002687 raise an exception if the functionality is not actually available.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002688
2689 To check whether a particular function permits use of its *follow_symlinks*
2690 parameter, use the ``in`` operator on ``supports_follow_symlinks``. As an
2691 example, this expression determines whether the *follow_symlinks* parameter
2692 of :func:`os.stat` is locally available::
2693
2694 os.stat in os.supports_follow_symlinks
2695
2696 .. versionadded:: 3.3
2697
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002698
Martin Panterbf19d162015-09-09 01:01:13 +00002699.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002700
Martin Panterbf19d162015-09-09 01:01:13 +00002701 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002702
Larry Hastings9cf065c2012-06-22 16:30:09 -07002703 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002704 morph to the target dynamically. If the target is present, the type of the
2705 symlink will be created to match. Otherwise, the symlink will be created
2706 as a directory if *target_is_directory* is ``True`` or a file symlink (the
2707 default) otherwise. On non-Window platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002708
Georg Brandl64a41ed2010-10-06 08:52:48 +00002709 Symbolic link support was introduced in Windows 6.0 (Vista). :func:`symlink`
2710 will raise a :exc:`NotImplementedError` on Windows versions earlier than 6.0.
Brian Curtin52173d42010-12-02 18:29:18 +00002711
Georg Brandl50c40002012-06-24 11:45:20 +02002712 This function can support :ref:`paths relative to directory descriptors
2713 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002714
Brian Curtin52173d42010-12-02 18:29:18 +00002715 .. note::
2716
Larry Hastings9cf065c2012-06-22 16:30:09 -07002717 On Windows, the *SeCreateSymbolicLinkPrivilege* is required in order to
2718 successfully create symlinks. This privilege is not typically granted to
2719 regular users but is available to accounts which can escalate privileges
2720 to the administrator level. Either obtaining the privilege or running your
Brian Curtin96245592010-12-28 17:08:22 +00002721 application as an administrator are ways to successfully create symlinks.
2722
Jason R. Coombs3a092862013-05-27 23:21:28 -04002723
Brian Curtin96245592010-12-28 17:08:22 +00002724 :exc:`OSError` is raised when the function is called by an unprivileged
2725 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002726
Georg Brandl64a41ed2010-10-06 08:52:48 +00002727 Availability: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002728
Georg Brandlb3823372010-07-10 08:58:37 +00002729 .. versionchanged:: 3.2
2730 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002731
Larry Hastings9cf065c2012-06-22 16:30:09 -07002732 .. versionadded:: 3.3
2733 Added the *dir_fd* argument, and now allow *target_is_directory*
2734 on non-Windows platforms.
2735
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002736 .. versionchanged:: 3.6
2737 Accepts a :term:`path-like object` for *src* and *dst*.
2738
Georg Brandl116aa622007-08-15 14:28:22 +00002739
Ross Lagerwall7807c352011-03-17 20:20:30 +02002740.. function:: sync()
2741
2742 Force write of everything to disk.
2743
2744 Availability: Unix.
2745
2746 .. versionadded:: 3.3
2747
2748
2749.. function:: truncate(path, length)
2750
2751 Truncate the file corresponding to *path*, so that it is at most
2752 *length* bytes in size.
2753
Georg Brandl306336b2012-06-24 12:55:33 +02002754 This function can support :ref:`specifying a file descriptor <path_fd>`.
2755
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002756 Availability: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002757
2758 .. versionadded:: 3.3
2759
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002760 .. versionchanged:: 3.5
2761 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002762
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002763 .. versionchanged:: 3.6
2764 Accepts a :term:`path-like object`.
2765
2766
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002767.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002768
Brett Cannon05039172015-12-28 17:28:19 -08002769 Remove (delete) the file *path*. This function is semantically
2770 identical to :func:`remove`; the ``unlink`` name is its
2771 traditional Unix name. Please see the documentation for
2772 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002773
Larry Hastings9cf065c2012-06-22 16:30:09 -07002774 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002775 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002776
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002777 .. versionchanged:: 3.6
2778 Accepts a :term:`path-like object`.
2779
Larry Hastings9cf065c2012-06-22 16:30:09 -07002780
Martin Panterbf19d162015-09-09 01:01:13 +00002781.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002782
Larry Hastings76ad59b2012-05-03 00:30:07 -07002783 Set the access and modified times of the file specified by *path*.
2784
2785 :func:`utime` takes two optional parameters, *times* and *ns*.
2786 These specify the times set on *path* and are used as follows:
2787
Martin Panterbf19d162015-09-09 01:01:13 +00002788 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002789 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2790 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002791 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002792 it must be a 2-tuple of the form ``(atime, mtime)``
2793 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002794 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002795 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002796 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002797
Larry Hastings9cf065c2012-06-22 16:30:09 -07002798 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002799
2800 Whether a directory can be given for *path*
Brian Curtin52fbea12011-11-06 13:41:17 -06002801 depends on whether the operating system implements directories as files
2802 (for example, Windows does not). Note that the exact times you set here may
2803 not be returned by a subsequent :func:`~os.stat` call, depending on the
2804 resolution with which your operating system records access and modification
Larry Hastings76ad59b2012-05-03 00:30:07 -07002805 times; see :func:`~os.stat`. The best way to preserve exact times is to
2806 use the *st_atime_ns* and *st_mtime_ns* fields from the :func:`os.stat`
2807 result object with the *ns* parameter to `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002808
Georg Brandl50c40002012-06-24 11:45:20 +02002809 This function can support :ref:`specifying a file descriptor <path_fd>`,
2810 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2811 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002812
Larry Hastings76ad59b2012-05-03 00:30:07 -07002813 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -07002814 Added support for specifying an open file descriptor for *path*,
2815 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002816
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002817 .. versionchanged:: 3.6
2818 Accepts a :term:`path-like object`.
2819
Georg Brandl116aa622007-08-15 14:28:22 +00002820
Georg Brandl18244152009-09-02 20:34:52 +00002821.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002822
2823 .. index::
2824 single: directory; walking
2825 single: directory; traversal
2826
Christian Heimesfaf2f632008-01-06 16:59:19 +00002827 Generate the file names in a directory tree by walking the tree
2828 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002829 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2830 filenames)``.
2831
2832 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2833 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2834 *filenames* is a list of the names of the non-directory files in *dirpath*.
2835 Note that the names in the lists contain no path components. To get a full path
2836 (which begins with *top*) to a file or directory in *dirpath*, do
2837 ``os.path.join(dirpath, name)``.
2838
Christian Heimesfaf2f632008-01-06 16:59:19 +00002839 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00002840 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07002841 (directories are generated top-down). If *topdown* is ``False``, the triple
2842 for a directory is generated after the triples for all of its subdirectories
2843 (directories are generated bottom-up). No matter the value of *topdown*, the
2844 list of subdirectories is retrieved before the tuples for the directory and
2845 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002846
Christian Heimesfaf2f632008-01-06 16:59:19 +00002847 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00002848 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
2849 recurse into the subdirectories whose names remain in *dirnames*; this can be
2850 used to prune the search, impose a specific order of visiting, or even to inform
2851 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02002852 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
2853 no effect on the behavior of the walk, because in bottom-up mode the directories
2854 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002855
Miss Islington (bot)f6d1d652018-04-02 20:33:38 -07002856 By default, errors from the :func:`scandir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00002857 argument *onerror* is specified, it should be a function; it will be called with
2858 one argument, an :exc:`OSError` instance. It can report the error to continue
2859 with the walk, or raise the exception to abort the walk. Note that the filename
2860 is available as the ``filename`` attribute of the exception object.
2861
2862 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00002863 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00002864 symlinks, on systems that support them.
2865
Georg Brandl116aa622007-08-15 14:28:22 +00002866 .. note::
2867
Georg Brandl50c40002012-06-24 11:45:20 +02002868 Be aware that setting *followlinks* to ``True`` can lead to infinite
2869 recursion if a link points to a parent directory of itself. :func:`walk`
2870 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00002871
2872 .. note::
2873
2874 If you pass a relative pathname, don't change the current working directory
2875 between resumptions of :func:`walk`. :func:`walk` never changes the current
2876 directory, and assumes that its caller doesn't either.
2877
2878 This example displays the number of bytes taken by non-directory files in each
2879 directory under the starting directory, except that it doesn't look under any
2880 CVS subdirectory::
2881
2882 import os
2883 from os.path import join, getsize
2884 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00002885 print(root, "consumes", end=" ")
2886 print(sum(getsize(join(root, name)) for name in files), end=" ")
2887 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00002888 if 'CVS' in dirs:
2889 dirs.remove('CVS') # don't visit CVS directories
2890
Victor Stinner47c41b42015-03-10 13:31:47 +01002891 In the next example (simple implementation of :func:`shutil.rmtree`),
2892 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
2893 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00002894
Christian Heimesfaf2f632008-01-06 16:59:19 +00002895 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00002896 # assuming there are no symbolic links.
2897 # CAUTION: This is dangerous! For example, if top == '/', it
2898 # could delete all your disk files.
2899 import os
2900 for root, dirs, files in os.walk(top, topdown=False):
2901 for name in files:
2902 os.remove(os.path.join(root, name))
2903 for name in dirs:
2904 os.rmdir(os.path.join(root, name))
2905
Victor Stinner524a5ba2015-03-10 13:20:34 +01002906 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02002907 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
2908 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01002909
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002910 .. versionchanged:: 3.6
2911 Accepts a :term:`path-like object`.
2912
Georg Brandl116aa622007-08-15 14:28:22 +00002913
Larry Hastingsb4038062012-07-15 10:57:38 -07002914.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01002915
2916 .. index::
2917 single: directory; walking
2918 single: directory; traversal
2919
Eli Benderskyd049d5c2012-02-11 09:52:29 +02002920 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07002921 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01002922
2923 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
2924 and *dirfd* is a file descriptor referring to the directory *dirpath*.
2925
Larry Hastingsc48fe982012-06-25 04:49:05 -07002926 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07002927 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07002928 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07002929 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07002930
Charles-François Natali7372b062012-02-05 15:15:38 +01002931 .. note::
2932
2933 Since :func:`fwalk` yields file descriptors, those are only valid until
2934 the next iteration step, so you should duplicate them (e.g. with
2935 :func:`dup`) if you want to keep them longer.
2936
2937 This example displays the number of bytes taken by non-directory files in each
2938 directory under the starting directory, except that it doesn't look under any
2939 CVS subdirectory::
2940
2941 import os
2942 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
2943 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02002944 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01002945 end="")
2946 print("bytes in", len(files), "non-directory files")
2947 if 'CVS' in dirs:
2948 dirs.remove('CVS') # don't visit CVS directories
2949
2950 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002951 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01002952 empty::
2953
2954 # Delete everything reachable from the directory named in "top",
2955 # assuming there are no symbolic links.
2956 # CAUTION: This is dangerous! For example, if top == '/', it
2957 # could delete all your disk files.
2958 import os
2959 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
2960 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002961 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002962 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002963 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002964
2965 Availability: Unix.
2966
2967 .. versionadded:: 3.3
2968
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002969 .. versionchanged:: 3.6
2970 Accepts a :term:`path-like object`.
2971
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02002972 .. versionchanged:: 3.7
2973 Added support for :class:`bytes` paths.
2974
Charles-François Natali7372b062012-02-05 15:15:38 +01002975
Georg Brandlb9831ab2012-06-24 11:57:07 +02002976Linux extended attributes
2977~~~~~~~~~~~~~~~~~~~~~~~~~
2978
2979.. versionadded:: 3.3
2980
2981These functions are all available on Linux only.
2982
2983.. function:: getxattr(path, attribute, *, follow_symlinks=True)
2984
2985 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002986 *path*. *attribute* can be bytes or str (directly or indirectly through the
2987 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
2988 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002989
2990 This function can support :ref:`specifying a file descriptor <path_fd>` and
2991 :ref:`not following symlinks <follow_symlinks>`.
2992
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002993 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03002994 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002995
Georg Brandlb9831ab2012-06-24 11:57:07 +02002996
2997.. function:: listxattr(path=None, *, follow_symlinks=True)
2998
2999 Return a list of the extended filesystem attributes on *path*. The
3000 attributes in the list are represented as strings decoded with the filesystem
3001 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
3002 directory.
3003
3004 This function can support :ref:`specifying a file descriptor <path_fd>` and
3005 :ref:`not following symlinks <follow_symlinks>`.
3006
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003007 .. versionchanged:: 3.6
3008 Accepts a :term:`path-like object`.
3009
Georg Brandlb9831ab2012-06-24 11:57:07 +02003010
3011.. function:: removexattr(path, attribute, *, follow_symlinks=True)
3012
3013 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003014 *attribute* should be bytes or str (directly or indirectly through the
3015 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02003016 with the filesystem encoding.
3017
3018 This function can support :ref:`specifying a file descriptor <path_fd>` and
3019 :ref:`not following symlinks <follow_symlinks>`.
3020
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003021 .. versionchanged:: 3.6
3022 Accepts a :term:`path-like object` for *path* and *attribute*.
3023
Georg Brandlb9831ab2012-06-24 11:57:07 +02003024
3025.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
3026
3027 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003028 *attribute* must be a bytes or str with no embedded NULs (directly or
3029 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02003030 it is encoded with the filesystem encoding. *flags* may be
3031 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
3032 given and the attribute does not exist, ``EEXISTS`` will be raised.
3033 If :data:`XATTR_CREATE` is given and the attribute already exists, the
3034 attribute will not be created and ``ENODATA`` will be raised.
3035
3036 This function can support :ref:`specifying a file descriptor <path_fd>` and
3037 :ref:`not following symlinks <follow_symlinks>`.
3038
3039 .. note::
3040
3041 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
3042 to be ignored on some filesystems.
3043
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003044 .. versionchanged:: 3.6
3045 Accepts a :term:`path-like object` for *path* and *attribute*.
3046
Georg Brandlb9831ab2012-06-24 11:57:07 +02003047
3048.. data:: XATTR_SIZE_MAX
3049
3050 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02003051 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003052
3053
3054.. data:: XATTR_CREATE
3055
3056 This is a possible value for the flags argument in :func:`setxattr`. It
3057 indicates the operation must create an attribute.
3058
3059
3060.. data:: XATTR_REPLACE
3061
3062 This is a possible value for the flags argument in :func:`setxattr`. It
3063 indicates the operation must replace an existing attribute.
3064
3065
Georg Brandl116aa622007-08-15 14:28:22 +00003066.. _os-process:
3067
3068Process Management
3069------------------
3070
3071These functions may be used to create and manage processes.
3072
Serhiy Storchakadab83542013-10-13 20:12:43 +03003073The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00003074program loaded into the process. In each case, the first of these arguments is
3075passed to the new program as its own name rather than as an argument a user may
3076have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00003077passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00003078['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
3079to be ignored.
3080
3081
3082.. function:: abort()
3083
3084 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
3085 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02003086 an exit code of ``3``. Be aware that calling this function will not call the
3087 Python signal handler registered for :const:`SIGABRT` with
3088 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003089
Georg Brandl116aa622007-08-15 14:28:22 +00003090
3091.. function:: execl(path, arg0, arg1, ...)
3092 execle(path, arg0, arg1, ..., env)
3093 execlp(file, arg0, arg1, ...)
3094 execlpe(file, arg0, arg1, ..., env)
3095 execv(path, args)
3096 execve(path, args, env)
3097 execvp(file, args)
3098 execvpe(file, args, env)
3099
3100 These functions all execute a new program, replacing the current process; they
3101 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00003102 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00003103 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003104
3105 The current process is replaced immediately. Open file objects and
3106 descriptors are not flushed, so if there may be data buffered
3107 on these open files, you should flush them using
3108 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03003109 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00003110
Serhiy Storchakadab83542013-10-13 20:12:43 +03003111 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003112 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003113 to work with if the number of parameters is fixed when the code is written; the
3114 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003115 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00003116 variable, with the arguments being passed in a list or tuple as the *args*
3117 parameter. In either case, the arguments to the child process should start with
3118 the name of the command being run, but this is not enforced.
3119
Christian Heimesfaf2f632008-01-06 16:59:19 +00003120 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003121 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
3122 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003123 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003124 discussed in the next paragraph), the new environment is used as the source of
3125 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
3126 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
3127 locate the executable; *path* must contain an appropriate absolute or relative
3128 path.
3129
3130 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00003131 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00003132 used to define the environment variables for the new process (these are used
3133 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00003134 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003135 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003136
Larry Hastings9cf065c2012-06-22 16:30:09 -07003137 For :func:`execve` on some platforms, *path* may also be specified as an open
3138 file descriptor. This functionality may not be supported on your platform;
3139 you can check whether or not it is available using :data:`os.supports_fd`.
3140 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3141
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003142 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003143
Larry Hastings9cf065c2012-06-22 16:30:09 -07003144 .. versionadded:: 3.3
3145 Added support for specifying an open file descriptor for *path*
3146 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003147
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003148 .. versionchanged:: 3.6
3149 Accepts a :term:`path-like object`.
3150
Georg Brandl116aa622007-08-15 14:28:22 +00003151.. function:: _exit(n)
3152
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003153 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003154 stdio buffers, etc.
3155
Georg Brandl116aa622007-08-15 14:28:22 +00003156 .. note::
3157
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003158 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3159 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003160
Christian Heimesfaf2f632008-01-06 16:59:19 +00003161The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003162although they are not required. These are typically used for system programs
3163written in Python, such as a mail server's external command delivery program.
3164
3165.. note::
3166
3167 Some of these may not be available on all Unix platforms, since there is some
3168 variation. These constants are defined where they are defined by the underlying
3169 platform.
3170
3171
3172.. data:: EX_OK
3173
Benjamin Petersonf650e462010-05-06 23:03:05 +00003174 Exit code that means no error occurred.
3175
3176 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003177
Georg Brandl116aa622007-08-15 14:28:22 +00003178
3179.. data:: EX_USAGE
3180
3181 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003182 number of arguments are given.
3183
3184 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003185
Georg Brandl116aa622007-08-15 14:28:22 +00003186
3187.. data:: EX_DATAERR
3188
Benjamin Petersonf650e462010-05-06 23:03:05 +00003189 Exit code that means the input data was incorrect.
3190
3191 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003192
Georg Brandl116aa622007-08-15 14:28:22 +00003193
3194.. data:: EX_NOINPUT
3195
3196 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003197
Georg Brandlc575c902008-09-13 17:46:05 +00003198 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003199
Georg Brandl116aa622007-08-15 14:28:22 +00003200
3201.. data:: EX_NOUSER
3202
Benjamin Petersonf650e462010-05-06 23:03:05 +00003203 Exit code that means a specified user did not exist.
3204
3205 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003206
Georg Brandl116aa622007-08-15 14:28:22 +00003207
3208.. data:: EX_NOHOST
3209
Benjamin Petersonf650e462010-05-06 23:03:05 +00003210 Exit code that means a specified host did not exist.
3211
3212 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003213
Georg Brandl116aa622007-08-15 14:28:22 +00003214
3215.. data:: EX_UNAVAILABLE
3216
Benjamin Petersonf650e462010-05-06 23:03:05 +00003217 Exit code that means that a required service is unavailable.
3218
3219 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003220
Georg Brandl116aa622007-08-15 14:28:22 +00003221
3222.. data:: EX_SOFTWARE
3223
Benjamin Petersonf650e462010-05-06 23:03:05 +00003224 Exit code that means an internal software error was detected.
3225
3226 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003227
Georg Brandl116aa622007-08-15 14:28:22 +00003228
3229.. data:: EX_OSERR
3230
3231 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003232 inability to fork or create a pipe.
3233
3234 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003235
Georg Brandl116aa622007-08-15 14:28:22 +00003236
3237.. data:: EX_OSFILE
3238
3239 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003240 some other kind of error.
3241
3242 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003243
Georg Brandl116aa622007-08-15 14:28:22 +00003244
3245.. data:: EX_CANTCREAT
3246
3247 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003248
Georg Brandlc575c902008-09-13 17:46:05 +00003249 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003250
Georg Brandl116aa622007-08-15 14:28:22 +00003251
3252.. data:: EX_IOERR
3253
3254 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003255
Georg Brandlc575c902008-09-13 17:46:05 +00003256 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003257
Georg Brandl116aa622007-08-15 14:28:22 +00003258
3259.. data:: EX_TEMPFAIL
3260
3261 Exit code that means a temporary failure occurred. This indicates something
3262 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003263 made during a retryable operation.
3264
3265 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003266
Georg Brandl116aa622007-08-15 14:28:22 +00003267
3268.. data:: EX_PROTOCOL
3269
3270 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003271 understood.
3272
3273 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003274
Georg Brandl116aa622007-08-15 14:28:22 +00003275
3276.. data:: EX_NOPERM
3277
3278 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003279 operation (but not intended for file system problems).
3280
3281 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003282
Georg Brandl116aa622007-08-15 14:28:22 +00003283
3284.. data:: EX_CONFIG
3285
3286 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003287
Georg Brandlc575c902008-09-13 17:46:05 +00003288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003289
Georg Brandl116aa622007-08-15 14:28:22 +00003290
3291.. data:: EX_NOTFOUND
3292
Benjamin Petersonf650e462010-05-06 23:03:05 +00003293 Exit code that means something like "an entry was not found".
3294
3295 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003296
Georg Brandl116aa622007-08-15 14:28:22 +00003297
3298.. function:: fork()
3299
Christian Heimesfaf2f632008-01-06 16:59:19 +00003300 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003301 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003302
Larry Hastings3732ed22014-03-15 21:13:56 -07003303 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003304 known issues when using fork() from a thread.
3305
Christian Heimes3046fe42013-10-29 21:08:56 +01003306 .. warning::
3307
3308 See :mod:`ssl` for applications that use the SSL module with fork().
3309
Georg Brandlc575c902008-09-13 17:46:05 +00003310 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003311
3312
3313.. function:: forkpty()
3314
3315 Fork a child process, using a new pseudo-terminal as the child's controlling
3316 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3317 new child's process id in the parent, and *fd* is the file descriptor of the
3318 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003319 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003320
Georg Brandlc575c902008-09-13 17:46:05 +00003321 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003322
3323
3324.. function:: kill(pid, sig)
3325
3326 .. index::
3327 single: process; killing
3328 single: process; signalling
3329
3330 Send signal *sig* to the process *pid*. Constants for the specific signals
3331 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003332
3333 Windows: The :data:`signal.CTRL_C_EVENT` and
3334 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3335 only be sent to console processes which share a common console window,
3336 e.g., some subprocesses. Any other value for *sig* will cause the process
3337 to be unconditionally killed by the TerminateProcess API, and the exit code
3338 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3339 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003340
Victor Stinnerb3e72192011-05-08 01:46:11 +02003341 See also :func:`signal.pthread_kill`.
3342
Georg Brandl67b21b72010-08-17 15:07:14 +00003343 .. versionadded:: 3.2
3344 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003345
Georg Brandl116aa622007-08-15 14:28:22 +00003346
3347.. function:: killpg(pgid, sig)
3348
3349 .. index::
3350 single: process; killing
3351 single: process; signalling
3352
Benjamin Petersonf650e462010-05-06 23:03:05 +00003353 Send the signal *sig* to the process group *pgid*.
3354
3355 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003356
Georg Brandl116aa622007-08-15 14:28:22 +00003357
3358.. function:: nice(increment)
3359
3360 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003361
Georg Brandlc575c902008-09-13 17:46:05 +00003362 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003363
3364
3365.. function:: plock(op)
3366
3367 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003368 ``<sys/lock.h>``) determines which segments are locked.
3369
3370 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003371
3372
Martin Panterbf19d162015-09-09 01:01:13 +00003373.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003374
Martin Panterbf19d162015-09-09 01:01:13 +00003375 Open a pipe to or from command *cmd*.
3376 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003377 connected to the pipe, which can be read or written depending on whether *mode*
3378 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3379 the corresponding argument to the built-in :func:`open` function. The
3380 returned file object reads or writes text strings rather than bytes.
3381
3382 The ``close`` method returns :const:`None` if the subprocess exited
3383 successfully, or the subprocess's return code if there was an
3384 error. On POSIX systems, if the return code is positive it
3385 represents the return value of the process left-shifted by one
3386 byte. If the return code is negative, the process was terminated
3387 by the signal given by the negated value of the return code. (For
3388 example, the return value might be ``- signal.SIGKILL`` if the
3389 subprocess was killed.) On Windows systems, the return value
3390 contains the signed integer return code from the child process.
3391
3392 This is implemented using :class:`subprocess.Popen`; see that class's
3393 documentation for more powerful ways to manage and communicate with
3394 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003395
3396
Gregory P. Smith163468a2017-05-29 10:03:41 -07003397.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3398 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003399
Gregory P. Smith163468a2017-05-29 10:03:41 -07003400 Register callables to be executed when a new child process is forked
3401 using :func:`os.fork` or similar process cloning APIs.
3402 The parameters are optional and keyword-only.
3403 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003404
Gregory P. Smith163468a2017-05-29 10:03:41 -07003405 * *before* is a function called before forking a child process.
3406 * *after_in_parent* is a function called from the parent process
3407 after forking a child process.
3408 * *after_in_child* is a function called from the child process.
3409
3410 These calls are only made if control is expected to return to the
3411 Python interpreter. A typical :mod:`subprocess` launch will not
3412 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003413
3414 Functions registered for execution before forking are called in
3415 reverse registration order. Functions registered for execution
3416 after forking (either in the parent or in the child) are called
3417 in registration order.
3418
3419 Note that :c:func:`fork` calls made by third-party C code may not
3420 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3421 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3422
Gregory P. Smith163468a2017-05-29 10:03:41 -07003423 There is no way to unregister a function.
3424
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003425 Availability: Unix.
3426
3427 .. versionadded:: 3.7
3428
3429
Georg Brandl116aa622007-08-15 14:28:22 +00003430.. function:: spawnl(mode, path, ...)
3431 spawnle(mode, path, ..., env)
3432 spawnlp(mode, file, ...)
3433 spawnlpe(mode, file, ..., env)
3434 spawnv(mode, path, args)
3435 spawnve(mode, path, args, env)
3436 spawnvp(mode, file, args)
3437 spawnvpe(mode, file, args, env)
3438
3439 Execute the program *path* in a new process.
3440
3441 (Note that the :mod:`subprocess` module provides more powerful facilities for
3442 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003443 preferable to using these functions. Check especially the
3444 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003445
Christian Heimesfaf2f632008-01-06 16:59:19 +00003446 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003447 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3448 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003449 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003450 be used with the :func:`waitpid` function.
3451
Serhiy Storchakadab83542013-10-13 20:12:43 +03003452 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003453 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003454 to work with if the number of parameters is fixed when the code is written; the
3455 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003456 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003457 parameters is variable, with the arguments being passed in a list or tuple as
3458 the *args* parameter. In either case, the arguments to the child process must
3459 start with the name of the command being run.
3460
Christian Heimesfaf2f632008-01-06 16:59:19 +00003461 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003462 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3463 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003464 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003465 discussed in the next paragraph), the new environment is used as the source of
3466 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3467 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3468 :envvar:`PATH` variable to locate the executable; *path* must contain an
3469 appropriate absolute or relative path.
3470
3471 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003472 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003473 which is used to define the environment variables for the new process (they are
3474 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003475 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003476 the new process to inherit the environment of the current process. Note that
3477 keys and values in the *env* dictionary must be strings; invalid keys or
3478 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003479
3480 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3481 equivalent::
3482
3483 import os
3484 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3485
3486 L = ['cp', 'index.html', '/dev/null']
3487 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3488
3489 Availability: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
Antoine Pitrou0e752dd2011-07-19 01:26:58 +02003490 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3491 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3492 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003493
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003494 .. versionchanged:: 3.6
3495 Accepts a :term:`path-like object`.
3496
Georg Brandl116aa622007-08-15 14:28:22 +00003497
3498.. data:: P_NOWAIT
3499 P_NOWAITO
3500
Serhiy Storchakadab83542013-10-13 20:12:43 +03003501 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003502 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003503 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003504 the return value.
3505
3506 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003507
Georg Brandl116aa622007-08-15 14:28:22 +00003508
3509.. data:: P_WAIT
3510
Serhiy Storchakadab83542013-10-13 20:12:43 +03003511 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003512 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3513 return until the new process has run to completion and will return the exit code
3514 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003515 process.
3516
3517 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003518
Georg Brandl116aa622007-08-15 14:28:22 +00003519
3520.. data:: P_DETACH
3521 P_OVERLAY
3522
Serhiy Storchakadab83542013-10-13 20:12:43 +03003523 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003524 functions. These are less portable than those listed above. :const:`P_DETACH`
3525 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3526 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003527 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003528
Georg Brandl116aa622007-08-15 14:28:22 +00003529 Availability: Windows.
3530
Georg Brandl116aa622007-08-15 14:28:22 +00003531
3532.. function:: startfile(path[, operation])
3533
3534 Start a file with its associated application.
3535
3536 When *operation* is not specified or ``'open'``, this acts like double-clicking
3537 the file in Windows Explorer, or giving the file name as an argument to the
3538 :program:`start` command from the interactive command shell: the file is opened
3539 with whatever application (if any) its extension is associated.
3540
3541 When another *operation* is given, it must be a "command verb" that specifies
3542 what should be done with the file. Common verbs documented by Microsoft are
3543 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3544 ``'find'`` (to be used on directories).
3545
3546 :func:`startfile` returns as soon as the associated application is launched.
3547 There is no option to wait for the application to close, and no way to retrieve
3548 the application's exit status. The *path* parameter is relative to the current
3549 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003550 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003551 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003552 the path is properly encoded for Win32.
3553
Steve Dower7d0e0c92015-01-24 08:18:24 -08003554 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3555 function is not resolved until this function is first called. If the function
3556 cannot be resolved, :exc:`NotImplementedError` will be raised.
3557
Benjamin Petersonf650e462010-05-06 23:03:05 +00003558 Availability: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003559
Georg Brandl116aa622007-08-15 14:28:22 +00003560
3561.. function:: system(command)
3562
3563 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003564 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003565 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3566 the executed command. If *command* generates any output, it will be sent to
3567 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003568
3569 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003570 format specified for :func:`wait`. Note that POSIX does not specify the
3571 meaning of the return value of the C :c:func:`system` function, so the return
3572 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003573
Georg Brandl8f7b4272010-10-14 06:35:53 +00003574 On Windows, the return value is that returned by the system shell after
3575 running *command*. The shell is given by the Windows environment variable
3576 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3577 status of the command run; on systems using a non-native shell, consult your
3578 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003579
Georg Brandl8f7b4272010-10-14 06:35:53 +00003580 The :mod:`subprocess` module provides more powerful facilities for spawning
3581 new processes and retrieving their results; using that module is preferable
3582 to using this function. See the :ref:`subprocess-replacements` section in
3583 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003584
Benjamin Petersonf650e462010-05-06 23:03:05 +00003585 Availability: Unix, Windows.
3586
Georg Brandl116aa622007-08-15 14:28:22 +00003587
3588.. function:: times()
3589
Larry Hastings605a62d2012-06-24 04:33:36 -07003590 Returns the current global process times.
3591 The return value is an object with five attributes:
3592
3593 * :attr:`user` - user time
3594 * :attr:`system` - system time
3595 * :attr:`children_user` - user time of all child processes
3596 * :attr:`children_system` - system time of all child processes
3597 * :attr:`elapsed` - elapsed real time since a fixed point in the past
3598
3599 For backwards compatibility, this object also behaves like a five-tuple
3600 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
3601 :attr:`children_system`, and :attr:`elapsed` in that order.
3602
3603 See the Unix manual page
Benjamin Petersonf650e462010-05-06 23:03:05 +00003604 :manpage:`times(2)` or the corresponding Windows Platform API documentation.
Larry Hastings605a62d2012-06-24 04:33:36 -07003605 On Windows, only :attr:`user` and :attr:`system` are known; the other
3606 attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003607
Georg Brandl8a5555f2012-06-24 13:29:09 +02003608 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003609
Larry Hastings605a62d2012-06-24 04:33:36 -07003610 .. versionchanged:: 3.3
3611 Return type changed from a tuple to a tuple-like object
3612 with named attributes.
3613
Georg Brandl116aa622007-08-15 14:28:22 +00003614
3615.. function:: wait()
3616
3617 Wait for completion of a child process, and return a tuple containing its pid
3618 and exit status indication: a 16-bit number, whose low byte is the signal number
3619 that killed the process, and whose high byte is the exit status (if the signal
3620 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003621 produced.
3622
3623 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003624
Ross Lagerwall7807c352011-03-17 20:20:30 +02003625.. function:: waitid(idtype, id, options)
3626
3627 Wait for the completion of one or more child processes.
3628 *idtype* can be :data:`P_PID`, :data:`P_PGID` or :data:`P_ALL`.
3629 *id* specifies the pid to wait on.
3630 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
3631 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
3632 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
3633 representing the data contained in the :c:type:`siginfo_t` structure, namely:
3634 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
3635 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
3636 children in a waitable state.
3637
3638 Availability: Unix.
3639
3640 .. versionadded:: 3.3
3641
3642.. data:: P_PID
3643 P_PGID
3644 P_ALL
3645
3646 These are the possible values for *idtype* in :func:`waitid`. They affect
3647 how *id* is interpreted.
3648
3649 Availability: Unix.
3650
3651 .. versionadded:: 3.3
3652
3653.. data:: WEXITED
3654 WSTOPPED
3655 WNOWAIT
3656
3657 Flags that can be used in *options* in :func:`waitid` that specify what
3658 child signal to wait for.
3659
3660 Availability: Unix.
3661
3662 .. versionadded:: 3.3
3663
3664
3665.. data:: CLD_EXITED
3666 CLD_DUMPED
3667 CLD_TRAPPED
3668 CLD_CONTINUED
3669
3670 These are the possible values for :attr:`si_code` in the result returned by
3671 :func:`waitid`.
3672
3673 Availability: Unix.
3674
3675 .. versionadded:: 3.3
3676
Georg Brandl116aa622007-08-15 14:28:22 +00003677
3678.. function:: waitpid(pid, options)
3679
3680 The details of this function differ on Unix and Windows.
3681
3682 On Unix: Wait for completion of a child process given by process id *pid*, and
3683 return a tuple containing its process id and exit status indication (encoded as
3684 for :func:`wait`). The semantics of the call are affected by the value of the
3685 integer *options*, which should be ``0`` for normal operation.
3686
3687 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
3688 that specific process. If *pid* is ``0``, the request is for the status of any
3689 child in the process group of the current process. If *pid* is ``-1``, the
3690 request pertains to any child of the current process. If *pid* is less than
3691 ``-1``, status is requested for any process in the process group ``-pid`` (the
3692 absolute value of *pid*).
3693
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00003694 An :exc:`OSError` is raised with the value of errno when the syscall
3695 returns -1.
3696
Georg Brandl116aa622007-08-15 14:28:22 +00003697 On Windows: Wait for completion of a process given by process handle *pid*, and
3698 return a tuple containing *pid*, and its exit status shifted left by 8 bits
3699 (shifting makes cross-platform use of the function easier). A *pid* less than or
3700 equal to ``0`` has no special meaning on Windows, and raises an exception. The
3701 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03003702 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
3703 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00003704
Victor Stinnera766ddf2015-03-26 23:50:57 +01003705 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02003706 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01003707 exception, the function now retries the system call instead of raising an
3708 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
3709
Georg Brandl116aa622007-08-15 14:28:22 +00003710
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02003711.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00003712
3713 Similar to :func:`waitpid`, except no process id argument is given and a
3714 3-element tuple containing the child's process id, exit status indication, and
3715 resource usage information is returned. Refer to :mod:`resource`.\
Serhiy Storchakadab83542013-10-13 20:12:43 +03003716 :func:`~resource.getrusage` for details on resource usage information. The
3717 option argument is the same as that provided to :func:`waitpid` and
3718 :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003719
Georg Brandl116aa622007-08-15 14:28:22 +00003720 Availability: Unix.
3721
Georg Brandl116aa622007-08-15 14:28:22 +00003722
Victor Stinner4195b5c2012-02-08 23:03:19 +01003723.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00003724
3725 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
3726 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03003727 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
3728 resource usage information. The arguments to :func:`wait4` are the same
3729 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003730
3731 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003732
Georg Brandl116aa622007-08-15 14:28:22 +00003733
3734.. data:: WNOHANG
3735
3736 The option for :func:`waitpid` to return immediately if no child process status
3737 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003738
Georg Brandlc575c902008-09-13 17:46:05 +00003739 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003740
3741
3742.. data:: WCONTINUED
3743
3744 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00003745 from a job control stop since their status was last reported.
3746
Georg Brandl8a5555f2012-06-24 13:29:09 +02003747 Availability: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00003748
Georg Brandl116aa622007-08-15 14:28:22 +00003749
3750.. data:: WUNTRACED
3751
3752 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00003753 their current state has not been reported since they were stopped.
3754
3755 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003756
Georg Brandl116aa622007-08-15 14:28:22 +00003757
3758The following functions take a process status code as returned by
3759:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
3760used to determine the disposition of a process.
3761
Georg Brandl116aa622007-08-15 14:28:22 +00003762.. function:: WCOREDUMP(status)
3763
Christian Heimesfaf2f632008-01-06 16:59:19 +00003764 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00003765 return ``False``.
3766
3767 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003768
Georg Brandl116aa622007-08-15 14:28:22 +00003769
3770.. function:: WIFCONTINUED(status)
3771
Christian Heimesfaf2f632008-01-06 16:59:19 +00003772 Return ``True`` if the process has been continued from a job control stop,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003773 otherwise return ``False``.
3774
3775 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003776
Georg Brandl116aa622007-08-15 14:28:22 +00003777
3778.. function:: WIFSTOPPED(status)
3779
Christian Heimesfaf2f632008-01-06 16:59:19 +00003780 Return ``True`` if the process has been stopped, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003781 ``False``.
3782
3783 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003784
3785
3786.. function:: WIFSIGNALED(status)
3787
Christian Heimesfaf2f632008-01-06 16:59:19 +00003788 Return ``True`` if the process exited due to a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003789 ``False``.
3790
3791 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003792
3793
3794.. function:: WIFEXITED(status)
3795
Christian Heimesfaf2f632008-01-06 16:59:19 +00003796 Return ``True`` if the process exited using the :manpage:`exit(2)` system call,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003797 otherwise return ``False``.
3798
3799 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003800
3801
3802.. function:: WEXITSTATUS(status)
3803
3804 If ``WIFEXITED(status)`` is true, return the integer parameter to the
3805 :manpage:`exit(2)` system call. Otherwise, the return value is meaningless.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003806
Georg Brandlc575c902008-09-13 17:46:05 +00003807 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003808
3809
3810.. function:: WSTOPSIG(status)
3811
Benjamin Petersonf650e462010-05-06 23:03:05 +00003812 Return the signal which caused the process to stop.
3813
3814 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003815
3816
3817.. function:: WTERMSIG(status)
3818
Benjamin Petersonf650e462010-05-06 23:03:05 +00003819 Return the signal which caused the process to exit.
3820
3821 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003822
3823
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003824Interface to the scheduler
3825--------------------------
3826
3827These functions control how a process is allocated CPU time by the operating
3828system. They are only available on some Unix platforms. For more detailed
3829information, consult your Unix manpages.
3830
3831.. versionadded:: 3.3
3832
Andrew Kuchling4921a082013-06-21 11:49:57 -04003833The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003834operating system.
3835
3836.. data:: SCHED_OTHER
3837
3838 The default scheduling policy.
3839
3840.. data:: SCHED_BATCH
3841
3842 Scheduling policy for CPU-intensive processes that tries to preserve
3843 interactivity on the rest of the computer.
3844
3845.. data:: SCHED_IDLE
3846
3847 Scheduling policy for extremely low priority background tasks.
3848
3849.. data:: SCHED_SPORADIC
3850
3851 Scheduling policy for sporadic server programs.
3852
3853.. data:: SCHED_FIFO
3854
3855 A First In First Out scheduling policy.
3856
3857.. data:: SCHED_RR
3858
3859 A round-robin scheduling policy.
3860
3861.. data:: SCHED_RESET_ON_FORK
3862
Martin Panter8d56c022016-05-29 04:13:35 +00003863 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003864 this flag set forks, its child's scheduling policy and priority are reset to
3865 the default.
3866
3867
3868.. class:: sched_param(sched_priority)
3869
3870 This class represents tunable scheduling parameters used in
3871 :func:`sched_setparam`, :func:`sched_setscheduler`, and
3872 :func:`sched_getparam`. It is immutable.
3873
3874 At the moment, there is only one possible parameter:
3875
3876 .. attribute:: sched_priority
3877
3878 The scheduling priority for a scheduling policy.
3879
3880
3881.. function:: sched_get_priority_min(policy)
3882
3883 Get the minimum priority value for *policy*. *policy* is one of the
3884 scheduling policy constants above.
3885
3886
3887.. function:: sched_get_priority_max(policy)
3888
3889 Get the maximum priority value for *policy*. *policy* is one of the
3890 scheduling policy constants above.
3891
3892
3893.. function:: sched_setscheduler(pid, policy, param)
3894
3895 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
3896 the calling process. *policy* is one of the scheduling policy constants
3897 above. *param* is a :class:`sched_param` instance.
3898
3899
3900.. function:: sched_getscheduler(pid)
3901
3902 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
3903 means the calling process. The result is one of the scheduling policy
3904 constants above.
3905
3906
3907.. function:: sched_setparam(pid, param)
3908
3909 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
3910 the calling process. *param* is a :class:`sched_param` instance.
3911
3912
3913.. function:: sched_getparam(pid)
3914
3915 Return the scheduling parameters as a :class:`sched_param` instance for the
3916 process with PID *pid*. A *pid* of 0 means the calling process.
3917
3918
3919.. function:: sched_rr_get_interval(pid)
3920
3921 Return the round-robin quantum in seconds for the process with PID *pid*. A
3922 *pid* of 0 means the calling process.
3923
3924
3925.. function:: sched_yield()
3926
3927 Voluntarily relinquish the CPU.
3928
3929
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003930.. function:: sched_setaffinity(pid, mask)
3931
Antoine Pitrou84869872012-08-04 16:16:35 +02003932 Restrict the process with PID *pid* (or the current process if zero) to a
3933 set of CPUs. *mask* is an iterable of integers representing the set of
3934 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003935
3936
Antoine Pitrou84869872012-08-04 16:16:35 +02003937.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003938
Antoine Pitrou84869872012-08-04 16:16:35 +02003939 Return the set of CPUs the process with PID *pid* (or the current process
3940 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003941
3942
Georg Brandl116aa622007-08-15 14:28:22 +00003943.. _os-path:
3944
3945Miscellaneous System Information
3946--------------------------------
3947
3948
3949.. function:: confstr(name)
3950
3951 Return string-valued system configuration values. *name* specifies the
3952 configuration value to retrieve; it may be a string which is the name of a
3953 defined system value; these names are specified in a number of standards (POSIX,
3954 Unix 95, Unix 98, and others). Some platforms define additional names as well.
3955 The names known to the host operating system are given as the keys of the
3956 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003957 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00003958
3959 If the configuration value specified by *name* isn't defined, ``None`` is
3960 returned.
3961
3962 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
3963 specific value for *name* is not supported by the host system, even if it is
3964 included in ``confstr_names``, an :exc:`OSError` is raised with
3965 :const:`errno.EINVAL` for the error number.
3966
Georg Brandl8a5555f2012-06-24 13:29:09 +02003967 Availability: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003968
Georg Brandl116aa622007-08-15 14:28:22 +00003969
3970.. data:: confstr_names
3971
3972 Dictionary mapping names accepted by :func:`confstr` to the integer values
3973 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003974 determine the set of names known to the system.
3975
3976 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003977
3978
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003979.. function:: cpu_count()
3980
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03003981 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003982
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01003983 This number is not equivalent to the number of CPUs the current process can
3984 use. The number of usable CPUs can be obtained with
3985 ``len(os.sched_getaffinity(0))``
3986
3987
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003988 .. versionadded:: 3.4
3989
3990
Georg Brandl116aa622007-08-15 14:28:22 +00003991.. function:: getloadavg()
3992
Christian Heimesa62da1d2008-01-12 19:39:10 +00003993 Return the number of processes in the system run queue averaged over the last
3994 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003995 unobtainable.
3996
3997 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003998
Georg Brandl116aa622007-08-15 14:28:22 +00003999
4000.. function:: sysconf(name)
4001
4002 Return integer-valued system configuration values. If the configuration value
4003 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
4004 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
4005 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00004006
Georg Brandlc575c902008-09-13 17:46:05 +00004007 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004008
4009
4010.. data:: sysconf_names
4011
4012 Dictionary mapping names accepted by :func:`sysconf` to the integer values
4013 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00004014 determine the set of names known to the system.
4015
4016 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004017
Christian Heimesfaf2f632008-01-06 16:59:19 +00004018The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00004019are defined for all platforms.
4020
4021Higher-level operations on pathnames are defined in the :mod:`os.path` module.
4022
4023
4024.. data:: curdir
4025
4026 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00004027 directory. This is ``'.'`` for Windows and POSIX. Also available via
4028 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004029
4030
4031.. data:: pardir
4032
4033 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00004034 directory. This is ``'..'`` for Windows and POSIX. Also available via
4035 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004036
4037
4038.. data:: sep
4039
Georg Brandlc575c902008-09-13 17:46:05 +00004040 The character used by the operating system to separate pathname components.
4041 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
4042 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00004043 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
4044 useful. Also available via :mod:`os.path`.
4045
4046
4047.. data:: altsep
4048
4049 An alternative character used by the operating system to separate pathname
4050 components, or ``None`` if only one separator character exists. This is set to
4051 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
4052 :mod:`os.path`.
4053
4054
4055.. data:: extsep
4056
4057 The character which separates the base filename from the extension; for example,
4058 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
4059
Georg Brandl116aa622007-08-15 14:28:22 +00004060
4061.. data:: pathsep
4062
4063 The character conventionally used by the operating system to separate search
4064 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
4065 Windows. Also available via :mod:`os.path`.
4066
4067
4068.. data:: defpath
4069
Serhiy Storchakadab83542013-10-13 20:12:43 +03004070 The default search path used by :func:`exec\*p\* <execl>` and
4071 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
4072 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004073
4074
4075.. data:: linesep
4076
4077 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00004078 platform. This may be a single character, such as ``'\n'`` for POSIX, or
4079 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
4080 *os.linesep* as a line terminator when writing files opened in text mode (the
4081 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00004082
4083
4084.. data:: devnull
4085
Georg Brandl850a9902010-05-21 22:04:32 +00004086 The file path of the null device. For example: ``'/dev/null'`` for
4087 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004088
Andrew Kuchling4921a082013-06-21 11:49:57 -04004089.. data:: RTLD_LAZY
4090 RTLD_NOW
4091 RTLD_GLOBAL
4092 RTLD_LOCAL
4093 RTLD_NODELETE
4094 RTLD_NOLOAD
4095 RTLD_DEEPBIND
4096
4097 Flags for use with the :func:`~sys.setdlopenflags` and
4098 :func:`~sys.getdlopenflags` functions. See the Unix manual page
4099 :manpage:`dlopen(3)` for what the different flags mean.
4100
4101 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00004102
Georg Brandl116aa622007-08-15 14:28:22 +00004103
Victor Stinner9b1f4742016-09-06 16:18:52 -07004104Random numbers
4105--------------
Georg Brandl116aa622007-08-15 14:28:22 +00004106
4107
Victor Stinner9b1f4742016-09-06 16:18:52 -07004108.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00004109
Victor Stinner9b1f4742016-09-06 16:18:52 -07004110 Get up to *size* random bytes. The function can return less bytes than
4111 requested.
4112
4113 These bytes can be used to seed user-space random number generators or for
4114 cryptographic purposes.
4115
4116 ``getrandom()`` relies on entropy gathered from device drivers and other
4117 sources of environmental noise. Unnecessarily reading large quantities of
4118 data will have a negative impact on other users of the ``/dev/random`` and
4119 ``/dev/urandom`` devices.
4120
4121 The flags argument is a bit mask that can contain zero or more of the
4122 following values ORed together: :py:data:`os.GRND_RANDOM` and
4123 :py:data:`GRND_NONBLOCK`.
4124
4125 See also the `Linux getrandom() manual page
4126 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
4127
4128 Availability: Linux 3.17 and newer.
4129
4130 .. versionadded:: 3.6
4131
4132.. function:: urandom(size)
4133
4134 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004135
4136 This function returns random bytes from an OS-specific randomness source. The
4137 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004138 though its exact quality depends on the OS implementation.
4139
Victor Stinnere66987e2016-09-06 16:33:52 -07004140 On Linux, if the ``getrandom()`` syscall is available, it is used in
4141 blocking mode: block until the system urandom entropy pool is initialized
4142 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4143 the rationale. On Linux, the :func:`getrandom` function can be used to get
4144 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4145 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004146
Victor Stinnere66987e2016-09-06 16:33:52 -07004147 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4148 device. If the ``/dev/urandom`` device is not available or not readable, the
4149 :exc:`NotImplementedError` exception is raised.
4150
4151 On Windows, it will use ``CryptGenRandom()``.
4152
4153 .. seealso::
4154 The :mod:`secrets` module provides higher level functions. For an
4155 easy-to-use interface to the random number generator provided by your
4156 platform, please see :class:`random.SystemRandom`.
4157
4158 .. versionchanged:: 3.6.0
4159 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4160 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004161
Victor Stinnerdddf4842016-06-07 11:21:42 +02004162 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004163 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4164 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004165
Victor Stinnerace88482015-07-29 02:28:32 +02004166 .. versionchanged:: 3.5
4167 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4168 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4169 function is now used. These functions avoid the usage of an internal file
4170 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004171
4172.. data:: GRND_NONBLOCK
4173
4174 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4175 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4176 if the entropy pool has not yet been initialized.
4177
4178 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4179 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4180
4181 .. versionadded:: 3.6
4182
4183.. data:: GRND_RANDOM
4184
4185 If this bit is set, then random bytes are drawn from the
4186 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4187
4188 .. versionadded:: 3.6